2023-12-12T23:41:58.072 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-12T23:41:58.073 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489252 --owner scheduled_yuriw@teuthology --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489252/orig.config.yaml 2023-12-12T23:41:58.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T23:41:58.211 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489252 branch: wip-yuri10-testing-2023-12-12-1229 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7489252' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri10-testing-2023-12-12-1229 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: 021ac1670a21c19759080c6da90baaeb42e7d175 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: 021ac1670a21c19759080c6da90baaeb42e7d175 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri10-testing-2023-12-12-1229 sha1: 021ac1670a21c19759080c6da90baaeb42e7d175 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 8124 sha1: 021ac1670a21c19759080c6da90baaeb42e7d175 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri10-testing-2023-12-12-1229 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 021ac1670a21c19759080c6da90baaeb42e7d175 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwF4NBeLAivyQUn36Egw1iPnhpM7o1AAYzEbC4jbdxggLlYBOtHlITta1b7df29QS/Nr8bzgn06YWP3wh5i/zs= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNDXc5/kqFVWyPJTSE1nTsD7rqE/wiS2HCugJc4U+fW78MucX7iHMdSdp2AnMT9qzxdquoNKDxaCLbMHWoZRLic= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-12_23:05:14 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-12T23:41:58.211 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa; will attempt to use it 2023-12-12T23:41:58.212 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa/tasks 2023-12-12T23:41:58.212 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-12T23:41:58.214 INFO:teuthology.task.internal:Checking packages... 2023-12-12T23:41:58.239 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '021ac1670a21c19759080c6da90baaeb42e7d175' 2023-12-12T23:41:58.239 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-12T23:41:58.240 INFO:teuthology.packaging:ref: None 2023-12-12T23:41:58.240 INFO:teuthology.packaging:tag: None 2023-12-12T23:41:58.240 INFO:teuthology.packaging:branch: wip-yuri10-testing-2023-12-12-1229 2023-12-12T23:41:58.240 INFO:teuthology.packaging:sha1: 021ac1670a21c19759080c6da90baaeb42e7d175 2023-12-12T23:41:58.240 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri10-testing-2023-12-12-1229 2023-12-12T23:41:58.452 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-157.g021ac167 2023-12-12T23:41:58.453 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-12T23:41:58.461 INFO:teuthology.task.internal:no buildpackages task found 2023-12-12T23:41:58.461 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-12T23:41:58.478 INFO:teuthology.task.internal:Saving configuration 2023-12-12T23:41:58.497 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-12T23:41:58.503 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T23:41:58.529 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489252', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 23:36:43.766826', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwF4NBeLAivyQUn36Egw1iPnhpM7o1AAYzEbC4jbdxggLlYBOtHlITta1b7df29QS/Nr8bzgn06YWP3wh5i/zs='} 2023-12-12T23:41:58.552 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489252', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 23:36:43.765006', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNDXc5/kqFVWyPJTSE1nTsD7rqE/wiS2HCugJc4U+fW78MucX7iHMdSdp2AnMT9qzxdquoNKDxaCLbMHWoZRLic='} 2023-12-12T23:41:58.552 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-12T23:41:58.566 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-12-12T23:41:58.566 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-12-12T23:41:58.566 INFO:teuthology.run_tasks:Running task console_log... 2023-12-12T23:41:58.642 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8feeacce50>, signals=[15]) 2023-12-12T23:41:58.643 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-12T23:41:58.652 INFO:teuthology.task.internal:Opening connections... 2023-12-12T23:41:58.653 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2023-12-12T23:41:58.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:41:58.737 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2023-12-12T23:41:58.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:41:58.821 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-12T23:41:58.830 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-12-12T23:41:58.848 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-12-12T23:41:58.848 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-12-12T23:41:58.905 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2023-12-12T23:41:58.905 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="9" 2023-12-12T23:41:58.905 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2023-12-12T23:41:58.906 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2023-12-12T23:41:58.906 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="9" 2023-12-12T23:41:58.906 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el9" 2023-12-12T23:41:58.906 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T23:41:58.906 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-12-12T23:41:58.906 INFO:teuthology.orchestra.run.smithi072.stdout:LOGO="fedora-logo-icon" 2023-12-12T23:41:58.906 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T23:41:58.906 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2023-12-12T23:41:58.906 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T23:41:58.906 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T23:41:58.906 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T23:41:58.907 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-12-12T23:41:58.923 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2023-12-12T23:41:58.940 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2023-12-12T23:41:58.940 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2023-12-12T23:41:59.000 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2023-12-12T23:41:59.000 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9" 2023-12-12T23:41:59.000 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2023-12-12T23:41:59.000 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2023-12-12T23:41:59.000 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9" 2023-12-12T23:41:59.000 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9" 2023-12-12T23:41:59.001 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T23:41:59.001 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2023-12-12T23:41:59.001 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon" 2023-12-12T23:41:59.001 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T23:41:59.001 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2023-12-12T23:41:59.001 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T23:41:59.002 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T23:41:59.002 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T23:41:59.002 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2023-12-12T23:41:59.023 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-12T23:41:59.037 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-12T23:41:59.048 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-12T23:41:59.048 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2023-12-12T23:41:59.051 DEBUG:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2023-12-12T23:41:59.066 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-12T23:41:59.077 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-12T23:41:59.077 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2023-12-12T23:41:59.108 DEBUG:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2023-12-12T23:41:59.139 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-12T23:41:59.208 INFO:teuthology.run_tasks:Running task kernel... 2023-12-12T23:41:59.231 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-12T23:41:59.231 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-12T23:41:59.232 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-12T23:41:59.232 DEBUG:teuthology.orchestra.run.smithi176:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-12T23:41:59.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T23:41:59.248 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2023-12-12T23:41:59.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T23:41:59.249 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-12-12T23:41:59.304 INFO:teuthology.orchestra.run.smithi176.stdout:5.14.0-361.el9.x86_64 2023-12-12T23:41:59.304 INFO:teuthology.task.kernel:Running kernel on smithi176: 5.14.0-361.el9.x86_64 2023-12-12T23:41:59.305 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum install -y kernel 2023-12-12T23:41:59.308 INFO:teuthology.orchestra.run.smithi072.stdout:5.14.0-361.el9.x86_64 2023-12-12T23:41:59.308 INFO:teuthology.task.kernel:Running kernel on smithi072: 5.14.0-361.el9.x86_64 2023-12-12T23:41:59.309 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum install -y kernel 2023-12-12T23:42:01.316 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2023-12-12T23:42:02.465 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2023-12-12T23:42:02.633 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS-9 - BaseOS 7.9 MB/s | 2.0 MB 00:00 2023-12-12T23:42:03.791 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.0 MB 00:00 2023-12-12T23:42:04.673 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 7.9 MB 00:01 2023-12-12T23:42:06.551 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 7.9 MB 00:02 2023-12-12T23:42:07.501 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 10 MB/s | 18 MB 00:01 2023-12-12T23:42:08.495 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - AppStream 19 MB/s | 18 MB 00:00 2023-12-12T23:42:11.358 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 12 MB/s | 5.8 MB 00:00 2023-12-12T23:42:12.692 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 15 kB 00:00 2023-12-12T23:42:13.664 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 5.8 MB 00:01 2023-12-12T23:42:14.551 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-12-12T23:42:15.517 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 15 kB 00:00 2023-12-12T23:42:17.362 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-12-12T23:42:19.334 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2023-12-12T23:42:21.424 INFO:teuthology.orchestra.run.smithi176.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-12T23:42:21.424 INFO:teuthology.orchestra.run.smithi176.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-12T23:42:21.506 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2023-12-12T23:42:21.513 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2023-12-12T23:42:21.513 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2023-12-12T23:42:21.513 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2023-12-12T23:42:21.514 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2023-12-12T23:42:21.514 INFO:teuthology.orchestra.run.smithi176.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-12T23:42:21.514 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2023-12-12T23:42:21.514 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-12T23:42:21.514 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-12T23:42:21.514 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-12T23:42:21.514 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:42:21.514 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2023-12-12T23:42:21.514 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2023-12-12T23:42:21.514 INFO:teuthology.orchestra.run.smithi176.stdout:Install 4 Packages 2023-12-12T23:42:21.514 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:42:21.515 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 96 M 2023-12-12T23:42:21.515 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 121 M 2023-12-12T23:42:21.515 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2023-12-12T23:42:21.995 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2023-12-12T23:42:22.936 INFO:teuthology.orchestra.run.smithi176.stdout:(1/4): kernel-5.14.0-391.el9.x86_64.rpm 4.3 MB/s | 5.6 MB 00:01 2023-12-12T23:42:23.561 INFO:teuthology.orchestra.run.smithi176.stdout:(2/4): kernel-core-5.14.0-391.el9.x86_64.rpm 11 MB/s | 20 MB 00:01 2023-12-12T23:42:24.145 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-12T23:42:24.145 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-12T23:42:24.242 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-12-12T23:42:24.257 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-12-12T23:42:24.258 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2023-12-12T23:42:24.258 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-12-12T23:42:24.258 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2023-12-12T23:42:24.258 INFO:teuthology.orchestra.run.smithi072.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-12T23:42:24.258 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2023-12-12T23:42:24.258 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-12T23:42:24.258 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-12T23:42:24.258 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-12T23:42:24.258 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:42:24.258 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2023-12-12T23:42:24.258 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-12-12T23:42:24.259 INFO:teuthology.orchestra.run.smithi072.stdout:Install 4 Packages 2023-12-12T23:42:24.259 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:42:24.259 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 96 M 2023-12-12T23:42:24.259 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 121 M 2023-12-12T23:42:24.259 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2023-12-12T23:42:24.344 INFO:teuthology.orchestra.run.smithi176.stdout:(3/4): kernel-modules-core-5.14.0-391.el9.x86_6 23 MB/s | 32 MB 00:01 2023-12-12T23:42:24.669 INFO:teuthology.orchestra.run.smithi176.stdout:(4/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 13 MB/s | 38 MB 00:03 2023-12-12T23:42:24.673 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2023-12-12T23:42:24.673 INFO:teuthology.orchestra.run.smithi176.stdout:Total 30 MB/s | 96 MB 00:03 2023-12-12T23:42:25.529 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2023-12-12T23:42:25.879 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2023-12-12T23:42:25.880 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2023-12-12T23:42:25.891 INFO:teuthology.orchestra.run.smithi072.stdout:(1/4): kernel-5.14.0-391.el9.x86_64.rpm 4.1 MB/s | 5.6 MB 00:01 2023-12-12T23:42:26.567 INFO:teuthology.orchestra.run.smithi072.stdout:(2/4): kernel-core-5.14.0-391.el9.x86_64.rpm 10 MB/s | 20 MB 00:02 2023-12-12T23:42:27.203 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2023-12-12T23:42:27.203 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2023-12-12T23:42:27.534 INFO:teuthology.orchestra.run.smithi072.stdout:(3/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 13 MB/s | 38 MB 00:03 2023-12-12T23:42:30.149 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2023-12-12T23:42:30.788 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-12T23:42:30.919 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-12T23:42:31.976 INFO:teuthology.orchestra.run.smithi072.stdout:(4/4): kernel-modules-core-5.14.0-391.el9.x86_6 5.3 MB/s | 32 MB 00:06 2023-12-12T23:42:31.976 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2023-12-12T23:42:31.976 INFO:teuthology.orchestra.run.smithi072.stdout:Total 12 MB/s | 96 MB 00:07 2023-12-12T23:42:32.833 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2023-12-12T23:42:33.216 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2023-12-12T23:42:33.216 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2023-12-12T23:42:33.703 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-12T23:42:33.869 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-12T23:42:34.530 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2023-12-12T23:42:34.531 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2023-12-12T23:42:37.185 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2023-12-12T23:42:37.987 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-12T23:42:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-12T23:42:38.482 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-12T23:42:38.602 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-12T23:42:40.956 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-12T23:42:41.217 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-12T23:42:43.219 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-12T23:42:45.815 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-12T23:42:45.981 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-12T23:42:50.597 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-12T23:43:11.872 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-12T23:43:11.916 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-12T23:43:12.333 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-12T23:43:12.333 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-12T23:43:12.334 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-12T23:43:12.334 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-12T23:43:12.751 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-12T23:43:12.751 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:43:12.751 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2023-12-12T23:43:12.751 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-12T23:43:12.752 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-12T23:43:12.752 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-12T23:43:12.752 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-12T23:43:12.752 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:43:12.752 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2023-12-12T23:43:13.221 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q kernel | sort -rV | head -n 1 2023-12-12T23:43:13.362 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-12T23:43:13.363 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-12T23:43:13.363 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-12T23:43:13.363 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-12T23:43:13.363 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-12T23:43:13.364 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-12-12T23:43:13.364 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi176.front.sepia.ceph.com, path=None, version=distro) 2023-12-12T23:43:13.364 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q kernel | sort -rV | head -n 1 2023-12-12T23:43:13.482 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-12T23:43:13.482 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-12T23:43:13.482 DEBUG:teuthology.orchestra.run.smithi176:> sudo rpm -qi grub2-tools 2023-12-12T23:43:13.526 INFO:teuthology.orchestra.run.smithi176.stdout:Name : grub2-tools 2023-12-12T23:43:13.526 INFO:teuthology.orchestra.run.smithi176.stdout:Epoch : 1 2023-12-12T23:43:13.526 INFO:teuthology.orchestra.run.smithi176.stdout:Version : 2.06 2023-12-12T23:43:13.526 INFO:teuthology.orchestra.run.smithi176.stdout:Release : 68.el9 2023-12-12T23:43:13.526 INFO:teuthology.orchestra.run.smithi176.stdout:Architecture: x86_64 2023-12-12T23:43:13.526 INFO:teuthology.orchestra.run.smithi176.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-12T23:43:13.526 INFO:teuthology.orchestra.run.smithi176.stdout:Group : Unspecified 2023-12-12T23:43:13.527 INFO:teuthology.orchestra.run.smithi176.stdout:Size : 8264254 2023-12-12T23:43:13.527 INFO:teuthology.orchestra.run.smithi176.stdout:License : GPLv3+ 2023-12-12T23:43:13.527 INFO:teuthology.orchestra.run.smithi176.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-12T23:43:13.527 INFO:teuthology.orchestra.run.smithi176.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-12T23:43:13.527 INFO:teuthology.orchestra.run.smithi176.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-12T23:43:13.527 INFO:teuthology.orchestra.run.smithi176.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-12T23:43:13.527 INFO:teuthology.orchestra.run.smithi176.stdout:Packager : builder@centos.org 2023-12-12T23:43:13.527 INFO:teuthology.orchestra.run.smithi176.stdout:Vendor : CentOS 2023-12-12T23:43:13.527 INFO:teuthology.orchestra.run.smithi176.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-12T23:43:13.527 INFO:teuthology.orchestra.run.smithi176.stdout:Summary : Support tools for GRUB. 2023-12-12T23:43:13.527 INFO:teuthology.orchestra.run.smithi176.stdout:Description : 2023-12-12T23:43:13.527 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:43:13.527 INFO:teuthology.orchestra.run.smithi176.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-12T23:43:13.528 INFO:teuthology.orchestra.run.smithi176.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-12T23:43:13.528 INFO:teuthology.orchestra.run.smithi176.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-12T23:43:13.528 INFO:teuthology.orchestra.run.smithi176.stdout:hardware devices. 2023-12-12T23:43:13.528 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:43:13.528 INFO:teuthology.orchestra.run.smithi176.stdout:This subpackage provides tools for support of all platforms. 2023-12-12T23:43:13.529 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-12T23:43:13.529 INFO:teuthology.task.kernel:Updating grub on smithi176 to boot 5.14.0-391.el9.x86_64 2023-12-12T23:43:13.529 DEBUG:teuthology.orchestra.run.smithi176:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-12T23:43:14.149 INFO:teuthology.orchestra.run.smithi176.stderr:Generating grub configuration file ... 2023-12-12T23:43:15.461 INFO:teuthology.orchestra.run.smithi176.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-12T23:43:15.498 INFO:teuthology.orchestra.run.smithi176.stderr:done 2023-12-12T23:43:15.500 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2023-12-12T23:43:15.515 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.tTPvnERHTp 2023-12-12T23:43:15.516 DEBUG:teuthology.orchestra.run.smithi176:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tTPvnERHTp 2023-12-12T23:43:15.584 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.tTPvnERHTp 2023-12-12T23:43:15.720 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.tTPvnERHTp is 6KB 2023-12-12T23:43:15.769 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.tTPvnERHTp 2023-12-12T23:43:15.783 DEBUG:teuthology.orchestra.run.smithi176:> sudo /bin/ls /boot/loader/entries || true 2023-12-12T23:43:15.848 INFO:teuthology.orchestra.run.smithi176.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-12T23:43:15.848 INFO:teuthology.orchestra.run.smithi176.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-12T23:43:15.848 INFO:teuthology.orchestra.run.smithi176.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-12T23:43:15.848 INFO:teuthology.orchestra.run.smithi176.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-12T23:43:15.850 DEBUG:teuthology.orchestra.run.smithi176:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-12T23:43:15.991 DEBUG:teuthology.orchestra.run.smithi176:> sudo shutdown -r now 2023-12-12T23:43:21.485 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-12T23:43:21.529 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-12T23:43:21.950 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-12T23:43:21.950 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-12T23:43:21.950 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-12T23:43:21.950 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-12T23:43:22.422 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-12T23:43:22.423 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:43:22.423 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2023-12-12T23:43:22.423 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-12T23:43:22.423 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-12T23:43:22.423 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-12T23:43:22.423 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-12T23:43:22.423 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:43:22.423 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-12-12T23:43:23.157 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2023-12-12T23:43:23.330 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-12T23:43:23.331 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-12T23:43:23.331 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-12T23:43:23.331 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-12T23:43:23.331 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-12T23:43:23.331 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-12T23:43:23.331 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=None, version=distro) 2023-12-12T23:43:23.331 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2023-12-12T23:43:23.450 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-12T23:43:23.450 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-12T23:43:23.450 DEBUG:teuthology.orchestra.run.smithi072:> sudo rpm -qi grub2-tools 2023-12-12T23:43:23.494 INFO:teuthology.orchestra.run.smithi072.stdout:Name : grub2-tools 2023-12-12T23:43:23.494 INFO:teuthology.orchestra.run.smithi072.stdout:Epoch : 1 2023-12-12T23:43:23.494 INFO:teuthology.orchestra.run.smithi072.stdout:Version : 2.06 2023-12-12T23:43:23.494 INFO:teuthology.orchestra.run.smithi072.stdout:Release : 68.el9 2023-12-12T23:43:23.494 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: x86_64 2023-12-12T23:43:23.494 INFO:teuthology.orchestra.run.smithi072.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-12T23:43:23.494 INFO:teuthology.orchestra.run.smithi072.stdout:Group : Unspecified 2023-12-12T23:43:23.494 INFO:teuthology.orchestra.run.smithi072.stdout:Size : 8264254 2023-12-12T23:43:23.494 INFO:teuthology.orchestra.run.smithi072.stdout:License : GPLv3+ 2023-12-12T23:43:23.495 INFO:teuthology.orchestra.run.smithi072.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-12T23:43:23.495 INFO:teuthology.orchestra.run.smithi072.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-12T23:43:23.495 INFO:teuthology.orchestra.run.smithi072.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-12T23:43:23.495 INFO:teuthology.orchestra.run.smithi072.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-12T23:43:23.495 INFO:teuthology.orchestra.run.smithi072.stdout:Packager : builder@centos.org 2023-12-12T23:43:23.495 INFO:teuthology.orchestra.run.smithi072.stdout:Vendor : CentOS 2023-12-12T23:43:23.495 INFO:teuthology.orchestra.run.smithi072.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-12T23:43:23.495 INFO:teuthology.orchestra.run.smithi072.stdout:Summary : Support tools for GRUB. 2023-12-12T23:43:23.495 INFO:teuthology.orchestra.run.smithi072.stdout:Description : 2023-12-12T23:43:23.495 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:43:23.495 INFO:teuthology.orchestra.run.smithi072.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-12T23:43:23.495 INFO:teuthology.orchestra.run.smithi072.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-12T23:43:23.495 INFO:teuthology.orchestra.run.smithi072.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-12T23:43:23.495 INFO:teuthology.orchestra.run.smithi072.stdout:hardware devices. 2023-12-12T23:43:23.495 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:43:23.496 INFO:teuthology.orchestra.run.smithi072.stdout:This subpackage provides tools for support of all platforms. 2023-12-12T23:43:23.496 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-12T23:43:23.497 INFO:teuthology.task.kernel:Updating grub on smithi072 to boot 5.14.0-391.el9.x86_64 2023-12-12T23:43:23.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-12T23:43:24.172 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2023-12-12T23:43:25.632 INFO:teuthology.orchestra.run.smithi072.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-12T23:43:25.658 INFO:teuthology.orchestra.run.smithi072.stderr:done 2023-12-12T23:43:25.660 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-12-12T23:43:25.675 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.ciRjUJYbsH 2023-12-12T23:43:25.675 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ciRjUJYbsH 2023-12-12T23:43:25.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.ciRjUJYbsH 2023-12-12T23:43:25.889 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.ciRjUJYbsH is 6KB 2023-12-12T23:43:25.938 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.ciRjUJYbsH 2023-12-12T23:43:25.951 DEBUG:teuthology.orchestra.run.smithi072:> sudo /bin/ls /boot/loader/entries || true 2023-12-12T23:43:26.016 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-12T23:43:26.016 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-12T23:43:26.016 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-12T23:43:26.016 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-12T23:43:26.017 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-12T23:43:26.161 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2023-12-12T23:43:46.014 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-12T23:43:46.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-12-12T23:43:46.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:43:56.173 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-12T23:43:56.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-12-12T23:43:56.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:44:46.067 DEBUG:teuthology.orchestra.remote:timed out 2023-12-12T23:44:55.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-12-12T23:44:55.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:44:56.177 DEBUG:teuthology.orchestra.remote:timed out 2023-12-12T23:44:56.659 DEBUG:teuthology.orchestra.run.smithi176:> true 2023-12-12T23:44:57.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-12-12T23:44:57.082 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-391.el9.x86_64"... 2023-12-12T23:44:57.082 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2023-12-12T23:44:57.096 INFO:teuthology.orchestra.run.smithi176.stdout:5.14.0-391.el9.x86_64 2023-12-12T23:44:57.097 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-12T23:44:57.097 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-12T23:44:57.097 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-12T23:44:58.098 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-12T23:44:58.098 DEBUG:teuthology.orchestra.run.smithi176:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-12T23:44:58.186 INFO:teuthology.orchestra.run.smithi176.stdout:ttyS1 2023-12-12T23:44:58.222 DEBUG:teuthology.parallel:result is None 2023-12-12T23:45:05.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-12-12T23:45:05.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:45:06.325 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-12-12T23:45:07.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-12-12T23:45:07.238 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-391.el9.x86_64"... 2023-12-12T23:45:07.238 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-12-12T23:45:07.252 INFO:teuthology.orchestra.run.smithi072.stdout:5.14.0-391.el9.x86_64 2023-12-12T23:45:07.252 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-12T23:45:07.252 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-12T23:45:07.252 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-12T23:45:08.254 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-12T23:45:08.257 DEBUG:teuthology.orchestra.run.smithi072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-12T23:45:08.362 INFO:teuthology.orchestra.run.smithi072.stdout:ttyS1 2023-12-12T23:45:08.410 DEBUG:teuthology.parallel:result is None 2023-12-12T23:45:08.410 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-12T23:45:08.418 INFO:teuthology.task.internal:Creating test directory... 2023-12-12T23:45:08.418 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-12T23:45:08.420 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-12T23:45:08.440 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-12T23:45:08.447 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-12T23:45:08.461 INFO:teuthology.task.internal:Creating archive directory... 2023-12-12T23:45:08.462 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-12T23:45:08.472 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-12T23:45:08.608 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-12T23:45:08.616 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-12T23:45:08.616 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-12T23:45:08.618 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-12T23:45:08.651 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T23:45:08.666 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T23:45:08.675 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T23:45:08.688 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T23:45:08.690 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-12T23:45:08.697 INFO:teuthology.task.internal:Configuring sudo... 2023-12-12T23:45:08.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-12T23:45:08.699 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-12T23:45:08.739 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-12T23:45:08.747 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-12T23:45:08.748 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-12T23:45:08.763 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-12T23:45:08.796 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T23:45:08.856 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T23:45:08.911 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T23:45:08.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T23:45:08.992 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:45:08.992 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-12T23:45:09.062 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T23:45:09.109 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T23:45:09.159 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T23:45:09.243 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T23:45:09.287 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:45:09.288 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-12T23:45:09.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2023-12-12T23:45:09.358 DEBUG:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2023-12-12T23:45:09.397 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-12T23:45:09.463 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-12T23:45:09.777 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-12T23:45:09.785 INFO:teuthology.task.internal:Starting timer... 2023-12-12T23:45:09.785 INFO:teuthology.run_tasks:Running task pcp... 2023-12-12T23:45:09.802 INFO:teuthology.run_tasks:Running task selinux... 2023-12-12T23:45:09.817 DEBUG:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2023-12-12T23:45:09.895 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: 2023-12-12T23:45:09.895 DEBUG:teuthology.orchestra.run.smithi176:> sudo service auditd rotate 2023-12-12T23:45:09.936 INFO:teuthology.orchestra.run.smithi176.stdout:Rotating logs: 2023-12-12T23:45:09.938 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-12T23:45:09.938 DEBUG:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2023-12-12T23:45:09.969 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2023-12-12T23:45:09.969 DEBUG:teuthology.orchestra.run.smithi176:> /usr/sbin/getenforce 2023-12-12T23:45:10.026 INFO:teuthology.orchestra.run.smithi176.stdout:Permissive 2023-12-12T23:45:10.026 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi072.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi176.front.sepia.ceph.com': 'permissive'} 2023-12-12T23:45:10.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-12T23:45:10.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T23:45:10.054 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-12T23:45:10.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T23:45:10.081 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-12T23:45:10.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2023-12-12T23:45:10.130 DEBUG:teuthology.orchestra.run.smithi176:> sudo /usr/sbin/setenforce permissive 2023-12-12T23:45:10.162 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-12T23:45:10.172 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-12T23:45:10.177 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-12T23:45:10.321 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-12T23:45:10.338 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-12T23:45:10.339 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi072.front.sepia.ceph.com,smithi176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-12T23:50:46.386 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi176.front.sepia.ceph.com')] 2023-12-12T23:50:46.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-12-12T23:50:46.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:50:46.472 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-12-12T23:50:46.540 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-12-12T23:50:46.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-12-12T23:50:46.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:50:46.624 DEBUG:teuthology.orchestra.run.smithi176:> true 2023-12-12T23:50:46.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-12-12T23:50:46.692 INFO:teuthology.run_tasks:Running task clock... 2023-12-12T23:50:46.703 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-12T23:50:46.703 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-12T23:50:46.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T23:50:46.706 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-12T23:50:46.706 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T23:50:46.736 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-12T23:50:46.753 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-12T23:50:46.761 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-12T23:50:46.778 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-12T23:50:46.782 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2023-12-12T23:50:46.796 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2023-12-12T23:50:46.807 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: ntpd: command not found 2023-12-12T23:50:46.812 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-12T23:50:46.820 INFO:teuthology.orchestra.run.smithi176.stdout:506 Cannot talk to daemon 2023-12-12T23:50:46.829 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-12T23:50:46.837 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-12T23:50:46.853 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-12T23:50:46.871 INFO:teuthology.orchestra.run.smithi072.stderr:bash: line 1: ntpq: command not found 2023-12-12T23:50:46.874 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-12T23:50:46.874 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2023-12-12T23:50:46.874 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T23:50:46.874 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T23:50:46.874 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T23:50:46.874 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T23:50:46.896 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2023-12-12T23:50:46.899 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-12T23:50:46.899 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2023-12-12T23:50:46.899 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T23:50:46.899 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T23:50:46.899 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T23:50:46.899 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T23:50:46.900 INFO:teuthology.run_tasks:Running task install... 2023-12-12T23:50:46.909 DEBUG:teuthology.task.install:project ceph 2023-12-12T23:50:46.909 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175'}} 2023-12-12T23:50:46.909 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175'} 2023-12-12T23:50:46.909 INFO:teuthology.task.install:Using flavor: default 2023-12-12T23:50:46.915 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2023-12-12T23:50:46.915 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-12T23:50:46.915 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175', 'tag': None, 'wait_for_package': False} 2023-12-12T23:50:46.916 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=021ac1670a21c19759080c6da90baaeb42e7d175 2023-12-12T23:50:46.918 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175', 'tag': None, 'wait_for_package': False} 2023-12-12T23:50:46.918 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=021ac1670a21c19759080c6da90baaeb42e7d175 2023-12-12T23:50:47.065 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/centos/9/flavors/default/ 2023-12-12T23:50:47.065 INFO:teuthology.task.install.rpm:Package version is 19.0.0-157.g021ac167 2023-12-12T23:50:47.129 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/centos/9/flavors/default/ 2023-12-12T23:50:47.129 INFO:teuthology.task.install.rpm:Package version is 19.0.0-157.g021ac167 2023-12-12T23:50:47.185 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-12T23:50:47.185 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:50:47.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-12T23:50:47.213 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-12T23:50:47.213 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/021ac1670a21c19759080c6da90baaeb42e7d175/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-12T23:50:47.281 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-12T23:50:47.299 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-12T23:50:47.299 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:50:47.299 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-12T23:50:47.327 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-12T23:50:47.327 DEBUG:teuthology.orchestra.run.smithi176:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/021ac1670a21c19759080c6da90baaeb42e7d175/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-12T23:50:47.361 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-12T23:50:47.394 DEBUG:teuthology.orchestra.run.smithi176:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-12T23:50:47.427 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2023-12-12T23:50:47.428 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2023-12-12T23:50:47.474 DEBUG:teuthology.orchestra.run.smithi176:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-12T23:50:47.540 INFO:teuthology.orchestra.run.smithi176.stdout:check_obsoletes = 1 2023-12-12T23:50:47.542 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum clean all 2023-12-12T23:50:47.664 INFO:teuthology.orchestra.run.smithi072.stdout:73 files removed 2023-12-12T23:50:47.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-12T23:50:47.782 INFO:teuthology.orchestra.run.smithi176.stdout:73 files removed 2023-12-12T23:50:47.809 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-12T23:50:48.404 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 198 kB/s | 78 kB 00:00 2023-12-12T23:50:48.599 INFO:teuthology.orchestra.run.smithi176.stdout:ceph packages for x86_64 166 kB/s | 78 kB 00:00 2023-12-12T23:50:48.823 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 26 kB/s | 9.5 kB 00:00 2023-12-12T23:50:48.957 INFO:teuthology.orchestra.run.smithi176.stdout:ceph noarch packages 31 kB/s | 9.5 kB 00:00 2023-12-12T23:50:49.248 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2023-12-12T23:50:49.366 INFO:teuthology.orchestra.run.smithi176.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2023-12-12T23:50:49.777 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS-9 - AppStream 17 MB/s | 6.4 MB 00:00 2023-12-12T23:50:49.860 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2023-12-12T23:50:51.094 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS-9 - BaseOS 7.8 MB/s | 2.0 MB 00:00 2023-12-12T23:50:51.195 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - BaseOS 7.3 MB/s | 2.0 MB 00:00 2023-12-12T23:50:52.280 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 7.9 MB 00:00 2023-12-12T23:50:53.735 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 7.9 MB 00:02 2023-12-12T23:50:54.691 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - AppStream 13 MB/s | 18 MB 00:01 2023-12-12T23:50:58.962 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - CRB 6.6 MB/s | 5.8 MB 00:00 2023-12-12T23:51:00.564 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 15 kB 00:00 2023-12-12T23:51:04.820 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 4.8 MB/s | 20 MB 00:04 2023-12-12T23:51:09.126 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 18 MB 00:14 2023-12-12T23:51:09.475 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2023-12-12T23:51:11.928 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-12T23:51:11.929 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-12T23:51:11.962 INFO:teuthology.orchestra.run.smithi072.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-12T23:51:11.963 INFO:teuthology.orchestra.run.smithi072.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-12T23:51:11.964 INFO:teuthology.orchestra.run.smithi072.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-12T23:51:11.965 INFO:teuthology.orchestra.run.smithi072.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-12T23:51:11.967 INFO:teuthology.orchestra.run.smithi072.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-12T23:51:11.970 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-12T23:51:11.971 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-12T23:51:12.046 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-12-12T23:51:12.079 INFO:teuthology.orchestra.run.smithi072.stdout:=================================================================================================== 2023-12-12T23:51:12.079 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2023-12-12T23:51:12.079 INFO:teuthology.orchestra.run.smithi072.stdout:=================================================================================================== 2023-12-12T23:51:12.080 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2023-12-12T23:51:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-12T23:51:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:19.0.0-157.g021ac167.el9 ceph 6.5 k 2023-12-12T23:51:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:19.0.0-157.g021ac167.el9 ceph 5.2 M 2023-12-12T23:51:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 73 M 2023-12-12T23:51:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 405 M 2023-12-12T23:51:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:19.0.0-157.g021ac167.el9 ceph 859 k 2023-12-12T23:51:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 5.8 M 2023-12-12T23:51:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-157.g021ac167.el9 ceph 141 k 2023-12-12T23:51:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 1.4 M 2023-12-12T23:51:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 47 M 2023-12-12T23:51:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:19.0.0-157.g021ac167.el9 ceph 1.5 M 2023-12-12T23:51:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 133 k 2023-12-12T23:51:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 1.8 M 2023-12-12T23:51:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 19 M 2023-12-12T23:51:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 7.4 M 2023-12-12T23:51:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 50 k 2023-12-12T23:51:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 111 M 2023-12-12T23:51:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 311 M 2023-12-12T23:51:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:19.0.0-157.g021ac167.el9 ceph 8.6 M 2023-12-12T23:51:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 173 M 2023-12-12T23:51:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:19.0.0-157.g021ac167.el9 ceph 41 M 2023-12-12T23:51:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 623 M 2023-12-12T23:51:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 262 k 2023-12-12T23:51:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 803 k 2023-12-12T23:51:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror x86_64 2:19.0.0-157.g021ac167.el9 ceph 217 k 2023-12-12T23:51:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-shell x86_64 2:19.0.0-157.g021ac167.el9 ceph 27 k 2023-12-12T23:51:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 18 k 2023-12-12T23:51:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-12T23:51:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-12T23:51:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-12T23:51:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:19.0.0-157.g021ac167.el9 ceph 31 k 2023-12-12T23:51:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:19.0.0-157.g021ac167.el9 ceph 719 k 2023-12-12T23:51:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 5.1 M 2023-12-12T23:51:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:19.0.0-157.g021ac167.el9 ceph 126 k 2023-12-12T23:51:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 108 k 2023-12-12T23:51:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 43 M 2023-12-12T23:51:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 50 M 2023-12-12T23:51:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-12T23:51:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-12T23:51:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-12T23:51:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-12T23:51:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-12T23:51:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-12T23:51:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:19.0.0-157.g021ac167.el9 ceph 161 k 2023-12-12T23:51:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 615 k 2023-12-12T23:51:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:19.0.0-157.g021ac167.el9 ceph 321 k 2023-12-12T23:51:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 770 k 2023-12-12T23:51:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:19.0.0-157.g021ac167.el9 ceph 298 k 2023-12-12T23:51:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 1.1 M 2023-12-12T23:51:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:19.0.0-157.g021ac167.el9 ceph 99 k 2023-12-12T23:51:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 337 k 2023-12-12T23:51:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:19.0.0-157.g021ac167.el9 ceph 85 k 2023-12-12T23:51:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 506 k 2023-12-12T23:51:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:19.0.0-157.g021ac167.el9 ceph 3.0 M 2023-12-12T23:51:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 50 M 2023-12-12T23:51:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:19.0.0-157.g021ac167.el9 ceph 170 k 2023-12-12T23:51:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 1.2 M 2023-12-12T23:51:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-12T23:51:12.084 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2023-12-12T23:51:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-12T23:51:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-12T23:51:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-12T23:51:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-12T23:51:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-12T23:51:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-12T23:51:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-12T23:51:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-12T23:51:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-12T23:51:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-12T23:51:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:19.0.0-157.g021ac167.el9 ceph 3.3 M 2023-12-12T23:51:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:19.0.0-157.g021ac167.el9 ceph 3.0 M 2023-12-12T23:51:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-12T23:51:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-12T23:51:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-12T23:51:12.085 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2023-12-12T23:51:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-12T23:51:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-12T23:51:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:19.0.0-157.g021ac167.el9 ceph 19 M 2023-12-12T23:51:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 21 M 2023-12-12T23:51:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 28 k 2023-12-12T23:51:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:19.0.0-157.g021ac167.el9 ceph 2.1 M 2023-12-12T23:51:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 243 k 2023-12-12T23:51:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:19.0.0-157.g021ac167.el9 ceph 4.4 M 2023-12-12T23:51:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:19.0.0-157.g021ac167.el9 ceph 18 M 2023-12-12T23:51:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 15 k 2023-12-12T23:51:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:19.0.0-157.g021ac167.el9 ceph 24 k 2023-12-12T23:51:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-12T23:51:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-12T23:51:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-12T23:51:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-12T23:51:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-12T23:51:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-12T23:51:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-12T23:51:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-12T23:51:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:19.0.0-157.g021ac167.el9 ceph 163 k 2023-12-12T23:51:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-12T23:51:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-12T23:51:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-12T23:51:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-12T23:51:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-12T23:51:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:19.0.0-157.g021ac167.el9 ceph 476 k 2023-12-12T23:51:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-12T23:51:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:19.0.0-157.g021ac167.el9 ceph 4.8 M 2023-12-12T23:51:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-12T23:51:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-12T23:51:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-12T23:51:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-12T23:51:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-12T23:51:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-12T23:51:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-12T23:51:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-12T23:51:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-12T23:51:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-12T23:51:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-12T23:51:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-12T23:51:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-12T23:51:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-12T23:51:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-12T23:51:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:19.0.0-157.g021ac167.el9 ceph 45 k 2023-12-12T23:51:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:19.0.0-157.g021ac167.el9 ceph 129 k 2023-12-12T23:51:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-12T23:51:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-12T23:51:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-12T23:51:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-12T23:51:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-12T23:51:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-12T23:51:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-12T23:51:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-12T23:51:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-12T23:51:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-12T23:51:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-12T23:51:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-12T23:51:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-12T23:51:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-12T23:51:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-12T23:51:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-12T23:51:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-12T23:51:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-12T23:51:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-12T23:51:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-12T23:51:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-12T23:51:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-12T23:51:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-12T23:51:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-12T23:51:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-12T23:51:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-12T23:51:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-12T23:51:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-12T23:51:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-12T23:51:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-12T23:51:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-12T23:51:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-12T23:51:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-12T23:51:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-12T23:51:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-12T23:51:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-12T23:51:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-12T23:51:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-12T23:51:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-12T23:51:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-12T23:51:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-12T23:51:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-12T23:51:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-12T23:51:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-12T23:51:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-12T23:51:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-12T23:51:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-12T23:51:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-12T23:51:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-12T23:51:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-12T23:51:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-12T23:51:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-12T23:51:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-12T23:51:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-12T23:51:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-12T23:51:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-12T23:51:12.094 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-12T23:51:12.094 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-12T23:51:12.094 INFO:teuthology.orchestra.run.smithi072.stdout:Installing weak dependencies: 2023-12-12T23:51:12.094 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-12T23:51:12.094 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:51:12.094 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2023-12-12T23:51:12.094 INFO:teuthology.orchestra.run.smithi072.stdout:=================================================================================================== 2023-12-12T23:51:12.094 INFO:teuthology.orchestra.run.smithi072.stdout:Install 162 Packages 2023-12-12T23:51:12.094 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 15 Packages 2023-12-12T23:51:12.094 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:51:12.095 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 2.1 G 2023-12-12T23:51:12.095 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2023-12-12T23:51:13.013 INFO:teuthology.orchestra.run.smithi072.stdout:(1/177): ceph-19.0.0-157.g021ac167.el9.x86_64.r 27 kB/s | 6.5 kB 00:00 2023-12-12T23:51:13.243 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 5.8 MB 00:00 2023-12-12T23:51:13.414 INFO:teuthology.orchestra.run.smithi072.stdout:(2/177): ceph-base-19.0.0-157.g021ac167.el9.x86 8.2 MB/s | 5.2 MB 00:00 2023-12-12T23:51:15.177 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 15 kB 00:00 2023-12-12T23:51:17.487 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 20 MB 00:02 2023-12-12T23:51:22.295 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2023-12-12T23:51:24.736 INFO:teuthology.orchestra.run.smithi176.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-12T23:51:24.737 INFO:teuthology.orchestra.run.smithi176.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-12T23:51:24.769 INFO:teuthology.orchestra.run.smithi176.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-12T23:51:24.770 INFO:teuthology.orchestra.run.smithi176.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-12T23:51:24.771 INFO:teuthology.orchestra.run.smithi176.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-12T23:51:24.772 INFO:teuthology.orchestra.run.smithi176.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-12T23:51:24.774 INFO:teuthology.orchestra.run.smithi176.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-12T23:51:24.777 INFO:teuthology.orchestra.run.smithi176.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-12T23:51:24.778 INFO:teuthology.orchestra.run.smithi176.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-12T23:51:24.853 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2023-12-12T23:51:24.865 INFO:teuthology.orchestra.run.smithi176.stdout:=================================================================================================== 2023-12-12T23:51:24.865 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2023-12-12T23:51:24.865 INFO:teuthology.orchestra.run.smithi176.stdout:=================================================================================================== 2023-12-12T23:51:24.865 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2023-12-12T23:51:24.865 INFO:teuthology.orchestra.run.smithi176.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-12T23:51:24.865 INFO:teuthology.orchestra.run.smithi176.stdout: ceph x86_64 2:19.0.0-157.g021ac167.el9 ceph 6.5 k 2023-12-12T23:51:24.865 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base x86_64 2:19.0.0-157.g021ac167.el9 ceph 5.2 M 2023-12-12T23:51:24.865 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 73 M 2023-12-12T23:51:24.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 405 M 2023-12-12T23:51:24.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse x86_64 2:19.0.0-157.g021ac167.el9 ceph 859 k 2023-12-12T23:51:24.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 5.8 M 2023-12-12T23:51:24.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-157.g021ac167.el9 ceph 141 k 2023-12-12T23:51:24.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 1.4 M 2023-12-12T23:51:24.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 47 M 2023-12-12T23:51:24.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr x86_64 2:19.0.0-157.g021ac167.el9 ceph 1.5 M 2023-12-12T23:51:24.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 133 k 2023-12-12T23:51:24.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 1.8 M 2023-12-12T23:51:24.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 19 M 2023-12-12T23:51:24.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 7.4 M 2023-12-12T23:51:24.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 50 k 2023-12-12T23:51:24.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 111 M 2023-12-12T23:51:24.867 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 311 M 2023-12-12T23:51:24.867 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw x86_64 2:19.0.0-157.g021ac167.el9 ceph 8.6 M 2023-12-12T23:51:24.867 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 173 M 2023-12-12T23:51:24.867 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test x86_64 2:19.0.0-157.g021ac167.el9 ceph 41 M 2023-12-12T23:51:24.867 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 623 M 2023-12-12T23:51:24.867 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 262 k 2023-12-12T23:51:24.867 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 803 k 2023-12-12T23:51:24.867 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror x86_64 2:19.0.0-157.g021ac167.el9 ceph 217 k 2023-12-12T23:51:24.867 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-shell x86_64 2:19.0.0-157.g021ac167.el9 ceph 27 k 2023-12-12T23:51:24.867 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-top noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 18 k 2023-12-12T23:51:24.867 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-12T23:51:24.867 INFO:teuthology.orchestra.run.smithi176.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-12T23:51:24.867 INFO:teuthology.orchestra.run.smithi176.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-12T23:51:24.868 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel x86_64 2:19.0.0-157.g021ac167.el9 ceph 31 k 2023-12-12T23:51:24.868 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2 x86_64 2:19.0.0-157.g021ac167.el9 ceph 719 k 2023-12-12T23:51:24.868 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 5.1 M 2023-12-12T23:51:24.868 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel x86_64 2:19.0.0-157.g021ac167.el9 ceph 126 k 2023-12-12T23:51:24.868 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 108 k 2023-12-12T23:51:24.868 INFO:teuthology.orchestra.run.smithi176.stdout: librados2-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 43 M 2023-12-12T23:51:24.868 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 50 M 2023-12-12T23:51:24.868 INFO:teuthology.orchestra.run.smithi176.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-12T23:51:24.868 INFO:teuthology.orchestra.run.smithi176.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-12T23:51:24.868 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-12T23:51:24.868 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-12T23:51:24.868 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-12T23:51:24.868 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-12T23:51:24.868 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs x86_64 2:19.0.0-157.g021ac167.el9 ceph 161 k 2023-12-12T23:51:24.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 615 k 2023-12-12T23:51:24.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados x86_64 2:19.0.0-157.g021ac167.el9 ceph 321 k 2023-12-12T23:51:24.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 770 k 2023-12-12T23:51:24.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd x86_64 2:19.0.0-157.g021ac167.el9 ceph 298 k 2023-12-12T23:51:24.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 1.1 M 2023-12-12T23:51:24.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw x86_64 2:19.0.0-157.g021ac167.el9 ceph 99 k 2023-12-12T23:51:24.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 337 k 2023-12-12T23:51:24.869 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse x86_64 2:19.0.0-157.g021ac167.el9 ceph 85 k 2023-12-12T23:51:24.869 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 506 k 2023-12-12T23:51:24.869 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror x86_64 2:19.0.0-157.g021ac167.el9 ceph 3.0 M 2023-12-12T23:51:24.869 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 50 M 2023-12-12T23:51:24.869 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd x86_64 2:19.0.0-157.g021ac167.el9 ceph 170 k 2023-12-12T23:51:24.869 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 1.2 M 2023-12-12T23:51:24.870 INFO:teuthology.orchestra.run.smithi176.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-12T23:51:24.870 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrading: 2023-12-12T23:51:24.870 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-12T23:51:24.870 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-12T23:51:24.870 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-12T23:51:24.870 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-12T23:51:24.870 INFO:teuthology.orchestra.run.smithi176.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-12T23:51:24.870 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-12T23:51:24.870 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-12T23:51:24.870 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-12T23:51:24.870 INFO:teuthology.orchestra.run.smithi176.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-12T23:51:24.870 INFO:teuthology.orchestra.run.smithi176.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-12T23:51:24.870 INFO:teuthology.orchestra.run.smithi176.stdout: librados2 x86_64 2:19.0.0-157.g021ac167.el9 ceph 3.3 M 2023-12-12T23:51:24.871 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1 x86_64 2:19.0.0-157.g021ac167.el9 ceph 3.0 M 2023-12-12T23:51:24.871 INFO:teuthology.orchestra.run.smithi176.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-12T23:51:24.871 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-12T23:51:24.871 INFO:teuthology.orchestra.run.smithi176.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-12T23:51:24.871 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2023-12-12T23:51:24.871 INFO:teuthology.orchestra.run.smithi176.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-12T23:51:24.871 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-12T23:51:24.871 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common x86_64 2:19.0.0-157.g021ac167.el9 ceph 19 M 2023-12-12T23:51:24.871 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-debuginfo x86_64 2:19.0.0-157.g021ac167.el9 ceph 21 M 2023-12-12T23:51:24.871 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 28 k 2023-12-12T23:51:24.871 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds x86_64 2:19.0.0-157.g021ac167.el9 ceph 2.1 M 2023-12-12T23:51:24.871 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 243 k 2023-12-12T23:51:24.871 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon x86_64 2:19.0.0-157.g021ac167.el9 ceph 4.4 M 2023-12-12T23:51:24.872 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd x86_64 2:19.0.0-157.g021ac167.el9 ceph 18 M 2023-12-12T23:51:24.872 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts noarch 2:19.0.0-157.g021ac167.el9 ceph-noarch 15 k 2023-12-12T23:51:24.872 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux x86_64 2:19.0.0-157.g021ac167.el9 ceph 24 k 2023-12-12T23:51:24.872 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-12T23:51:24.872 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-12T23:51:24.872 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-12T23:51:24.872 INFO:teuthology.orchestra.run.smithi176.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-12T23:51:24.872 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-12T23:51:24.872 INFO:teuthology.orchestra.run.smithi176.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-12T23:51:24.872 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-12T23:51:24.872 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-12T23:51:24.872 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite x86_64 2:19.0.0-157.g021ac167.el9 ceph 163 k 2023-12-12T23:51:24.872 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-12T23:51:24.872 INFO:teuthology.orchestra.run.smithi176.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-12T23:51:24.873 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-12T23:51:24.873 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-12T23:51:24.873 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-12T23:51:24.873 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1 x86_64 2:19.0.0-157.g021ac167.el9 ceph 476 k 2023-12-12T23:51:24.873 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-12T23:51:24.873 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2 x86_64 2:19.0.0-157.g021ac167.el9 ceph 4.8 M 2023-12-12T23:51:24.873 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-12T23:51:24.873 INFO:teuthology.orchestra.run.smithi176.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-12T23:51:24.873 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-12T23:51:24.873 INFO:teuthology.orchestra.run.smithi176.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-12T23:51:24.873 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-12T23:51:24.873 INFO:teuthology.orchestra.run.smithi176.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-12T23:51:24.873 INFO:teuthology.orchestra.run.smithi176.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-12T23:51:24.874 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-12T23:51:24.874 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-12T23:51:24.874 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-12T23:51:24.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-12T23:51:24.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-12T23:51:24.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-12T23:51:24.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-12T23:51:24.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-12T23:51:24.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse x86_64 2:19.0.0-157.g021ac167.el9 ceph 45 k 2023-12-12T23:51:24.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common x86_64 2:19.0.0-157.g021ac167.el9 ceph 129 k 2023-12-12T23:51:24.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-12T23:51:24.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-12T23:51:24.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-12T23:51:24.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-12T23:51:24.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-12T23:51:24.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-12T23:51:24.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-12T23:51:24.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-12T23:51:24.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-12T23:51:24.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-12T23:51:24.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-12T23:51:24.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-12T23:51:24.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-12T23:51:24.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-12T23:51:24.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-12T23:51:24.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-12T23:51:24.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-12T23:51:24.876 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-12T23:51:24.876 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-12T23:51:24.876 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-12T23:51:24.876 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-12T23:51:24.876 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-12T23:51:24.876 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-12T23:51:24.876 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-12T23:51:24.876 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-12T23:51:24.876 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-12T23:51:24.876 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-12T23:51:24.876 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-12T23:51:24.876 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-12T23:51:24.876 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-12T23:51:24.876 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-12T23:51:24.877 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-12T23:51:24.877 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-12T23:51:24.877 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-12T23:51:24.877 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-12T23:51:24.877 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-12T23:51:24.877 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-12T23:51:24.877 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-12T23:51:24.877 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-12T23:51:24.877 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-12T23:51:24.877 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-12T23:51:24.877 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-12T23:51:24.877 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-12T23:51:24.877 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-12T23:51:24.877 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-12T23:51:24.878 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-12T23:51:24.878 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-12T23:51:24.878 INFO:teuthology.orchestra.run.smithi176.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-12T23:51:24.878 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-12T23:51:24.878 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-12T23:51:24.878 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-12T23:51:24.878 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-12T23:51:24.878 INFO:teuthology.orchestra.run.smithi176.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-12T23:51:24.878 INFO:teuthology.orchestra.run.smithi176.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-12T23:51:24.878 INFO:teuthology.orchestra.run.smithi176.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-12T23:51:24.878 INFO:teuthology.orchestra.run.smithi176.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-12T23:51:24.878 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-12T23:51:24.878 INFO:teuthology.orchestra.run.smithi176.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-12T23:51:24.879 INFO:teuthology.orchestra.run.smithi176.stdout:Installing weak dependencies: 2023-12-12T23:51:24.879 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-12T23:51:24.879 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:51:24.879 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2023-12-12T23:51:24.879 INFO:teuthology.orchestra.run.smithi176.stdout:=================================================================================================== 2023-12-12T23:51:24.879 INFO:teuthology.orchestra.run.smithi176.stdout:Install 162 Packages 2023-12-12T23:51:24.879 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrade 15 Packages 2023-12-12T23:51:24.879 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:51:24.880 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 2.1 G 2023-12-12T23:51:24.880 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2023-12-12T23:51:25.815 INFO:teuthology.orchestra.run.smithi176.stdout:(1/177): ceph-19.0.0-157.g021ac167.el9.x86_64.r 18 kB/s | 6.5 kB 00:00 2023-12-12T23:51:28.098 INFO:teuthology.orchestra.run.smithi176.stdout:(2/177): ceph-base-19.0.0-157.g021ac167.el9.x86 2.0 MB/s | 5.2 MB 00:02 2023-12-12T23:51:30.032 INFO:teuthology.orchestra.run.smithi176.stdout:(3/177): ceph-common-19.0.0-157.g021ac167.el9.x 4.5 MB/s | 19 MB 00:04 2023-12-12T23:51:31.838 INFO:teuthology.orchestra.run.smithi072.stdout:(3/177): ceph-common-19.0.0-157.g021ac167.el9.x 1.0 MB/s | 19 MB 00:18 2023-12-12T23:51:33.790 INFO:teuthology.orchestra.run.smithi176.stdout:(4/177): ceph-debuginfo-19.0.0-157.g021ac167.el 5.5 MB/s | 21 MB 00:03 2023-12-12T23:51:34.055 INFO:teuthology.orchestra.run.smithi176.stdout:(5/177): ceph-fuse-19.0.0-157.g021ac167.el9.x86 3.2 MB/s | 859 kB 00:00 2023-12-12T23:51:35.465 INFO:teuthology.orchestra.run.smithi176.stdout:(6/177): ceph-fuse-debuginfo-19.0.0-157.g021ac1 4.1 MB/s | 5.8 MB 00:01 2023-12-12T23:51:35.557 INFO:teuthology.orchestra.run.smithi176.stdout:(7/177): ceph-immutable-object-cache-19.0.0-157 1.5 MB/s | 141 kB 00:00 2023-12-12T23:51:35.966 INFO:teuthology.orchestra.run.smithi176.stdout:(8/177): ceph-immutable-object-cache-debuginfo- 3.4 MB/s | 1.4 MB 00:00 2023-12-12T23:51:36.541 INFO:teuthology.orchestra.run.smithi176.stdout:(9/177): ceph-mds-19.0.0-157.g021ac167.el9.x86_ 3.6 MB/s | 2.1 MB 00:00 2023-12-12T23:51:40.947 INFO:teuthology.orchestra.run.smithi072.stdout:(4/177): ceph-debuginfo-19.0.0-157.g021ac167.el 2.3 MB/s | 21 MB 00:09 2023-12-12T23:51:41.322 INFO:teuthology.orchestra.run.smithi072.stdout:(5/177): ceph-fuse-19.0.0-157.g021ac167.el9.x86 2.2 MB/s | 859 kB 00:00 2023-12-12T23:51:44.607 INFO:teuthology.orchestra.run.smithi176.stdout:(10/177): ceph-mds-debuginfo-19.0.0-157.g021ac1 5.8 MB/s | 47 MB 00:08 2023-12-12T23:51:44.790 INFO:teuthology.orchestra.run.smithi176.stdout:(11/177): ceph-mgr-19.0.0-157.g021ac167.el9.x86 8.0 MB/s | 1.5 MB 00:00 2023-12-12T23:51:46.390 INFO:teuthology.orchestra.run.smithi176.stdout:(12/177): ceph-mgr-debuginfo-19.0.0-157.g021ac1 12 MB/s | 19 MB 00:01 2023-12-12T23:51:46.732 INFO:teuthology.orchestra.run.smithi176.stdout:(13/177): ceph-mon-19.0.0-157.g021ac167.el9.x86 13 MB/s | 4.4 MB 00:00 2023-12-12T23:51:49.978 INFO:teuthology.orchestra.run.smithi072.stdout:(6/177): ceph-common-debuginfo-19.0.0-157.g021a 11 MB/s | 405 MB 00:36 2023-12-12T23:51:50.095 INFO:teuthology.orchestra.run.smithi072.stdout:(7/177): ceph-fuse-debuginfo-19.0.0-157.g021ac1 672 kB/s | 5.8 MB 00:08 2023-12-12T23:51:50.154 INFO:teuthology.orchestra.run.smithi072.stdout:(8/177): ceph-immutable-object-cache-19.0.0-157 804 kB/s | 141 kB 00:00 2023-12-12T23:51:50.472 INFO:teuthology.orchestra.run.smithi072.stdout:(9/177): ceph-mds-19.0.0-157.g021ac167.el9.x86_ 6.6 MB/s | 2.1 MB 00:00 2023-12-12T23:51:50.856 INFO:teuthology.orchestra.run.smithi072.stdout:(10/177): ceph-immutable-object-cache-debuginfo 1.8 MB/s | 1.4 MB 00:00 2023-12-12T23:51:51.559 INFO:teuthology.orchestra.run.smithi072.stdout:(11/177): ceph-mgr-19.0.0-157.g021ac167.el9.x86 2.1 MB/s | 1.5 MB 00:00 2023-12-12T23:51:55.101 INFO:teuthology.orchestra.run.smithi072.stdout:(12/177): ceph-mds-debuginfo-19.0.0-157.g021ac1 10 MB/s | 47 MB 00:04 2023-12-12T23:51:55.651 INFO:teuthology.orchestra.run.smithi072.stdout:(13/177): ceph-mon-19.0.0-157.g021ac167.el9.x86 8.0 MB/s | 4.4 MB 00:00 2023-12-12T23:51:58.307 INFO:teuthology.orchestra.run.smithi176.stdout:(14/177): ceph-mon-debuginfo-19.0.0-157.g021ac1 9.6 MB/s | 111 MB 00:11 2023-12-12T23:51:58.702 INFO:teuthology.orchestra.run.smithi072.stdout:(14/177): ceph-base-debuginfo-19.0.0-157.g021ac 1.6 MB/s | 73 MB 00:45 2023-12-12T23:52:00.965 INFO:teuthology.orchestra.run.smithi176.stdout:(15/177): ceph-osd-19.0.0-157.g021ac167.el9.x86 6.7 MB/s | 18 MB 00:02 2023-12-12T23:52:01.044 INFO:teuthology.orchestra.run.smithi072.stdout:(15/177): ceph-mgr-debuginfo-19.0.0-157.g021ac1 2.0 MB/s | 19 MB 00:09 2023-12-12T23:52:05.769 INFO:teuthology.orchestra.run.smithi072.stdout:(16/177): ceph-mon-debuginfo-19.0.0-157.g021ac1 11 MB/s | 111 MB 00:10 2023-12-12T23:52:06.953 INFO:teuthology.orchestra.run.smithi072.stdout:(17/177): ceph-radosgw-19.0.0-157.g021ac167.el9 7.3 MB/s | 8.6 MB 00:01 2023-12-12T23:52:07.206 INFO:teuthology.orchestra.run.smithi176.stdout:(16/177): ceph-base-debuginfo-19.0.0-157.g021ac 1.7 MB/s | 73 MB 00:41 2023-12-12T23:52:08.286 INFO:teuthology.orchestra.run.smithi072.stdout:(18/177): ceph-osd-19.0.0-157.g021ac167.el9.x86 1.8 MB/s | 18 MB 00:09 2023-12-12T23:52:08.395 INFO:teuthology.orchestra.run.smithi072.stdout:(19/177): ceph-selinux-19.0.0-157.g021ac167.el9 222 kB/s | 24 kB 00:00 2023-12-12T23:52:10.223 INFO:teuthology.orchestra.run.smithi176.stdout:(17/177): ceph-radosgw-19.0.0-157.g021ac167.el9 2.8 MB/s | 8.6 MB 00:03 2023-12-12T23:52:23.578 INFO:teuthology.orchestra.run.smithi072.stdout:(20/177): ceph-test-19.0.0-157.g021ac167.el9.x8 2.7 MB/s | 41 MB 00:15 2023-12-12T23:52:39.477 INFO:teuthology.orchestra.run.smithi072.stdout:(21/177): ceph-radosgw-debuginfo-19.0.0-157.g02 5.3 MB/s | 173 MB 00:32 2023-12-12T23:52:39.721 INFO:teuthology.orchestra.run.smithi072.stdout:(22/177): cephfs-mirror-19.0.0-157.g021ac167.el 894 kB/s | 217 kB 00:00 2023-12-12T23:52:39.796 INFO:teuthology.orchestra.run.smithi072.stdout:(23/177): cephfs-shell-19.0.0-157.g021ac167.el9 360 kB/s | 27 kB 00:00 2023-12-12T23:52:39.872 INFO:teuthology.orchestra.run.smithi072.stdout:(24/177): libcephfs-devel-19.0.0-157.g021ac167. 415 kB/s | 31 kB 00:00 2023-12-12T23:52:40.089 INFO:teuthology.orchestra.run.smithi072.stdout:(25/177): libcephfs2-19.0.0-157.g021ac167.el9.x 3.2 MB/s | 719 kB 00:00 2023-12-12T23:52:40.998 INFO:teuthology.orchestra.run.smithi072.stdout:(26/177): libcephfs2-debuginfo-19.0.0-157.g021a 5.7 MB/s | 5.1 MB 00:00 2023-12-12T23:52:41.081 INFO:teuthology.orchestra.run.smithi072.stdout:(27/177): libcephsqlite-19.0.0-157.g021ac167.el 1.9 MB/s | 163 kB 00:00 2023-12-12T23:52:41.165 INFO:teuthology.orchestra.run.smithi072.stdout:(28/177): librados-devel-19.0.0-157.g021ac167.e 1.5 MB/s | 126 kB 00:00 2023-12-12T23:52:41.249 INFO:teuthology.orchestra.run.smithi072.stdout:(29/177): librados-devel-debuginfo-19.0.0-157.g 1.3 MB/s | 108 kB 00:00 2023-12-12T23:52:48.275 INFO:teuthology.orchestra.run.smithi072.stdout:(30/177): librados2-debuginfo-19.0.0-157.g021ac 6.2 MB/s | 43 MB 00:07 2023-12-12T23:52:48.483 INFO:teuthology.orchestra.run.smithi072.stdout:(31/177): libradosstriper1-19.0.0-157.g021ac167 2.2 MB/s | 476 kB 00:00 2023-12-12T23:52:56.517 INFO:teuthology.orchestra.run.smithi072.stdout:(32/177): librbd1-debuginfo-19.0.0-157.g021ac16 6.2 MB/s | 50 MB 00:08 2023-12-12T23:52:56.600 INFO:teuthology.orchestra.run.smithi176.stdout:(18/177): ceph-osd-debuginfo-19.0.0-157.g021ac1 5.6 MB/s | 311 MB 00:55 2023-12-12T23:52:57.059 INFO:teuthology.orchestra.run.smithi072.stdout:(33/177): librgw2-19.0.0-157.g021ac167.el9.x86_ 8.8 MB/s | 4.8 MB 00:00 2023-12-12T23:52:57.126 INFO:teuthology.orchestra.run.smithi072.stdout:(34/177): python3-ceph-argparse-19.0.0-157.g021 677 kB/s | 45 kB 00:00 2023-12-12T23:52:57.201 INFO:teuthology.orchestra.run.smithi072.stdout:(35/177): python3-ceph-common-19.0.0-157.g021ac 1.7 MB/s | 129 kB 00:00 2023-12-12T23:52:57.262 INFO:teuthology.orchestra.run.smithi072.stdout:(36/177): python3-cephfs-19.0.0-157.g021ac167.e 2.6 MB/s | 161 kB 00:00 2023-12-12T23:52:57.354 INFO:teuthology.orchestra.run.smithi072.stdout:(37/177): python3-cephfs-debuginfo-19.0.0-157.g 6.5 MB/s | 615 kB 00:00 2023-12-12T23:52:57.413 INFO:teuthology.orchestra.run.smithi072.stdout:(38/177): python3-rados-19.0.0-157.g021ac167.el 5.4 MB/s | 321 kB 00:00 2023-12-12T23:52:57.530 INFO:teuthology.orchestra.run.smithi072.stdout:(39/177): python3-rados-debuginfo-19.0.0-157.g0 6.4 MB/s | 770 kB 00:00 2023-12-12T23:52:57.614 INFO:teuthology.orchestra.run.smithi072.stdout:(40/177): python3-rbd-19.0.0-157.g021ac167.el9. 3.5 MB/s | 298 kB 00:00 2023-12-12T23:52:57.765 INFO:teuthology.orchestra.run.smithi072.stdout:(41/177): python3-rbd-debuginfo-19.0.0-157.g021 7.5 MB/s | 1.1 MB 00:00 2023-12-12T23:52:57.824 INFO:teuthology.orchestra.run.smithi072.stdout:(42/177): python3-rgw-19.0.0-157.g021ac167.el9. 1.7 MB/s | 99 kB 00:00 2023-12-12T23:52:57.899 INFO:teuthology.orchestra.run.smithi072.stdout:(43/177): python3-rgw-debuginfo-19.0.0-157.g021 4.4 MB/s | 337 kB 00:00 2023-12-12T23:52:57.958 INFO:teuthology.orchestra.run.smithi072.stdout:(44/177): rbd-fuse-19.0.0-157.g021ac167.el9.x86 1.4 MB/s | 85 kB 00:00 2023-12-12T23:52:58.034 INFO:teuthology.orchestra.run.smithi072.stdout:(45/177): rbd-fuse-debuginfo-19.0.0-157.g021ac1 6.6 MB/s | 506 kB 00:00 2023-12-12T23:52:58.142 INFO:teuthology.orchestra.run.smithi176.stdout:(19/177): ceph-common-debuginfo-19.0.0-157.g021 4.5 MB/s | 405 MB 01:30 2023-12-12T23:52:58.167 INFO:teuthology.orchestra.run.smithi176.stdout:(20/177): ceph-selinux-19.0.0-157.g021ac167.el9 15 kB/s | 24 kB 00:01 2023-12-12T23:52:58.376 INFO:teuthology.orchestra.run.smithi072.stdout:(46/177): rbd-mirror-19.0.0-157.g021ac167.el9.x 8.8 MB/s | 3.0 MB 00:00 2023-12-12T23:53:05.850 INFO:teuthology.orchestra.run.smithi176.stdout:(21/177): ceph-radosgw-debuginfo-19.0.0-157.g02 3.1 MB/s | 173 MB 00:55 2023-12-12T23:53:06.017 INFO:teuthology.orchestra.run.smithi176.stdout:(22/177): cephfs-mirror-19.0.0-157.g021ac167.el 1.3 MB/s | 217 kB 00:00 2023-12-12T23:53:06.100 INFO:teuthology.orchestra.run.smithi176.stdout:(23/177): cephfs-shell-19.0.0-157.g021ac167.el9 326 kB/s | 27 kB 00:00 2023-12-12T23:53:06.176 INFO:teuthology.orchestra.run.smithi176.stdout:(24/177): libcephfs-devel-19.0.0-157.g021ac167. 416 kB/s | 31 kB 00:00 2023-12-12T23:53:06.367 INFO:teuthology.orchestra.run.smithi176.stdout:(25/177): libcephfs2-19.0.0-157.g021ac167.el9.x 3.7 MB/s | 719 kB 00:00 2023-12-12T23:53:06.818 INFO:teuthology.orchestra.run.smithi072.stdout:(47/177): rbd-mirror-debuginfo-19.0.0-157.g021a 5.9 MB/s | 50 MB 00:08 2023-12-12T23:53:07.151 INFO:teuthology.orchestra.run.smithi176.stdout:(26/177): libcephfs2-debuginfo-19.0.0-157.g021a 6.6 MB/s | 5.1 MB 00:00 2023-12-12T23:53:07.226 INFO:teuthology.orchestra.run.smithi176.stdout:(27/177): libcephsqlite-19.0.0-157.g021ac167.el 2.1 MB/s | 163 kB 00:00 2023-12-12T23:53:07.318 INFO:teuthology.orchestra.run.smithi176.stdout:(28/177): librados-devel-19.0.0-157.g021ac167.e 1.4 MB/s | 126 kB 00:00 2023-12-12T23:53:07.410 INFO:teuthology.orchestra.run.smithi176.stdout:(29/177): librados-devel-debuginfo-19.0.0-157.g 1.2 MB/s | 108 kB 00:00 2023-12-12T23:53:07.677 INFO:teuthology.orchestra.run.smithi072.stdout:(48/177): rbd-nbd-19.0.0-157.g021ac167.el9.x86_ 198 kB/s | 170 kB 00:00 2023-12-12T23:53:08.219 INFO:teuthology.orchestra.run.smithi176.stdout:(30/177): ceph-test-19.0.0-157.g021ac167.el9.x8 4.1 MB/s | 41 MB 00:10 2023-12-12T23:53:08.394 INFO:teuthology.orchestra.run.smithi176.stdout:(31/177): libradosstriper1-19.0.0-157.g021ac167 2.7 MB/s | 476 kB 00:00 2023-12-12T23:53:08.621 INFO:teuthology.orchestra.run.smithi072.stdout:(49/177): rbd-nbd-debuginfo-19.0.0-157.g021ac16 1.3 MB/s | 1.2 MB 00:00 2023-12-12T23:53:09.183 INFO:teuthology.orchestra.run.smithi072.stdout:(50/177): ceph-grafana-dashboards-19.0.0-157.g0 50 kB/s | 28 kB 00:00 2023-12-12T23:53:09.417 INFO:teuthology.orchestra.run.smithi072.stdout:(51/177): ceph-mgr-cephadm-19.0.0-157.g021ac167 569 kB/s | 133 kB 00:00 2023-12-12T23:53:09.944 INFO:teuthology.orchestra.run.smithi072.stdout:(52/177): ceph-mgr-dashboard-19.0.0-157.g021ac1 3.3 MB/s | 1.8 MB 00:00 2023-12-12T23:53:11.512 INFO:teuthology.orchestra.run.smithi072.stdout:(53/177): ceph-osd-debuginfo-19.0.0-157.g021ac1 4.4 MB/s | 311 MB 01:10 2023-12-12T23:53:11.846 INFO:teuthology.orchestra.run.smithi072.stdout:(54/177): ceph-mgr-diskprediction-local-19.0.0- 3.9 MB/s | 7.4 MB 00:01 2023-12-12T23:53:11.871 INFO:teuthology.orchestra.run.smithi072.stdout:(55/177): ceph-mgr-modules-core-19.0.0-157.g021 677 kB/s | 243 kB 00:00 2023-12-12T23:53:11.921 INFO:teuthology.orchestra.run.smithi072.stdout:(56/177): ceph-mgr-rook-19.0.0-157.g021ac167.el 664 kB/s | 50 kB 00:00 2023-12-12T23:53:11.964 INFO:teuthology.orchestra.run.smithi072.stdout:(57/177): ceph-prometheus-alerts-19.0.0-157.g02 163 kB/s | 15 kB 00:00 2023-12-12T23:53:12.014 INFO:teuthology.orchestra.run.smithi072.stdout:(58/177): ceph-volume-19.0.0-157.g021ac167.el9. 2.8 MB/s | 262 kB 00:00 2023-12-12T23:53:12.107 INFO:teuthology.orchestra.run.smithi072.stdout:(59/177): cephfs-top-19.0.0-157.g021ac167.el9.n 198 kB/s | 18 kB 00:00 2023-12-12T23:53:12.240 INFO:teuthology.orchestra.run.smithi072.stdout:(60/177): cephadm-19.0.0-157.g021ac167.el9.noar 2.8 MB/s | 803 kB 00:00 2023-12-12T23:53:12.291 INFO:teuthology.orchestra.run.smithi072.stdout:(61/177): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 662 kB 00:00 2023-12-12T23:53:12.333 INFO:teuthology.orchestra.run.smithi072.stdout:(62/177): bison-3.7.4-5.el9.x86_64.rpm 9.8 MB/s | 920 kB 00:00 2023-12-12T23:53:12.367 INFO:teuthology.orchestra.run.smithi072.stdout:(63/177): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 106 kB 00:00 2023-12-12T23:53:12.384 INFO:teuthology.orchestra.run.smithi072.stdout:(64/177): elfutils-libelf-devel-0.190-1.el9.x86 424 kB/s | 21 kB 00:00 2023-12-12T23:53:12.418 INFO:teuthology.orchestra.run.smithi072.stdout:(65/177): flex-2.6.4-9.el9.x86_64.rpm 5.9 MB/s | 307 kB 00:00 2023-12-12T23:53:12.446 INFO:teuthology.orchestra.run.smithi072.stdout:(66/177): flexiblas-3.0.4-8.el9.x86_64.rpm 524 kB/s | 32 kB 00:00 2023-12-12T23:53:12.530 INFO:teuthology.orchestra.run.smithi072.stdout:(67/177): flexiblas-netlib-3.0.4-8.el9.x86_64.r 27 MB/s | 3.0 MB 00:00 2023-12-12T23:53:12.555 INFO:teuthology.orchestra.run.smithi072.stdout:(68/177): flexiblas-openblas-openmp-3.0.4-8.el9 160 kB/s | 17 kB 00:00 2023-12-12T23:53:12.589 INFO:teuthology.orchestra.run.smithi072.stdout:(69/177): jq-1.6-16.el9.x86_64.rpm 3.1 MB/s | 186 kB 00:00 2023-12-12T23:53:12.614 INFO:teuthology.orchestra.run.smithi072.stdout:(70/177): libaio-devel-0.3.111-13.el9.x86_64.rp 171 kB/s | 10 kB 00:00 2023-12-12T23:53:12.640 INFO:teuthology.orchestra.run.smithi072.stdout:(71/177): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-12-12T23:53:12.666 INFO:teuthology.orchestra.run.smithi072.stdout:(72/177): librabbitmq-0.11.0-7.el9.x86_64.rpm 870 kB/s | 44 kB 00:00 2023-12-12T23:53:12.699 INFO:teuthology.orchestra.run.smithi072.stdout:(73/177): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-12-12T23:53:12.742 INFO:teuthology.orchestra.run.smithi072.stdout:(74/177): libtool-2.4.6-45.el9.x86_64.rpm 7.5 MB/s | 578 kB 00:00 2023-12-12T23:53:12.767 INFO:teuthology.orchestra.run.smithi072.stdout:(75/177): libuuid-devel-2.37.4-15.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2023-12-12T23:53:12.793 INFO:teuthology.orchestra.run.smithi072.stdout:(76/177): libzstd-devel-1.5.1-2.el9.x86_64.rpm 914 kB/s | 46 kB 00:00 2023-12-12T23:53:12.818 INFO:teuthology.orchestra.run.smithi072.stdout:(77/177): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.4 MB/s | 282 kB 00:00 2023-12-12T23:53:12.852 INFO:teuthology.orchestra.run.smithi072.stdout:(78/177): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-12-12T23:53:12.886 INFO:teuthology.orchestra.run.smithi072.stdout:(79/177): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.1 MB/s | 217 kB 00:00 2023-12-12T23:53:12.914 INFO:teuthology.orchestra.run.smithi072.stdout:(80/177): openblas-0.3.21-2.el9.x86_64.rpm 565 kB/s | 34 kB 00:00 2023-12-12T23:53:13.023 INFO:teuthology.orchestra.run.smithi072.stdout:(81/177): openblas-openmp-0.3.21-2.el9.x86_64.r 35 MB/s | 4.7 MB 00:00 2023-12-12T23:53:13.073 INFO:teuthology.orchestra.run.smithi072.stdout:(82/177): postgresql-13.11-1.el9.x86_64.rpm 9.7 MB/s | 1.5 MB 00:00 2023-12-12T23:53:13.115 INFO:teuthology.orchestra.run.smithi072.stdout:(83/177): postgresql-contrib-13.11-1.el9.x86_64 8.8 MB/s | 811 kB 00:00 2023-12-12T23:53:13.141 INFO:teuthology.orchestra.run.smithi072.stdout:(84/177): postgresql-private-libs-13.11-1.el9.x 2.0 MB/s | 134 kB 00:00 2023-12-12T23:53:13.267 INFO:teuthology.orchestra.run.smithi072.stdout:(85/177): postgresql-server-13.11-1.el9.x86_64. 38 MB/s | 5.7 MB 00:00 2023-12-12T23:53:13.292 INFO:teuthology.orchestra.run.smithi072.stdout:(86/177): python3-attrs-20.3.0-7.el9.noarch.rpm 524 kB/s | 78 kB 00:00 2023-12-12T23:53:13.302 INFO:teuthology.orchestra.run.smithi176.stdout:(32/177): librados2-debuginfo-19.0.0-157.g021ac 7.3 MB/s | 43 MB 00:05 2023-12-12T23:53:13.334 INFO:teuthology.orchestra.run.smithi072.stdout:(87/177): python3-jinja2-2.11.3-4.el9.noarch.rp 5.4 MB/s | 228 kB 00:00 2023-12-12T23:53:13.451 INFO:teuthology.orchestra.run.smithi072.stdout:(88/177): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 5.8 MB 00:00 2023-12-12T23:53:13.477 INFO:teuthology.orchestra.run.smithi072.stdout:(89/177): python3-jsonpatch-1.21-16.el9.noarch. 174 kB/s | 24 kB 00:00 2023-12-12T23:53:13.502 INFO:teuthology.orchestra.run.smithi072.stdout:(90/177): python3-jsonpointer-2.0-4.el9.noarch. 357 kB/s | 18 kB 00:00 2023-12-12T23:53:13.536 INFO:teuthology.orchestra.run.smithi072.stdout:(91/177): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2023-12-12T23:53:13.562 INFO:teuthology.orchestra.run.smithi072.stdout:(92/177): python3-markupsafe-1.1.1-12.el9.x86_6 537 kB/s | 32 kB 00:00 2023-12-12T23:53:13.671 INFO:teuthology.orchestra.run.smithi072.stdout:(93/177): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2023-12-12T23:53:13.690 INFO:teuthology.orchestra.run.smithi072.stdout:(94/177): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 217 kB 00:00 2023-12-12T23:53:13.715 INFO:teuthology.orchestra.run.smithi072.stdout:(95/177): python3-oauthlib-3.1.1-5.el9.noarch.r 3.9 MB/s | 174 kB 00:00 2023-12-12T23:53:13.741 INFO:teuthology.orchestra.run.smithi072.stdout:(96/177): python3-prettytable-0.7.2-27.el9.noar 814 kB/s | 41 kB 00:00 2023-12-12T23:53:13.775 INFO:teuthology.orchestra.run.smithi072.stdout:(97/177): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2023-12-12T23:53:13.809 INFO:teuthology.orchestra.run.smithi072.stdout:(98/177): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2023-12-12T23:53:13.834 INFO:teuthology.orchestra.run.smithi072.stdout:(99/177): python3-pytz-2021.1-5.el9.noarch.rpm 805 kB/s | 47 kB 00:00 2023-12-12T23:53:13.860 INFO:teuthology.orchestra.run.smithi072.stdout:(100/177): python3-requests-oauthlib-1.3.0-12.e 843 kB/s | 43 kB 00:00 2023-12-12T23:53:13.943 INFO:teuthology.orchestra.run.smithi176.stdout:(33/177): librgw2-19.0.0-157.g021ac167.el9.x86_ 7.4 MB/s | 4.8 MB 00:00 2023-12-12T23:53:13.969 INFO:teuthology.orchestra.run.smithi072.stdout:(101/177): python3-toml-0.10.2-6.el9.noarch.rpm 366 kB/s | 39 kB 00:00 2023-12-12T23:53:14.019 INFO:teuthology.orchestra.run.smithi176.stdout:(34/177): python3-ceph-argparse-19.0.0-157.g021 603 kB/s | 45 kB 00:00 2023-12-12T23:53:14.094 INFO:teuthology.orchestra.run.smithi176.stdout:(35/177): python3-ceph-common-19.0.0-157.g021ac 1.7 MB/s | 129 kB 00:00 2023-12-12T23:53:14.169 INFO:teuthology.orchestra.run.smithi176.stdout:(36/177): python3-cephfs-19.0.0-157.g021ac167.e 2.1 MB/s | 161 kB 00:00 2023-12-12T23:53:14.236 INFO:teuthology.orchestra.run.smithi072.stdout:(102/177): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2023-12-12T23:53:14.261 INFO:teuthology.orchestra.run.smithi072.stdout:(103/177): python3-wcwidth-0.2.5-8.el9.noarch.r 140 kB/s | 41 kB 00:00 2023-12-12T23:53:14.295 INFO:teuthology.orchestra.run.smithi176.stdout:(37/177): python3-cephfs-debuginfo-19.0.0-157.g 4.8 MB/s | 615 kB 00:00 2023-12-12T23:53:14.295 INFO:teuthology.orchestra.run.smithi072.stdout:(104/177): socat-1.7.4.1-5.el9.x86_64.rpm 5.0 MB/s | 300 kB 00:00 2023-12-12T23:53:14.321 INFO:teuthology.orchestra.run.smithi072.stdout:(105/177): uuid-1.6.2-55.el9.x86_64.rpm 963 kB/s | 56 kB 00:00 2023-12-12T23:53:14.347 INFO:teuthology.orchestra.run.smithi072.stdout:(106/177): xfsprogs-devel-5.19.0-4.el9.x86_64.r 1.6 MB/s | 85 kB 00:00 2023-12-12T23:53:14.372 INFO:teuthology.orchestra.run.smithi072.stdout:(107/177): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-12-12T23:53:14.395 INFO:teuthology.orchestra.run.smithi176.stdout:(38/177): python3-rados-19.0.0-157.g021ac167.el 3.1 MB/s | 321 kB 00:00 2023-12-12T23:53:14.398 INFO:teuthology.orchestra.run.smithi072.stdout:(108/177): zlib-devel-1.2.11-40.el9.x86_64.rpm 871 kB/s | 44 kB 00:00 2023-12-12T23:53:14.425 INFO:teuthology.orchestra.run.smithi072.stdout:(109/177): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-12-12T23:53:14.467 INFO:teuthology.orchestra.run.smithi072.stdout:(110/177): libgfortran-11.4.1-2.3.el9.x86_64.rp 11 MB/s | 803 kB 00:00 2023-12-12T23:53:14.493 INFO:teuthology.orchestra.run.smithi072.stdout:(111/177): libquadmath-11.4.1-2.3.el9.x86_64.rp 2.9 MB/s | 195 kB 00:00 2023-12-12T23:53:14.527 INFO:teuthology.orchestra.run.smithi072.stdout:(112/177): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2023-12-12T23:53:14.537 INFO:teuthology.orchestra.run.smithi176.stdout:(39/177): python3-rados-debuginfo-19.0.0-157.g0 5.3 MB/s | 770 kB 00:00 2023-12-12T23:53:14.569 INFO:teuthology.orchestra.run.smithi072.stdout:(113/177): python3-cryptography-36.0.1-4.el9.x8 15 MB/s | 1.1 MB 00:00 2023-12-12T23:53:14.603 INFO:teuthology.orchestra.run.smithi072.stdout:(114/177): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2023-12-12T23:53:14.637 INFO:teuthology.orchestra.run.smithi072.stdout:(115/177): python3-pycparser-2.20-6.el9.noarch. 1.8 MB/s | 124 kB 00:00 2023-12-12T23:53:14.637 INFO:teuthology.orchestra.run.smithi176.stdout:(40/177): python3-rbd-19.0.0-157.g021ac167.el9. 2.9 MB/s | 298 kB 00:00 2023-12-12T23:53:14.662 INFO:teuthology.orchestra.run.smithi072.stdout:(116/177): python3-requests-2.25.1-7.el9.noarch 1.9 MB/s | 113 kB 00:00 2023-12-12T23:53:14.697 INFO:teuthology.orchestra.run.smithi072.stdout:(117/177): python3-urllib3-1.26.5-4.el9.noarch. 3.1 MB/s | 187 kB 00:00 2023-12-12T23:53:14.813 INFO:teuthology.orchestra.run.smithi176.stdout:(41/177): python3-rbd-debuginfo-19.0.0-157.g021 6.4 MB/s | 1.1 MB 00:00 2023-12-12T23:53:14.905 INFO:teuthology.orchestra.run.smithi176.stdout:(42/177): python3-rgw-19.0.0-157.g021ac167.el9. 1.1 MB/s | 99 kB 00:00 2023-12-12T23:53:14.997 INFO:teuthology.orchestra.run.smithi176.stdout:(43/177): python3-rgw-debuginfo-19.0.0-157.g021 3.6 MB/s | 337 kB 00:00 2023-12-12T23:53:15.080 INFO:teuthology.orchestra.run.smithi176.stdout:(44/177): rbd-fuse-19.0.0-157.g021ac167.el9.x86 1.0 MB/s | 85 kB 00:00 2023-12-12T23:53:15.181 INFO:teuthology.orchestra.run.smithi176.stdout:(45/177): rbd-fuse-debuginfo-19.0.0-157.g021ac1 5.0 MB/s | 506 kB 00:00 2023-12-12T23:53:15.205 INFO:teuthology.orchestra.run.smithi072.stdout:(118/177): python3-devel-3.9.17-2.el9.x86_64.rp 483 kB/s | 245 kB 00:00 2023-12-12T23:53:15.564 INFO:teuthology.orchestra.run.smithi176.stdout:(46/177): rbd-mirror-19.0.0-157.g021ac167.el9.x 7.8 MB/s | 3.0 MB 00:00 2023-12-12T23:53:15.747 INFO:teuthology.orchestra.run.smithi072.stdout:(119/177): openssl-devel-3.0.7-25.el9.x86_64.rp 3.8 MB/s | 4.1 MB 00:01 2023-12-12T23:53:16.115 INFO:teuthology.orchestra.run.smithi072.stdout:(120/177): gperftools-libs-2.9.1-2.el9.x86_64.r 340 kB/s | 309 kB 00:00 2023-12-12T23:53:16.332 INFO:teuthology.orchestra.run.smithi072.stdout:(121/177): libarrow-doc-9.0.0-10.el9.noarch.rpm 120 kB/s | 26 kB 00:00 2023-12-12T23:53:16.466 INFO:teuthology.orchestra.run.smithi072.stdout:(122/177): libarrow-9.0.0-10.el9.x86_64.rpm 6.2 MB/s | 4.4 MB 00:00 2023-12-12T23:53:16.494 INFO:teuthology.orchestra.run.smithi072.stdout:(123/177): liboath-2.6.7-2.el9.x86_64.rpm 305 kB/s | 49 kB 00:00 2023-12-12T23:53:16.569 INFO:teuthology.orchestra.run.smithi072.stdout:(124/177): libunwind-1.6.2-1.el9.x86_64.rpm 659 kB/s | 67 kB 00:00 2023-12-12T23:53:16.594 INFO:teuthology.orchestra.run.smithi072.stdout:(125/177): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2023-12-12T23:53:16.695 INFO:teuthology.orchestra.run.smithi072.stdout:(126/177): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.5 MB/s | 838 kB 00:00 2023-12-12T23:53:16.729 INFO:teuthology.orchestra.run.smithi072.stdout:(127/177): python3-asyncssh-2.13.2-3.el9.noarch 4.0 MB/s | 548 kB 00:00 2023-12-12T23:53:16.796 INFO:teuthology.orchestra.run.smithi072.stdout:(128/177): python3-bcrypt-3.2.2-1.el9.x86_64.rp 435 kB/s | 43 kB 00:00 2023-12-12T23:53:16.830 INFO:teuthology.orchestra.run.smithi072.stdout:(129/177): python3-cachetools-4.2.4-1.el9.noarc 319 kB/s | 32 kB 00:00 2023-12-12T23:53:16.897 INFO:teuthology.orchestra.run.smithi072.stdout:(130/177): python3-certifi-2021.10.8-2.el9.noar 148 kB/s | 15 kB 00:00 2023-12-12T23:53:16.939 INFO:teuthology.orchestra.run.smithi072.stdout:(131/177): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2023-12-12T23:53:17.006 INFO:teuthology.orchestra.run.smithi072.stdout:(132/177): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2023-12-12T23:53:17.049 INFO:teuthology.orchestra.run.smithi072.stdout:(133/177): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2023-12-12T23:53:17.108 INFO:teuthology.orchestra.run.smithi072.stdout:(134/177): python3-colorama-0.4.4-12.el9.noarch 349 kB/s | 35 kB 00:00 2023-12-12T23:53:17.158 INFO:teuthology.orchestra.run.smithi072.stdout:(135/177): python3-google-auth-2.23.4-1.el9.noa 1.8 MB/s | 197 kB 00:00 2023-12-12T23:53:17.209 INFO:teuthology.orchestra.run.smithi072.stdout:(136/177): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2023-12-12T23:53:17.261 INFO:teuthology.orchestra.run.smithi072.stdout:(137/177): python3-jaraco-classes-3.2.1-5.el9.n 173 kB/s | 18 kB 00:00 2023-12-12T23:53:17.303 INFO:teuthology.orchestra.run.smithi072.stdout:(138/177): python3-jaraco-collections-3.0.0-8.e 247 kB/s | 23 kB 00:00 2023-12-12T23:53:17.370 INFO:teuthology.orchestra.run.smithi072.stdout:(139/177): python3-jaraco-functools-3.5.0-2.el9 178 kB/s | 19 kB 00:00 2023-12-12T23:53:17.404 INFO:teuthology.orchestra.run.smithi072.stdout:(140/177): python3-jaraco-text-3.2.0-6.el9.noar 195 kB/s | 20 kB 00:00 2023-12-12T23:53:17.471 INFO:teuthology.orchestra.run.smithi072.stdout:(141/177): python3-jwt+crypto-2.4.0-1.el9.noarc 90 kB/s | 9.0 kB 00:00 2023-12-12T23:53:17.505 INFO:teuthology.orchestra.run.smithi072.stdout:(142/177): python3-jwt-2.4.0-1.el9.noarch.rpm 405 kB/s | 41 kB 00:00 2023-12-12T23:53:17.606 INFO:teuthology.orchestra.run.smithi072.stdout:(143/177): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2023-12-12T23:53:17.631 INFO:teuthology.orchestra.run.smithi072.stdout:(144/177): python3-logutils-0.3.5-21.el9.noarch 368 kB/s | 46 kB 00:00 2023-12-12T23:53:17.707 INFO:teuthology.orchestra.run.smithi072.stdout:(145/177): python3-more-itertools-8.12.0-2.el9. 783 kB/s | 79 kB 00:00 2023-12-12T23:53:17.733 INFO:teuthology.orchestra.run.smithi072.stdout:(146/177): python3-natsort-7.1.1-5.el9.noarch.r 572 kB/s | 58 kB 00:00 2023-12-12T23:53:17.825 INFO:teuthology.orchestra.run.smithi072.stdout:(147/177): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2023-12-12T23:53:17.850 INFO:teuthology.orchestra.run.smithi072.stdout:(148/177): python3-portend-3.1.0-2.el9.noarch.r 140 kB/s | 16 kB 00:00 2023-12-12T23:53:17.934 INFO:teuthology.orchestra.run.smithi072.stdout:(149/177): python3-pyOpenSSL-21.0.0-1.el9.noarc 825 kB/s | 90 kB 00:00 2023-12-12T23:53:17.960 INFO:teuthology.orchestra.run.smithi072.stdout:(150/177): python3-pyperclip-1.8.2-2.el9.noarch 258 kB/s | 28 kB 00:00 2023-12-12T23:53:18.036 INFO:teuthology.orchestra.run.smithi072.stdout:(151/177): python3-repoze-lru-0.7-16.el9.noarch 305 kB/s | 31 kB 00:00 2023-12-12T23:53:18.071 INFO:teuthology.orchestra.run.smithi072.stdout:(152/177): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2023-12-12T23:53:18.138 INFO:teuthology.orchestra.run.smithi072.stdout:(153/177): python3-rsa-4.9-2.el9.noarch.rpm 577 kB/s | 59 kB 00:00 2023-12-12T23:53:18.172 INFO:teuthology.orchestra.run.smithi072.stdout:(154/177): python3-tempora-5.0.0-2.el9.noarch.r 355 kB/s | 36 kB 00:00 2023-12-12T23:53:18.564 INFO:teuthology.orchestra.run.smithi072.stdout:(155/177): python3-typing-extensions-4.4.0-2.el 120 kB/s | 51 kB 00:00 2023-12-12T23:53:18.598 INFO:teuthology.orchestra.run.smithi072.stdout:(156/177): python3-webob-1.8.7-6.el9.noarch.rpm 539 kB/s | 230 kB 00:00 2023-12-12T23:53:18.665 INFO:teuthology.orchestra.run.smithi072.stdout:(157/177): python3-websocket-client-1.2.3-2.el9 892 kB/s | 90 kB 00:00 2023-12-12T23:53:18.689 INFO:teuthology.orchestra.run.smithi176.stdout:(47/177): librbd1-debuginfo-19.0.0-157.g021ac16 4.8 MB/s | 50 MB 00:10 2023-12-12T23:53:18.716 INFO:teuthology.orchestra.run.smithi072.stdout:(158/177): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2023-12-12T23:53:18.767 INFO:teuthology.orchestra.run.smithi072.stdout:(159/177): python3-zc-lockfile-2.0-10.el9.noarc 198 kB/s | 20 kB 00:00 2023-12-12T23:53:18.781 INFO:teuthology.orchestra.run.smithi176.stdout:(48/177): rbd-nbd-19.0.0-157.g021ac167.el9.x86_ 1.8 MB/s | 170 kB 00:00 2023-12-12T23:53:18.826 INFO:teuthology.orchestra.run.smithi072.stdout:(160/177): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2023-12-12T23:53:18.910 INFO:teuthology.orchestra.run.smithi072.stdout:(161/177): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2023-12-12T23:53:19.131 INFO:teuthology.orchestra.run.smithi176.stdout:(49/177): rbd-nbd-debuginfo-19.0.0-157.g021ac16 3.5 MB/s | 1.2 MB 00:00 2023-12-12T23:53:19.240 INFO:teuthology.orchestra.run.smithi176.stdout:(50/177): ceph-grafana-dashboards-19.0.0-157.g0 260 kB/s | 28 kB 00:00 2023-12-12T23:53:19.340 INFO:teuthology.orchestra.run.smithi176.stdout:(51/177): ceph-mgr-cephadm-19.0.0-157.g021ac167 1.3 MB/s | 133 kB 00:00 2023-12-12T23:53:19.718 INFO:teuthology.orchestra.run.smithi072.stdout:(162/177): librbd1-19.0.0-157.g021ac167.el9.x86 3.7 MB/s | 3.0 MB 00:00 2023-12-12T23:53:19.752 INFO:teuthology.orchestra.run.smithi072.stdout:(163/177): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-12T23:53:19.786 INFO:teuthology.orchestra.run.smithi072.stdout:(164/177): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-12-12T23:53:19.820 INFO:teuthology.orchestra.run.smithi072.stdout:(165/177): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-12T23:53:19.864 INFO:teuthology.orchestra.run.smithi072.stdout:(166/177): elfutils-libelf-0.190-1.el9.x86_64.r 4.3 MB/s | 192 kB 00:00 2023-12-12T23:53:19.906 INFO:teuthology.orchestra.run.smithi072.stdout:(167/177): elfutils-libs-0.190-1.el9.x86_64.rpm 5.9 MB/s | 255 kB 00:00 2023-12-12T23:53:19.940 INFO:teuthology.orchestra.run.smithi072.stdout:(168/177): libacl-2.3.1-4.el9.x86_64.rpm 656 kB/s | 22 kB 00:00 2023-12-12T23:53:19.982 INFO:teuthology.orchestra.run.smithi072.stdout:(169/177): xfsdump-3.1.12-4.el9.x86_64.rpm 7.5 MB/s | 321 kB 00:00 2023-12-12T23:53:20.208 INFO:teuthology.orchestra.run.smithi072.stdout:(170/177): NetworkManager-1.45.7-1.el9.x86_64.r 10 MB/s | 2.3 MB 00:00 2023-12-12T23:53:20.291 INFO:teuthology.orchestra.run.smithi072.stdout:(171/177): NetworkManager-libnm-1.45.7-1.el9.x8 21 MB/s | 1.8 MB 00:00 2023-12-12T23:53:20.334 INFO:teuthology.orchestra.run.smithi072.stdout:(172/177): NetworkManager-team-1.45.7-1.el9.x86 1.0 MB/s | 43 kB 00:00 2023-12-12T23:53:20.384 INFO:teuthology.orchestra.run.smithi072.stdout:(173/177): NetworkManager-tui-1.45.7-1.el9.x86_ 4.8 MB/s | 246 kB 00:00 2023-12-12T23:53:20.460 INFO:teuthology.orchestra.run.smithi072.stdout:(174/177): openssl-3.0.7-25.el9.x86_64.rpm 16 MB/s | 1.2 MB 00:00 2023-12-12T23:53:20.552 INFO:teuthology.orchestra.run.smithi072.stdout:(175/177): openssl-libs-3.0.7-25.el9.x86_64.rpm 23 MB/s | 2.2 MB 00:00 2023-12-12T23:53:26.314 INFO:teuthology.orchestra.run.smithi176.stdout:(52/177): ceph-mgr-dashboard-19.0.0-157.g021ac1 259 kB/s | 1.8 MB 00:06 2023-12-12T23:53:26.427 INFO:teuthology.orchestra.run.smithi072.stdout:(176/177): librados2-19.0.0-157.g021ac167.el9.x 447 kB/s | 3.3 MB 00:07 2023-12-12T23:53:27.631 INFO:teuthology.orchestra.run.smithi176.stdout:(53/177): ceph-mgr-diskprediction-local-19.0.0- 5.6 MB/s | 7.4 MB 00:01 2023-12-12T23:53:27.706 INFO:teuthology.orchestra.run.smithi176.stdout:(54/177): ceph-mgr-modules-core-19.0.0-157.g021 3.2 MB/s | 243 kB 00:00 2023-12-12T23:53:27.773 INFO:teuthology.orchestra.run.smithi176.stdout:(55/177): ceph-mgr-rook-19.0.0-157.g021ac167.el 755 kB/s | 50 kB 00:00 2023-12-12T23:53:27.849 INFO:teuthology.orchestra.run.smithi176.stdout:(56/177): ceph-prometheus-alerts-19.0.0-157.g02 202 kB/s | 15 kB 00:00 2023-12-12T23:53:27.924 INFO:teuthology.orchestra.run.smithi176.stdout:(57/177): ceph-volume-19.0.0-157.g021ac167.el9. 3.4 MB/s | 262 kB 00:00 2023-12-12T23:53:28.349 INFO:teuthology.orchestra.run.smithi176.stdout:(58/177): rbd-mirror-debuginfo-19.0.0-157.g021a 3.9 MB/s | 50 MB 00:12 2023-12-12T23:53:28.383 INFO:teuthology.orchestra.run.smithi176.stdout:(59/177): cephadm-19.0.0-157.g021ac167.el9.noar 1.7 MB/s | 803 kB 00:00 2023-12-12T23:53:28.408 INFO:teuthology.orchestra.run.smithi176.stdout:(60/177): cephfs-top-19.0.0-157.g021ac167.el9.n 314 kB/s | 18 kB 00:00 2023-12-12T23:53:28.559 INFO:teuthology.orchestra.run.smithi176.stdout:(61/177): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 662 kB 00:00 2023-12-12T23:53:28.592 INFO:teuthology.orchestra.run.smithi176.stdout:(62/177): bison-3.7.4-5.el9.x86_64.rpm 5.7 MB/s | 920 kB 00:00 2023-12-12T23:53:28.617 INFO:teuthology.orchestra.run.smithi176.stdout:(63/177): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2023-12-12T23:53:28.643 INFO:teuthology.orchestra.run.smithi176.stdout:(64/177): elfutils-libelf-devel-0.190-1.el9.x86 430 kB/s | 21 kB 00:00 2023-12-12T23:53:28.668 INFO:teuthology.orchestra.run.smithi176.stdout:(65/177): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2023-12-12T23:53:28.693 INFO:teuthology.orchestra.run.smithi176.stdout:(66/177): flexiblas-3.0.4-8.el9.x86_64.rpm 637 kB/s | 32 kB 00:00 2023-12-12T23:53:28.760 INFO:teuthology.orchestra.run.smithi176.stdout:(67/177): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2023-12-12T23:53:28.785 INFO:teuthology.orchestra.run.smithi176.stdout:(68/177): flexiblas-openblas-openmp-3.0.4-8.el9 191 kB/s | 17 kB 00:00 2023-12-12T23:53:28.819 INFO:teuthology.orchestra.run.smithi176.stdout:(69/177): libaio-devel-0.3.111-13.el9.x86_64.rp 304 kB/s | 10 kB 00:00 2023-12-12T23:53:28.844 INFO:teuthology.orchestra.run.smithi176.stdout:(70/177): jq-1.6-16.el9.x86_64.rpm 3.1 MB/s | 186 kB 00:00 2023-12-12T23:53:28.870 INFO:teuthology.orchestra.run.smithi176.stdout:(71/177): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-12-12T23:53:28.895 INFO:teuthology.orchestra.run.smithi176.stdout:(72/177): librabbitmq-0.11.0-7.el9.x86_64.rpm 880 kB/s | 44 kB 00:00 2023-12-12T23:53:28.920 INFO:teuthology.orchestra.run.smithi176.stdout:(73/177): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-12T23:53:28.954 INFO:teuthology.orchestra.run.smithi176.stdout:(74/177): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2023-12-12T23:53:28.972 INFO:teuthology.orchestra.run.smithi176.stdout:(75/177): libuuid-devel-2.37.4-15.el9.x86_64.rp 497 kB/s | 24 kB 00:00 2023-12-12T23:53:28.988 INFO:teuthology.orchestra.run.smithi176.stdout:(76/177): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-12-12T23:53:29.013 INFO:teuthology.orchestra.run.smithi176.stdout:(77/177): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2023-12-12T23:53:29.038 INFO:teuthology.orchestra.run.smithi176.stdout:(78/177): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-12-12T23:53:29.064 INFO:teuthology.orchestra.run.smithi176.stdout:(79/177): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2023-12-12T23:53:29.089 INFO:teuthology.orchestra.run.smithi176.stdout:(80/177): openblas-0.3.21-2.el9.x86_64.rpm 686 kB/s | 34 kB 00:00 2023-12-12T23:53:29.164 INFO:teuthology.orchestra.run.smithi176.stdout:(81/177): openblas-openmp-0.3.21-2.el9.x86_64.r 47 MB/s | 4.7 MB 00:00 2023-12-12T23:53:29.198 INFO:teuthology.orchestra.run.smithi176.stdout:(82/177): postgresql-13.11-1.el9.x86_64.rpm 14 MB/s | 1.5 MB 00:00 2023-12-12T23:53:29.261 INFO:teuthology.orchestra.run.smithi176.stdout:(83/177): postgresql-contrib-13.11-1.el9.x86_64 8.4 MB/s | 811 kB 00:00 2023-12-12T23:53:29.290 INFO:teuthology.orchestra.run.smithi176.stdout:(84/177): postgresql-private-libs-13.11-1.el9.x 1.4 MB/s | 134 kB 00:00 2023-12-12T23:53:29.365 INFO:teuthology.orchestra.run.smithi176.stdout:(85/177): postgresql-server-13.11-1.el9.x86_64. 55 MB/s | 5.7 MB 00:00 2023-12-12T23:53:29.390 INFO:teuthology.orchestra.run.smithi176.stdout:(86/177): python3-attrs-20.3.0-7.el9.noarch.rpm 797 kB/s | 78 kB 00:00 2023-12-12T23:53:29.424 INFO:teuthology.orchestra.run.smithi176.stdout:(87/177): python3-jinja2-2.11.3-4.el9.noarch.rp 6.7 MB/s | 228 kB 00:00 2023-12-12T23:53:29.524 INFO:teuthology.orchestra.run.smithi176.stdout:(88/177): python3-babel-2.9.1-2.el9.noarch.rpm 43 MB/s | 5.8 MB 00:00 2023-12-12T23:53:29.549 INFO:teuthology.orchestra.run.smithi176.stdout:(89/177): python3-jsonpatch-1.21-16.el9.noarch. 199 kB/s | 24 kB 00:00 2023-12-12T23:53:29.583 INFO:teuthology.orchestra.run.smithi176.stdout:(90/177): python3-jsonpointer-2.0-4.el9.noarch. 544 kB/s | 18 kB 00:00 2023-12-12T23:53:29.609 INFO:teuthology.orchestra.run.smithi176.stdout:(91/177): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2023-12-12T23:53:29.633 INFO:teuthology.orchestra.run.smithi176.stdout:(92/177): python3-markupsafe-1.1.1-12.el9.x86_6 633 kB/s | 32 kB 00:00 2023-12-12T23:53:29.709 INFO:teuthology.orchestra.run.smithi176.stdout:(93/177): python3-numpy-1.20.1-5.el9.x86_64.rpm 48 MB/s | 4.8 MB 00:00 2023-12-12T23:53:29.734 INFO:teuthology.orchestra.run.smithi176.stdout:(94/177): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.2 MB/s | 217 kB 00:00 2023-12-12T23:53:29.759 INFO:teuthology.orchestra.run.smithi176.stdout:(95/177): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2023-12-12T23:53:29.785 INFO:teuthology.orchestra.run.smithi176.stdout:(96/177): python3-prettytable-0.7.2-27.el9.noar 825 kB/s | 41 kB 00:00 2023-12-12T23:53:29.810 INFO:teuthology.orchestra.run.smithi176.stdout:(97/177): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-12-12T23:53:29.835 INFO:teuthology.orchestra.run.smithi176.stdout:(98/177): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-12-12T23:53:29.860 INFO:teuthology.orchestra.run.smithi176.stdout:(99/177): python3-pytz-2021.1-5.el9.noarch.rpm 951 kB/s | 47 kB 00:00 2023-12-12T23:53:29.886 INFO:teuthology.orchestra.run.smithi176.stdout:(100/177): python3-requests-oauthlib-1.3.0-12.e 853 kB/s | 43 kB 00:00 2023-12-12T23:53:30.094 INFO:teuthology.orchestra.run.smithi176.stdout:(101/177): python3-scipy-1.6.2-8.el9.x86_64.rpm 67 MB/s | 16 MB 00:00 2023-12-12T23:53:30.128 INFO:teuthology.orchestra.run.smithi176.stdout:(102/177): python3-toml-0.10.2-6.el9.noarch.rpm 161 kB/s | 39 kB 00:00 2023-12-12T23:53:30.162 INFO:teuthology.orchestra.run.smithi176.stdout:(103/177): python3-wcwidth-0.2.5-8.el9.noarch.r 1.2 MB/s | 41 kB 00:00 2023-12-12T23:53:30.187 INFO:teuthology.orchestra.run.smithi176.stdout:(104/177): socat-1.7.4.1-5.el9.x86_64.rpm 5.0 MB/s | 300 kB 00:00 2023-12-12T23:53:30.212 INFO:teuthology.orchestra.run.smithi176.stdout:(105/177): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2023-12-12T23:53:30.237 INFO:teuthology.orchestra.run.smithi176.stdout:(106/177): xfsprogs-devel-5.19.0-4.el9.x86_64.r 1.7 MB/s | 85 kB 00:00 2023-12-12T23:53:30.263 INFO:teuthology.orchestra.run.smithi176.stdout:(107/177): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-12-12T23:53:30.288 INFO:teuthology.orchestra.run.smithi176.stdout:(108/177): zlib-devel-1.2.11-40.el9.x86_64.rpm 881 kB/s | 44 kB 00:00 2023-12-12T23:53:30.313 INFO:teuthology.orchestra.run.smithi176.stdout:(109/177): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-12-12T23:53:30.347 INFO:teuthology.orchestra.run.smithi176.stdout:(110/177): libgfortran-11.4.1-2.3.el9.x86_64.rp 13 MB/s | 803 kB 00:00 2023-12-12T23:53:30.380 INFO:teuthology.orchestra.run.smithi176.stdout:(111/177): libquadmath-11.4.1-2.3.el9.x86_64.rp 2.9 MB/s | 195 kB 00:00 2023-12-12T23:53:30.406 INFO:teuthology.orchestra.run.smithi176.stdout:(112/177): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2023-12-12T23:53:30.448 INFO:teuthology.orchestra.run.smithi176.stdout:(113/177): python3-cryptography-36.0.1-4.el9.x8 17 MB/s | 1.1 MB 00:00 2023-12-12T23:53:30.473 INFO:teuthology.orchestra.run.smithi176.stdout:(114/177): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2023-12-12T23:53:30.498 INFO:teuthology.orchestra.run.smithi176.stdout:(115/177): python3-pycparser-2.20-6.el9.noarch. 2.4 MB/s | 124 kB 00:00 2023-12-12T23:53:30.523 INFO:teuthology.orchestra.run.smithi176.stdout:(116/177): python3-requests-2.25.1-7.el9.noarch 2.2 MB/s | 113 kB 00:00 2023-12-12T23:53:30.557 INFO:teuthology.orchestra.run.smithi176.stdout:(117/177): python3-urllib3-1.26.5-4.el9.noarch. 3.1 MB/s | 187 kB 00:00 2023-12-12T23:53:30.766 INFO:teuthology.orchestra.run.smithi176.stdout:(118/177): python3-devel-3.9.17-2.el9.x86_64.rp 1.2 MB/s | 245 kB 00:00 2023-12-12T23:53:30.949 INFO:teuthology.orchestra.run.smithi176.stdout:(119/177): openssl-devel-3.0.7-25.el9.x86_64.rp 9.7 MB/s | 4.1 MB 00:00 2023-12-12T23:53:31.091 INFO:teuthology.orchestra.run.smithi176.stdout:(120/177): gperftools-libs-2.9.1-2.el9.x86_64.r 950 kB/s | 309 kB 00:00 2023-12-12T23:53:31.150 INFO:teuthology.orchestra.run.smithi176.stdout:(121/177): libarrow-doc-9.0.0-10.el9.noarch.rpm 447 kB/s | 26 kB 00:00 2023-12-12T23:53:31.217 INFO:teuthology.orchestra.run.smithi176.stdout:(122/177): liboath-2.6.7-2.el9.x86_64.rpm 729 kB/s | 49 kB 00:00 2023-12-12T23:53:31.292 INFO:teuthology.orchestra.run.smithi176.stdout:(123/177): libunwind-1.6.2-1.el9.x86_64.rpm 899 kB/s | 67 kB 00:00 2023-12-12T23:53:31.401 INFO:teuthology.orchestra.run.smithi176.stdout:(124/177): libarrow-9.0.0-10.el9.x86_64.rpm 9.8 MB/s | 4.4 MB 00:00 2023-12-12T23:53:31.426 INFO:teuthology.orchestra.run.smithi176.stdout:(125/177): luarocks-3.9.2-1.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2023-12-12T23:53:31.468 INFO:teuthology.orchestra.run.smithi176.stdout:(126/177): parquet-libs-9.0.0-10.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2023-12-12T23:53:31.518 INFO:teuthology.orchestra.run.smithi176.stdout:(127/177): python3-bcrypt-3.2.2-1.el9.x86_64.rp 870 kB/s | 43 kB 00:00 2023-12-12T23:53:31.568 INFO:teuthology.orchestra.run.smithi176.stdout:(128/177): python3-cachetools-4.2.4-1.el9.noarc 644 kB/s | 32 kB 00:00 2023-12-12T23:53:31.619 INFO:teuthology.orchestra.run.smithi176.stdout:(129/177): python3-certifi-2021.10.8-2.el9.noar 300 kB/s | 15 kB 00:00 2023-12-12T23:53:31.677 INFO:teuthology.orchestra.run.smithi176.stdout:(130/177): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2023-12-12T23:53:31.720 INFO:teuthology.orchestra.run.smithi176.stdout:(131/177): python3-asyncssh-2.13.2-3.el9.noarch 1.8 MB/s | 548 kB 00:00 2023-12-12T23:53:32.020 INFO:teuthology.orchestra.run.smithi176.stdout:(132/177): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.0 MB/s | 303 kB 00:00 2023-12-12T23:53:32.304 INFO:teuthology.orchestra.run.smithi176.stdout:(133/177): python3-cherrypy-18.6.1-2.el9.noarch 573 kB/s | 358 kB 00:00 2023-12-12T23:53:32.620 INFO:teuthology.orchestra.run.smithi176.stdout:(134/177): python3-colorama-0.4.4-12.el9.noarch 59 kB/s | 35 kB 00:00 2023-12-12T23:53:32.879 INFO:teuthology.orchestra.run.smithi176.stdout:(135/177): python3-google-auth-2.23.4-1.el9.noa 343 kB/s | 197 kB 00:00 2023-12-12T23:53:33.171 INFO:teuthology.orchestra.run.smithi176.stdout:(136/177): python3-jaraco-8.2.1-3.el9.noarch.rp 19 kB/s | 11 kB 00:00 2023-12-12T23:53:33.246 INFO:teuthology.orchestra.run.smithi176.stdout:(137/177): python3-jaraco-classes-3.2.1-5.el9.n 48 kB/s | 18 kB 00:00 2023-12-12T23:53:33.271 INFO:teuthology.orchestra.run.smithi176.stdout:(138/177): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2023-12-12T23:53:33.305 INFO:teuthology.orchestra.run.smithi176.stdout:(139/177): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2023-12-12T23:53:33.331 INFO:teuthology.orchestra.run.smithi176.stdout:(140/177): python3-jaraco-text-3.2.0-6.el9.noar 335 kB/s | 20 kB 00:00 2023-12-12T23:53:33.364 INFO:teuthology.orchestra.run.smithi176.stdout:(141/177): python3-jwt+crypto-2.4.0-1.el9.noarc 155 kB/s | 9.0 kB 00:00 2023-12-12T23:53:33.389 INFO:teuthology.orchestra.run.smithi176.stdout:(142/177): python3-jwt-2.4.0-1.el9.noarch.rpm 700 kB/s | 41 kB 00:00 2023-12-12T23:53:33.448 INFO:teuthology.orchestra.run.smithi176.stdout:(143/177): python3-logutils-0.3.5-21.el9.noarch 795 kB/s | 46 kB 00:00 2023-12-12T23:53:33.507 INFO:teuthology.orchestra.run.smithi176.stdout:(144/177): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2023-12-12T23:53:33.557 INFO:teuthology.orchestra.run.smithi176.stdout:(145/177): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2023-12-12T23:53:33.615 INFO:teuthology.orchestra.run.smithi176.stdout:(146/177): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2023-12-12T23:53:33.666 INFO:teuthology.orchestra.run.smithi176.stdout:(147/177): python3-portend-3.1.0-2.el9.noarch.r 329 kB/s | 16 kB 00:00 2023-12-12T23:53:33.699 INFO:teuthology.orchestra.run.smithi176.stdout:(148/177): python3-kubernetes-26.1.0-2.el9.noar 3.0 MB/s | 1.0 MB 00:00 2023-12-12T23:53:33.725 INFO:teuthology.orchestra.run.smithi176.stdout:(149/177): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2023-12-12T23:53:33.758 INFO:teuthology.orchestra.run.smithi176.stdout:(150/177): python3-pyperclip-1.8.2-2.el9.noarch 483 kB/s | 28 kB 00:00 2023-12-12T23:53:33.784 INFO:teuthology.orchestra.run.smithi176.stdout:(151/177): python3-repoze-lru-0.7-16.el9.noarch 524 kB/s | 31 kB 00:00 2023-12-12T23:53:33.842 INFO:teuthology.orchestra.run.smithi176.stdout:(152/177): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2023-12-12T23:53:33.867 INFO:teuthology.orchestra.run.smithi176.stdout:(153/177): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2023-12-12T23:53:33.893 INFO:teuthology.orchestra.run.smithi176.stdout:(154/177): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2023-12-12T23:53:33.934 INFO:teuthology.orchestra.run.smithi176.stdout:(155/177): python3-typing-extensions-4.4.0-2.el 762 kB/s | 51 kB 00:00 2023-12-12T23:53:33.961 INFO:teuthology.orchestra.run.smithi176.stdout:(156/177): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2023-12-12T23:53:34.010 INFO:teuthology.orchestra.run.smithi176.stdout:(157/177): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2023-12-12T23:53:34.036 INFO:teuthology.orchestra.run.smithi176.stdout:(158/177): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2023-12-12T23:53:34.061 INFO:teuthology.orchestra.run.smithi176.stdout:(159/177): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2023-12-12T23:53:34.095 INFO:teuthology.orchestra.run.smithi176.stdout:(160/177): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2023-12-12T23:53:34.428 INFO:teuthology.orchestra.run.smithi176.stdout:(161/177): thrift-0.15.0-2.el9.x86_64.rpm 4.3 MB/s | 1.6 MB 00:00 2023-12-12T23:53:34.779 INFO:teuthology.orchestra.run.smithi176.stdout:(162/177): librados2-19.0.0-157.g021ac167.el9.x 4.8 MB/s | 3.3 MB 00:00 2023-12-12T23:53:34.812 INFO:teuthology.orchestra.run.smithi176.stdout:(163/177): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-12T23:53:34.846 INFO:teuthology.orchestra.run.smithi176.stdout:(164/177): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-12-12T23:53:34.879 INFO:teuthology.orchestra.run.smithi176.stdout:(165/177): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-12T23:53:34.913 INFO:teuthology.orchestra.run.smithi176.stdout:(166/177): elfutils-libelf-0.190-1.el9.x86_64.r 5.6 MB/s | 192 kB 00:00 2023-12-12T23:53:34.946 INFO:teuthology.orchestra.run.smithi176.stdout:(167/177): elfutils-libs-0.190-1.el9.x86_64.rpm 7.5 MB/s | 255 kB 00:00 2023-12-12T23:53:34.980 INFO:teuthology.orchestra.run.smithi176.stdout:(168/177): libacl-2.3.1-4.el9.x86_64.rpm 659 kB/s | 22 kB 00:00 2023-12-12T23:53:35.013 INFO:teuthology.orchestra.run.smithi176.stdout:(169/177): xfsdump-3.1.12-4.el9.x86_64.rpm 9.4 MB/s | 321 kB 00:00 2023-12-12T23:53:35.131 INFO:teuthology.orchestra.run.smithi176.stdout:(170/177): librbd1-19.0.0-157.g021ac167.el9.x86 4.3 MB/s | 3.0 MB 00:00 2023-12-12T23:53:35.306 INFO:teuthology.orchestra.run.smithi176.stdout:(171/177): NetworkManager-1.45.7-1.el9.x86_64.r 7.7 MB/s | 2.3 MB 00:00 2023-12-12T23:53:35.356 INFO:teuthology.orchestra.run.smithi176.stdout:(172/177): NetworkManager-team-1.45.7-1.el9.x86 871 kB/s | 43 kB 00:00 2023-12-12T23:53:35.406 INFO:teuthology.orchestra.run.smithi176.stdout:(173/177): NetworkManager-libnm-1.45.7-1.el9.x8 6.5 MB/s | 1.8 MB 00:00 2023-12-12T23:53:35.432 INFO:teuthology.orchestra.run.smithi176.stdout:(174/177): NetworkManager-tui-1.45.7-1.el9.x86_ 3.2 MB/s | 246 kB 00:00 2023-12-12T23:53:35.474 INFO:teuthology.orchestra.run.smithi176.stdout:(175/177): openssl-3.0.7-25.el9.x86_64.rpm 18 MB/s | 1.2 MB 00:00 2023-12-12T23:53:35.524 INFO:teuthology.orchestra.run.smithi176.stdout:(176/177): openssl-libs-3.0.7-25.el9.x86_64.rpm 24 MB/s | 2.2 MB 00:00 2023-12-12T23:54:01.517 INFO:teuthology.orchestra.run.smithi072.stdout:(177/177): ceph-test-debuginfo-19.0.0-157.g021a 6.4 MB/s | 623 MB 01:37 2023-12-12T23:54:01.522 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2023-12-12T23:54:01.522 INFO:teuthology.orchestra.run.smithi072.stdout:Total 13 MB/s | 2.1 GB 02:49 2023-12-12T23:54:01.684 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2023-12-12T23:54:01.873 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2023-12-12T23:54:01.873 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2023-12-12T23:54:01.920 INFO:teuthology.orchestra.run.smithi176.stdout:(177/177): ceph-test-debuginfo-19.0.0-157.g021a 9.8 MB/s | 623 MB 01:03 2023-12-12T23:54:01.925 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2023-12-12T23:54:01.925 INFO:teuthology.orchestra.run.smithi176.stdout:Total 14 MB/s | 2.1 GB 02:37 2023-12-12T23:54:02.087 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2023-12-12T23:54:02.280 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2023-12-12T23:54:02.280 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2023-12-12T23:54:15.059 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2023-12-12T23:54:15.059 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2023-12-12T23:54:15.445 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2023-12-12T23:54:15.446 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2023-12-12T23:54:35.413 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2023-12-12T23:54:35.613 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2023-12-12T23:54:35.827 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 1/192 2023-12-12T23:54:35.844 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 1/192 2023-12-12T23:54:35.921 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 2/192 2023-12-12T23:54:35.957 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : thrift-0.15.0-2.el9.x86_64 3/192 2023-12-12T23:54:35.962 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 2/192 2023-12-12T23:54:35.996 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/192 2023-12-12T23:54:35.998 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : thrift-0.15.0-2.el9.x86_64 3/192 2023-12-12T23:54:36.031 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/192 2023-12-12T23:54:36.038 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/192 2023-12-12T23:54:36.057 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/192 2023-12-12T23:54:36.085 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/192 2023-12-12T23:54:36.108 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/192 2023-12-12T23:54:36.119 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/192 2023-12-12T23:54:36.182 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/192 2023-12-12T23:54:36.430 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/192 2023-12-12T23:54:36.491 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librados2-2:19.0.0-157.g021ac167.el9.x86_64 9/192 2023-12-12T23:54:36.516 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/192 2023-12-12T23:54:36.635 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:19.0.0-157.g021ac167.el9.x86_64 9/192 2023-12-12T23:54:36.647 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:19.0.0-157.g021ac167.el9.x86_64 9/192 2023-12-12T23:54:36.659 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs2-2:19.0.0-157.g021ac167.el9.x86_64 10/192 2023-12-12T23:54:36.750 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephfs2-2:19.0.0-157.g021ac167.el9.x86_64 10/192 2023-12-12T23:54:36.783 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:19.0.0-157.g021ac167.el9.x86_64 9/192 2023-12-12T23:54:36.789 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rados-2:19.0.0-157.g021ac167.el9.x86_64 11/192 2023-12-12T23:54:36.817 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:19.0.0-157.g021ac167.el9.x86_64 10/192 2023-12-12T23:54:36.857 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/192 2023-12-12T23:54:36.907 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:19.0.0-157.g021ac167.el9.x86_64 10/192 2023-12-12T23:54:36.946 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:19.0.0-157.g021ac167.el9.x86_64 11/192 2023-12-12T23:54:37.004 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/192 2023-12-12T23:54:37.061 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 13/192 2023-12-12T23:54:37.111 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/192 2023-12-12T23:54:37.139 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephsqlite-2:19.0.0-157.g021ac167.el9.x86_64 15/192 2023-12-12T23:54:37.184 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 13/192 2023-12-12T23:54:37.224 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephsqlite-2:19.0.0-157.g021ac167.el9.x86_64 15/192 2023-12-12T23:54:37.242 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/192 2023-12-12T23:54:37.248 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libradosstriper1-2:19.0.0-157.g021ac167.el9.x86_ 16/192 2023-12-12T23:54:37.278 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephsqlite-2:19.0.0-157.g021ac167.el9.x86_64 15/192 2023-12-12T23:54:37.364 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:19.0.0-157.g021ac167.el9.x86_64 15/192 2023-12-12T23:54:37.397 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:19.0.0-157.g021ac167.el9.x86_ 16/192 2023-12-12T23:54:37.433 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libradosstriper1-2:19.0.0-157.g021ac167.el9.x86_ 16/192 2023-12-12T23:54:37.552 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 17/192 2023-12-12T23:54:37.620 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 17/192 2023-12-12T23:54:37.741 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-12T23:54:37.788 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-12T23:54:37.818 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:19.0.0-157.g021ac167.el9.x86_ 16/192 2023-12-12T23:54:37.889 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 17/192 2023-12-12T23:54:37.950 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 17/192 2023-12-12T23:54:37.998 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-12T23:54:38.075 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-12T23:54:38.109 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 19/192 2023-12-12T23:54:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-12T23:54:38.142 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/192 2023-12-12T23:54:38.230 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/192 2023-12-12T23:54:38.292 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 22/192 2023-12-12T23:54:38.322 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/192 2023-12-12T23:54:38.348 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-12T23:54:38.365 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 24/192 2023-12-12T23:54:38.405 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 25/192 2023-12-12T23:54:38.457 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 19/192 2023-12-12T23:54:38.480 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/192 2023-12-12T23:54:38.494 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/192 2023-12-12T23:54:38.521 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/192 2023-12-12T23:54:38.549 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/192 2023-12-12T23:54:38.564 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/192 2023-12-12T23:54:38.620 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/192 2023-12-12T23:54:38.626 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 22/192 2023-12-12T23:54:38.653 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-common-2:19.0.0-157.g021ac167.el9.x 30/192 2023-12-12T23:54:38.666 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/192 2023-12-12T23:54:38.697 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-argparse-2:19.0.0-157.g021ac167.el9 31/192 2023-12-12T23:54:38.720 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 24/192 2023-12-12T23:54:38.761 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 25/192 2023-12-12T23:54:38.772 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cephfs-2:19.0.0-157.g021ac167.el9.x86_64 32/192 2023-12-12T23:54:38.834 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/192 2023-12-12T23:54:38.878 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/192 2023-12-12T23:54:38.914 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/192 2023-12-12T23:54:38.927 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/192 2023-12-12T23:54:38.983 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/192 2023-12-12T23:54:38.984 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/192 2023-12-12T23:54:39.029 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:19.0.0-157.g021ac167.el9.x 30/192 2023-12-12T23:54:39.073 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:19.0.0-157.g021ac167.el9 31/192 2023-12-12T23:54:39.156 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:19.0.0-157.g021ac167.el9.x86_64 32/192 2023-12-12T23:54:39.326 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/192 2023-12-12T23:54:39.378 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/192 2023-12-12T23:54:39.515 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/192 2023-12-12T23:54:39.595 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/192 2023-12-12T23:54:39.630 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/192 2023-12-12T23:54:39.674 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 38/192 2023-12-12T23:54:39.712 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librados-devel-2:19.0.0-157.g021ac167.el9.x86_64 39/192 2023-12-12T23:54:39.754 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/192 2023-12-12T23:54:39.911 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/192 2023-12-12T23:54:39.911 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 41/192 2023-12-12T23:54:39.955 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 42/192 2023-12-12T23:54:40.003 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/192 2023-12-12T23:54:40.056 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/192 2023-12-12T23:54:40.061 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : re2-1:20211101-3.el9.x86_64 43/192 2023-12-12T23:54:40.099 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 44/192 2023-12-12T23:54:40.108 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 38/192 2023-12-12T23:54:40.148 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:19.0.0-157.g021ac167.el9.x86_64 39/192 2023-12-12T23:54:40.155 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/192 2023-12-12T23:54:40.198 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/192 2023-12-12T23:54:40.238 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/192 2023-12-12T23:54:40.283 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/192 2023-12-12T23:54:40.320 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/192 2023-12-12T23:54:40.329 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 41/192 2023-12-12T23:54:40.368 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/192 2023-12-12T23:54:40.378 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 42/192 2023-12-12T23:54:40.402 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/192 2023-12-12T23:54:40.446 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/192 2023-12-12T23:54:40.485 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : re2-1:20211101-3.el9.x86_64 43/192 2023-12-12T23:54:40.489 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/192 2023-12-12T23:54:40.523 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 44/192 2023-12-12T23:54:40.579 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/192 2023-12-12T23:54:40.626 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/192 2023-12-12T23:54:40.653 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/192 2023-12-12T23:54:40.677 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/192 2023-12-12T23:54:40.694 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/192 2023-12-12T23:54:40.707 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 55/192 2023-12-12T23:54:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/192 2023-12-12T23:54:40.852 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/192 2023-12-12T23:54:40.891 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 58/192 2023-12-12T23:54:40.904 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/192 2023-12-12T23:54:40.931 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/192 2023-12-12T23:54:40.964 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/192 2023-12-12T23:54:41.062 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 61/192 2023-12-12T23:54:41.134 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/192 2023-12-12T23:54:41.190 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/192 2023-12-12T23:54:41.247 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/192 2023-12-12T23:54:41.448 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/192 2023-12-12T23:54:41.450 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/192 2023-12-12T23:54:41.504 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/192 2023-12-12T23:54:41.648 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/192 2023-12-12T23:54:41.690 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/192 2023-12-12T23:54:41.719 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/192 2023-12-12T23:54:41.761 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/192 2023-12-12T23:54:41.793 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/192 2023-12-12T23:54:41.824 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/192 2023-12-12T23:54:41.852 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/192 2023-12-12T23:54:41.890 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/192 2023-12-12T23:54:41.911 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/192 2023-12-12T23:54:41.934 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/192 2023-12-12T23:54:41.966 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/192 2023-12-12T23:54:41.995 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/192 2023-12-12T23:54:42.090 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/192 2023-12-12T23:54:42.122 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/192 2023-12-12T23:54:42.156 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/192 2023-12-12T23:54:42.197 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/192 2023-12-12T23:54:42.240 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/192 2023-12-12T23:54:42.298 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/192 2023-12-12T23:54:42.331 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/192 2023-12-12T23:54:42.348 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/192 2023-12-12T23:54:42.376 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/192 2023-12-12T23:54:42.479 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/192 2023-12-12T23:54:42.497 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/192 2023-12-12T23:54:42.527 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/192 2023-12-12T23:54:42.553 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/192 2023-12-12T23:54:42.593 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 55/192 2023-12-12T23:54:42.644 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/192 2023-12-12T23:54:42.738 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/192 2023-12-12T23:54:42.789 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 58/192 2023-12-12T23:54:42.836 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/192 2023-12-12T23:54:42.870 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/192 2023-12-12T23:54:42.974 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 61/192 2023-12-12T23:54:43.026 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/192 2023-12-12T23:54:43.083 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/192 2023-12-12T23:54:43.148 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/192 2023-12-12T23:54:43.261 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/192 2023-12-12T23:54:43.307 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/192 2023-12-12T23:54:43.341 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/192 2023-12-12T23:54:43.345 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/192 2023-12-12T23:54:43.390 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/192 2023-12-12T23:54:43.402 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/192 2023-12-12T23:54:43.488 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/192 2023-12-12T23:54:43.533 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/192 2023-12-12T23:54:43.540 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/192 2023-12-12T23:54:43.589 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/192 2023-12-12T23:54:43.619 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/192 2023-12-12T23:54:43.661 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/192 2023-12-12T23:54:43.710 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/192 2023-12-12T23:54:43.710 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/192 2023-12-12T23:54:43.739 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/192 2023-12-12T23:54:43.742 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/192 2023-12-12T23:54:43.772 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/192 2023-12-12T23:54:43.821 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/192 2023-12-12T23:54:43.836 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/192 2023-12-12T23:54:43.880 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/192 2023-12-12T23:54:43.920 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/192 2023-12-12T23:54:43.959 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/192 2023-12-12T23:54:44.037 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/192 2023-12-12T23:54:44.079 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/192 2023-12-12T23:54:44.123 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/192 2023-12-12T23:54:44.165 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/192 2023-12-12T23:54:44.200 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/192 2023-12-12T23:54:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/192 2023-12-12T23:54:44.371 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/192 2023-12-12T23:54:44.475 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/192 2023-12-12T23:54:44.526 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/192 2023-12-12T23:54:44.534 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/192 2023-12-12T23:54:44.637 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/192 2023-12-12T23:54:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/192 2023-12-12T23:54:45.327 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/192 2023-12-12T23:54:45.361 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/192 2023-12-12T23:54:45.411 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/192 2023-12-12T23:54:45.508 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/192 2023-12-12T23:54:45.547 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/192 2023-12-12T23:54:45.729 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/192 2023-12-12T23:54:45.754 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/192 2023-12-12T23:54:45.855 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/192 2023-12-12T23:54:45.897 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/192 2023-12-12T23:54:45.973 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/192 2023-12-12T23:54:46.015 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/192 2023-12-12T23:54:46.049 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : jq-1.6-16.el9.x86_64 101/192 2023-12-12T23:54:46.124 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-5.4.4-4.el9.x86_64 102/192 2023-12-12T23:54:46.154 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : luarocks-3.9.2-1.el9.noarch 103/192 2023-12-12T23:54:46.185 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/192 2023-12-12T23:54:46.215 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 105/192 2023-12-12T23:54:46.514 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 106/192 2023-12-12T23:54:46.538 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/192 2023-12-12T23:54:46.545 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librbd1-2:19.0.0-157.g021ac167.el9.x86_64 107/192 2023-12-12T23:54:46.619 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:19.0.0-157.g021ac167.el9.x86_64 107/192 2023-12-12T23:54:46.649 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rbd-2:19.0.0-157.g021ac167.el9.x86_64 108/192 2023-12-12T23:54:46.661 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/192 2023-12-12T23:54:46.685 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 109/192 2023-12-12T23:54:47.108 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 110/192 2023-12-12T23:54:47.139 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librgw2-2:19.0.0-157.g021ac167.el9.x86_64 111/192 2023-12-12T23:54:47.194 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librgw2-2:19.0.0-157.g021ac167.el9.x86_64 111/192 2023-12-12T23:54:47.224 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rgw-2:19.0.0-157.g021ac167.el9.x86_64 112/192 2023-12-12T23:54:47.898 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/192 2023-12-12T23:54:47.997 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/192 2023-12-12T23:54:48.028 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/192 2023-12-12T23:54:48.066 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : jq-1.6-16.el9.x86_64 101/192 2023-12-12T23:54:48.148 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lua-5.4.4-4.el9.x86_64 102/192 2023-12-12T23:54:48.182 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : luarocks-3.9.2-1.el9.noarch 103/192 2023-12-12T23:54:48.210 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/192 2023-12-12T23:54:48.244 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 105/192 2023-12-12T23:54:48.552 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 106/192 2023-12-12T23:54:48.583 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:19.0.0-157.g021ac167.el9.x86_64 107/192 2023-12-12T23:54:48.675 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:19.0.0-157.g021ac167.el9.x86_64 107/192 2023-12-12T23:54:48.706 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:19.0.0-157.g021ac167.el9.x86_64 108/192 2023-12-12T23:54:48.753 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 109/192 2023-12-12T23:54:49.176 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 110/192 2023-12-12T23:54:49.207 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:19.0.0-157.g021ac167.el9.x86_64 111/192 2023-12-12T23:54:49.278 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:19.0.0-157.g021ac167.el9.x86_64 111/192 2023-12-12T23:54:49.305 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.0.0-157.g021ac167.el9.x86_64 113/192 2023-12-12T23:54:49.310 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:19.0.0-157.g021ac167.el9.x86_64 112/192 2023-12-12T23:54:49.337 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-common-2:19.0.0-157.g021ac167.el9.x86_64 113/192 2023-12-12T23:54:49.875 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.0.0-157.g021ac167.el9.x86_64 113/192 2023-12-12T23:54:49.916 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-base-2:19.0.0-157.g021ac167.el9.x86_64 114/192 2023-12-12T23:54:50.006 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-base-2:19.0.0-157.g021ac167.el9.x86_64 114/192 2023-12-12T23:54:50.006 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-12T23:54:50.006 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-12T23:54:50.006 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:54:50.042 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-selinux-2:19.0.0-157.g021ac167.el9.x86_64 115/192 2023-12-12T23:54:51.419 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:19.0.0-157.g021ac167.el9.x86_64 113/192 2023-12-12T23:54:51.471 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:19.0.0-157.g021ac167.el9.x86_64 113/192 2023-12-12T23:54:52.005 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:19.0.0-157.g021ac167.el9.x86_64 113/192 2023-12-12T23:54:52.046 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:19.0.0-157.g021ac167.el9.x86_64 114/192 2023-12-12T23:54:52.134 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:19.0.0-157.g021ac167.el9.x86_64 114/192 2023-12-12T23:54:52.134 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-12T23:54:52.134 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-12T23:54:52.134 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:54:52.182 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:19.0.0-157.g021ac167.el9.x86_64 115/192 2023-12-12T23:55:02.120 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-selinux-2:19.0.0-157.g021ac167.el9.x86_64 115/192 2023-12-12T23:55:02.120 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /sys 2023-12-12T23:55:02.120 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /proc 2023-12-12T23:55:02.120 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /mnt 2023-12-12T23:55:02.120 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /var/tmp 2023-12-12T23:55:02.120 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /home 2023-12-12T23:55:02.120 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /root 2023-12-12T23:55:02.120 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /tmp 2023-12-12T23:55:02.120 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:55:02.287 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-volume-2:19.0.0-157.g021ac167.el9.noarch 116/192 2023-12-12T23:55:02.302 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-volume-2:19.0.0-157.g021ac167.el9.noarch 116/192 2023-12-12T23:55:02.302 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:02.302 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-12T23:55:02.302 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:55:03.873 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-osd-2:19.0.0-157.g021ac167.el9.x86_64 117/192 2023-12-12T23:55:03.899 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-osd-2:19.0.0-157.g021ac167.el9.x86_64 117/192 2023-12-12T23:55:03.899 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:03.899 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-12T23:55:03.899 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-12T23:55:03.899 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-12T23:55:03.899 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:55:04.107 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mds-2:19.0.0-157.g021ac167.el9.x86_64 118/192 2023-12-12T23:55:04.130 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mds-2:19.0.0-157.g021ac167.el9.x86_64 118/192 2023-12-12T23:55:04.130 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:04.130 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-12T23:55:04.130 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-12T23:55:04.130 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-12T23:55:04.130 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:55:04.583 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mon-2:19.0.0-157.g021ac167.el9.x86_64 119/192 2023-12-12T23:55:04.605 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mon-2:19.0.0-157.g021ac167.el9.x86_64 119/192 2023-12-12T23:55:04.605 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:04.605 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-12T23:55:04.605 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-12T23:55:04.605 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-12T23:55:04.605 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:55:04.702 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : automake-1.16.2-8.el9.noarch 120/192 2023-12-12T23:55:05.045 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephadm-2:19.0.0-157.g021ac167.el9.noarch 121/192 2023-12-12T23:55:05.075 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephadm-2:19.0.0-157.g021ac167.el9.noarch 121/192 2023-12-12T23:55:05.104 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-157.g021ac167.el 122/192 2023-12-12T23:55:05.166 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-157.g021ac167.e 123/192 2023-12-12T23:55:05.189 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-157.g021ac167.el9.noar 124/192 2023-12-12T23:55:05.416 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-157.g021ac167.el9.noar 124/192 2023-12-12T23:55:05.449 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-157.g021ac167.el9.no 125/192 2023-12-12T23:55:06.411 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-157.g021ac167.el9.no 125/192 2023-12-12T23:55:06.441 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-157.g021a 126/192 2023-12-12T23:55:06.539 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-157.g021a 126/192 2023-12-12T23:55:06.690 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-157.g021ac167.el9 127/192 2023-12-12T23:55:06.718 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-2:19.0.0-157.g021ac167.el9.x86_64 128/192 2023-12-12T23:55:06.741 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-2:19.0.0-157.g021ac167.el9.x86_64 128/192 2023-12-12T23:55:06.741 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:06.741 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-12T23:55:06.741 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-12T23:55:06.741 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-12T23:55:06.741 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:55:06.785 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-rook-2:19.0.0-157.g021ac167.el9.noarch 129/192 2023-12-12T23:55:06.796 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-157.g021ac167.el9.noarch 129/192 2023-12-12T23:55:06.847 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-2:19.0.0-157.g021ac167.el9.x86_64 130/192 2023-12-12T23:55:07.386 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:19.0.0-157.g021ac167.el9.x86_64 115/192 2023-12-12T23:55:07.386 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2023-12-12T23:55:07.386 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2023-12-12T23:55:07.386 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2023-12-12T23:55:07.386 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2023-12-12T23:55:07.386 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2023-12-12T23:55:07.386 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /root 2023-12-12T23:55:07.386 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2023-12-12T23:55:07.387 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:55:07.561 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-volume-2:19.0.0-157.g021ac167.el9.noarch 116/192 2023-12-12T23:55:07.575 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-volume-2:19.0.0-157.g021ac167.el9.noarch 116/192 2023-12-12T23:55:07.576 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:07.576 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-12T23:55:07.576 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:55:07.619 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/192 2023-12-12T23:55:07.654 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-radosgw-2:19.0.0-157.g021ac167.el9.x86_64 132/192 2023-12-12T23:55:07.676 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-157.g021ac167.el9.x86_64 132/192 2023-12-12T23:55:07.676 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:07.676 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-12T23:55:07.676 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-12T23:55:07.676 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-12T23:55:07.676 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:55:07.713 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-157.g021ac1 133/192 2023-12-12T23:55:07.734 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-157.g021ac1 133/192 2023-12-12T23:55:07.734 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:07.734 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-12T23:55:07.734 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:55:07.788 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-mirror-2:19.0.0-157.g021ac167.el9.x86_64 134/192 2023-12-12T23:55:07.810 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-157.g021ac167.el9.x86_64 134/192 2023-12-12T23:55:07.810 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:07.810 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-12T23:55:07.811 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-12T23:55:07.811 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-12T23:55:07.811 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:55:08.106 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-mirror-2:19.0.0-157.g021ac167.el9.x86_64 135/192 2023-12-12T23:55:08.127 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-mirror-2:19.0.0-157.g021ac167.el9.x86_64 135/192 2023-12-12T23:55:08.127 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:08.127 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-12T23:55:08.127 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-12T23:55:08.127 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-12T23:55:08.128 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:55:09.127 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:19.0.0-157.g021ac167.el9.x86_64 117/192 2023-12-12T23:55:09.152 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:19.0.0-157.g021ac167.el9.x86_64 117/192 2023-12-12T23:55:09.152 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:09.152 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-12T23:55:09.152 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-12T23:55:09.152 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-12T23:55:09.152 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:55:09.353 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:19.0.0-157.g021ac167.el9.x86_64 118/192 2023-12-12T23:55:09.375 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:19.0.0-157.g021ac167.el9.x86_64 118/192 2023-12-12T23:55:09.375 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:09.375 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-12T23:55:09.376 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-12T23:55:09.376 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-12T23:55:09.376 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:55:09.823 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:19.0.0-157.g021ac167.el9.x86_64 119/192 2023-12-12T23:55:09.845 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:19.0.0-157.g021ac167.el9.x86_64 119/192 2023-12-12T23:55:09.845 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:09.845 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-12T23:55:09.846 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-12T23:55:09.846 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-12T23:55:09.846 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:55:09.943 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : automake-1.16.2-8.el9.noarch 120/192 2023-12-12T23:55:10.366 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:19.0.0-157.g021ac167.el9.noarch 121/192 2023-12-12T23:55:10.396 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephadm-2:19.0.0-157.g021ac167.el9.noarch 121/192 2023-12-12T23:55:10.434 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-157.g021ac167.el 122/192 2023-12-12T23:55:10.496 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-157.g021ac167.e 123/192 2023-12-12T23:55:10.520 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-157.g021ac167.el9.noar 124/192 2023-12-12T23:55:10.743 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-157.g021ac167.el9.noar 124/192 2023-12-12T23:55:10.780 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-157.g021ac167.el9.no 125/192 2023-12-12T23:55:11.733 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-157.g021ac167.el9.no 125/192 2023-12-12T23:55:11.764 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-157.g021a 126/192 2023-12-12T23:55:11.862 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-157.g021a 126/192 2023-12-12T23:55:11.959 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-test-2:19.0.0-157.g021ac167.el9.x86_64 136/192 2023-12-12T23:55:12.000 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-fuse-2:19.0.0-157.g021ac167.el9.x86_64 137/192 2023-12-12T23:55:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-157.g021ac167.el9 127/192 2023-12-12T23:55:12.041 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-nbd-2:19.0.0-157.g021ac167.el9.x86_64 138/192 2023-12-12T23:55:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:19.0.0-157.g021ac167.el9.x86_64 128/192 2023-12-12T23:55:12.073 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 139/192 2023-12-12T23:55:12.075 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:19.0.0-157.g021ac167.el9.x86_64 128/192 2023-12-12T23:55:12.075 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:12.076 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-12T23:55:12.076 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-12T23:55:12.076 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-12T23:55:12.076 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:55:12.121 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:19.0.0-157.g021ac167.el9.noarch 129/192 2023-12-12T23:55:12.125 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 140/192 2023-12-12T23:55:12.131 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-157.g021ac167.el9.noarch 129/192 2023-12-12T23:55:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:19.0.0-157.g021ac167.el9.x86_64 130/192 2023-12-12T23:55:12.307 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-shell-2:19.0.0-157.g021ac167.el9.x86_64 141/192 2023-12-12T23:55:12.422 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 142/192 2023-12-12T23:55:12.464 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-fuse-2:19.0.0-157.g021ac167.el9.x86_64 143/192 2023-12-12T23:55:12.496 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs-devel-2:19.0.0-157.g021ac167.el9.x86_6 144/192 2023-12-12T23:55:12.560 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 145/192 2023-12-12T23:55:12.626 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 146/192 2023-12-12T23:55:12.665 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 147/192 2023-12-12T23:55:12.694 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 148/192 2023-12-12T23:55:12.740 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 149/192 2023-12-12T23:55:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/192 2023-12-12T23:55:12.983 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:19.0.0-157.g021ac167.el9.x86_64 132/192 2023-12-12T23:55:13.005 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-157.g021ac167.el9.x86_64 132/192 2023-12-12T23:55:13.005 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:13.005 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-12T23:55:13.006 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-12T23:55:13.006 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-12T23:55:13.006 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:55:13.052 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-157.g021ac1 133/192 2023-12-12T23:55:13.074 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-157.g021ac1 133/192 2023-12-12T23:55:13.074 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:13.074 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-12T23:55:13.074 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:55:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-mirror-2:19.0.0-157.g021ac167.el9.x86_64 134/192 2023-12-12T23:55:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-157.g021ac167.el9.x86_64 134/192 2023-12-12T23:55:13.150 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:13.151 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-12T23:55:13.151 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-12T23:55:13.151 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-12T23:55:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:55:13.312 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-12T23:55:13.350 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-12T23:55:13.369 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-12T23:55:13.438 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:19.0.0-157.g021ac167.el9.x86_64 135/192 2023-12-12T23:55:13.460 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:19.0.0-157.g021ac167.el9.x86_64 135/192 2023-12-12T23:55:13.460 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T23:55:13.460 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-12T23:55:13.461 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-12T23:55:13.461 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-12T23:55:13.461 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:55:14.181 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-top-2:19.0.0-157.g021ac167.el9.noarch 151/192 2023-12-12T23:55:17.288 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:19.0.0-157.g021ac167.el9.x86_64 136/192 2023-12-12T23:55:17.338 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:19.0.0-157.g021ac167.el9.x86_64 137/192 2023-12-12T23:55:17.379 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:19.0.0-157.g021ac167.el9.x86_64 138/192 2023-12-12T23:55:17.413 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 139/192 2023-12-12T23:55:17.440 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 140/192 2023-12-12T23:55:17.612 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-shell-2:19.0.0-157.g021ac167.el9.x86_64 141/192 2023-12-12T23:55:17.737 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 142/192 2023-12-12T23:55:17.771 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:19.0.0-157.g021ac167.el9.x86_64 143/192 2023-12-12T23:55:17.803 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:19.0.0-157.g021ac167.el9.x86_6 144/192 2023-12-12T23:55:17.862 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 145/192 2023-12-12T23:55:17.921 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 146/192 2023-12-12T23:55:17.951 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 147/192 2023-12-12T23:55:17.982 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 148/192 2023-12-12T23:55:18.037 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 149/192 2023-12-12T23:55:18.621 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-12T23:55:18.671 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-12T23:55:18.690 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-12T23:55:19.489 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-top-2:19.0.0-157.g021ac167.el9.noarch 151/192 2023-12-12T23:55:21.755 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/192 2023-12-12T23:55:27.081 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/192 2023-12-12T23:56:00.088 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-base-debuginfo-2:19.0.0-157.g021ac167.el9.x 153/192 2023-12-12T23:56:00.687 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-common-debuginfo-2:19.0.0-157.g021ac167.el9 154/192 2023-12-12T23:56:00.847 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-157.g021ac167.el9.x 155/192 2023-12-12T23:56:05.082 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 156/192 2023-12-12T23:56:05.448 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-debuginfo-2:19.0.0-157.g021ac167.el9.x 153/192 2023-12-12T23:56:06.048 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-debuginfo-2:19.0.0-157.g021ac167.el9 154/192 2023-12-12T23:56:06.809 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-157.g021ac167.el9.x 155/192 2023-12-12T23:56:07.305 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-157.g021ac167.el9.x8 157/192 2023-12-12T23:56:11.674 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 156/192 2023-12-12T23:56:13.638 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-157.g021ac167.el9.x8 157/192 2023-12-12T23:56:18.378 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-157.g021ac167.el9.x8 158/192 2023-12-12T23:56:24.516 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-157.g021ac167.el9.x8 158/192 2023-12-12T23:56:48.568 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-157.g021ac167.el9.x8 159/192 2023-12-12T23:56:54.687 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-157.g021ac167.el9.x8 159/192 2023-12-12T23:57:05.106 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-157.g021ac167.el9.x8 160/192 2023-12-12T23:57:11.810 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-157.g021ac167.el9.x8 160/192 2023-12-12T23:58:06.645 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-157.g021ac167.el 161/192 2023-12-12T23:58:07.189 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-test-debuginfo-2:19.0.0-157.g021ac167.el9.x 162/192 2023-12-12T23:58:07.221 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-157.g021ac167.el9. 163/192 2023-12-12T23:58:11.806 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librados-devel-debuginfo-2:19.0.0-157.g021ac167. 164/192 2023-12-12T23:58:13.414 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-157.g021ac167.el 161/192 2023-12-12T23:58:14.599 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-debuginfo-2:19.0.0-157.g021ac167.el9.x 162/192 2023-12-12T23:58:15.321 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-157.g021ac167.el9. 163/192 2023-12-12T23:58:17.424 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librados2-debuginfo-2:19.0.0-157.g021ac167.el9.x 165/192 2023-12-12T23:58:17.508 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librbd1-debuginfo-2:19.0.0-157.g021ac167.el9.x86 166/192 2023-12-12T23:58:17.615 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-157.g021ac167. 167/192 2023-12-12T23:58:17.751 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rados-debuginfo-2:19.0.0-157.g021ac167.e 168/192 2023-12-12T23:58:17.809 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-157.g021ac167.el9 169/192 2023-12-12T23:58:17.889 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-157.g021ac167.el9 170/192 2023-12-12T23:58:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-debuginfo-2:19.0.0-157.g021ac167. 164/192 2023-12-12T23:58:23.183 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-157.g021ac167.el9.x8 171/192 2023-12-12T23:58:23.325 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-157.g021ac167.el9. 172/192 2023-12-12T23:58:23.383 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-157.g021ac167.el9.x86 173/192 2023-12-12T23:58:23.424 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 174/192 2023-12-12T23:58:23.470 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 175/192 2023-12-12T23:58:23.571 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flex-2.6.4-9.el9.x86_64 176/192 2023-12-12T23:58:23.612 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : bison-3.7.4-5.el9.x86_64 177/192 2023-12-12T23:58:23.645 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 178/192 2023-12-12T23:58:23.671 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 179/192 2023-12-12T23:58:23.697 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 180/192 2023-12-12T23:58:23.697 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 181/192 2023-12-12T23:58:23.790 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 181/192 2023-12-12T23:58:23.817 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 182/192 2023-12-12T23:58:23.866 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 183/192 2023-12-12T23:58:23.898 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 184/192 2023-12-12T23:58:23.898 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 185/192 2023-12-12T23:58:23.983 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 185/192 2023-12-12T23:58:24.008 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 186/192 2023-12-12T23:58:24.015 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-12T23:58:24.015 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-12T23:58:24.194 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-12T23:58:24.194 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 188/192 2023-12-12T23:58:24.278 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 188/192 2023-12-12T23:58:24.302 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 189/192 2023-12-12T23:58:24.335 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 190/192 2023-12-12T23:58:24.361 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 191/192 2023-12-12T23:58:24.428 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 192/192 2023-12-12T23:58:25.838 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados2-debuginfo-2:19.0.0-157.g021ac167.el9.x 165/192 2023-12-12T23:58:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librbd1-debuginfo-2:19.0.0-157.g021ac167.el9.x86 166/192 2023-12-12T23:58:27.213 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-157.g021ac167. 167/192 2023-12-12T23:58:27.875 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-debuginfo-2:19.0.0-157.g021ac167.e 168/192 2023-12-12T23:58:28.583 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-157.g021ac167.el9 169/192 2023-12-12T23:58:29.179 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-157.g021ac167.el9 170/192 2023-12-12T23:58:35.010 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-157.g021ac167.el9.x8 171/192 2023-12-12T23:58:35.158 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-157.g021ac167.el9. 172/192 2023-12-12T23:58:35.225 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-157.g021ac167.el9.x86 173/192 2023-12-12T23:58:35.276 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 174/192 2023-12-12T23:58:35.322 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 175/192 2023-12-12T23:58:35.424 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flex-2.6.4-9.el9.x86_64 176/192 2023-12-12T23:58:35.468 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : bison-3.7.4-5.el9.x86_64 177/192 2023-12-12T23:58:35.494 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 178/192 2023-12-12T23:58:35.528 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 179/192 2023-12-12T23:58:35.563 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 180/192 2023-12-12T23:58:35.564 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 181/192 2023-12-12T23:58:35.624 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 192/192 2023-12-12T23:58:35.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-2:19.0.0-157.g021ac167.el9.x86_64 1/192 2023-12-12T23:58:35.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-base-2:19.0.0-157.g021ac167.el9.x86_64 2/192 2023-12-12T23:58:35.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-157.g021ac167.el9.x 3/192 2023-12-12T23:58:35.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-common-2:19.0.0-157.g021ac167.el9.x86_64 4/192 2023-12-12T23:58:35.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-157.g021ac167.el9 5/192 2023-12-12T23:58:35.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 6/192 2023-12-12T23:58:35.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-fuse-2:19.0.0-157.g021ac167.el9.x86_64 7/192 2023-12-12T23:58:35.624 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-157.g021ac167.el9.x 8/192 2023-12-12T23:58:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-157.g021ac1 9/192 2023-12-12T23:58:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 10/192 2023-12-12T23:58:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mds-2:19.0.0-157.g021ac167.el9.x86_64 11/192 2023-12-12T23:58:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-157.g021ac167.el9.x8 12/192 2023-12-12T23:58:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-2:19.0.0-157.g021ac167.el9.x86_64 13/192 2023-12-12T23:58:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-157.g021ac167.el9.x8 14/192 2023-12-12T23:58:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mon-2:19.0.0-157.g021ac167.el9.x86_64 15/192 2023-12-12T23:58:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-157.g021ac167.el9.x8 16/192 2023-12-12T23:58:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-osd-2:19.0.0-157.g021ac167.el9.x86_64 17/192 2023-12-12T23:58:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-157.g021ac167.el9.x8 18/192 2023-12-12T23:58:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-radosgw-2:19.0.0-157.g021ac167.el9.x86_64 19/192 2023-12-12T23:58:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-157.g021ac167.el 20/192 2023-12-12T23:58:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-selinux-2:19.0.0-157.g021ac167.el9.x86_64 21/192 2023-12-12T23:58:35.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-test-2:19.0.0-157.g021ac167.el9.x86_64 22/192 2023-12-12T23:58:35.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-157.g021ac167.el9.x 23/192 2023-12-12T23:58:35.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-mirror-2:19.0.0-157.g021ac167.el9.x86_64 24/192 2023-12-12T23:58:35.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-shell-2:19.0.0-157.g021ac167.el9.x86_64 25/192 2023-12-12T23:58:35.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs-devel-2:19.0.0-157.g021ac167.el9.x86_6 26/192 2023-12-12T23:58:35.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs2-2:19.0.0-157.g021ac167.el9.x86_64 27/192 2023-12-12T23:58:35.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-157.g021ac167.el9. 28/192 2023-12-12T23:58:35.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephsqlite-2:19.0.0-157.g021ac167.el9.x86_64 29/192 2023-12-12T23:58:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados-devel-2:19.0.0-157.g021ac167.el9.x86_64 30/192 2023-12-12T23:58:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-157.g021ac167. 31/192 2023-12-12T23:58:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-debuginfo-2:19.0.0-157.g021ac167.el9.x 32/192 2023-12-12T23:58:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libradosstriper1-2:19.0.0-157.g021ac167.el9.x86_ 33/192 2023-12-12T23:58:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-debuginfo-2:19.0.0-157.g021ac167.el9.x86 34/192 2023-12-12T23:58:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librgw2-2:19.0.0-157.g021ac167.el9.x86_64 35/192 2023-12-12T23:58:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-argparse-2:19.0.0-157.g021ac167.el9 36/192 2023-12-12T23:58:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-common-2:19.0.0-157.g021ac167.el9.x 37/192 2023-12-12T23:58:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cephfs-2:19.0.0-157.g021ac167.el9.x86_64 38/192 2023-12-12T23:58:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-157.g021ac167. 39/192 2023-12-12T23:58:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rados-2:19.0.0-157.g021ac167.el9.x86_64 40/192 2023-12-12T23:58:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-157.g021ac167.e 41/192 2023-12-12T23:58:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rbd-2:19.0.0-157.g021ac167.el9.x86_64 42/192 2023-12-12T23:58:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-157.g021ac167.el9 43/192 2023-12-12T23:58:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rgw-2:19.0.0-157.g021ac167.el9.x86_64 44/192 2023-12-12T23:58:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-157.g021ac167.el9 45/192 2023-12-12T23:58:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-fuse-2:19.0.0-157.g021ac167.el9.x86_64 46/192 2023-12-12T23:58:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-157.g021ac167.el9.x8 47/192 2023-12-12T23:58:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-mirror-2:19.0.0-157.g021ac167.el9.x86_64 48/192 2023-12-12T23:58:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-157.g021ac167.el9. 49/192 2023-12-12T23:58:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-nbd-2:19.0.0-157.g021ac167.el9.x86_64 50/192 2023-12-12T23:58:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-157.g021ac167.el9.x86 51/192 2023-12-12T23:58:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-157.g021ac167.e 52/192 2023-12-12T23:58:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-157.g021ac167.el9.noar 53/192 2023-12-12T23:58:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-157.g021ac167.el9.no 54/192 2023-12-12T23:58:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-157.g021a 55/192 2023-12-12T23:58:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-157.g021ac167.el9 56/192 2023-12-12T23:58:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-rook-2:19.0.0-157.g021ac167.el9.noarch 57/192 2023-12-12T23:58:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-157.g021ac167.el 58/192 2023-12-12T23:58:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-volume-2:19.0.0-157.g021ac167.el9.noarch 59/192 2023-12-12T23:58:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephadm-2:19.0.0-157.g021ac167.el9.noarch 60/192 2023-12-12T23:58:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-top-2:19.0.0-157.g021ac167.el9.noarch 61/192 2023-12-12T23:58:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/192 2023-12-12T23:58:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/192 2023-12-12T23:58:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/192 2023-12-12T23:58:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 65/192 2023-12-12T23:58:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flex-2.6.4-9.el9.x86_64 66/192 2023-12-12T23:58:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 67/192 2023-12-12T23:58:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 68/192 2023-12-12T23:58:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 69/192 2023-12-12T23:58:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : jq-1.6-16.el9.x86_64 70/192 2023-12-12T23:58:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 71/192 2023-12-12T23:58:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 72/192 2023-12-12T23:58:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 73/192 2023-12-12T23:58:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 74/192 2023-12-12T23:58:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 75/192 2023-12-12T23:58:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 76/192 2023-12-12T23:58:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 77/192 2023-12-12T23:58:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 78/192 2023-12-12T23:58:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-5.4.4-4.el9.x86_64 79/192 2023-12-12T23:58:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 80/192 2023-12-12T23:58:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 81/192 2023-12-12T23:58:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 82/192 2023-12-12T23:58:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-13.11-1.el9.x86_64 83/192 2023-12-12T23:58:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 84/192 2023-12-12T23:58:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 85/192 2023-12-12T23:58:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 86/192 2023-12-12T23:58:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 87/192 2023-12-12T23:58:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 88/192 2023-12-12T23:58:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 89/192 2023-12-12T23:58:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 90/192 2023-12-12T23:58:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 91/192 2023-12-12T23:58:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 92/192 2023-12-12T23:58:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 93/192 2023-12-12T23:58:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 94/192 2023-12-12T23:58:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/192 2023-12-12T23:58:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 96/192 2023-12-12T23:58:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 97/192 2023-12-12T23:58:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 98/192 2023-12-12T23:58:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 99/192 2023-12-12T23:58:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 100/192 2023-12-12T23:58:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 101/192 2023-12-12T23:58:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 102/192 2023-12-12T23:58:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 103/192 2023-12-12T23:58:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 104/192 2023-12-12T23:58:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 105/192 2023-12-12T23:58:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 106/192 2023-12-12T23:58:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 107/192 2023-12-12T23:58:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 108/192 2023-12-12T23:58:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 109/192 2023-12-12T23:58:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 110/192 2023-12-12T23:58:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 111/192 2023-12-12T23:58:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 112/192 2023-12-12T23:58:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 113/192 2023-12-12T23:58:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 114/192 2023-12-12T23:58:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ply-3.11-14.el9.noarch 115/192 2023-12-12T23:58:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 116/192 2023-12-12T23:58:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 117/192 2023-12-12T23:58:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 118/192 2023-12-12T23:58:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 119/192 2023-12-12T23:58:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 120/192 2023-12-12T23:58:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 121/192 2023-12-12T23:58:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 122/192 2023-12-12T23:58:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 123/192 2023-12-12T23:58:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 124/192 2023-12-12T23:58:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/192 2023-12-12T23:58:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 126/192 2023-12-12T23:58:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 127/192 2023-12-12T23:58:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 128/192 2023-12-12T23:58:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 129/192 2023-12-12T23:58:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 130/192 2023-12-12T23:58:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 131/192 2023-12-12T23:58:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 132/192 2023-12-12T23:58:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 133/192 2023-12-12T23:58:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 134/192 2023-12-12T23:58:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 135/192 2023-12-12T23:58:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 136/192 2023-12-12T23:58:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 137/192 2023-12-12T23:58:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 138/192 2023-12-12T23:58:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 139/192 2023-12-12T23:58:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 140/192 2023-12-12T23:58:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 141/192 2023-12-12T23:58:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 142/192 2023-12-12T23:58:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 143/192 2023-12-12T23:58:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 144/192 2023-12-12T23:58:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 145/192 2023-12-12T23:58:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 146/192 2023-12-12T23:58:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 147/192 2023-12-12T23:58:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 148/192 2023-12-12T23:58:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/192 2023-12-12T23:58:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/192 2023-12-12T23:58:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/192 2023-12-12T23:58:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/192 2023-12-12T23:58:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/192 2023-12-12T23:58:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/192 2023-12-12T23:58:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/192 2023-12-12T23:58:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 156/192 2023-12-12T23:58:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 157/192 2023-12-12T23:58:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 158/192 2023-12-12T23:58:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 159/192 2023-12-12T23:58:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 160/192 2023-12-12T23:58:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : re2-1:20211101-3.el9.x86_64 161/192 2023-12-12T23:58:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 162/192 2023-12-12T23:58:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:19.0.0-157.g021ac167.el9.x86_64 163/192 2023-12-12T23:58:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/192 2023-12-12T23:58:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:19.0.0-157.g021ac167.el9.x86_64 165/192 2023-12-12T23:58:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/192 2023-12-12T23:58:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 167/192 2023-12-12T23:58:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 168/192 2023-12-12T23:58:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : acl-2.3.1-4.el9.x86_64 169/192 2023-12-12T23:58:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : acl-2.3.1-3.el9.x86_64 170/192 2023-12-12T23:58:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 171/192 2023-12-12T23:58:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 172/192 2023-12-12T23:58:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 173/192 2023-12-12T23:58:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 174/192 2023-12-12T23:58:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 175/192 2023-12-12T23:58:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 176/192 2023-12-12T23:58:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/192 2023-12-12T23:58:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/192 2023-12-12T23:58:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 179/192 2023-12-12T23:58:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 180/192 2023-12-12T23:58:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 181/192 2023-12-12T23:58:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 182/192 2023-12-12T23:58:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 183/192 2023-12-12T23:58:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 184/192 2023-12-12T23:58:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 185/192 2023-12-12T23:58:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 186/192 2023-12-12T23:58:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 187/192 2023-12-12T23:58:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 188/192 2023-12-12T23:58:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/192 2023-12-12T23:58:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/192 2023-12-12T23:58:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/192 2023-12-12T23:58:35.657 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 181/192 2023-12-12T23:58:35.685 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 182/192 2023-12-12T23:58:35.733 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 183/192 2023-12-12T23:58:35.767 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 184/192 2023-12-12T23:58:35.767 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 185/192 2023-12-12T23:58:35.862 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 185/192 2023-12-12T23:58:35.887 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 186/192 2023-12-12T23:58:35.893 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-12T23:58:35.893 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-12T23:58:36.074 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-12T23:58:36.075 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 188/192 2023-12-12T23:58:36.159 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 188/192 2023-12-12T23:58:36.192 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 189/192 2023-12-12T23:58:36.226 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 190/192 2023-12-12T23:58:36.260 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 191/192 2023-12-12T23:58:36.329 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 192/192 2023-12-12T23:58:38.204 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/192 2023-12-12T23:58:38.204 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:58:38.204 INFO:teuthology.orchestra.run.smithi176.stdout:Upgraded: 2023-12-12T23:58:38.204 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-12T23:58:38.204 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-12T23:58:38.204 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-12T23:58:38.205 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-12T23:58:38.205 INFO:teuthology.orchestra.run.smithi176.stdout: acl-2.3.1-4.el9.x86_64 2023-12-12T23:58:38.205 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-12T23:58:38.205 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-12T23:58:38.205 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-12T23:58:38.205 INFO:teuthology.orchestra.run.smithi176.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-12T23:58:38.205 INFO:teuthology.orchestra.run.smithi176.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-12T23:58:38.205 INFO:teuthology.orchestra.run.smithi176.stdout: librados2-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.205 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.205 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-12T23:58:38.205 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-12T23:58:38.205 INFO:teuthology.orchestra.run.smithi176.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-12T23:58:38.206 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2023-12-12T23:58:38.206 INFO:teuthology.orchestra.run.smithi176.stdout: automake-1.16.2-8.el9.noarch 2023-12-12T23:58:38.206 INFO:teuthology.orchestra.run.smithi176.stdout: bison-3.7.4-5.el9.x86_64 2023-12-12T23:58:38.206 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-12T23:58:38.206 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.206 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.206 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.206 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.206 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.206 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.206 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.206 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.207 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:38.207 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.207 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.207 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.207 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.207 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.207 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:38.207 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:38.207 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.207 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:38.207 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:38.207 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:38.207 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.208 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.208 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.208 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.208 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:38.208 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.208 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.208 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.208 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.208 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.208 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:38.208 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:38.208 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.208 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-shell-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.209 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-top-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:38.209 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-12T23:58:38.209 INFO:teuthology.orchestra.run.smithi176.stdout: flex-2.6.4-9.el9.x86_64 2023-12-12T23:58:38.209 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-12T23:58:38.209 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-12T23:58:38.209 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-12T23:58:38.209 INFO:teuthology.orchestra.run.smithi176.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-12T23:58:38.209 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-12T23:58:38.209 INFO:teuthology.orchestra.run.smithi176.stdout: jq-1.6-16.el9.x86_64 2023-12-12T23:58:38.209 INFO:teuthology.orchestra.run.smithi176.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-12T23:58:38.209 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-12T23:58:38.209 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-12T23:58:38.209 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.210 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.210 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.210 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.210 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-12T23:58:38.210 INFO:teuthology.orchestra.run.smithi176.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-12T23:58:38.210 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-12T23:58:38.210 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-12T23:58:38.210 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-12T23:58:38.210 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.210 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.210 INFO:teuthology.orchestra.run.smithi176.stdout: librados2-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.210 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.210 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.210 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-12T23:58:38.211 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.211 INFO:teuthology.orchestra.run.smithi176.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-12T23:58:38.211 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-12T23:58:38.211 INFO:teuthology.orchestra.run.smithi176.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-12T23:58:38.211 INFO:teuthology.orchestra.run.smithi176.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-12T23:58:38.211 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-12T23:58:38.211 INFO:teuthology.orchestra.run.smithi176.stdout: lua-5.4.4-4.el9.x86_64 2023-12-12T23:58:38.211 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-12T23:58:38.211 INFO:teuthology.orchestra.run.smithi176.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-12T23:58:38.211 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-12T23:58:38.211 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-12T23:58:38.211 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-12T23:58:38.211 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-12T23:58:38.212 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-13.11-1.el9.x86_64 2023-12-12T23:58:38.212 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-12T23:58:38.212 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-12T23:58:38.212 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-12T23:58:38.212 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-12T23:58:38.212 INFO:teuthology.orchestra.run.smithi176.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-12T23:58:38.212 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-12T23:58:38.212 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-12T23:58:38.212 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-12T23:58:38.212 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.212 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.212 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.212 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.213 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-12T23:58:38.213 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-12T23:58:38.213 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-12T23:58:38.213 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-12T23:58:38.213 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-12T23:58:38.213 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-12T23:58:38.213 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-12T23:58:38.213 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-12T23:58:38.213 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-12T23:58:38.213 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-12T23:58:38.213 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-12T23:58:38.214 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-12T23:58:38.214 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-12T23:58:38.214 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-12T23:58:38.214 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-12T23:58:38.214 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-12T23:58:38.214 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-12T23:58:38.214 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-12T23:58:38.214 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-12T23:58:38.214 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-12T23:58:38.214 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-12T23:58:38.215 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-12T23:58:38.215 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-12T23:58:38.215 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-12T23:58:38.215 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-12T23:58:38.215 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-12T23:58:38.215 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-12T23:58:38.215 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-12T23:58:38.216 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-12T23:58:38.216 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply-3.11-14.el9.noarch 2023-12-12T23:58:38.216 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-12T23:58:38.216 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-12T23:58:38.216 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-12T23:58:38.216 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-12T23:58:38.216 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-12T23:58:38.216 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-12T23:58:38.216 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-12T23:58:38.216 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-12T23:58:38.217 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.217 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.217 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.217 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.217 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-12T23:58:38.217 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-12T23:58:38.217 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-12T23:58:38.217 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.217 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.217 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-12T23:58:38.218 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-12T23:58:38.218 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-12T23:58:38.218 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-12T23:58:38.218 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-12T23:58:38.218 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-12T23:58:38.218 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-12T23:58:38.218 INFO:teuthology.orchestra.run.smithi176.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-12T23:58:38.218 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-12T23:58:38.218 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-12T23:58:38.218 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-12T23:58:38.219 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-12T23:58:38.219 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.219 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.219 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.219 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.219 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.219 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:38.219 INFO:teuthology.orchestra.run.smithi176.stdout: re2-1:20211101-3.el9.x86_64 2023-12-12T23:58:38.219 INFO:teuthology.orchestra.run.smithi176.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-12T23:58:38.219 INFO:teuthology.orchestra.run.smithi176.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-12T23:58:38.219 INFO:teuthology.orchestra.run.smithi176.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-12T23:58:38.220 INFO:teuthology.orchestra.run.smithi176.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-12T23:58:38.220 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-12T23:58:38.220 INFO:teuthology.orchestra.run.smithi176.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-12T23:58:38.220 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:58:38.220 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2023-12-12T23:58:38.826 DEBUG:teuthology.parallel:result is None 2023-12-12T23:58:53.943 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 192/192 2023-12-12T23:58:53.943 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:19.0.0-157.g021ac167.el9.x86_64 1/192 2023-12-12T23:58:53.943 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:19.0.0-157.g021ac167.el9.x86_64 2/192 2023-12-12T23:58:53.943 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-157.g021ac167.el9.x 3/192 2023-12-12T23:58:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:19.0.0-157.g021ac167.el9.x86_64 4/192 2023-12-12T23:58:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-157.g021ac167.el9 5/192 2023-12-12T23:58:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 6/192 2023-12-12T23:58:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:19.0.0-157.g021ac167.el9.x86_64 7/192 2023-12-12T23:58:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-157.g021ac167.el9.x 8/192 2023-12-12T23:58:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-157.g021ac1 9/192 2023-12-12T23:58:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 10/192 2023-12-12T23:58:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:19.0.0-157.g021ac167.el9.x86_64 11/192 2023-12-12T23:58:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-157.g021ac167.el9.x8 12/192 2023-12-12T23:58:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:19.0.0-157.g021ac167.el9.x86_64 13/192 2023-12-12T23:58:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-157.g021ac167.el9.x8 14/192 2023-12-12T23:58:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:19.0.0-157.g021ac167.el9.x86_64 15/192 2023-12-12T23:58:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-157.g021ac167.el9.x8 16/192 2023-12-12T23:58:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:19.0.0-157.g021ac167.el9.x86_64 17/192 2023-12-12T23:58:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-157.g021ac167.el9.x8 18/192 2023-12-12T23:58:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:19.0.0-157.g021ac167.el9.x86_64 19/192 2023-12-12T23:58:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-157.g021ac167.el 20/192 2023-12-12T23:58:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:19.0.0-157.g021ac167.el9.x86_64 21/192 2023-12-12T23:58:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:19.0.0-157.g021ac167.el9.x86_64 22/192 2023-12-12T23:58:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-157.g021ac167.el9.x 23/192 2023-12-12T23:58:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-mirror-2:19.0.0-157.g021ac167.el9.x86_64 24/192 2023-12-12T23:58:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-shell-2:19.0.0-157.g021ac167.el9.x86_64 25/192 2023-12-12T23:58:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:19.0.0-157.g021ac167.el9.x86_6 26/192 2023-12-12T23:58:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:19.0.0-157.g021ac167.el9.x86_64 27/192 2023-12-12T23:58:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-157.g021ac167.el9. 28/192 2023-12-12T23:58:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:19.0.0-157.g021ac167.el9.x86_64 29/192 2023-12-12T23:58:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:19.0.0-157.g021ac167.el9.x86_64 30/192 2023-12-12T23:58:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-157.g021ac167. 31/192 2023-12-12T23:58:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-debuginfo-2:19.0.0-157.g021ac167.el9.x 32/192 2023-12-12T23:58:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:19.0.0-157.g021ac167.el9.x86_ 33/192 2023-12-12T23:58:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-debuginfo-2:19.0.0-157.g021ac167.el9.x86 34/192 2023-12-12T23:58:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:19.0.0-157.g021ac167.el9.x86_64 35/192 2023-12-12T23:58:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:19.0.0-157.g021ac167.el9 36/192 2023-12-12T23:58:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:19.0.0-157.g021ac167.el9.x 37/192 2023-12-12T23:58:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:19.0.0-157.g021ac167.el9.x86_64 38/192 2023-12-12T23:58:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-157.g021ac167. 39/192 2023-12-12T23:58:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:19.0.0-157.g021ac167.el9.x86_64 40/192 2023-12-12T23:58:53.966 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-157.g021ac167.e 41/192 2023-12-12T23:58:53.966 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:19.0.0-157.g021ac167.el9.x86_64 42/192 2023-12-12T23:58:53.966 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-157.g021ac167.el9 43/192 2023-12-12T23:58:53.966 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:19.0.0-157.g021ac167.el9.x86_64 44/192 2023-12-12T23:58:53.966 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-157.g021ac167.el9 45/192 2023-12-12T23:58:53.966 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:19.0.0-157.g021ac167.el9.x86_64 46/192 2023-12-12T23:58:53.966 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-157.g021ac167.el9.x8 47/192 2023-12-12T23:58:53.966 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:19.0.0-157.g021ac167.el9.x86_64 48/192 2023-12-12T23:58:53.966 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-157.g021ac167.el9. 49/192 2023-12-12T23:58:53.966 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:19.0.0-157.g021ac167.el9.x86_64 50/192 2023-12-12T23:58:53.967 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-157.g021ac167.el9.x86 51/192 2023-12-12T23:58:53.967 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-157.g021ac167.e 52/192 2023-12-12T23:58:53.967 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-157.g021ac167.el9.noar 53/192 2023-12-12T23:58:53.967 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-157.g021ac167.el9.no 54/192 2023-12-12T23:58:53.967 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-157.g021a 55/192 2023-12-12T23:58:53.967 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-157.g021ac167.el9 56/192 2023-12-12T23:58:53.967 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:19.0.0-157.g021ac167.el9.noarch 57/192 2023-12-12T23:58:53.967 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-157.g021ac167.el 58/192 2023-12-12T23:58:53.967 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-volume-2:19.0.0-157.g021ac167.el9.noarch 59/192 2023-12-12T23:58:53.967 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephadm-2:19.0.0-157.g021ac167.el9.noarch 60/192 2023-12-12T23:58:53.967 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-top-2:19.0.0-157.g021ac167.el9.noarch 61/192 2023-12-12T23:58:53.968 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/192 2023-12-12T23:58:53.968 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/192 2023-12-12T23:58:53.968 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/192 2023-12-12T23:58:53.968 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 65/192 2023-12-12T23:58:53.968 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flex-2.6.4-9.el9.x86_64 66/192 2023-12-12T23:58:53.968 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 67/192 2023-12-12T23:58:53.968 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 68/192 2023-12-12T23:58:53.968 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 69/192 2023-12-12T23:58:53.968 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : jq-1.6-16.el9.x86_64 70/192 2023-12-12T23:58:53.968 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 71/192 2023-12-12T23:58:53.968 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 72/192 2023-12-12T23:58:53.969 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 73/192 2023-12-12T23:58:53.969 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 74/192 2023-12-12T23:58:53.969 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 75/192 2023-12-12T23:58:53.969 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 76/192 2023-12-12T23:58:53.969 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 77/192 2023-12-12T23:58:53.969 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 78/192 2023-12-12T23:58:53.969 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lua-5.4.4-4.el9.x86_64 79/192 2023-12-12T23:58:53.969 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 80/192 2023-12-12T23:58:53.969 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 81/192 2023-12-12T23:58:53.969 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 82/192 2023-12-12T23:58:53.969 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-13.11-1.el9.x86_64 83/192 2023-12-12T23:58:53.969 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 84/192 2023-12-12T23:58:53.970 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 85/192 2023-12-12T23:58:53.970 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 86/192 2023-12-12T23:58:53.970 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 87/192 2023-12-12T23:58:53.970 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 88/192 2023-12-12T23:58:53.970 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 89/192 2023-12-12T23:58:53.970 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 90/192 2023-12-12T23:58:53.970 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 91/192 2023-12-12T23:58:53.970 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 92/192 2023-12-12T23:58:53.970 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 93/192 2023-12-12T23:58:53.970 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 94/192 2023-12-12T23:58:53.970 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/192 2023-12-12T23:58:53.970 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 96/192 2023-12-12T23:58:53.971 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 97/192 2023-12-12T23:58:53.971 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 98/192 2023-12-12T23:58:53.971 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 99/192 2023-12-12T23:58:53.971 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 100/192 2023-12-12T23:58:53.971 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 101/192 2023-12-12T23:58:53.971 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 102/192 2023-12-12T23:58:53.971 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 103/192 2023-12-12T23:58:53.971 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 104/192 2023-12-12T23:58:53.971 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 105/192 2023-12-12T23:58:53.971 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 106/192 2023-12-12T23:58:53.971 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 107/192 2023-12-12T23:58:53.971 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 108/192 2023-12-12T23:58:53.971 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 109/192 2023-12-12T23:58:53.972 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 110/192 2023-12-12T23:58:53.972 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 111/192 2023-12-12T23:58:53.972 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 112/192 2023-12-12T23:58:53.972 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 113/192 2023-12-12T23:58:53.972 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 114/192 2023-12-12T23:58:53.972 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ply-3.11-14.el9.noarch 115/192 2023-12-12T23:58:53.972 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 116/192 2023-12-12T23:58:53.972 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 117/192 2023-12-12T23:58:53.972 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 118/192 2023-12-12T23:58:53.972 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 119/192 2023-12-12T23:58:53.972 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 120/192 2023-12-12T23:58:53.973 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 121/192 2023-12-12T23:58:53.973 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 122/192 2023-12-12T23:58:53.973 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 123/192 2023-12-12T23:58:53.973 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 124/192 2023-12-12T23:58:53.973 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/192 2023-12-12T23:58:53.973 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 126/192 2023-12-12T23:58:53.973 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 127/192 2023-12-12T23:58:53.973 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 128/192 2023-12-12T23:58:53.973 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 129/192 2023-12-12T23:58:53.973 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 130/192 2023-12-12T23:58:53.973 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 131/192 2023-12-12T23:58:53.973 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 132/192 2023-12-12T23:58:53.974 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 133/192 2023-12-12T23:58:53.974 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 134/192 2023-12-12T23:58:53.974 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 135/192 2023-12-12T23:58:53.974 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 136/192 2023-12-12T23:58:53.974 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 137/192 2023-12-12T23:58:53.974 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 138/192 2023-12-12T23:58:53.974 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 139/192 2023-12-12T23:58:53.974 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 140/192 2023-12-12T23:58:53.974 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 141/192 2023-12-12T23:58:53.974 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 142/192 2023-12-12T23:58:53.974 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 143/192 2023-12-12T23:58:53.974 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 144/192 2023-12-12T23:58:53.974 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 145/192 2023-12-12T23:58:53.975 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 146/192 2023-12-12T23:58:53.975 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 147/192 2023-12-12T23:58:53.975 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 148/192 2023-12-12T23:58:53.975 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/192 2023-12-12T23:58:53.975 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/192 2023-12-12T23:58:53.975 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/192 2023-12-12T23:58:53.975 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/192 2023-12-12T23:58:53.975 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/192 2023-12-12T23:58:53.975 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/192 2023-12-12T23:58:53.975 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/192 2023-12-12T23:58:53.975 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 156/192 2023-12-12T23:58:53.975 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 157/192 2023-12-12T23:58:53.975 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 158/192 2023-12-12T23:58:53.976 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 159/192 2023-12-12T23:58:53.976 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 160/192 2023-12-12T23:58:53.976 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : re2-1:20211101-3.el9.x86_64 161/192 2023-12-12T23:58:53.976 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 162/192 2023-12-12T23:58:53.976 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:19.0.0-157.g021ac167.el9.x86_64 163/192 2023-12-12T23:58:53.976 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/192 2023-12-12T23:58:53.976 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:19.0.0-157.g021ac167.el9.x86_64 165/192 2023-12-12T23:58:53.976 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/192 2023-12-12T23:58:53.976 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 167/192 2023-12-12T23:58:53.976 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 168/192 2023-12-12T23:58:53.976 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : acl-2.3.1-4.el9.x86_64 169/192 2023-12-12T23:58:53.976 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : acl-2.3.1-3.el9.x86_64 170/192 2023-12-12T23:58:53.976 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 171/192 2023-12-12T23:58:53.976 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 172/192 2023-12-12T23:58:53.977 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 173/192 2023-12-12T23:58:53.977 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 174/192 2023-12-12T23:58:53.977 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 175/192 2023-12-12T23:58:53.977 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 176/192 2023-12-12T23:58:53.977 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/192 2023-12-12T23:58:53.977 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/192 2023-12-12T23:58:53.977 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 179/192 2023-12-12T23:58:53.977 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 180/192 2023-12-12T23:58:53.977 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 181/192 2023-12-12T23:58:53.977 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 182/192 2023-12-12T23:58:53.977 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 183/192 2023-12-12T23:58:53.977 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 184/192 2023-12-12T23:58:53.978 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 185/192 2023-12-12T23:58:53.978 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 186/192 2023-12-12T23:58:53.978 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 187/192 2023-12-12T23:58:53.978 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 188/192 2023-12-12T23:58:53.978 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/192 2023-12-12T23:58:53.978 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/192 2023-12-12T23:58:53.978 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/192 2023-12-12T23:58:56.809 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/192 2023-12-12T23:58:56.809 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:58:56.810 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2023-12-12T23:58:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-12T23:58:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-12T23:58:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-12T23:58:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-12T23:58:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: acl-2.3.1-4.el9.x86_64 2023-12-12T23:58:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-12T23:58:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-12T23:58:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-12T23:58:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-12T23:58:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-12T23:58:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-12T23:58:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-12T23:58:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-12T23:58:56.811 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2023-12-12T23:58:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: automake-1.16.2-8.el9.noarch 2023-12-12T23:58:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: bison-3.7.4-5.el9.x86_64 2023-12-12T23:58:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-12T23:58:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-shell-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top-2:19.0.0-157.g021ac167.el9.noarch 2023-12-12T23:58:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-12T23:58:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: flex-2.6.4-9.el9.x86_64 2023-12-12T23:58:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-12T23:58:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-12T23:58:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-12T23:58:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-12T23:58:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-12T23:58:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: jq-1.6-16.el9.x86_64 2023-12-12T23:58:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-12T23:58:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-12T23:58:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-12T23:58:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-12T23:58:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-12T23:58:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-12T23:58:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-12T23:58:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-12T23:58:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-12T23:58:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-12T23:58:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-12T23:58:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-12T23:58:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-12T23:58:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-12T23:58:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: lua-5.4.4-4.el9.x86_64 2023-12-12T23:58:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-12T23:58:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-12T23:58:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-12T23:58:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-12T23:58:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-12T23:58:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-12T23:58:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-13.11-1.el9.x86_64 2023-12-12T23:58:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-12T23:58:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-12T23:58:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-12T23:58:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-12T23:58:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-12T23:58:56.818 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-12T23:58:56.818 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-12T23:58:56.818 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-12T23:58:56.818 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-12T23:58:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-12T23:58:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-12T23:58:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-12T23:58:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-12T23:58:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-12T23:58:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-12T23:58:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-12T23:58:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-12T23:58:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-12T23:58:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-12T23:58:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-12T23:58:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-12T23:58:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-12T23:58:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-12T23:58:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-12T23:58:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-12T23:58:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-12T23:58:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-12T23:58:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-12T23:58:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-12T23:58:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-12T23:58:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-12T23:58:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-12T23:58:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-12T23:58:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-12T23:58:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-12T23:58:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-12T23:58:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-12T23:58:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ply-3.11-14.el9.noarch 2023-12-12T23:58:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-12T23:58:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-12T23:58:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-12T23:58:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-12T23:58:56.822 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-12T23:58:56.822 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-12T23:58:56.822 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-12T23:58:56.822 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-12T23:58:56.822 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.822 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.822 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.822 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.822 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-12T23:58:56.822 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-12T23:58:56.822 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-12T23:58:56.822 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-12T23:58:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-12T23:58:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-12T23:58:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-12T23:58:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-12T23:58:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-12T23:58:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-12T23:58:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-12T23:58:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-12T23:58:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-12T23:58:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-12T23:58:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-12T23:58:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-debuginfo-2:19.0.0-157.g021ac167.el9.x86_64 2023-12-12T23:58:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: re2-1:20211101-3.el9.x86_64 2023-12-12T23:58:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-12T23:58:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-12T23:58:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-12T23:58:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-12T23:58:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-12T23:58:56.825 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-12T23:58:56.825 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:58:56.825 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-12-12T23:58:57.601 DEBUG:teuthology.parallel:result is None 2023-12-12T23:58:57.601 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=021ac1670a21c19759080c6da90baaeb42e7d175 2023-12-12T23:58:57.748 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-12T23:58:57.772 INFO:teuthology.orchestra.run.smithi072.stdout:19.0.0-157.g021ac167.el9 2023-12-12T23:58:57.772 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-157.g021ac167.el9 2023-12-12T23:58:57.772 INFO:teuthology.task.install:The correct ceph version 19.0.0-157.g021ac167 is installed. 2023-12-12T23:58:57.775 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=021ac1670a21c19759080c6da90baaeb42e7d175 2023-12-12T23:58:57.987 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-12T23:58:58.013 INFO:teuthology.orchestra.run.smithi176.stdout:19.0.0-157.g021ac167.el9 2023-12-12T23:58:58.014 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-157.g021ac167.el9 2023-12-12T23:58:58.014 INFO:teuthology.task.install:The correct ceph version 19.0.0-157.g021ac167 is installed. 2023-12-12T23:58:58.015 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-12T23:58:58.016 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:58:58.016 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-12T23:58:58.049 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:58:58.049 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-12T23:58:58.087 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-12T23:58:58.087 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:58:58.087 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2023-12-12T23:58:58.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-12T23:58:58.186 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:58:58.186 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/daemon-helper 2023-12-12T23:58:58.217 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-12T23:58:58.286 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-12T23:58:58.286 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:58:58.286 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-12T23:58:58.315 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-12T23:58:58.383 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:58:58.383 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-12T23:58:58.414 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-12T23:58:58.484 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-12T23:58:58.484 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:58:58.484 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2023-12-12T23:58:58.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-12T23:58:58.580 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:58:58.580 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/stdin-killer 2023-12-12T23:58:58.608 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-12T23:58:58.677 INFO:teuthology.run_tasks:Running task ceph... 2023-12-12T23:58:58.744 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-12T23:58:58.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2023-12-12T23:58:58.746 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 777 /var/log/ceph 2023-12-12T23:58:58.776 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-12T23:58:58.776 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-12T23:58:58.814 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-12T23:58:58.842 INFO:tasks.ceph:Creating extra log directories... 2023-12-12T23:58:58.843 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-12T23:58:58.883 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-12T23:58:58.916 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-12T23:58:58.916 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-12T23:58:58.916 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-12T23:58:58.916 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:58:58.916 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-12T23:58:58.962 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-12T23:58:59.080 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-12T23:58:59.107 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:58:59.107 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-12T23:58:59.122 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-12T23:58:59.239 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-12T23:58:59.271 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-12T23:58:59.271 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-12T23:58:59.271 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489252', 'branch': 'wip-yuri10-testing-2023-12-12-1229', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7489252', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri10-testing-2023-12-12-1229'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri10-testing-2023-12-12-1229', 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 8124, 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri10-testing-2023-12-12-1229', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '021ac1670a21c19759080c6da90baaeb42e7d175', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi072.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwF4NBeLAivyQUn36Egw1iPnhpM7o1AAYzEbC4jbdxggLlYBOtHlITta1b7df29QS/Nr8bzgn06YWP3wh5i/zs=', 'smithi176.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNDXc5/kqFVWyPJTSE1nTsD7rqE/wiS2HCugJc4U+fW78MucX7iHMdSdp2AnMT9qzxdquoNKDxaCLbMHWoZRLic='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-12_23:05:14', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-12T23:58:59.272 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-12T23:58:59.274 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-12T23:58:59.321 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2023-12-12T23:58:59.328 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/run/ceph 2023-12-12T23:58:59.388 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:58:59.388 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2023-12-12T23:58:59.408 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-12T23:58:59.408 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2023-12-12T23:58:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-12T23:58:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T23:58:59.463 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-12-12T23:58:59.464 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T23:58:59.464 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T23:58:59.464 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-12-12 23:58:36.665566056 +0000 2023-12-12T23:58:59.464 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-12-12 23:50:19.116129903 +0000 2023-12-12T23:58:59.464 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-12-12 23:50:19.116129903 +0000 2023-12-12T23:58:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2023-12-12 23:50:19.116129903 +0000 2023-12-12T23:58:59.464 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-12T23:58:59.528 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-12-12T23:58:59.528 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-12-12T23:58:59.528 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000181451 s, 2.8 MB/s 2023-12-12T23:58:59.530 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-12T23:58:59.585 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2023-12-12T23:58:59.640 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-12T23:58:59.640 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T23:58:59.640 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-12-12T23:58:59.640 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T23:58:59.640 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T23:58:59.641 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-12-12 23:58:36.665566056 +0000 2023-12-12T23:58:59.641 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-12-12 23:50:19.608119312 +0000 2023-12-12T23:58:59.641 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-12-12 23:50:19.608119312 +0000 2023-12-12T23:58:59.641 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2023-12-12 23:50:19.608119312 +0000 2023-12-12T23:58:59.641 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-12T23:58:59.706 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-12-12T23:58:59.707 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-12-12T23:58:59.707 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000166389 s, 3.1 MB/s 2023-12-12T23:58:59.708 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-12T23:58:59.764 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2023-12-12T23:58:59.819 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-12T23:58:59.819 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T23:58:59.819 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 701 Links: 1 2023-12-12T23:58:59.819 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T23:58:59.819 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T23:58:59.820 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-12-12 23:58:36.665566056 +0000 2023-12-12T23:58:59.820 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-12-12 23:50:20.080109150 +0000 2023-12-12T23:58:59.820 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-12-12 23:50:20.080109150 +0000 2023-12-12T23:58:59.820 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2023-12-12 23:50:20.080109150 +0000 2023-12-12T23:58:59.820 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-12T23:58:59.885 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-12-12T23:58:59.885 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-12-12T23:58:59.885 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000191708 s, 2.7 MB/s 2023-12-12T23:58:59.886 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-12T23:58:59.942 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2023-12-12T23:58:59.997 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-12T23:58:59.997 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T23:58:59.997 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 718 Links: 1 2023-12-12T23:58:59.997 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T23:58:59.997 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T23:58:59.997 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-12-12 23:58:36.666566034 +0000 2023-12-12T23:58:59.997 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-12-12 23:50:20.569098624 +0000 2023-12-12T23:58:59.997 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-12-12 23:50:20.569098624 +0000 2023-12-12T23:58:59.997 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2023-12-12 23:50:20.569098624 +0000 2023-12-12T23:58:59.998 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-12T23:59:00.062 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-12-12T23:59:00.063 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-12-12T23:59:00.063 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000202989 s, 2.5 MB/s 2023-12-12T23:59:00.064 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-12T23:59:00.120 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T23:59:00.120 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:59:00.120 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/scratch_devs of=/dev/stdout 2023-12-12T23:59:00.136 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-12T23:59:00.137 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_1 2023-12-12T23:59:00.193 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-12T23:59:00.193 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T23:59:00.193 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 664 Links: 1 2023-12-12T23:59:00.193 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T23:59:00.193 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T23:59:00.193 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2023-12-12 23:58:24.790864020 +0000 2023-12-12T23:59:00.193 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2023-12-12 23:50:09.633471667 +0000 2023-12-12T23:59:00.193 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2023-12-12 23:50:09.633471667 +0000 2023-12-12T23:59:00.193 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2023-12-12 23:50:09.633471667 +0000 2023-12-12T23:59:00.194 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-12T23:59:00.261 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2023-12-12T23:59:00.261 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2023-12-12T23:59:00.261 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000214365 s, 2.4 MB/s 2023-12-12T23:59:00.262 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-12T23:59:00.319 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_2 2023-12-12T23:59:00.375 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-12T23:59:00.375 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T23:59:00.375 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-12-12T23:59:00.375 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T23:59:00.375 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T23:59:00.375 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2023-12-12 23:58:24.790864020 +0000 2023-12-12T23:59:00.376 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2023-12-12 23:50:10.125467213 +0000 2023-12-12T23:59:00.376 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2023-12-12 23:50:10.125467213 +0000 2023-12-12T23:59:00.376 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2023-12-12 23:50:10.125467213 +0000 2023-12-12T23:59:00.376 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-12T23:59:00.441 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2023-12-12T23:59:00.442 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2023-12-12T23:59:00.442 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000174196 s, 2.9 MB/s 2023-12-12T23:59:00.443 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-12T23:59:00.499 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_3 2023-12-12T23:59:00.553 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-12T23:59:00.553 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T23:59:00.553 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-12-12T23:59:00.553 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T23:59:00.554 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T23:59:00.554 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2023-12-12 23:58:24.790864020 +0000 2023-12-12T23:59:00.554 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2023-12-12 23:50:10.595462958 +0000 2023-12-12T23:59:00.554 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2023-12-12 23:50:10.595462958 +0000 2023-12-12T23:59:00.554 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2023-12-12 23:50:10.595462958 +0000 2023-12-12T23:59:00.554 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-12T23:59:00.619 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2023-12-12T23:59:00.619 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2023-12-12T23:59:00.619 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000187854 s, 2.7 MB/s 2023-12-12T23:59:00.620 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-12T23:59:00.676 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_4 2023-12-12T23:59:00.730 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-12T23:59:00.730 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T23:59:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-12-12T23:59:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T23:59:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T23:59:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2023-12-12 23:58:24.791864011 +0000 2023-12-12T23:59:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2023-12-12 23:50:11.068458676 +0000 2023-12-12T23:59:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2023-12-12 23:50:11.068458676 +0000 2023-12-12T23:59:00.730 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2023-12-12 23:50:11.068458676 +0000 2023-12-12T23:59:00.730 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-12T23:59:00.795 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2023-12-12T23:59:00.795 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2023-12-12T23:59:00.796 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000181109 s, 2.8 MB/s 2023-12-12T23:59:00.796 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-12T23:59:00.852 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T23:59:00.852 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-12T23:59:00.852 INFO:tasks.ceph:Generating config... 2023-12-12T23:59:00.853 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-12T23:59:00.854 INFO:tasks.ceph:[client] debug client = 20 2023-12-12T23:59:00.854 INFO:tasks.ceph:[client] debug ms = 1 2023-12-12T23:59:00.854 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-12T23:59:00.854 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-12T23:59:00.854 INFO:tasks.ceph:[global] mds beacon grace = 60 2023-12-12T23:59:00.854 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2023-12-12T23:59:00.854 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2023-12-12T23:59:00.854 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-12T23:59:00.854 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-12T23:59:00.854 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-12T23:59:00.854 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-12T23:59:00.854 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-12T23:59:00.854 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-12T23:59:00.854 INFO:tasks.ceph:[mds] mds valgrind exit = True 2023-12-12T23:59:00.855 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-12T23:59:00.855 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-12T23:59:00.855 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-12T23:59:00.855 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-12T23:59:00.855 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-12T23:59:00.855 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-12T23:59:00.855 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-12T23:59:00.855 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-12T23:59:00.855 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-12T23:59:00.855 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-12T23:59:00.855 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-12-12T23:59:00.855 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-12T23:59:00.855 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-12T23:59:00.855 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-12T23:59:00.855 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-12T23:59:00.855 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-12T23:59:00.856 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-12T23:59:00.856 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-12T23:59:00.856 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-12T23:59:00.856 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-12T23:59:00.856 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-12T23:59:00.856 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-12T23:59:00.856 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-12-12T23:59:00.856 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-12T23:59:00.856 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-12T23:59:00.856 INFO:tasks.ceph:Setting up mon.a... 2023-12-12T23:59:00.856 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-12T23:59:00.907 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.keyring 2023-12-12T23:59:00.910 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-12T23:59:00.956 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-12T23:59:00.983 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.72'), ('mon.b', '172.21.15.176'), ('mon.c', '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]')] 2023-12-12T23:59:00.983 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.72,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-12T23:59:00.984 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:00.984 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-12T23:59:01.038 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.72 --add b 172.21.15.176 --addv c '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-12T23:59:01.122 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-12T23:59:01.122 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: generated fsid 37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d 2023-12-12T23:59:01.122 INFO:teuthology.orchestra.run.smithi072.stdout:setting min_mon_release = quincy 2023-12-12T23:59:01.122 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 0 2023-12-12T23:59:01.122 INFO:teuthology.orchestra.run.smithi072.stdout:fsid 37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d 2023-12-12T23:59:01.122 INFO:teuthology.orchestra.run.smithi072.stdout:last_changed 2023-12-12T23:59:01.123028+0000 2023-12-12T23:59:01.123 INFO:teuthology.orchestra.run.smithi072.stdout:created 2023-12-12T23:59:01.123028+0000 2023-12-12T23:59:01.123 INFO:teuthology.orchestra.run.smithi072.stdout:min_mon_release 17 (quincy) 2023-12-12T23:59:01.123 INFO:teuthology.orchestra.run.smithi072.stdout:election_strategy: 1 2023-12-12T23:59:01.123 INFO:teuthology.orchestra.run.smithi072.stdout:0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2023-12-12T23:59:01.123 INFO:teuthology.orchestra.run.smithi072.stdout:1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.b 2023-12-12T23:59:01.123 INFO:teuthology.orchestra.run.smithi072.stdout:2: [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] mon.c 2023-12-12T23:59:01.123 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-12T23:59:01.124 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-12T23:59:01.179 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d... 2023-12-12T23:59:01.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-12T23:59:01.222 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-12T23:59:01.269 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2023-12-12T23:59:01.269 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2023-12-12T23:59:01.269 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-12T23:59:01.270 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2023-12-12T23:59:01.270 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.270 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2023-12-12T23:59:01.270 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.270 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2023-12-12T23:59:01.270 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.270 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2023-12-12T23:59:01.270 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2023-12-12T23:59:01.270 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.270 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2023-12-12T23:59:01.270 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2023-12-12T23:59:01.270 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.270 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-12T23:59:01.271 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2023-12-12T23:59:01.271 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.271 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2023-12-12T23:59:01.271 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-12T23:59:01.271 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.271 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2023-12-12T23:59:01.271 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.271 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2023-12-12T23:59:01.271 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2023-12-12T23:59:01.271 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2023-12-12T23:59:01.271 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2023-12-12T23:59:01.271 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2023-12-12T23:59:01.271 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2023-12-12T23:59:01.272 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2023-12-12T23:59:01.272 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-12T23:59:01.272 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-12T23:59:01.272 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2023-12-12T23:59:01.272 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.272 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-12T23:59:01.272 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.272 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2023-12-12T23:59:01.272 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.272 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2023-12-12T23:59:01.272 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.272 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2023-12-12T23:59:01.272 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2023-12-12T23:59:01.272 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2023-12-12T23:59:01.273 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.72,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2023-12-12T23:59:01.273 INFO:teuthology.orchestra.run.smithi072.stdout: mds beacon grace = 60 2023-12-12T23:59:01.273 INFO:teuthology.orchestra.run.smithi072.stdout: mds heartbeat grace = 60 2023-12-12T23:59:01.273 INFO:teuthology.orchestra.run.smithi072.stdout: osd heartbeat grace = 60 2023-12-12T23:59:01.273 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = 37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d 2023-12-12T23:59:01.273 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.273 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2023-12-12T23:59:01.273 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2023-12-12T23:59:01.273 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.273 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2023-12-12T23:59:01.273 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2023-12-12T23:59:01.273 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2023-12-12T23:59:01.273 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.274 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2023-12-12T23:59:01.274 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2023-12-12T23:59:01.274 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.274 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2023-12-12T23:59:01.274 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2023-12-12T23:59:01.274 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2023-12-12T23:59:01.274 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug trim objects = true 2023-12-12T23:59:01.274 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.274 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2023-12-12T23:59:01.274 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2023-12-12T23:59:01.274 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.274 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2023-12-12T23:59:01.275 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.275 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2023-12-12T23:59:01.275 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.275 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2023-12-12T23:59:01.275 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.275 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2023-12-12T23:59:01.275 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2023-12-12T23:59:01.275 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.275 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2023-12-12T23:59:01.275 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2023-12-12T23:59:01.275 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2023-12-12T23:59:01.275 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2023-12-12T23:59:01.275 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 20 2023-12-12T23:59:01.275 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 20 2023-12-12T23:59:01.276 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-12-12T23:59:01.276 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2023-12-12T23:59:01.276 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 10 2023-12-12T23:59:01.276 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2023-12-12T23:59:01.276 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2023-12-12T23:59:01.276 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2023-12-12T23:59:01.276 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2023-12-12T23:59:01.276 INFO:teuthology.orchestra.run.smithi072.stdout: osd fast shutdown = False 2023-12-12T23:59:01.276 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2023-12-12T23:59:01.276 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-12-12T23:59:01.276 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.276 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2023-12-12T23:59:01.276 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-12-12T23:59:01.276 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2023-12-12T23:59:01.277 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-12-12T23:59:01.277 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-12-12T23:59:01.277 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-12-12T23:59:01.277 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-12-12T23:59:01.277 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2023-12-12T23:59:01.277 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.277 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2023-12-12T23:59:01.277 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-12-12T23:59:01.277 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-12-12T23:59:01.277 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2023-12-12T23:59:01.277 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-12-12T23:59:01.277 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2023-12-12T23:59:01.277 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2023-12-12T23:59:01.278 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-12-12T23:59:01.278 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2023-12-12T23:59:01.278 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2023-12-12T23:59:01.278 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-12-12T23:59:01.278 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.278 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-12T23:59:01.278 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2023-12-12T23:59:01.278 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2023-12-12T23:59:01.278 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.278 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2023-12-12T23:59:01.278 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-12T23:59:01.278 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-12T23:59:01.278 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.278 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2023-12-12T23:59:01.279 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2023-12-12T23:59:01.279 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.279 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2023-12-12T23:59:01.279 INFO:teuthology.orchestra.run.smithi072.stdout: mon op complaint time = 120 2023-12-12T23:59:01.279 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd crush smoke test = False 2023-12-12T23:59:01.279 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:01.279 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2023-12-12T23:59:01.279 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2023-12-12T23:59:01.279 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2023-12-12T23:59:01.279 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2023-12-12T23:59:01.279 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-12T23:59:01.279 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-12T23:59:01.279 INFO:teuthology.orchestra.run.smithi072.stdout: client mount timeout = 600 2023-12-12T23:59:01.279 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2023-12-12T23:59:01.280 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-12-12T23:59:01.280 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-12-12T23:59:01.280 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-12-12T23:59:01.280 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2023-12-12T23:59:01.280 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2023-12-12T23:59:01.280 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2023-12-12T23:59:01.280 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-12-12T23:59:01.280 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2023-12-12T23:59:01.280 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.e] 2023-12-12T23:59:01.280 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2023-12-12T23:59:01.280 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2023-12-12T23:59:01.280 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.f] 2023-12-12T23:59:01.280 INFO:teuthology.orchestra.run.smithi072.stdout:[mds] 2023-12-12T23:59:01.280 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds = 20 2023-12-12T23:59:01.281 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds balancer = 20 2023-12-12T23:59:01.281 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-12-12T23:59:01.281 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug frag = True 2023-12-12T23:59:01.281 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug scatterstat = True 2023-12-12T23:59:01.281 INFO:teuthology.orchestra.run.smithi072.stdout: mds op complaint time = 180 2023-12-12T23:59:01.281 INFO:teuthology.orchestra.run.smithi072.stdout: mds valgrind exit = True 2023-12-12T23:59:01.281 INFO:teuthology.orchestra.run.smithi072.stdout: mds verify scatter = True 2023-12-12T23:59:01.281 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-12-12T23:59:01.281 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-12-12T23:59:01.281 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-12-12T23:59:01.282 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2023-12-12T23:59:01.282 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2023-12-12T23:59:01.282 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-12T23:59:01.282 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2023-12-12T23:59:01.282 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.282 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2023-12-12T23:59:01.282 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.282 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2023-12-12T23:59:01.282 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.282 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2023-12-12T23:59:01.283 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2023-12-12T23:59:01.283 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.283 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2023-12-12T23:59:01.283 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2023-12-12T23:59:01.283 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.283 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-12T23:59:01.283 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2023-12-12T23:59:01.283 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.283 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2023-12-12T23:59:01.283 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-12T23:59:01.283 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.283 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2023-12-12T23:59:01.284 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.284 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2023-12-12T23:59:01.284 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2023-12-12T23:59:01.284 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2023-12-12T23:59:01.284 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2023-12-12T23:59:01.284 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2023-12-12T23:59:01.284 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2023-12-12T23:59:01.284 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2023-12-12T23:59:01.284 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-12T23:59:01.284 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-12T23:59:01.284 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2023-12-12T23:59:01.284 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.284 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-12T23:59:01.285 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.285 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2023-12-12T23:59:01.285 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.285 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2023-12-12T23:59:01.285 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.285 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2023-12-12T23:59:01.285 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2023-12-12T23:59:01.285 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2023-12-12T23:59:01.285 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.72,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2023-12-12T23:59:01.285 INFO:teuthology.orchestra.run.smithi176.stdout: mds beacon grace = 60 2023-12-12T23:59:01.285 INFO:teuthology.orchestra.run.smithi176.stdout: mds heartbeat grace = 60 2023-12-12T23:59:01.285 INFO:teuthology.orchestra.run.smithi176.stdout: osd heartbeat grace = 60 2023-12-12T23:59:01.285 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = 37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d 2023-12-12T23:59:01.286 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.286 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2023-12-12T23:59:01.286 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2023-12-12T23:59:01.286 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.286 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2023-12-12T23:59:01.286 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2023-12-12T23:59:01.286 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2023-12-12T23:59:01.286 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.286 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2023-12-12T23:59:01.286 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2023-12-12T23:59:01.286 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.286 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2023-12-12T23:59:01.286 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2023-12-12T23:59:01.287 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2023-12-12T23:59:01.287 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug trim objects = true 2023-12-12T23:59:01.287 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.287 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2023-12-12T23:59:01.287 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2023-12-12T23:59:01.287 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.287 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2023-12-12T23:59:01.287 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.287 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2023-12-12T23:59:01.287 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.287 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2023-12-12T23:59:01.287 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.287 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2023-12-12T23:59:01.288 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2023-12-12T23:59:01.288 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.288 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2023-12-12T23:59:01.288 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2023-12-12T23:59:01.288 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2023-12-12T23:59:01.288 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2023-12-12T23:59:01.288 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 20 2023-12-12T23:59:01.288 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 20 2023-12-12T23:59:01.288 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-12-12T23:59:01.288 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2023-12-12T23:59:01.288 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 10 2023-12-12T23:59:01.288 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2023-12-12T23:59:01.288 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2023-12-12T23:59:01.289 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2023-12-12T23:59:01.289 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2023-12-12T23:59:01.289 INFO:teuthology.orchestra.run.smithi176.stdout: osd fast shutdown = False 2023-12-12T23:59:01.289 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2023-12-12T23:59:01.289 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2023-12-12T23:59:01.289 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.289 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2023-12-12T23:59:01.289 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-12-12T23:59:01.289 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2023-12-12T23:59:01.289 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2023-12-12T23:59:01.289 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2023-12-12T23:59:01.289 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2023-12-12T23:59:01.289 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2023-12-12T23:59:01.289 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2023-12-12T23:59:01.290 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.290 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2023-12-12T23:59:01.290 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-12-12T23:59:01.290 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2023-12-12T23:59:01.290 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2023-12-12T23:59:01.290 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2023-12-12T23:59:01.290 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2023-12-12T23:59:01.290 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2023-12-12T23:59:01.290 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2023-12-12T23:59:01.290 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2023-12-12T23:59:01.290 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2023-12-12T23:59:01.290 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2023-12-12T23:59:01.290 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.291 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-12T23:59:01.291 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2023-12-12T23:59:01.291 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2023-12-12T23:59:01.291 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.291 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2023-12-12T23:59:01.291 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-12T23:59:01.291 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-12T23:59:01.291 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.291 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2023-12-12T23:59:01.291 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2023-12-12T23:59:01.291 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.291 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2023-12-12T23:59:01.291 INFO:teuthology.orchestra.run.smithi176.stdout: mon op complaint time = 120 2023-12-12T23:59:01.291 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd crush smoke test = False 2023-12-12T23:59:01.292 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-12-12T23:59:01.292 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2023-12-12T23:59:01.292 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2023-12-12T23:59:01.292 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2023-12-12T23:59:01.292 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2023-12-12T23:59:01.292 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-12T23:59:01.292 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-12T23:59:01.292 INFO:teuthology.orchestra.run.smithi176.stdout: client mount timeout = 600 2023-12-12T23:59:01.292 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2023-12-12T23:59:01.292 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-12-12T23:59:01.292 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2023-12-12T23:59:01.292 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2023-12-12T23:59:01.292 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2023-12-12T23:59:01.293 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2023-12-12T23:59:01.293 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2023-12-12T23:59:01.293 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2023-12-12T23:59:01.293 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2023-12-12T23:59:01.293 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.e] 2023-12-12T23:59:01.293 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2023-12-12T23:59:01.293 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2023-12-12T23:59:01.293 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.f] 2023-12-12T23:59:01.293 INFO:teuthology.orchestra.run.smithi176.stdout:[mds] 2023-12-12T23:59:01.293 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds = 20 2023-12-12T23:59:01.293 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds balancer = 20 2023-12-12T23:59:01.293 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-12-12T23:59:01.293 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug frag = True 2023-12-12T23:59:01.293 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug scatterstat = True 2023-12-12T23:59:01.294 INFO:teuthology.orchestra.run.smithi176.stdout: mds op complaint time = 180 2023-12-12T23:59:01.294 INFO:teuthology.orchestra.run.smithi176.stdout: mds valgrind exit = True 2023-12-12T23:59:01.294 INFO:teuthology.orchestra.run.smithi176.stdout: mds verify scatter = True 2023-12-12T23:59:01.294 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2023-12-12T23:59:01.294 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2023-12-12T23:59:01.294 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2023-12-12T23:59:01.296 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-12T23:59:01.296 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-12T23:59:01.390 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-12T23:59:01.390 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:01.391 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-12T23:59:01.405 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:01.406 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-12T23:59:01.460 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2023-12-12T23:59:01.460 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:01.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-12T23:59:01.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-12T23:59:01.539 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:01.539 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-12T23:59:01.595 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi176.front.sepia.ceph.com 2023-12-12T23:59:01.595 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:59:01.595 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-12T23:59:01.595 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-12T23:59:01.634 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:59:01.634 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-12T23:59:01.689 INFO:tasks.ceph:Setting up mon nodes... 2023-12-12T23:59:01.689 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-12T23:59:01.689 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-12T23:59:01.744 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-12T23:59:01.746 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-12T23:59:01.814 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-12T23:59:01.816 INFO:tasks.ceph:Setting up mds nodes... 2023-12-12T23:59:01.817 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-12T23:59:01.871 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-12T23:59:01.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-12T23:59:01.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-12T23:59:01.994 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-12T23:59:01.997 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-12T23:59:02.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-12-12T23:59:02.121 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-12-12T23:59:02.123 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-12-12T23:59:02.150 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-12T23:59:02.204 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-12T23:59:02.207 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-12T23:59:02.233 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-12T23:59:02.328 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-12T23:59:02.330 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-12T23:59:02.357 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-12-12T23:59:02.451 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-12-12T23:59:02.454 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-12-12T23:59:02.480 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-12T23:59:02.480 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-12T23:59:02.523 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-12T23:59:02.538 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-12T23:59:02.538 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-12T23:59:02.539 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-12T23:59:02.605 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T23:59:02.605 INFO:tasks.ceph:role: osd.0 2023-12-12T23:59:02.605 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2023-12-12T23:59:02.606 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-12T23:59:02.679 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T23:59:02.680 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T23:59:02.680 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T23:59:02.680 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T23:59:02.680 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T23:59:02.680 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-12-12T23:59:02.680 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T23:59:02.680 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T23:59:02.680 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T23:59:02.680 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T23:59:03.199 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-12-12T23:59:03.201 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-12-12T23:59:03.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-12T23:59:03.324 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-12T23:59:03.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-12T23:59:03.424 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T23:59:03.424 INFO:tasks.ceph:role: osd.1 2023-12-12T23:59:03.424 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com 2023-12-12T23:59:03.424 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-12T23:59:03.499 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T23:59:03.499 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T23:59:03.499 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T23:59:03.499 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T23:59:03.499 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T23:59:03.499 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-12-12T23:59:03.499 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T23:59:03.499 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T23:59:03.499 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T23:59:03.499 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T23:59:03.954 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-12-12T23:59:03.956 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-12-12T23:59:03.956 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-12T23:59:04.049 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-12T23:59:04.080 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-12T23:59:04.146 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T23:59:04.147 INFO:tasks.ceph:role: osd.2 2023-12-12T23:59:04.147 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com 2023-12-12T23:59:04.147 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-12T23:59:04.221 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T23:59:04.221 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T23:59:04.221 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T23:59:04.221 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T23:59:04.221 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T23:59:04.221 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-12-12T23:59:04.221 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T23:59:04.221 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T23:59:04.221 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T23:59:04.221 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T23:59:04.711 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-12-12T23:59:04.713 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-12-12T23:59:04.713 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-12T23:59:04.863 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-12T23:59:04.895 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-12T23:59:04.962 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T23:59:04.962 INFO:tasks.ceph:role: osd.3 2023-12-12T23:59:04.962 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com 2023-12-12T23:59:04.962 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-12T23:59:05.036 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T23:59:05.036 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T23:59:05.036 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T23:59:05.036 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T23:59:05.036 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T23:59:05.036 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-12-12T23:59:05.036 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T23:59:05.036 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T23:59:05.037 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T23:59:05.037 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T23:59:05.555 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-12-12T23:59:05.556 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-12-12T23:59:05.557 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-12T23:59:05.701 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-12T23:59:05.734 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T23:59:05.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:05.831+0000 7fe852a0f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-12T23:59:05.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:05.832+0000 7fe852a0f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-12T23:59:05.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:05.832+0000 7fe852a0f500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-12T23:59:05.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:05.832+0000 7fe852a0f500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-12T23:59:05.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:05.832+0000 7fe852a0f500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-12T23:59:05.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:05.832+0000 7fe852a0f500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-12T23:59:08.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-12T23:59:08.720 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T23:59:08.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:08.808+0000 7ff2f8c12500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-12T23:59:08.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:08.808+0000 7ff2f8c12500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-12T23:59:08.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:08.808+0000 7ff2f8c12500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-12T23:59:08.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:08.808+0000 7ff2f8c12500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-12T23:59:08.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:08.808+0000 7ff2f8c12500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-12T23:59:08.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:08.808+0000 7ff2f8c12500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-12T23:59:11.651 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-12T23:59:11.682 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T23:59:11.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:11.772+0000 7f60cf038500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-12T23:59:11.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:11.772+0000 7f60cf038500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-12T23:59:11.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:11.772+0000 7f60cf038500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-12T23:59:11.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:11.772+0000 7f60cf038500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-12T23:59:11.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:11.772+0000 7f60cf038500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-12T23:59:11.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:11.773+0000 7f60cf038500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-12T23:59:14.623 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-12T23:59:14.654 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T23:59:14.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:14.744+0000 7fe933811500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-12T23:59:14.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:14.745+0000 7fe933811500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-12T23:59:14.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:14.745+0000 7fe933811500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-12T23:59:14.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:14.745+0000 7fe933811500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-12T23:59:14.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:14.745+0000 7fe933811500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-12T23:59:14.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:14.745+0000 7fe933811500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-12T23:59:17.590 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-12T23:59:17.620 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-12T23:59:17.652 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T23:59:17.652 INFO:tasks.ceph:role: osd.4 2023-12-12T23:59:17.652 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com 2023-12-12T23:59:17.652 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-12T23:59:17.730 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T23:59:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T23:59:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T23:59:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T23:59:17.731 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T23:59:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2023-12-12T23:59:17.731 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T23:59:17.731 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T23:59:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T23:59:17.731 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T23:59:18.243 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2023-12-12T23:59:18.245 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2023-12-12T23:59:18.245 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-12T23:59:18.389 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-12T23:59:18.426 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-12T23:59:18.499 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T23:59:18.499 INFO:tasks.ceph:role: osd.5 2023-12-12T23:59:18.499 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com 2023-12-12T23:59:18.499 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-12T23:59:18.574 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T23:59:18.574 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T23:59:18.574 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T23:59:18.574 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T23:59:18.574 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T23:59:18.575 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2023-12-12T23:59:18.575 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T23:59:18.575 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T23:59:18.575 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T23:59:18.575 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T23:59:19.024 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2023-12-12T23:59:19.026 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2023-12-12T23:59:19.026 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-12T23:59:19.120 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-12T23:59:19.152 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-12T23:59:19.219 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T23:59:19.219 INFO:tasks.ceph:role: osd.6 2023-12-12T23:59:19.219 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com 2023-12-12T23:59:19.220 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-12T23:59:19.293 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T23:59:19.294 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T23:59:19.294 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T23:59:19.294 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T23:59:19.294 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T23:59:19.294 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2023-12-12T23:59:19.294 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T23:59:19.294 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T23:59:19.294 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T23:59:19.295 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T23:59:19.786 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2023-12-12T23:59:19.788 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2023-12-12T23:59:19.788 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-12T23:59:19.927 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-12T23:59:19.959 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-12T23:59:20.026 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T23:59:20.026 INFO:tasks.ceph:role: osd.7 2023-12-12T23:59:20.027 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com 2023-12-12T23:59:20.027 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-12T23:59:20.101 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T23:59:20.101 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T23:59:20.101 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T23:59:20.101 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T23:59:20.101 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T23:59:20.101 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2023-12-12T23:59:20.102 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T23:59:20.102 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T23:59:20.102 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T23:59:20.102 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T23:59:20.613 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2023-12-12T23:59:20.615 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2023-12-12T23:59:20.616 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-12T23:59:20.770 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-12T23:59:20.803 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T23:59:20.906 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:20.905+0000 7f2123e16500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-12T23:59:20.906 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:20.905+0000 7f2123e16500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-12T23:59:20.906 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:20.905+0000 7f2123e16500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-12T23:59:20.907 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:20.905+0000 7f2123e16500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-12T23:59:20.907 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:20.905+0000 7f2123e16500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-12T23:59:20.907 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:20.906+0000 7f2123e16500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-12T23:59:23.758 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-12T23:59:23.785 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T23:59:23.872 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:23.872+0000 7fc368412500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-12T23:59:23.873 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:23.872+0000 7fc368412500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-12T23:59:23.873 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:23.872+0000 7fc368412500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-12T23:59:23.873 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:23.872+0000 7fc368412500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-12T23:59:23.873 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:23.872+0000 7fc368412500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-12T23:59:23.873 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:23.873+0000 7fc368412500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-12T23:59:26.715 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-12T23:59:26.746 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T23:59:26.835 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:26.835+0000 7f7b28422500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-12T23:59:26.836 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:26.836+0000 7f7b28422500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-12T23:59:26.836 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:26.836+0000 7f7b28422500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-12T23:59:26.836 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:26.836+0000 7f7b28422500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-12T23:59:26.836 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:26.836+0000 7f7b28422500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-12T23:59:26.836 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:26.836+0000 7f7b28422500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-12T23:59:29.274 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T23:59:29.276 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T23:59:29.680 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-12T23:59:29.710 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T23:59:29.797 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:29.797+0000 7fad61825500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-12T23:59:29.797 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:29.797+0000 7fad61825500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-12T23:59:29.797 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:29.797+0000 7fad61825500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-12T23:59:29.797 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:29.797+0000 7fad61825500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-12T23:59:29.798 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:29.797+0000 7fad61825500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-12T23:59:29.798 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:29.798+0000 7fad61825500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-12T23:59:32.649 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-12T23:59:32.680 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-12T23:59:32.680 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:32.680 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-12T23:59:32.712 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:32.712 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-12T23:59:32.782 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:32.782 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-12T23:59:32.852 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:32.852 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-12-12T23:59:32.921 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:32.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-12T23:59:32.989 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:32.989 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-12T23:59:33.056 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:33.056 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-12T23:59:33.123 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:33.123 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-12T23:59:33.190 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:59:33.191 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-12T23:59:33.225 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:59:33.225 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-12T23:59:33.293 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:59:33.293 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-12T23:59:33.363 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:59:33.363 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-12-12T23:59:33.431 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:59:33.431 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-12T23:59:33.498 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:59:33.498 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-12T23:59:33.566 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:59:33.566 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-12T23:59:33.634 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:59:33.634 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-12T23:59:33.702 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:33.703 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-12T23:59:33.717 INFO:tasks.ceph:Adding keys to all mons... 2023-12-12T23:59:33.718 DEBUG:teuthology.orchestra.run.smithi072:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-12T23:59:33.760 DEBUG:teuthology.orchestra.run.smithi176:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-12T23:59:33.782 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.y] 2023-12-12T23:59:33.782 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDF83hl7WlkLBAAmqBfctWZ+8f+e72IcLQ8bQ== 2023-12-12T23:59:33.783 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-12-12T23:59:33.783 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDF83hlWLUCNBAAGlpwHcBFL8n+E9S/poceNg== 2023-12-12T23:59:33.783 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2023-12-12T23:59:33.783 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDF83hlq6BTOxAA4ilpgaURj3cuRw9RwwDrgg== 2023-12-12T23:59:33.783 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.e] 2023-12-12T23:59:33.783 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDG83hlRA5KBxAAXgs1rSvx6OF7A2JqXCdFEQ== 2023-12-12T23:59:33.783 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.0] 2023-12-12T23:59:33.783 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDJ83hl1JapMRAAuPN/ZE2JGh9v8/KCjaBVPA== 2023-12-12T23:59:33.783 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.1] 2023-12-12T23:59:33.783 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDM83hlty48MBAAag4hMmRytdW6xVBGjozESw== 2023-12-12T23:59:33.783 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.2] 2023-12-12T23:59:33.783 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDP83hlKlgdLhAADqXOwuVJH980oVCrDitMvQ== 2023-12-12T23:59:33.783 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.3] 2023-12-12T23:59:33.784 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDS83hlo+x2LBAAak1zHxS0vOtmP9UJFQ13ww== 2023-12-12T23:59:33.784 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.x] 2023-12-12T23:59:33.784 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDF83hlqlqTMBAAkRcTzx4E7CbddG5yQApQVA== 2023-12-12T23:59:33.784 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2023-12-12T23:59:33.784 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDG83hlaHVCDBAAfSJeLYGzVJ6PDXyslmT0jw== 2023-12-12T23:59:33.784 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2023-12-12T23:59:33.784 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDG83hlTZebExAABcznXq0gydTSg4fW83IfGA== 2023-12-12T23:59:33.784 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.f] 2023-12-12T23:59:33.784 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDG83hl5P75GhAAB2Tg526v0epM5SzKWurSiA== 2023-12-12T23:59:33.784 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.4] 2023-12-12T23:59:33.784 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDY83hl098LNhAA8v6ZsMMoeI/zKX7dD7m8qA== 2023-12-12T23:59:33.784 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.5] 2023-12-12T23:59:33.784 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDb83hlVUsJNBAAq1f7aGkfc24Q3RViNPGHbQ== 2023-12-12T23:59:33.784 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.6] 2023-12-12T23:59:33.784 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDe83hledrXMRAAgbVLf7X10gdKURF48MZEXg== 2023-12-12T23:59:33.785 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.7] 2023-12-12T23:59:33.785 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDh83hl5amLLxAAwJ6cQKwPT3XCEMIg3wb5RQ== 2023-12-12T23:59:33.785 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2023-12-12T23:59:33.785 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDG83hl0LpBHxAAFG2NDusvpy5HtvcOZbgmlA== 2023-12-12T23:59:33.785 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.y] 2023-12-12T23:59:33.785 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDF83hl7WlkLBAAmqBfctWZ+8f+e72IcLQ8bQ== 2023-12-12T23:59:33.785 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2023-12-12T23:59:33.785 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDF83hlWLUCNBAAGlpwHcBFL8n+E9S/poceNg== 2023-12-12T23:59:33.785 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2023-12-12T23:59:33.786 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDF83hlq6BTOxAA4ilpgaURj3cuRw9RwwDrgg== 2023-12-12T23:59:33.786 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.e] 2023-12-12T23:59:33.786 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDG83hlRA5KBxAAXgs1rSvx6OF7A2JqXCdFEQ== 2023-12-12T23:59:33.786 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.0] 2023-12-12T23:59:33.786 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDJ83hl1JapMRAAuPN/ZE2JGh9v8/KCjaBVPA== 2023-12-12T23:59:33.786 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.1] 2023-12-12T23:59:33.786 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDM83hlty48MBAAag4hMmRytdW6xVBGjozESw== 2023-12-12T23:59:33.786 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.2] 2023-12-12T23:59:33.786 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDP83hlKlgdLhAADqXOwuVJH980oVCrDitMvQ== 2023-12-12T23:59:33.786 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.3] 2023-12-12T23:59:33.786 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDS83hlo+x2LBAAak1zHxS0vOtmP9UJFQ13ww== 2023-12-12T23:59:33.786 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.x] 2023-12-12T23:59:33.787 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDF83hlqlqTMBAAkRcTzx4E7CbddG5yQApQVA== 2023-12-12T23:59:33.787 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2023-12-12T23:59:33.787 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDG83hlaHVCDBAAfSJeLYGzVJ6PDXyslmT0jw== 2023-12-12T23:59:33.787 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2023-12-12T23:59:33.787 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDG83hlTZebExAABcznXq0gydTSg4fW83IfGA== 2023-12-12T23:59:33.787 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.f] 2023-12-12T23:59:33.787 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDG83hl5P75GhAAB2Tg526v0epM5SzKWurSiA== 2023-12-12T23:59:33.787 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.4] 2023-12-12T23:59:33.787 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDY83hl098LNhAA8v6ZsMMoeI/zKX7dD7m8qA== 2023-12-12T23:59:33.787 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.5] 2023-12-12T23:59:33.787 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDb83hlVUsJNBAAq1f7aGkfc24Q3RViNPGHbQ== 2023-12-12T23:59:33.787 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.6] 2023-12-12T23:59:33.787 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDe83hledrXMRAAgbVLf7X10gdKURF48MZEXg== 2023-12-12T23:59:33.787 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.7] 2023-12-12T23:59:33.787 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDh83hl5amLLxAAwJ6cQKwPT3XCEMIg3wb5RQ== 2023-12-12T23:59:33.788 INFO:teuthology.orchestra.run.smithi176.stdout:[client.0] 2023-12-12T23:59:33.788 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDG83hl0LpBHxAAFG2NDusvpy5HtvcOZbgmlA== 2023-12-12T23:59:33.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-12T23:59:33.831 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-12T23:59:33.882 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T23:59:33.885 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T23:59:33.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T23:59:33.941 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T23:59:33.995 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T23:59:33.997 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T23:59:34.052 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T23:59:34.053 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T23:59:34.104 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T23:59:34.106 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T23:59:34.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T23:59:34.160 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T23:59:34.211 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T23:59:34.213 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T23:59:34.264 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-12T23:59:34.266 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-12T23:59:34.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T23:59:34.319 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T23:59:34.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T23:59:34.375 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T23:59:34.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T23:59:34.431 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T23:59:34.485 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T23:59:34.488 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T23:59:34.539 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T23:59:34.542 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T23:59:34.593 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T23:59:34.595 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T23:59:34.646 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T23:59:34.648 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T23:59:34.699 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T23:59:34.701 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T23:59:34.755 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-12T23:59:34.756 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-12T23:59:34.782 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-12T23:59:34.879 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-12T23:59:34.905 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-12T23:59:34.932 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-12T23:59:35.028 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-12T23:59:35.055 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-12T23:59:35.122 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-12T23:59:35.219 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-12T23:59:35.245 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-12T23:59:35.248 DEBUG:teuthology.orchestra.run.smithi176:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-12T23:59:35.299 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-12T23:59:35.300 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-12T23:59:35.300 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-12T23:59:35.300 DEBUG:teuthology.orchestra.run.smithi072:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2023-12-12T23:59:35.303 INFO:tasks.ceph.mon.a:Started 2023-12-12T23:59:35.303 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-12T23:59:35.303 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-12T23:59:35.303 DEBUG:teuthology.orchestra.run.smithi176:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2023-12-12T23:59:35.342 INFO:tasks.ceph.mon.b:Started 2023-12-12T23:59:35.342 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-12T23:59:35.342 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-12T23:59:35.342 DEBUG:teuthology.orchestra.run.smithi176:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2023-12-12T23:59:35.344 INFO:tasks.ceph.mon.c:Started 2023-12-12T23:59:35.344 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-12T23:59:35.345 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-12T23:59:35.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2023-12-12T23:59:35.347 INFO:tasks.ceph.mgr.y:Started 2023-12-12T23:59:35.347 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-12T23:59:35.347 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2023-12-12T23:59:35.349 INFO:tasks.ceph.mgr.x:Started 2023-12-12T23:59:35.349 INFO:tasks.ceph:Setting crush tunables to default 2023-12-12T23:59:35.349 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd crush tunables default 2023-12-12T23:59:35.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:35.448+0000 7f93abecf640 1 Processor -- start 2023-12-12T23:59:35.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:35.448+0000 7f93abecf640 1 -- start start 2023-12-12T23:59:35.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:35.449+0000 7f93abecf640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93a40c7650 0x7f93a415a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:35.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:35.449+0000 7f93abecf640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f93a41560f0 0x7f93a40c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:35.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:35.449+0000 7f93abecf640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a4159dd0 con 0x7f93a40c7a30 2023-12-12T23:59:35.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:35.449+0000 7f93abecf640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a4156560 con 0x7f93a40c7650 2023-12-12T23:59:35.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:35.449+0000 7f93abecf640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a40c5cc0 con 0x7f93a41560f0 2023-12-12T23:59:35.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:35.449+0000 7f93a9c6b640 1 -- >> v2:172.21.15.72:3300/0 conn(0x7f93a40c7650 msgr2=0x7f93a415a260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.72:3300/0 2023-12-12T23:59:35.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:35.449+0000 7f93a9c6b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93a40c7650 0x7f93a415a260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T23:59:35.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:35.449+0000 7f93a946a640 1 -- >> v1:172.21.15.72:6789/0 conn(0x7f93a40c7a30 legacy=0x7f93a40c6c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.72:6789/0 2023-12-12T23:59:35.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:35.449+0000 7f93aa46c640 1 -- >> v2:172.21.15.176:3300/0 conn(0x7f93a41560f0 msgr2=0x7f93a40c53c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.176:3300/0 2023-12-12T23:59:35.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:35.449+0000 7f93aa46c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f93a41560f0 0x7f93a40c53c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T23:59:35.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:35.650+0000 7f93a946a640 1 -- >> v1:172.21.15.72:6789/0 conn(0x7f93a40c7a30 legacy=0x7f93a40c6c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.72:6789/0 2023-12-12T23:59:35.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:35.650+0000 7f93a9c6b640 1 -- >> v2:172.21.15.72:3300/0 conn(0x7f93a40c7650 msgr2=0x7f93a415a260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.72:3300/0 2023-12-12T23:59:35.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:35.650+0000 7f93a9c6b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93a40c7650 0x7f93a415a260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T23:59:35.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:35.650+0000 7f93aa46c640 1 -- >> v2:172.21.15.176:3300/0 conn(0x7f93a41560f0 msgr2=0x7f93a40c53c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.176:3300/0 2023-12-12T23:59:35.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:35.650+0000 7f93aa46c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f93a41560f0 0x7f93a40c53c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T23:59:36.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:36.051+0000 7f93a946a640 1 -- >> v1:172.21.15.72:6789/0 conn(0x7f93a40c7a30 legacy=0x7f93a40c6c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.72:6789/0 2023-12-12T23:59:36.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:36.051+0000 7f93a9c6b640 1 -- >> v2:172.21.15.72:3300/0 conn(0x7f93a40c7650 msgr2=0x7f93a415a260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.72:3300/0 2023-12-12T23:59:36.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:36.051+0000 7f93a9c6b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93a40c7650 0x7f93a415a260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-12T23:59:36.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:36.051+0000 7f93aa46c640 1 -- >> v2:172.21.15.176:3300/0 conn(0x7f93a41560f0 msgr2=0x7f93a40c53c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.176:3300/0 2023-12-12T23:59:36.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:36.051+0000 7f93aa46c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f93a41560f0 0x7f93a40c53c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-12T23:59:36.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:36.852+0000 7f93a946a640 1 -- >> v1:172.21.15.72:6789/0 conn(0x7f93a40c7a30 legacy=0x7f93a40c6c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.72:6789/0 2023-12-12T23:59:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:36.852+0000 7f93a9c6b640 1 -- >> v2:172.21.15.72:3300/0 conn(0x7f93a40c7650 msgr2=0x7f93a415a260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.72:3300/0 2023-12-12T23:59:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:36.852+0000 7f93a9c6b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93a40c7650 0x7f93a415a260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-12T23:59:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:36.852+0000 7f93aa46c640 1 -- >> v2:172.21.15.176:3300/0 conn(0x7f93a41560f0 msgr2=0x7f93a40c53c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.176:3300/0 2023-12-12T23:59:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:36.852+0000 7f93aa46c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f93a41560f0 0x7f93a40c53c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-12T23:59:38.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:38.449+0000 7f939b7fe640 1 -- >> v2:172.21.15.176:3300/0 conn(0x7f93a41560f0 msgr2=0x7f93a40c53c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T23:59:38.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:38.449+0000 7f939b7fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f93a41560f0 0x7f93a40c53c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:38.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:38.449+0000 7f939b7fe640 1 -- >> v2:172.21.15.72:3300/0 conn(0x7f93a40c7650 msgr2=0x7f93a415a260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T23:59:38.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:38.449+0000 7f939b7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93a40c7650 0x7f93a415a260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:38.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:38.449+0000 7f939b7fe640 1 -- >> v1:172.21.15.72:6789/0 conn(0x7f93a40c7a30 legacy=0x7f93a40c6c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T23:59:38.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:38.449+0000 7f939b7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880058a0 0x7f9388007cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:38.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:38.449+0000 7f939b7fe640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a40c6260 con 0x7f9388008330 2023-12-12T23:59:38.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:38.449+0000 7f939b7fe640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4156560 con 0x7f93880058a0 2023-12-12T23:59:38.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:38.449+0000 7f93a9c6b640 1 -- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880058a0 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.176:3301/0 2023-12-12T23:59:38.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:38.449+0000 7f93a9c6b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880058a0 0x7f9388007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T23:59:38.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:38.449+0000 7f93a946a640 1 -- >> v1:172.21.15.176:6789/0 conn(0x7f9388008330 legacy=0x7f938800a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.176:6789/0 2023-12-12T23:59:38.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:38.650+0000 7f93a946a640 1 -- >> v1:172.21.15.176:6789/0 conn(0x7f9388008330 legacy=0x7f938800a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.176:6789/0 2023-12-12T23:59:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:38.650+0000 7f93a9c6b640 1 -- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880058a0 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.176:3301/0 2023-12-12T23:59:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:38.650+0000 7f93a9c6b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880058a0 0x7f9388007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T23:59:39.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:39.051+0000 7f93a9c6b640 1 -- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880058a0 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.176:3301/0 2023-12-12T23:59:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:39.051+0000 7f93a946a640 1 -- >> v1:172.21.15.176:6789/0 conn(0x7f9388008330 legacy=0x7f938800a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.176:6789/0 2023-12-12T23:59:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:39.051+0000 7f93a9c6b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880058a0 0x7f9388007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-12T23:59:39.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:39.852+0000 7f93a946a640 1 -- >> v1:172.21.15.176:6789/0 conn(0x7f9388008330 legacy=0x7f938800a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.176:6789/0 2023-12-12T23:59:39.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:39.852+0000 7f93a9c6b640 1 -- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880058a0 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.176:3301/0 2023-12-12T23:59:39.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:39.852+0000 7f93a9c6b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880058a0 0x7f9388007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-12T23:59:41.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:41.450+0000 7f939b7fe640 1 -- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880058a0 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T23:59:41.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:41.450+0000 7f939b7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880058a0 0x7f9388007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:41.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:41.450+0000 7f939b7fe640 1 -- >> v1:172.21.15.176:6789/0 conn(0x7f9388008330 legacy=0x7f938800a7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T23:59:41.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:41.450+0000 7f93aa46c640 1 -- reap_dead start 2023-12-12T23:59:41.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:41.450+0000 7f939b7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c0b0 0x7f9388007cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:41.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:41.450+0000 7f939b7fe640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a4159dd0 con 0x7f938800c580 2023-12-12T23:59:41.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:41.450+0000 7f939b7fe640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a40c6260 con 0x7f938800caa0 2023-12-12T23:59:41.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:41.450+0000 7f939b7fe640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4156560 con 0x7f938800c0b0 2023-12-12T23:59:41.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:41.450+0000 7f93a946a640 1 -- >> v1:172.21.15.72:6789/0 conn(0x7f938800c580 legacy=0x7f938800a770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.72:6789/0 2023-12-12T23:59:41.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:41.450+0000 7f93a9c6b640 1 -- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c0b0 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.176:3301/0 2023-12-12T23:59:41.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:41.450+0000 7f93a9c6b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c0b0 0x7f9388007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T23:59:41.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:41.450+0000 7f93aa46c640 1 -- >> v1:172.21.15.176:6789/0 conn(0x7f938800caa0 legacy=0x7f938800f2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.176:6789/0 2023-12-12T23:59:41.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:41.651+0000 7f93a946a640 1 -- >> v1:172.21.15.72:6789/0 conn(0x7f938800c580 legacy=0x7f938800a770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.72:6789/0 2023-12-12T23:59:41.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:41.651+0000 7f93aa46c640 1 -- >> v1:172.21.15.176:6789/0 conn(0x7f938800caa0 legacy=0x7f938800f2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.176:6789/0 2023-12-12T23:59:41.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:41.651+0000 7f93a9c6b640 1 -- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c0b0 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.176:3301/0 2023-12-12T23:59:41.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:41.651+0000 7f93a9c6b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c0b0 0x7f9388007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T23:59:42.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:42.052+0000 7f93a946a640 1 -- >> v1:172.21.15.72:6789/0 conn(0x7f938800c580 legacy=0x7f938800a770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.72:6789/0 2023-12-12T23:59:42.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:42.052+0000 7f93a9c6b640 1 -- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c0b0 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.176:3301/0 2023-12-12T23:59:42.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:42.052+0000 7f93aa46c640 1 -- >> v1:172.21.15.176:6789/0 conn(0x7f938800caa0 legacy=0x7f938800f2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.176:6789/0 2023-12-12T23:59:42.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:42.052+0000 7f93a9c6b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c0b0 0x7f9388007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-12T23:59:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:42.853+0000 7f93a946a640 1 -- >> v1:172.21.15.72:6789/0 conn(0x7f938800c580 legacy=0x7f938800a770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.72:6789/0 2023-12-12T23:59:42.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:42.853+0000 7f93aa46c640 1 -- >> v1:172.21.15.176:6789/0 conn(0x7f938800caa0 legacy=0x7f938800f2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.176:6789/0 2023-12-12T23:59:42.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:42.853+0000 7f93a9c6b640 1 -- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c0b0 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.176:3301/0 2023-12-12T23:59:42.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:42.853+0000 7f93a9c6b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c0b0 0x7f9388007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-12T23:59:42.905 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:00:07.445 88575== Warning: unimplemented fcntl command: 1036 2023-12-12T23:59:43.216 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:00:07.756 88575== Warning: unimplemented fcntl command: 1036 2023-12-12T23:59:43.303 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:00:07.837 88391== Warning: unimplemented fcntl command: 1036 2023-12-12T23:59:43.304 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:00:07.838 88390== Warning: unimplemented fcntl command: 1036 2023-12-12T23:59:43.627 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:00:08.161 88391== Warning: unimplemented fcntl command: 1036 2023-12-12T23:59:43.630 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:00:08.163 88390== Warning: unimplemented fcntl command: 1036 2023-12-12T23:59:44.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.450+0000 7f939b7fe640 1 -- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c0b0 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T23:59:44.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.450+0000 7f939b7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c0b0 0x7f9388007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:44.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.450+0000 7f939b7fe640 1 -- >> v1:172.21.15.176:6789/0 conn(0x7f938800caa0 legacy=0x7f938800f2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T23:59:44.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.450+0000 7f939b7fe640 1 -- >> v1:172.21.15.72:6789/0 conn(0x7f938800c580 legacy=0x7f938800a770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T23:59:44.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.450+0000 7f939b7fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9388011b40 0x7f9388011f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:44.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.450+0000 7f939b7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 0x7f9388010a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:44.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.450+0000 7f939b7fe640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a4156560 con 0x7f9388012620 2023-12-12T23:59:44.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.450+0000 7f939b7fe640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a40c5cc0 con 0x7f9388011b40 2023-12-12T23:59:44.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.450+0000 7f93a9c6b640 1 -- >> v2:172.21.15.176:3300/0 conn(0x7f9388011b40 msgr2=0x7f9388011f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.176:3300/0 2023-12-12T23:59:44.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.450+0000 7f93a9c6b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9388011b40 0x7f9388011f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T23:59:44.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.651+0000 7f93a9c6b640 1 -- >> v2:172.21.15.176:3300/0 conn(0x7f9388011b40 msgr2=0x7f9388011f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.176:3300/0 2023-12-12T23:59:44.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.651+0000 7f93a9c6b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9388011b40 0x7f9388011f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T23:59:44.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.684+0000 7f93a946a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 0x7f9388010a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:44.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.699+0000 7f93a946a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 0x7f9388010a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45692/0 (socket says 172.21.15.72:45692) 2023-12-12T23:59:44.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.699+0000 7f93a946a640 1 -- 172.21.15.72:0/2513963155 learned_addr learned my addr 172.21.15.72:0/2513963155 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-12T23:59:44.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.730+0000 7f93a946a640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T23:59:44.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.730+0000 7f93a946a640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:44.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.730+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 0x7f9388010a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:44.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.730+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 0x7f9388010a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T23:59:44.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.931+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 0x7f9388010a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:44.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.932+0000 7f93a946a640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T23:59:44.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.932+0000 7f93a946a640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:44.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.932+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 0x7f9388010a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:44.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:44.932+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 0x7f9388010a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T23:59:45.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:45.174+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011b40 0x7f9388011f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:45.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:45.216+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011b40 msgr2=0x7f9388011f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T23:59:45.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:45.216+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011b40 msgr2=0x7f9388011f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:45.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:45.216+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011b40 0x7f9388011f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:45.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:45.217+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011b40 0x7f9388011f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-12T23:59:45.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:45.333+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 0x7f9388010a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:45.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:45.334+0000 7f93a946a640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T23:59:45.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:45.334+0000 7f93a946a640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:45.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:45.334+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 0x7f9388010a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:45.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:45.334+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 0x7f9388010a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-12T23:59:46.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:46.081+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011b40 0x7f9388011f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:46.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:46.082+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011b40 msgr2=0x7f9388011f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T23:59:46.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:46.082+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011b40 msgr2=0x7f9388011f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:46.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:46.082+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011b40 0x7f9388011f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:46.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:46.082+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011b40 0x7f9388011f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-12T23:59:46.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:46.178+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 0x7f9388010a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:46.312+0000 7f93a946a640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T23:59:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:46.312+0000 7f93a946a640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:46.312+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 0x7f9388010a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:46.312+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 0x7f9388010a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-12T23:59:47.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.450+0000 7f939b7fe640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011b40 msgr2=0x7f9388011f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T23:59:47.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.450+0000 7f939b7fe640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011b40 0x7f9388011f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:47.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.450+0000 7f939b7fe640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T23:59:47.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.450+0000 7f939b7fe640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f9388012620 0x7f9388010a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:47.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.451+0000 7f93aa46c640 1 -- 172.21.15.72:0/2513963155 reap_dead start 2023-12-12T23:59:47.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.451+0000 7f939b7fe640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 0x7f9388010a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:47.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.451+0000 7f939b7fe640 1 -- 172.21.15.72:0/2513963155 --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9388012bd0 con 0x7f938800caa0 2023-12-12T23:59:47.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.451+0000 7f939b7fe640 1 -- 172.21.15.72:0/2513963155 --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a4159dd0 con 0x7f938800c060 2023-12-12T23:59:47.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.451+0000 7f939b7fe640 1 -- 172.21.15.72:0/2513963155 --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a4156560 con 0x7f938800c580 2023-12-12T23:59:47.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.451+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 0x7f9388010a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:47.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.453+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T23:59:47.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.453+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:47.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.453+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 0x7f9388010a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:47.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.453+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 0x7f9388010a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T23:59:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.654+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 0x7f9388010a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.655+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T23:59:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.655+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.655+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 0x7f9388010a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:47.655+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 0x7f9388010a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T23:59:48.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:48.056+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 0x7f9388010a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:48.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:48.057+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T23:59:48.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:48.057+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:48.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:48.057+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 0x7f9388010a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:48.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:48.057+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 0x7f9388010a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-12T23:59:48.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:48.859+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 0x7f9388010a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:48.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:48.860+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T23:59:48.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:48.860+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:48.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:48.860+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 0x7f9388010a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:48.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:48.860+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 0x7f9388010a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-12T23:59:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.450+0000 7f939b7fe640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 msgr2=0x7f9388010a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T23:59:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.450+0000 7f939b7fe640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.72:3300/0 conn(0x7f938800c580 0x7f9388010a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.450+0000 7f939b7fe640 1 -- 172.21.15.72:0/2513963155 >> v1:172.21.15.176:6789/0 conn(0x7f938800c060 legacy=0x7f9388011070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.450+0000 7f939b7fe640 1 -- 172.21.15.72:0/2513963155 >> v1:172.21.15.72:6789/0 conn(0x7f938800caa0 legacy=0x7f938800a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.450+0000 7f939b7fe640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 0x7f9388007cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.450+0000 7f939b7fe640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.450+0000 7f939b7fe640 1 -- 172.21.15.72:0/2513963155 --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a4156560 con 0x7f9388011f20 2023-12-12T23:59:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.450+0000 7f939b7fe640 1 -- 172.21.15.72:0/2513963155 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a40c5cc0 con 0x7f93880102d0 2023-12-12T23:59:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.451+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.452+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 0x7f9388007cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.452+0000 7f93a946a640 1 -- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 msgr2=0x7f9388016e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T23:59:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.452+0000 7f93a946a640 1 -- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 msgr2=0x7f9388016e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.452+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.452+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T23:59:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.453+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T23:59:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.453+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.453+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 0x7f9388007cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.453+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 0x7f9388007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T23:59:50.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.653+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:50.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.654+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 0x7f9388007cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:50.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.654+0000 7f93a946a640 1 -- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 msgr2=0x7f9388016e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T23:59:50.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.654+0000 7f93a946a640 1 -- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 msgr2=0x7f9388016e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:50.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.654+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:50.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.654+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T23:59:50.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.655+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T23:59:50.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.655+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:50.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.655+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 0x7f9388007cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:50.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:50.655+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 0x7f9388007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T23:59:51.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.055+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:51.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.057+0000 7f93a946a640 1 -- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 msgr2=0x7f9388016e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T23:59:51.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.057+0000 7f93a946a640 1 -- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 msgr2=0x7f9388016e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:51.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.057+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 0x7f9388007cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:51.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.057+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:51.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.057+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-12T23:59:51.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.058+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T23:59:51.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.058+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:51.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.058+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 0x7f9388007cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:51.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.058+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 0x7f9388007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-12T23:59:51.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.858+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:51.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.859+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 0x7f9388007cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:51.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.859+0000 7f93a946a640 1 -- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 msgr2=0x7f9388016e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T23:59:51.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.859+0000 7f93a946a640 1 -- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 msgr2=0x7f9388016e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:51.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.859+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:51.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.859+0000 7f93a946a640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-12T23:59:51.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.860+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T23:59:51.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.860+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T23:59:51.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.860+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 0x7f9388007cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T23:59:51.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:51.860+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 0x7f9388007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-12T23:59:53.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.450+0000 7f939b7fe640 1 -- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 msgr2=0x7f9388016e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T23:59:53.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.450+0000 7f939b7fe640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:53.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.450+0000 7f939b7fe640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 msgr2=0x7f9388007cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T23:59:53.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.450+0000 7f939b7fe640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f9388011f20 0x7f9388007cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:53.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.450+0000 7f93aa46c640 1 -- 172.21.15.72:0/2513963155 reap_dead start 2023-12-12T23:59:53.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.450+0000 7f939b7fe640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:53.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.450+0000 7f939b7fe640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f938800c580 0x7f9388007c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:53.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.450+0000 7f939b7fe640 1 -- 172.21.15.72:0/2513963155 --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a40c6260 con 0x7f938800c060 2023-12-12T23:59:53.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.450+0000 7f939b7fe640 1 -- 172.21.15.72:0/2513963155 --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a4156560 con 0x7f938800c580 2023-12-12T23:59:53.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.450+0000 7f939b7fe640 1 -- 172.21.15.72:0/2513963155 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a40c5cc0 con 0x7f93880102d0 2023-12-12T23:59:53.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.500+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.502+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f938800c580 msgr2=0x7f9388007c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T23:59:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.502+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f938800c580 0x7f9388007c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.503+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 >> v1:172.21.15.176:6789/0 conn(0x7f938800c060 legacy=0x7f9388010a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T23:59:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.503+0000 7f93a9c6b640 1 -- 172.21.15.72:0/2513963155 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938800c9e0 con 0x7f93880102d0 2023-12-12T23:59:53.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.506+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9394006fd0 tx=0x7f939402d5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d00bd4fe318612e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:53.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.544+0000 7f93a8c69640 1 -- 172.21.15.72:0/2513963155 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9394036410 con 0x7f93880102d0 2023-12-12T23:59:53.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.544+0000 7f93a8c69640 1 -- 172.21.15.72:0/2513963155 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9394030030 con 0x7f93880102d0 2023-12-12T23:59:53.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.544+0000 7f93a8c69640 1 -- 172.21.15.72:0/2513963155 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93940367b0 con 0x7f93880102d0 2023-12-12T23:59:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.545+0000 7f93abecf640 1 -- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 msgr2=0x7f9388016e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.545+0000 7f93abecf640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9394006fd0 tx=0x7f939402d5e0 comp rx=0 tx=0).stop 2023-12-12T23:59:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.545+0000 7f93abecf640 1 -- 172.21.15.72:0/2513963155 shutdown_connections 2023-12-12T23:59:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.545+0000 7f93abecf640 1 --2- 172.21.15.72:0/2513963155 >> v2:172.21.15.176:3300/0 conn(0x7f938800c580 0x7f9388007c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.545+0000 7f93abecf640 1 --2- 172.21.15.72:0/2513963155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93880102d0 0x7f9388016e20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.545+0000 7f93abecf640 1 -- 172.21.15.72:0/2513963155 >> 172.21.15.72:0/2513963155 conn(0x7f93a406c5f0 msgr2=0x7f93a406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.545+0000 7f93abecf640 1 -- 172.21.15.72:0/2513963155 shutdown_connections 2023-12-12T23:59:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.545+0000 7f93abecf640 1 -- 172.21.15.72:0/2513963155 wait complete. 2023-12-12T23:59:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.546+0000 7f93abecf640 1 Processor -- start 2023-12-12T23:59:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.546+0000 7f93abecf640 1 -- start start 2023-12-12T23:59:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.547+0000 7f93abecf640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938800c060 0x7f93a4072210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.547+0000 7f93abecf640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c580 0x7f93a41ef040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.547+0000 7f93abecf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93880102d0 0x7f93a4145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.547+0000 7f93abecf640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a41f2f10 con 0x7f93880102d0 2023-12-12T23:59:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.547+0000 7f93abecf640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a41f2650 con 0x7f938800c060 2023-12-12T23:59:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.547+0000 7f93abecf640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a414cb90 con 0x7f938800c580 2023-12-12T23:59:53.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.554+0000 7f93a946a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c580 0x7f93a41ef040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:53.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.555+0000 7f93a946a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c580 0x7f93a41ef040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:45560/0 (socket says 172.21.15.72:45560) 2023-12-12T23:59:53.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.555+0000 7f93a946a640 1 -- 172.21.15.72:0/829223805 learned_addr learned my addr 172.21.15.72:0/829223805 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-12T23:59:53.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.558+0000 7f93a9c6b640 1 --2- 172.21.15.72:0/829223805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938800c060 0x7f93a4072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:53.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.567+0000 7f93a946a640 1 -- 172.21.15.72:0/829223805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938800c060 msgr2=0x7f93a4072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:53.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.567+0000 7f93a946a640 1 --2- 172.21.15.72:0/829223805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938800c060 0x7f93a4072210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:53.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.567+0000 7f93a946a640 1 -- 172.21.15.72:0/829223805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93880102d0 msgr2=0x7f93a4145130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:53.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.567+0000 7f93a946a640 1 --2- 172.21.15.72:0/829223805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93880102d0 0x7f93a4145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:53.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.567+0000 7f93a946a640 1 -- 172.21.15.72:0/829223805 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939400e040 con 0x7f938800c580 2023-12-12T23:59:53.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.575+0000 7f93a946a640 1 --2- 172.21.15.72:0/829223805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c580 0x7f93a41ef040 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f93a001ad80 tx=0x7f93a0018790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:53.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.586+0000 7f939a7fc640 1 -- 172.21.15.72:0/829223805 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a000e050 con 0x7f938800c580 2023-12-12T23:59:53.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.586+0000 7f939a7fc640 1 -- 172.21.15.72:0/829223805 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a000a250 con 0x7f938800c580 2023-12-12T23:59:53.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.586+0000 7f939a7fc640 1 -- 172.21.15.72:0/829223805 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a000a600 con 0x7f938800c580 2023-12-12T23:59:53.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.586+0000 7f93abecf640 1 -- 172.21.15.72:0/829223805 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a41f28c0 con 0x7f938800c580 2023-12-12T23:59:53.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.586+0000 7f93abecf640 1 -- 172.21.15.72:0/829223805 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a4152e00 con 0x7f938800c580 2023-12-12T23:59:53.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.587+0000 7f93abecf640 1 -- 172.21.15.72:0/829223805 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a41f30c0 con 0x7f938800c580 2023-12-12T23:59:53.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.798+0000 7f939a7fc640 1 -- 172.21.15.72:0/829223805 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f93a0009760 con 0x7f938800c580 2023-12-12T23:59:53.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.805+0000 7f939a7fc640 1 -- 172.21.15.72:0/829223805 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f93a0024be0 con 0x7f938800c580 2023-12-12T23:59:53.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.805+0000 7f939a7fc640 1 -- 172.21.15.72:0/829223805 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f93a000ae60 con 0x7f938800c580 2023-12-12T23:59:53.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:53.872+0000 7f93abecf640 1 -- 172.21.15.72:0/829223805 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f93a40c3040 con 0x7f938800c580 2023-12-12T23:59:54.100 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:54.100+0000 7f779063c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-12T23:59:54.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:54.130+0000 7f939a7fc640 1 -- 172.21.15.72:0/829223805 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f93a00243f0 con 0x7f938800c580 2023-12-12T23:59:54.131 INFO:teuthology.orchestra.run.smithi072.stderr:adjusted tunables profile to default 2023-12-12T23:59:54.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:54.131+0000 7f93abecf640 1 -- 172.21.15.72:0/829223805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c580 msgr2=0x7f93a41ef040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:54.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:54.131+0000 7f93abecf640 1 --2- 172.21.15.72:0/829223805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c580 0x7f93a41ef040 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f93a001ad80 tx=0x7f93a0018790 comp rx=0 tx=0).stop 2023-12-12T23:59:54.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:54.131+0000 7f93abecf640 1 -- 172.21.15.72:0/829223805 shutdown_connections 2023-12-12T23:59:54.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:54.131+0000 7f93abecf640 1 --2- 172.21.15.72:0/829223805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93880102d0 0x7f93a4145130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:54.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:54.131+0000 7f93abecf640 1 --2- 172.21.15.72:0/829223805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938800c580 0x7f93a41ef040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:54.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:54.131+0000 7f93abecf640 1 --2- 172.21.15.72:0/829223805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938800c060 0x7f93a4072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:54.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:54.131+0000 7f93abecf640 1 -- 172.21.15.72:0/829223805 >> 172.21.15.72:0/829223805 conn(0x7f93a406c5f0 msgr2=0x7f93a4154ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:54.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:54.131+0000 7f93abecf640 1 -- 172.21.15.72:0/829223805 shutdown_connections 2023-12-12T23:59:54.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:54.131+0000 7f93abecf640 1 -- 172.21.15.72:0/829223805 wait complete. 2023-12-12T23:59:54.143 INFO:tasks.ceph:check_enable_crimson: False 2023-12-12T23:59:54.143 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-12T23:59:54.143 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:54.144 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-12T23:59:54.155 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:54.155+0000 7f779063c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-12T23:59:54.172 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:54.172 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-12T23:59:54.239 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:54.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-12T23:59:54.307 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-12T23:59:54.307 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-12T23:59:54.361 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:54.361+0000 7fb236432040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-12T23:59:54.376 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:59:54.376 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-12T23:59:54.403 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:59:54.403 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-12T23:59:54.417 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:54.418+0000 7fb236432040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-12T23:59:54.443 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:59:54.443 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-12T23:59:54.510 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-12-12T23:59:54.510 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-12T23:59:54.578 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new b50be7d6-a064-484b-8f53-59e2aadea9f8 0 2023-12-12T23:59:54.718 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.718+0000 7f0ad7708640 1 Processor -- start 2023-12-12T23:59:54.718 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.719+0000 7f0ad7708640 1 -- start start 2023-12-12T23:59:54.719 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:54.718+0000 7f779063c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-12T23:59:54.720 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.719+0000 7f0ad7708640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ad0151450 0x7f0ad00c6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:54.720 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.719+0000 7f0ad7708640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0ad006aec0 0x7f0ad0157230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:54.720 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.719+0000 7f0ad7708640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad015a820 con 0x7f0ad00c8e00 2023-12-12T23:59:54.720 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.719+0000 7f0ad7708640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad00c6c00 con 0x7f0ad0151450 2023-12-12T23:59:54.720 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.719+0000 7f0ad7708640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad00c6ee0 con 0x7f0ad006aec0 2023-12-12T23:59:54.720 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.720+0000 7f0ad4ca3640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0ad006aec0 0x7f0ad0157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:54.720 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.720+0000 7f0ad54a4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ad0151450 0x7f0ad00c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:54.721 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.720+0000 7f0ad4ca3640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0ad006aec0 0x7f0ad0157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:41130/0 (socket says 172.21.15.176:41130) 2023-12-12T23:59:54.721 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.720+0000 7f0ad4ca3640 1 -- 172.21.15.176:0/1034344915 learned_addr learned my addr 172.21.15.176:0/1034344915 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-12-12T23:59:54.722 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.723+0000 7f0ad4ca3640 1 -- 172.21.15.176:0/1034344915 >> v2:172.21.15.72:3300/0 conn(0x7f0ad0151450 msgr2=0x7f0ad00c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T23:59:54.722 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.723+0000 7f0ad4ca3640 1 --2- 172.21.15.176:0/1034344915 >> v2:172.21.15.72:3300/0 conn(0x7f0ad0151450 0x7f0ad00c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:54.722 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.723+0000 7f0ad4ca3640 1 -- 172.21.15.176:0/1034344915 >> v1:172.21.15.176:6789/0 conn(0x7f0ad00c8e00 legacy=0x7f0ad00c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T23:59:54.722 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.723+0000 7f0ad4ca3640 1 -- 172.21.15.176:0/1034344915 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad00c71c0 con 0x7f0ad006aec0 2023-12-12T23:59:54.724 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.724+0000 7f0ad4ca3640 1 --2- 172.21.15.176:0/1034344915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ad006aec0 0x7f0ad0157230 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0ad01583c0 tx=0x7f0acc02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e58c0b630452b136 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:54.730 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.730+0000 7f0ac7fff640 1 -- 172.21.15.176:0/1034344915 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc030860 con 0x7f0ad006aec0 2023-12-12T23:59:54.731 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.730+0000 7f0ac7fff640 1 -- 172.21.15.176:0/1034344915 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc0309c0 con 0x7f0ad006aec0 2023-12-12T23:59:54.731 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.730+0000 7f0ac7fff640 1 -- 172.21.15.176:0/1034344915 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc030d50 con 0x7f0ad006aec0 2023-12-12T23:59:54.731 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.730+0000 7f0ad7708640 1 -- 172.21.15.176:0/1034344915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ad006aec0 msgr2=0x7f0ad0157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:54.731 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.730+0000 7f0ad7708640 1 --2- 172.21.15.176:0/1034344915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ad006aec0 0x7f0ad0157230 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0ad01583c0 tx=0x7f0acc02b9a0 comp rx=0 tx=0).stop 2023-12-12T23:59:54.731 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.730+0000 7f0ad7708640 1 -- 172.21.15.176:0/1034344915 shutdown_connections 2023-12-12T23:59:54.731 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.730+0000 7f0ad7708640 1 --2- 172.21.15.176:0/1034344915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ad006aec0 0x7f0ad0157230 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:54.731 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.730+0000 7f0ad7708640 1 --2- 172.21.15.176:0/1034344915 >> v2:172.21.15.72:3300/0 conn(0x7f0ad0151450 0x7f0ad00c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:54.731 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.730+0000 7f0ad7708640 1 -- 172.21.15.176:0/1034344915 >> 172.21.15.176:0/1034344915 conn(0x7f0ad00700e0 msgr2=0x7f0ad006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:54.731 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.730+0000 7f0ad7708640 1 -- 172.21.15.176:0/1034344915 shutdown_connections 2023-12-12T23:59:54.731 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.730+0000 7f0ad7708640 1 -- 172.21.15.176:0/1034344915 wait complete. 2023-12-12T23:59:54.732 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.732+0000 7f0ad7708640 1 Processor -- start 2023-12-12T23:59:54.732 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.732+0000 7f0ad7708640 1 -- start start 2023-12-12T23:59:54.732 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.732+0000 7f0ad7708640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ad006aec0 0x7f0ad0159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:54.732 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.732+0000 7f0ad7708640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ad00c8e00 0x7f0ad0154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:54.732 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.732+0000 7f0ad7708640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ad0151450 0x7f0ad01ef720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:54.732 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.732+0000 7f0ad7708640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0155a80 con 0x7f0ad00c8e00 2023-12-12T23:59:54.732 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.732+0000 7f0ad7708640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad014cfe0 con 0x7f0ad0151450 2023-12-12T23:59:54.733 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.732+0000 7f0ad7708640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad01557a0 con 0x7f0ad006aec0 2023-12-12T23:59:54.733 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.733+0000 7f0ad5ca5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ad0151450 0x7f0ad01ef720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:54.733 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.733+0000 7f0ad54a4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ad006aec0 0x7f0ad0159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:54.733 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.733+0000 7f0ad4ca3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ad00c8e00 0x7f0ad0154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:54.733 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.733+0000 7f0ad5ca5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ad0151450 0x7f0ad01ef720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:41134/0 (socket says 172.21.15.176:41134) 2023-12-12T23:59:54.733 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.733+0000 7f0ad5ca5640 1 -- 172.21.15.176:0/484767216 learned_addr learned my addr 172.21.15.176:0/484767216 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-12-12T23:59:54.736 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.736+0000 7f0ad5ca5640 1 -- 172.21.15.176:0/484767216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ad006aec0 msgr2=0x7f0ad0159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:54.736 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.736+0000 7f0ad5ca5640 1 --2- 172.21.15.176:0/484767216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ad006aec0 0x7f0ad0159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:54.736 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.736+0000 7f0ad5ca5640 1 -- 172.21.15.176:0/484767216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ad00c8e00 msgr2=0x7f0ad0154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:54.736 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.736+0000 7f0ad5ca5640 1 --2- 172.21.15.176:0/484767216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ad00c8e00 0x7f0ad0154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:54.736 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.736+0000 7f0ad5ca5640 1 -- 172.21.15.176:0/484767216 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc0094d0 con 0x7f0ad0151450 2023-12-12T23:59:54.738 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.738+0000 7f0ad5ca5640 1 --2- 172.21.15.176:0/484767216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ad0151450 0x7f0ad01ef720 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800c780 tx=0x7f0ac800cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:54.740 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.741+0000 7f0ac5ffb640 1 -- 172.21.15.176:0/484767216 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8003d80 con 0x7f0ad0151450 2023-12-12T23:59:54.740 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.741+0000 7f0ad7708640 1 -- 172.21.15.176:0/484767216 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad014c640 con 0x7f0ad0151450 2023-12-12T23:59:54.740 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.741+0000 7f0ad7708640 1 -- 172.21.15.176:0/484767216 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad014cc00 con 0x7f0ad0151450 2023-12-12T23:59:54.742 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.742+0000 7f0ad7708640 1 -- 172.21.15.176:0/484767216 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad006ad30 con 0x7f0ad0151450 2023-12-12T23:59:54.745 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.745+0000 7f0ac5ffb640 1 -- 172.21.15.176:0/484767216 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac800ce90 con 0x7f0ad0151450 2023-12-12T23:59:54.745 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.745+0000 7f0ac5ffb640 1 -- 172.21.15.176:0/484767216 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8006d30 con 0x7f0ad0151450 2023-12-12T23:59:54.772 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:54.772+0000 7f779063c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-12T23:59:54.816 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:54.816+0000 7f779063c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-12T23:59:54.869 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:54.868+0000 7f779063c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-12T23:59:54.910 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:54.909+0000 7f779063c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-12T23:59:54.921 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.922+0000 7f0ac5ffb640 1 -- 172.21.15.176:0/484767216 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f0ac8005450 con 0x7f0ad0151450 2023-12-12T23:59:54.921 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.922+0000 7f0ac5ffb640 1 -- 172.21.15.176:0/484767216 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0ac8007390 con 0x7f0ad0151450 2023-12-12T23:59:54.921 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.922+0000 7f0ac5ffb640 1 -- 172.21.15.176:0/484767216 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f0ac8021060 con 0x7f0ad0151450 2023-12-12T23:59:54.994 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:54.994+0000 7fb236432040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-12T23:59:54.995 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:54.995+0000 7f0ad7708640 1 -- 172.21.15.176:0/484767216 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b50be7d6-a064-484b-8f53-59e2aadea9f8", "id": 0} v 0) v1 -- 0x7f0ad0073dc0 con 0x7f0ad0151450 2023-12-12T23:59:55.008 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:55.008+0000 7f779063c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-12T23:59:55.048 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:55.048+0000 7fb236432040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-12T23:59:55.078 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:55.077+0000 7f779063c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-12T23:59:55.092 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:55.092+0000 7fb236432040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-12T23:59:55.127 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:55.127+0000 7f779063c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-12T23:59:55.149 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:55.149+0000 7fb236432040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-12T23:59:55.181 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.181+0000 7f0ac5ffb640 1 -- 172.21.15.176:0/484767216 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b50be7d6-a064-484b-8f53-59e2aadea9f8", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0ac8017070 con 0x7f0ad0151450 2023-12-12T23:59:55.181 INFO:teuthology.orchestra.run.smithi176.stdout:0 2023-12-12T23:59:55.182 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.182+0000 7f0ad7708640 1 -- 172.21.15.176:0/484767216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ad0151450 msgr2=0x7f0ad01ef720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:55.182 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.182+0000 7f0ad7708640 1 --2- 172.21.15.176:0/484767216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ad0151450 0x7f0ad01ef720 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800c780 tx=0x7f0ac800cc40 comp rx=0 tx=0).stop 2023-12-12T23:59:55.182 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.182+0000 7f0ad7708640 1 -- 172.21.15.176:0/484767216 shutdown_connections 2023-12-12T23:59:55.182 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.182+0000 7f0ad7708640 1 --2- 172.21.15.176:0/484767216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ad0151450 0x7f0ad01ef720 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:55.182 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.182+0000 7f0ad7708640 1 --2- 172.21.15.176:0/484767216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ad00c8e00 0x7f0ad0154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:55.182 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.182+0000 7f0ad7708640 1 --2- 172.21.15.176:0/484767216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ad006aec0 0x7f0ad0159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:55.182 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.182+0000 7f0ad7708640 1 -- 172.21.15.176:0/484767216 >> 172.21.15.176:0/484767216 conn(0x7f0ad00700e0 msgr2=0x7f0ad00c5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:55.182 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.182+0000 7f0ad7708640 1 -- 172.21.15.176:0/484767216 shutdown_connections 2023-12-12T23:59:55.182 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.182+0000 7f0ad7708640 1 -- 172.21.15.176:0/484767216 wait complete. 2023-12-12T23:59:55.183 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:55.182+0000 7f779063c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-12T23:59:55.192 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 277ed5f0-a6a5-4987-955a-bbfd38c9d230 1 2023-12-12T23:59:55.195 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:55.196+0000 7fb236432040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-12T23:59:55.229 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:55.228+0000 7f779063c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-12T23:59:55.293 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.293+0000 7f9f35e9b640 1 Processor -- start 2023-12-12T23:59:55.293 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.293+0000 7f9f35e9b640 1 -- start start 2023-12-12T23:59:55.293 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.293+0000 7f9f35e9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f301571d0 0x7f9f300c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:55.293 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.293+0000 7f9f35e9b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9f300ccac0 0x7f9f300cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:55.293 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.293+0000 7f9f35e9b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f301575f0 con 0x7f9f30151680 2023-12-12T23:59:55.294 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.293+0000 7f9f35e9b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f300cd410 con 0x7f9f301571d0 2023-12-12T23:59:55.294 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.293+0000 7f9f35e9b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f3006fb00 con 0x7f9f300ccac0 2023-12-12T23:59:55.294 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.294+0000 7f9f2ffff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9f300ccac0 0x7f9f300cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:55.294 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.294+0000 7f9f2effd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f301571d0 0x7f9f300c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:55.294 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.294+0000 7f9f2ffff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9f300ccac0 0x7f9f300cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:41148/0 (socket says 172.21.15.176:41148) 2023-12-12T23:59:55.294 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.294+0000 7f9f2ffff640 1 -- 172.21.15.176:0/139098656 learned_addr learned my addr 172.21.15.176:0/139098656 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-12-12T23:59:55.296 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.297+0000 7f9f2ffff640 1 -- 172.21.15.176:0/139098656 >> v2:172.21.15.72:3300/0 conn(0x7f9f301571d0 msgr2=0x7f9f300c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T23:59:55.297 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.297+0000 7f9f2ffff640 1 --2- 172.21.15.176:0/139098656 >> v2:172.21.15.72:3300/0 conn(0x7f9f301571d0 0x7f9f300c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:55.297 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.297+0000 7f9f2ffff640 1 -- 172.21.15.176:0/139098656 >> v1:172.21.15.176:6789/0 conn(0x7f9f30151680 legacy=0x7f9f3006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T23:59:55.297 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.297+0000 7f9f2ffff640 1 -- 172.21.15.176:0/139098656 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f30157880 con 0x7f9f300ccac0 2023-12-12T23:59:55.297 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.297+0000 7f9f2effd640 1 --2- 172.21.15.176:0/139098656 >> v2:172.21.15.72:3300/0 conn(0x7f9f301571d0 0x7f9f300c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T23:59:55.298 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.298+0000 7f9f2ffff640 1 --2- 172.21.15.176:0/139098656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f300ccac0 0x7f9f300cced0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9f30154dc0 tx=0x7f9f2802bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42fea087a9c108fc server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:55.303 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.304+0000 7f9f2e7fc640 1 -- 172.21.15.176:0/139098656 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2802cb20 con 0x7f9f300ccac0 2023-12-12T23:59:55.303 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.304+0000 7f9f2e7fc640 1 -- 172.21.15.176:0/139098656 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2802cc80 con 0x7f9f300ccac0 2023-12-12T23:59:55.304 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.304+0000 7f9f2e7fc640 1 -- 172.21.15.176:0/139098656 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f280343f0 con 0x7f9f300ccac0 2023-12-12T23:59:55.305 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.304+0000 7f9f35e9b640 1 -- 172.21.15.176:0/139098656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f300ccac0 msgr2=0x7f9f300cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:55.305 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.304+0000 7f9f35e9b640 1 --2- 172.21.15.176:0/139098656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f300ccac0 0x7f9f300cced0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9f30154dc0 tx=0x7f9f2802bf80 comp rx=0 tx=0).stop 2023-12-12T23:59:55.305 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.304+0000 7f9f35e9b640 1 -- 172.21.15.176:0/139098656 shutdown_connections 2023-12-12T23:59:55.305 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.304+0000 7f9f35e9b640 1 --2- 172.21.15.176:0/139098656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f300ccac0 0x7f9f300cced0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:55.305 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.304+0000 7f9f35e9b640 1 --2- 172.21.15.176:0/139098656 >> v2:172.21.15.72:3300/0 conn(0x7f9f301571d0 0x7f9f300c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:55.305 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.304+0000 7f9f35e9b640 1 -- 172.21.15.176:0/139098656 >> 172.21.15.176:0/139098656 conn(0x7f9f300707f0 msgr2=0x7f9f30070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:55.306 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.305+0000 7f9f35e9b640 1 -- 172.21.15.176:0/139098656 shutdown_connections 2023-12-12T23:59:55.306 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.305+0000 7f9f35e9b640 1 -- 172.21.15.176:0/139098656 wait complete. 2023-12-12T23:59:55.306 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:55.305+0000 7fb236432040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-12T23:59:55.307 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.306+0000 7f9f35e9b640 1 Processor -- start 2023-12-12T23:59:55.308 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.306+0000 7f9f35e9b640 1 -- start start 2023-12-12T23:59:55.308 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.307+0000 7f9f35e9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f300ccac0 0x7f9f30148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:55.308 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.307+0000 7f9f35e9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f30151680 0x7f9f300c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:55.308 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.307+0000 7f9f35e9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f301571d0 0x7f9f30147930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:55.308 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.307+0000 7f9f35e9b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f301e1aa0 con 0x7f9f301571d0 2023-12-12T23:59:55.308 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.307+0000 7f9f35e9b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f30149380 con 0x7f9f30151680 2023-12-12T23:59:55.308 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.307+0000 7f9f35e9b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f30149660 con 0x7f9f300ccac0 2023-12-12T23:59:55.308 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.307+0000 7f9f2effd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f30151680 0x7f9f300c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:55.308 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.307+0000 7f9f2ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f301571d0 0x7f9f30147930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:55.308 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.307+0000 7f9f2f7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f300ccac0 0x7f9f30148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:55.308 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.307+0000 7f9f2effd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f30151680 0x7f9f300c1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:41164/0 (socket says 172.21.15.176:41164) 2023-12-12T23:59:55.308 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.307+0000 7f9f2effd640 1 -- 172.21.15.176:0/2684664148 learned_addr learned my addr 172.21.15.176:0/2684664148 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-12-12T23:59:55.310 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.311+0000 7f9f2ffff640 1 -- 172.21.15.176:0/2684664148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f300ccac0 msgr2=0x7f9f30148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:55.310 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.311+0000 7f9f2ffff640 1 --2- 172.21.15.176:0/2684664148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f300ccac0 0x7f9f30148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:55.311 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.311+0000 7f9f2ffff640 1 -- 172.21.15.176:0/2684664148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f30151680 msgr2=0x7f9f300c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:55.311 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.311+0000 7f9f2ffff640 1 --2- 172.21.15.176:0/2684664148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f30151680 0x7f9f300c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:55.311 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.311+0000 7f9f2ffff640 1 -- 172.21.15.176:0/2684664148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f24009400 con 0x7f9f301571d0 2023-12-12T23:59:55.311 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.311+0000 7f9f2effd640 1 --2- 172.21.15.176:0/2684664148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f30151680 0x7f9f300c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T23:59:55.312 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.313+0000 7f9f2ffff640 1 --2- 172.21.15.176:0/2684664148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f301571d0 0x7f9f30147930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9f28032000 tx=0x7f9f28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:55.317 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.317+0000 7f9f17fff640 1 -- 172.21.15.176:0/2684664148 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2802c920 con 0x7f9f301571d0 2023-12-12T23:59:55.317 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.317+0000 7f9f17fff640 1 -- 172.21.15.176:0/2684664148 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2802ca80 con 0x7f9f301571d0 2023-12-12T23:59:55.317 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.317+0000 7f9f17fff640 1 -- 172.21.15.176:0/2684664148 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2803e690 con 0x7f9f301571d0 2023-12-12T23:59:55.317 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.317+0000 7f9f35e9b640 1 -- 172.21.15.176:0/2684664148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f28009b30 con 0x7f9f301571d0 2023-12-12T23:59:55.317 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.317+0000 7f9f35e9b640 1 -- 172.21.15.176:0/2684664148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f301e2b00 con 0x7f9f301571d0 2023-12-12T23:59:55.318 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.318+0000 7f9f35e9b640 1 -- 172.21.15.176:0/2684664148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f301e2660 con 0x7f9f301571d0 2023-12-12T23:59:55.333 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.334+0000 7f9f17fff640 1 -- 172.21.15.176:0/2684664148 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f9f2803e7f0 con 0x7f9f301571d0 2023-12-12T23:59:55.334 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.334+0000 7f9f17fff640 1 -- 172.21.15.176:0/2684664148 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f9f28051bf0 con 0x7f9f301571d0 2023-12-12T23:59:55.377 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:55.377+0000 7fb236432040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-12T23:59:55.422 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:55.422+0000 7fb236432040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-12T23:59:55.444 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.444+0000 7f9f17fff640 1 -- 172.21.15.176:0/2684664148 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f9f28043020 con 0x7f9f301571d0 2023-12-12T23:59:55.475 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:55.475+0000 7fb236432040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-12T23:59:55.517 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.518+0000 7f9f35e9b640 1 -- 172.21.15.176:0/2684664148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "277ed5f0-a6a5-4987-955a-bbfd38c9d230", "id": 1} v 0) v1 -- 0x7f9f30073dc0 con 0x7f9f301571d0 2023-12-12T23:59:55.524 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:55.524+0000 7fb236432040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-12T23:59:55.561 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.561+0000 7f9f17fff640 1 -- 172.21.15.176:0/2684664148 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "277ed5f0-a6a5-4987-955a-bbfd38c9d230", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9f2803eaa0 con 0x7f9f301571d0 2023-12-12T23:59:55.562 INFO:teuthology.orchestra.run.smithi176.stdout:1 2023-12-12T23:59:55.563 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.563+0000 7f9f35e9b640 1 -- 172.21.15.176:0/2684664148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f301571d0 msgr2=0x7f9f30147930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:55.563 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.563+0000 7f9f35e9b640 1 --2- 172.21.15.176:0/2684664148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f301571d0 0x7f9f30147930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9f28032000 tx=0x7f9f28004a40 comp rx=0 tx=0).stop 2023-12-12T23:59:55.563 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.563+0000 7f9f35e9b640 1 -- 172.21.15.176:0/2684664148 shutdown_connections 2023-12-12T23:59:55.563 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.563+0000 7f9f35e9b640 1 --2- 172.21.15.176:0/2684664148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f301571d0 0x7f9f30147930 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:55.563 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.563+0000 7f9f35e9b640 1 --2- 172.21.15.176:0/2684664148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f30151680 0x7f9f300c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:55.563 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.563+0000 7f9f35e9b640 1 --2- 172.21.15.176:0/2684664148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f300ccac0 0x7f9f30148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:55.563 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.563+0000 7f9f35e9b640 1 -- 172.21.15.176:0/2684664148 >> 172.21.15.176:0/2684664148 conn(0x7f9f300707f0 msgr2=0x7f9f300c31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:55.563 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.563+0000 7f9f35e9b640 1 -- 172.21.15.176:0/2684664148 shutdown_connections 2023-12-12T23:59:55.563 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.563+0000 7f9f35e9b640 1 -- 172.21.15.176:0/2684664148 wait complete. 2023-12-12T23:59:55.575 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new ad2105a9-8fe8-4121-a234-51a442670f0b 2 2023-12-12T23:59:55.619 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:55.619+0000 7f779063c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-12T23:59:55.720 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.719+0000 7fda9359e640 1 Processor -- start 2023-12-12T23:59:55.720 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.719+0000 7fda9359e640 1 -- start start 2023-12-12T23:59:55.720 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.720+0000 7fda9359e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fda94060f20 0x7fda94071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:55.720 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.720+0000 7fda9359e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda940ae080 con 0x7fda941536a0 2023-12-12T23:59:55.720 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.720+0000 7fda9359e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda94153a80 con 0x7fda940adb40 2023-12-12T23:59:55.720 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.720+0000 7fda9359e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda941594c0 con 0x7fda94060f20 2023-12-12T23:59:55.721 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.721+0000 7fda8bfff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fda94060f20 0x7fda94071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:55.721 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.721+0000 7fda9259c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fda941536a0 0x7fda940c71c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.176:33662/0 (socket says 172.21.15.176:33662) 2023-12-12T23:59:55.721 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.721+0000 7fda9259c640 1 -- 172.21.15.176:0/2663709277 learned_addr learned my addr 172.21.15.176:0/2663709277 (peer_addr_for_me v1:172.21.15.176:0/0) 2023-12-12T23:59:55.723 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.723+0000 7fda8bfff640 1 -- 172.21.15.176:0/2663709277 >> v1:172.21.15.176:6789/0 conn(0x7fda940adb40 legacy=0x7fda94163cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T23:59:55.723 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.723+0000 7fda8bfff640 1 -- 172.21.15.176:0/2663709277 >> v1:172.21.15.72:6789/0 conn(0x7fda941536a0 legacy=0x7fda940c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:55.723 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.723+0000 7fda8bfff640 1 -- 172.21.15.176:0/2663709277 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda94159780 con 0x7fda94060f20 2023-12-12T23:59:55.726 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.726+0000 7fda8bfff640 1 --2- 172.21.15.176:0/2663709277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda94060f20 0x7fda94071b50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0097a0 tx=0x7fda7c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3f5bc4dc46824ed server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:55.729 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.729+0000 7fda91d9b640 1 -- 172.21.15.176:0/2663709277 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c030610 con 0x7fda94060f20 2023-12-12T23:59:55.729 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.730+0000 7fda91d9b640 1 -- 172.21.15.176:0/2663709277 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7c030770 con 0x7fda94060f20 2023-12-12T23:59:55.729 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.730+0000 7fda91d9b640 1 -- 172.21.15.176:0/2663709277 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c030b00 con 0x7fda94060f20 2023-12-12T23:59:55.730 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.730+0000 7fda9359e640 1 -- 172.21.15.176:0/2663709277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda94060f20 msgr2=0x7fda94071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:55.730 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.730+0000 7fda9359e640 1 --2- 172.21.15.176:0/2663709277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda94060f20 0x7fda94071b50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0097a0 tx=0x7fda7c02b960 comp rx=0 tx=0).stop 2023-12-12T23:59:55.730 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.730+0000 7fda9359e640 1 -- 172.21.15.176:0/2663709277 shutdown_connections 2023-12-12T23:59:55.730 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.730+0000 7fda9359e640 1 --2- 172.21.15.176:0/2663709277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda94060f20 0x7fda94071b50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:55.731 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.730+0000 7fda9359e640 1 -- 172.21.15.176:0/2663709277 >> 172.21.15.176:0/2663709277 conn(0x7fda940cb270 msgr2=0x7fda940cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:55.731 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.730+0000 7fda9359e640 1 -- 172.21.15.176:0/2663709277 shutdown_connections 2023-12-12T23:59:55.731 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.730+0000 7fda9359e640 1 -- 172.21.15.176:0/2663709277 wait complete. 2023-12-12T23:59:55.731 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.732+0000 7fda9359e640 1 Processor -- start 2023-12-12T23:59:55.731 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.732+0000 7fda9359e640 1 -- start start 2023-12-12T23:59:55.732 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.732+0000 7fda9359e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda94060f20 0x7fda941efea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:55.732 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.732+0000 7fda9359e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda940adb40 0x7fda940ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:55.732 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.732+0000 7fda9359e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda941536a0 0x7fda941e4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:55.732 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.733+0000 7fda9359e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda941e4300 con 0x7fda940adb40 2023-12-12T23:59:55.733 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.733+0000 7fda9359e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda941e5640 con 0x7fda94060f20 2023-12-12T23:59:55.733 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.733+0000 7fda9359e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda941f03e0 con 0x7fda941536a0 2023-12-12T23:59:55.733 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.733+0000 7fda9259c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda94060f20 0x7fda941efea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:55.733 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.733+0000 7fda92d9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda941536a0 0x7fda941e4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:55.733 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.733+0000 7fda9259c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda94060f20 0x7fda941efea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:41192/0 (socket says 172.21.15.176:41192) 2023-12-12T23:59:55.733 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.733+0000 7fda8bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda940adb40 0x7fda940ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:55.733 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.733+0000 7fda9259c640 1 -- 172.21.15.176:0/3111240495 learned_addr learned my addr 172.21.15.176:0/3111240495 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-12-12T23:59:55.736 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.737+0000 7fda9259c640 1 -- 172.21.15.176:0/3111240495 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda941536a0 msgr2=0x7fda941e4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:55.736 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.737+0000 7fda9259c640 1 --2- 172.21.15.176:0/3111240495 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda941536a0 0x7fda941e4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:55.737 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.737+0000 7fda9259c640 1 -- 172.21.15.176:0/3111240495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda940adb40 msgr2=0x7fda940ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:55.737 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.737+0000 7fda9259c640 1 --2- 172.21.15.176:0/3111240495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda940adb40 0x7fda940ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:55.737 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.737+0000 7fda9259c640 1 -- 172.21.15.176:0/3111240495 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c009400 con 0x7fda94060f20 2023-12-12T23:59:55.737 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.737+0000 7fda8bfff640 1 --2- 172.21.15.176:0/3111240495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda940adb40 0x7fda940ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T23:59:55.738 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.739+0000 7fda9259c640 1 --2- 172.21.15.176:0/3111240495 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda94060f20 0x7fda941efea0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fda8400c3c0 tx=0x7fda8400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:55.742 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.742+0000 7fda8affd640 1 -- 172.21.15.176:0/3111240495 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda84005ce0 con 0x7fda94060f20 2023-12-12T23:59:55.742 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.742+0000 7fda8affd640 1 -- 172.21.15.176:0/3111240495 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda84005e40 con 0x7fda94060f20 2023-12-12T23:59:55.742 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.742+0000 7fda8affd640 1 -- 172.21.15.176:0/3111240495 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda840072d0 con 0x7fda94060f20 2023-12-12T23:59:55.742 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.742+0000 7fda9359e640 1 -- 172.21.15.176:0/3111240495 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda941e5360 con 0x7fda94060f20 2023-12-12T23:59:55.742 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.742+0000 7fda9359e640 1 -- 172.21.15.176:0/3111240495 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda941e3c40 con 0x7fda94060f20 2023-12-12T23:59:55.743 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.744+0000 7fda9359e640 1 -- 172.21.15.176:0/3111240495 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda94156d60 con 0x7fda94060f20 2023-12-12T23:59:55.744 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.744+0000 7fda8affd640 1 -- 172.21.15.176:0/3111240495 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fda8401c440 con 0x7fda94060f20 2023-12-12T23:59:55.757 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:55.756+0000 7f779063c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-12T23:59:55.845 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.845+0000 7fda8affd640 1 -- 172.21.15.176:0/3111240495 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fda8401b7d0 con 0x7fda94060f20 2023-12-12T23:59:55.845 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.845+0000 7fda8affd640 1 -- 172.21.15.176:0/3111240495 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fda84017070 con 0x7fda94060f20 2023-12-12T23:59:55.862 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:55.861+0000 7f779063c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-12T23:59:55.907 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:55.906+0000 7f779063c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-12T23:59:55.917 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.917+0000 7fda9359e640 1 -- 172.21.15.176:0/3111240495 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ad2105a9-8fe8-4121-a234-51a442670f0b", "id": 2} v 0) v1 -- 0x7fda9404e920 con 0x7fda94060f20 2023-12-12T23:59:55.930 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:55.931+0000 7fb236432040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-12T23:59:55.988 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.989+0000 7fda8affd640 1 -- 172.21.15.176:0/3111240495 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad2105a9-8fe8-4121-a234-51a442670f0b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fda8401b480 con 0x7fda94060f20 2023-12-12T23:59:55.989 INFO:teuthology.orchestra.run.smithi176.stdout:2 2023-12-12T23:59:55.990 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.990+0000 7fda9359e640 1 -- 172.21.15.176:0/3111240495 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda94060f20 msgr2=0x7fda941efea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:55.990 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.990+0000 7fda9359e640 1 --2- 172.21.15.176:0/3111240495 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda94060f20 0x7fda941efea0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fda8400c3c0 tx=0x7fda8400c880 comp rx=0 tx=0).stop 2023-12-12T23:59:55.990 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.990+0000 7fda9359e640 1 -- 172.21.15.176:0/3111240495 shutdown_connections 2023-12-12T23:59:55.990 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.990+0000 7fda9359e640 1 --2- 172.21.15.176:0/3111240495 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda941536a0 0x7fda941e4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:55.990 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.990+0000 7fda9359e640 1 --2- 172.21.15.176:0/3111240495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda940adb40 0x7fda940ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:55.990 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.990+0000 7fda9359e640 1 --2- 172.21.15.176:0/3111240495 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda94060f20 0x7fda941efea0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:55.990 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.990+0000 7fda9359e640 1 -- 172.21.15.176:0/3111240495 >> 172.21.15.176:0/3111240495 conn(0x7fda940cb270 msgr2=0x7fda940cb650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:55.990 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.990+0000 7fda9359e640 1 -- 172.21.15.176:0/3111240495 shutdown_connections 2023-12-12T23:59:55.990 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:55.990+0000 7fda9359e640 1 -- 172.21.15.176:0/3111240495 wait complete. 2023-12-12T23:59:56.000 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 366d47c2-de6f-4c5f-9f9b-182c33ca75d5 3 2023-12-12T23:59:56.011 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:56.011+0000 7f779063c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-12T23:59:56.074 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:56.074+0000 7fb236432040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-12T23:59:56.098 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.098+0000 7fd64af33640 1 Processor -- start 2023-12-12T23:59:56.098 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.098+0000 7fd64af33640 1 -- start start 2023-12-12T23:59:56.099 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.099+0000 7fd64af33640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd644153770 0x7fd64415cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:56.099 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.099+0000 7fd64af33640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd64406a760 0x7fd64406ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:56.099 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.099+0000 7fd64af33640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd644159b70 con 0x7fd6440c6710 2023-12-12T23:59:56.099 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.099+0000 7fd64af33640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd64415dbe0 con 0x7fd644153770 2023-12-12T23:59:56.099 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.099+0000 7fd64af33640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6441595f0 con 0x7fd64406a760 2023-12-12T23:59:56.100 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.100+0000 7fd6494d0640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd64406a760 0x7fd64406ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:56.100 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.100+0000 7fd648ccf640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd644153770 0x7fd64415cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:56.100 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.100+0000 7fd6494d0640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd64406a760 0x7fd64406ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:41200/0 (socket says 172.21.15.176:41200) 2023-12-12T23:59:56.100 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.100+0000 7fd6494d0640 1 -- 172.21.15.176:0/1439767443 learned_addr learned my addr 172.21.15.176:0/1439767443 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-12-12T23:59:56.102 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.102+0000 7fd6494d0640 1 -- 172.21.15.176:0/1439767443 >> v2:172.21.15.72:3300/0 conn(0x7fd644153770 msgr2=0x7fd64415cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T23:59:56.102 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.102+0000 7fd6494d0640 1 --2- 172.21.15.176:0/1439767443 >> v2:172.21.15.72:3300/0 conn(0x7fd644153770 0x7fd64415cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.102 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.102+0000 7fd6494d0640 1 -- 172.21.15.176:0/1439767443 >> v1:172.21.15.176:6789/0 conn(0x7fd6440c6710 legacy=0x7fd64415a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T23:59:56.102 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.102+0000 7fd6494d0640 1 -- 172.21.15.176:0/1439767443 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64415d340 con 0x7fd64406a760 2023-12-12T23:59:56.104 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.105+0000 7fd6494d0640 1 --2- 172.21.15.176:0/1439767443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd64406a760 0x7fd64406ab70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd6441571e0 tx=0x7fd63c02bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7fe91b9342b7a2b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:56.105 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:56.104+0000 7f779063c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-12T23:59:56.108 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.108+0000 7fd6437fe640 1 -- 172.21.15.176:0/1439767443 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c02cb20 con 0x7fd64406a760 2023-12-12T23:59:56.108 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.108+0000 7fd6437fe640 1 -- 172.21.15.176:0/1439767443 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63c02cc80 con 0x7fd64406a760 2023-12-12T23:59:56.108 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.108+0000 7fd6437fe640 1 -- 172.21.15.176:0/1439767443 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c0343f0 con 0x7fd64406a760 2023-12-12T23:59:56.109 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.109+0000 7fd64af33640 1 -- 172.21.15.176:0/1439767443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd64406a760 msgr2=0x7fd64406ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:56.109 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.109+0000 7fd64af33640 1 --2- 172.21.15.176:0/1439767443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd64406a760 0x7fd64406ab70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd6441571e0 tx=0x7fd63c02bf80 comp rx=0 tx=0).stop 2023-12-12T23:59:56.109 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.109+0000 7fd64af33640 1 -- 172.21.15.176:0/1439767443 shutdown_connections 2023-12-12T23:59:56.109 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.109+0000 7fd64af33640 1 --2- 172.21.15.176:0/1439767443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd64406a760 0x7fd64406ab70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.109 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.109+0000 7fd64af33640 1 --2- 172.21.15.176:0/1439767443 >> v2:172.21.15.72:3300/0 conn(0x7fd644153770 0x7fd64415cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.109 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.109+0000 7fd64af33640 1 -- 172.21.15.176:0/1439767443 >> 172.21.15.176:0/1439767443 conn(0x7fd64406d170 msgr2=0x7fd64406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:56.109 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.109+0000 7fd64af33640 1 -- 172.21.15.176:0/1439767443 shutdown_connections 2023-12-12T23:59:56.109 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.109+0000 7fd64af33640 1 -- 172.21.15.176:0/1439767443 wait complete. 2023-12-12T23:59:56.110 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.110+0000 7fd64af33640 1 Processor -- start 2023-12-12T23:59:56.110 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.110+0000 7fd64af33640 1 -- start start 2023-12-12T23:59:56.111 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.111+0000 7fd64af33640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd64406a760 0x7fd644154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:56.111 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.111+0000 7fd64af33640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6440c6710 0x7fd64415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:56.111 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.111+0000 7fd64af33640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd644153770 0x7fd64415c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:56.111 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.111+0000 7fd64af33640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd644148890 con 0x7fd64406a760 2023-12-12T23:59:56.111 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.111+0000 7fd64af33640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd644154870 con 0x7fd644153770 2023-12-12T23:59:56.111 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.111+0000 7fd64af33640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64415bbd0 con 0x7fd6440c6710 2023-12-12T23:59:56.111 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.111+0000 7fd6494d0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd644153770 0x7fd64415c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:56.112 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.112+0000 7fd648ccf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd64406a760 0x7fd644154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:56.112 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.112+0000 7fd643fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6440c6710 0x7fd64415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:56.112 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.112+0000 7fd6494d0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd644153770 0x7fd64415c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:41212/0 (socket says 172.21.15.176:41212) 2023-12-12T23:59:56.112 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.112+0000 7fd6494d0640 1 -- 172.21.15.176:0/2357681325 learned_addr learned my addr 172.21.15.176:0/2357681325 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-12-12T23:59:56.115 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.115+0000 7fd648ccf640 1 -- 172.21.15.176:0/2357681325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6440c6710 msgr2=0x7fd64415aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:56.115 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.115+0000 7fd648ccf640 1 --2- 172.21.15.176:0/2357681325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6440c6710 0x7fd64415aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.115 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.115+0000 7fd648ccf640 1 -- 172.21.15.176:0/2357681325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd644153770 msgr2=0x7fd64415c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:56.115 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.115+0000 7fd648ccf640 1 --2- 172.21.15.176:0/2357681325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd644153770 0x7fd64415c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.115 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.115+0000 7fd648ccf640 1 -- 172.21.15.176:0/2357681325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c009b30 con 0x7fd64406a760 2023-12-12T23:59:56.117 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.117+0000 7fd648ccf640 1 --2- 172.21.15.176:0/2357681325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd64406a760 0x7fd644154330 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd63800e8a0 tx=0x7fd63800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:56.121 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.121+0000 7fd6417fa640 1 -- 172.21.15.176:0/2357681325 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638009e60 con 0x7fd64406a760 2023-12-12T23:59:56.121 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.121+0000 7fd6417fa640 1 -- 172.21.15.176:0/2357681325 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63800c8e0 con 0x7fd64406a760 2023-12-12T23:59:56.121 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.121+0000 7fd64af33640 1 -- 172.21.15.176:0/2357681325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64415b2e0 con 0x7fd64406a760 2023-12-12T23:59:56.121 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.121+0000 7fd6417fa640 1 -- 172.21.15.176:0/2357681325 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63800cc70 con 0x7fd64406a760 2023-12-12T23:59:56.121 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.121+0000 7fd64af33640 1 -- 172.21.15.176:0/2357681325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64415b860 con 0x7fd64406a760 2023-12-12T23:59:56.121 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.122+0000 7fd64af33640 1 -- 172.21.15.176:0/2357681325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd644073dc0 con 0x7fd64406a760 2023-12-12T23:59:56.123 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.123+0000 7fd6417fa640 1 -- 172.21.15.176:0/2357681325 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fd638005990 con 0x7fd64406a760 2023-12-12T23:59:56.123 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.123+0000 7fd6417fa640 1 -- 172.21.15.176:0/2357681325 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fd638006700 con 0x7fd64406a760 2023-12-12T23:59:56.197 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:56.196+0000 7fb236432040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-12T23:59:56.222 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.223+0000 7fd6417fa640 1 -- 172.21.15.176:0/2357681325 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fd638021060 con 0x7fd64406a760 2023-12-12T23:59:56.243 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:56.243+0000 7fb236432040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-12T23:59:56.250 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:56.249+0000 7f779063c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-12T23:59:56.292 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:56.291+0000 7f779063c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-12T23:59:56.294 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.294+0000 7fd64af33640 1 -- 172.21.15.176:0/2357681325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "366d47c2-de6f-4c5f-9f9b-182c33ca75d5", "id": 3} v 0) v1 -- 0x7fd64406b140 con 0x7fd64406a760 2023-12-12T23:59:56.338 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.338+0000 7fd6417fa640 1 -- 172.21.15.176:0/2357681325 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "366d47c2-de6f-4c5f-9f9b-182c33ca75d5", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd638017070 con 0x7fd64406a760 2023-12-12T23:59:56.338 INFO:teuthology.orchestra.run.smithi176.stdout:3 2023-12-12T23:59:56.339 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.339+0000 7fd64af33640 1 -- 172.21.15.176:0/2357681325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd64406a760 msgr2=0x7fd644154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:56.339 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.339+0000 7fd64af33640 1 --2- 172.21.15.176:0/2357681325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd64406a760 0x7fd644154330 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd63800e8a0 tx=0x7fd63800ed60 comp rx=0 tx=0).stop 2023-12-12T23:59:56.339 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.339+0000 7fd64af33640 1 -- 172.21.15.176:0/2357681325 shutdown_connections 2023-12-12T23:59:56.339 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.339+0000 7fd64af33640 1 --2- 172.21.15.176:0/2357681325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd644153770 0x7fd64415c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.340 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.339+0000 7fd64af33640 1 --2- 172.21.15.176:0/2357681325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6440c6710 0x7fd64415aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.340 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.339+0000 7fd64af33640 1 --2- 172.21.15.176:0/2357681325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd64406a760 0x7fd644154330 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.340 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.339+0000 7fd64af33640 1 -- 172.21.15.176:0/2357681325 >> 172.21.15.176:0/2357681325 conn(0x7fd64406d170 msgr2=0x7fd6441574e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:56.340 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.339+0000 7fd64af33640 1 -- 172.21.15.176:0/2357681325 shutdown_connections 2023-12-12T23:59:56.340 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.339+0000 7fd64af33640 1 -- 172.21.15.176:0/2357681325 wait complete. 2023-12-12T23:59:56.342 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:56.342+0000 7fb236432040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-12T23:59:56.352 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd 4 2023-12-12T23:59:56.437 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:56.437+0000 7f779063c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-12T23:59:56.444 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:56.444+0000 7fb236432040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-12T23:59:56.453 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.453+0000 7f1bd2d61640 1 Processor -- start 2023-12-12T23:59:56.453 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.453+0000 7f1bd2d61640 1 -- start start 2023-12-12T23:59:56.453 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.454+0000 7f1bd2d61640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1bcc06aec0 0x7f1bcc0c6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:56.453 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.454+0000 7f1bd2d61640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bcc15a820 con 0x7f1bcc0c8e00 2023-12-12T23:59:56.454 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.454+0000 7f1bd2d61640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bcc0c6c00 con 0x7f1bcc151450 2023-12-12T23:59:56.454 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.454+0000 7f1bd2d61640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bcc0c6ee0 con 0x7f1bcc06aec0 2023-12-12T23:59:56.454 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.454+0000 7f1bd0afd640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f1bcc151450 0x7f1bcc0c5280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:60950/0 (socket says 172.21.15.176:60950) 2023-12-12T23:59:56.454 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.454+0000 7f1bd0afd640 1 -- 172.21.15.176:0/3560590333 learned_addr learned my addr 172.21.15.176:0/3560590333 (peer_addr_for_me v1:172.21.15.176:0/0) 2023-12-12T23:59:56.454 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.454+0000 7f1bcbfff640 1 --2- 172.21.15.176:0/3560590333 >> v2:172.21.15.72:3300/0 conn(0x7f1bcc06aec0 0x7f1bcc0c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:56.457 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.457+0000 7f1bcbfff640 1 -- 172.21.15.176:0/3560590333 >> v1:172.21.15.176:6789/0 conn(0x7f1bcc151450 legacy=0x7f1bcc0c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:56.457 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.457+0000 7f1bcbfff640 1 -- 172.21.15.176:0/3560590333 >> v1:172.21.15.72:6789/0 conn(0x7f1bcc0c8e00 legacy=0x7f1bcc161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T23:59:56.457 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.457+0000 7f1bcbfff640 1 -- 172.21.15.176:0/3560590333 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc0c71c0 con 0x7f1bcc06aec0 2023-12-12T23:59:56.459 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.460+0000 7f1bcbfff640 1 --2- 172.21.15.176:0/3560590333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bcc06aec0 0x7f1bcc0c6570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80097a0 tx=0x7f1bb802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c3de1459447285 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:56.466 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.466+0000 7f1bcb7fe640 1 -- 172.21.15.176:0/3560590333 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8030610 con 0x7f1bcc06aec0 2023-12-12T23:59:56.466 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.466+0000 7f1bcb7fe640 1 -- 172.21.15.176:0/3560590333 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb8030770 con 0x7f1bcc06aec0 2023-12-12T23:59:56.466 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.466+0000 7f1bcb7fe640 1 -- 172.21.15.176:0/3560590333 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8030b00 con 0x7f1bcc06aec0 2023-12-12T23:59:56.467 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.467+0000 7f1bd2d61640 1 -- 172.21.15.176:0/3560590333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bcc06aec0 msgr2=0x7f1bcc0c6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:56.467 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.467+0000 7f1bd2d61640 1 --2- 172.21.15.176:0/3560590333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bcc06aec0 0x7f1bcc0c6570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80097a0 tx=0x7f1bb802b960 comp rx=0 tx=0).stop 2023-12-12T23:59:56.467 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.467+0000 7f1bd2d61640 1 -- 172.21.15.176:0/3560590333 shutdown_connections 2023-12-12T23:59:56.467 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.467+0000 7f1bd2d61640 1 --2- 172.21.15.176:0/3560590333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bcc06aec0 0x7f1bcc0c6570 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.467 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.467+0000 7f1bd2d61640 1 -- 172.21.15.176:0/3560590333 >> 172.21.15.176:0/3560590333 conn(0x7f1bcc0700e0 msgr2=0x7f1bcc06b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:56.467 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.467+0000 7f1bd2d61640 1 -- 172.21.15.176:0/3560590333 shutdown_connections 2023-12-12T23:59:56.467 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.467+0000 7f1bd2d61640 1 -- 172.21.15.176:0/3560590333 wait complete. 2023-12-12T23:59:56.468 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.468+0000 7f1bd2d61640 1 Processor -- start 2023-12-12T23:59:56.468 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.468+0000 7f1bd2d61640 1 -- start start 2023-12-12T23:59:56.468 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.469+0000 7f1bd2d61640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bcc06aec0 0x7f1bcc1e2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:56.469 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.469+0000 7f1bd2d61640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bcc0c8e00 0x7f1bcc1562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:56.469 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.469+0000 7f1bd2d61640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bcc151450 0x7f1bcc1521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:56.469 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.469+0000 7f1bd2d61640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc1e2dd0 con 0x7f1bcc06aec0 2023-12-12T23:59:56.469 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.469+0000 7f1bd2d61640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc151d10 con 0x7f1bcc0c8e00 2023-12-12T23:59:56.469 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.469+0000 7f1bd2d61640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc1edcf0 con 0x7f1bcc151450 2023-12-12T23:59:56.470 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.469+0000 7f1bcbfff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bcc0c8e00 0x7f1bcc1562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:56.470 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.469+0000 7f1bd0afd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bcc06aec0 0x7f1bcc1e2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:56.470 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.469+0000 7f1bd12fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bcc151450 0x7f1bcc1521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:56.470 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.470+0000 7f1bcbfff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bcc0c8e00 0x7f1bcc1562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:44348/0 (socket says 172.21.15.176:44348) 2023-12-12T23:59:56.471 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.470+0000 7f1bcbfff640 1 -- 172.21.15.176:0/1082696154 learned_addr learned my addr 172.21.15.176:0/1082696154 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-12-12T23:59:56.473 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.473+0000 7f1bd0afd640 1 -- 172.21.15.176:0/1082696154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bcc151450 msgr2=0x7f1bcc1521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:56.473 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.473+0000 7f1bd0afd640 1 --2- 172.21.15.176:0/1082696154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bcc151450 0x7f1bcc1521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.473 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.473+0000 7f1bd0afd640 1 -- 172.21.15.176:0/1082696154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bcc0c8e00 msgr2=0x7f1bcc1562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:56.473 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.473+0000 7f1bd0afd640 1 --2- 172.21.15.176:0/1082696154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bcc0c8e00 0x7f1bcc1562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.473 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.473+0000 7f1bd0afd640 1 -- 172.21.15.176:0/1082696154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb8009400 con 0x7f1bcc06aec0 2023-12-12T23:59:56.475 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.475+0000 7f1bd0afd640 1 --2- 172.21.15.176:0/1082696154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bcc06aec0 0x7f1bcc1e2890 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0000f60 tx=0x7f1bc000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:56.479 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.478+0000 7f1bc97fa640 1 -- 172.21.15.176:0/1082696154 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0005ce0 con 0x7f1bcc06aec0 2023-12-12T23:59:56.480 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.478+0000 7f1bc97fa640 1 -- 172.21.15.176:0/1082696154 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc0005e40 con 0x7f1bcc06aec0 2023-12-12T23:59:56.480 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.478+0000 7f1bd2d61640 1 -- 172.21.15.176:0/1082696154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bcc1532e0 con 0x7f1bcc06aec0 2023-12-12T23:59:56.480 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.478+0000 7f1bc97fa640 1 -- 172.21.15.176:0/1082696154 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0007310 con 0x7f1bcc06aec0 2023-12-12T23:59:56.480 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.479+0000 7f1bd2d61640 1 -- 172.21.15.176:0/1082696154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bcc1538a0 con 0x7f1bcc06aec0 2023-12-12T23:59:56.480 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.479+0000 7f1bd2d61640 1 -- 172.21.15.176:0/1082696154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bcc151b00 con 0x7f1bcc06aec0 2023-12-12T23:59:56.576 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.576+0000 7f1bc97fa640 1 -- 172.21.15.176:0/1082696154 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f1bc001c440 con 0x7f1bcc06aec0 2023-12-12T23:59:56.580 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.581+0000 7f1bc97fa640 1 -- 172.21.15.176:0/1082696154 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f1bc001b8c0 con 0x7f1bcc06aec0 2023-12-12T23:59:56.580 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.581+0000 7f1bc97fa640 1 -- 172.21.15.176:0/1082696154 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f1bc0017070 con 0x7f1bcc06aec0 2023-12-12T23:59:56.592 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:56.592+0000 7fb236432040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-12T23:59:56.637 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:56.637+0000 7fb236432040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-12T23:59:56.653 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.653+0000 7f1bd2d61640 1 -- 172.21.15.176:0/1082696154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd", "id": 4} v 0) v1 -- 0x7f1bcc073dc0 con 0x7f1bcc06aec0 2023-12-12T23:59:56.696 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.696+0000 7f1bc97fa640 1 -- 172.21.15.176:0/1082696154 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1bc001b3b0 con 0x7f1bcc06aec0 2023-12-12T23:59:56.696 INFO:teuthology.orchestra.run.smithi176.stdout:4 2023-12-12T23:59:56.697 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.697+0000 7f1bd2d61640 1 -- 172.21.15.176:0/1082696154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bcc06aec0 msgr2=0x7f1bcc1e2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:56.697 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.697+0000 7f1bd2d61640 1 --2- 172.21.15.176:0/1082696154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bcc06aec0 0x7f1bcc1e2890 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0000f60 tx=0x7f1bc000c760 comp rx=0 tx=0).stop 2023-12-12T23:59:56.698 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.698+0000 7f1bd2d61640 1 -- 172.21.15.176:0/1082696154 shutdown_connections 2023-12-12T23:59:56.698 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.698+0000 7f1bd2d61640 1 --2- 172.21.15.176:0/1082696154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bcc151450 0x7f1bcc1521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.698 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.698+0000 7f1bd2d61640 1 --2- 172.21.15.176:0/1082696154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bcc0c8e00 0x7f1bcc1562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.698 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.698+0000 7f1bd2d61640 1 --2- 172.21.15.176:0/1082696154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bcc06aec0 0x7f1bcc1e2890 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.698 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.698+0000 7f1bd2d61640 1 -- 172.21.15.176:0/1082696154 >> 172.21.15.176:0/1082696154 conn(0x7f1bcc0700e0 msgr2=0x7f1bcc0c5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:56.698 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.698+0000 7f1bd2d61640 1 -- 172.21.15.176:0/1082696154 shutdown_connections 2023-12-12T23:59:56.698 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.698+0000 7f1bd2d61640 1 -- 172.21.15.176:0/1082696154 wait complete. 2023-12-12T23:59:56.709 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 5bef04ae-8b8c-4033-b92e-af2f2287e462 5 2023-12-12T23:59:56.790 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:56.790+0000 7fb236432040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-12T23:59:56.809 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.809+0000 7fc5767be640 1 Processor -- start 2023-12-12T23:59:56.809 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.809+0000 7fc5767be640 1 -- start start 2023-12-12T23:59:56.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.810+0000 7fc5767be640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5700c58d0 0x7fc570157300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:56.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.810+0000 7fc5767be640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc57006aeb0 0x7fc570157840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:56.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.810+0000 7fc5767be640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57015a930 con 0x7fc5700c54f0 2023-12-12T23:59:56.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.810+0000 7fc5767be640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5700c7ed0 con 0x7fc5700c58d0 2023-12-12T23:59:56.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.810+0000 7fc5767be640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc570072220 con 0x7fc57006aeb0 2023-12-12T23:59:56.811 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.810+0000 7fc56ffff640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fc5700c54f0 0x7fc570071b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:60958/0 (socket says 172.21.15.176:60958) 2023-12-12T23:59:56.811 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.810+0000 7fc56ffff640 1 -- 172.21.15.176:0/3864144027 learned_addr learned my addr 172.21.15.176:0/3864144027 (peer_addr_for_me v1:172.21.15.176:0/0) 2023-12-12T23:59:56.811 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.811+0000 7fc574d5b640 1 --2- 172.21.15.176:0/3864144027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc57006aeb0 0x7fc570157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:56.811 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.811+0000 7fc56f7fe640 1 --2- 172.21.15.176:0/3864144027 >> v2:172.21.15.72:3300/0 conn(0x7fc5700c58d0 0x7fc570157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:56.813 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.813+0000 7fc56f7fe640 1 -- 172.21.15.176:0/3864144027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc57006aeb0 msgr2=0x7fc570157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T23:59:56.813 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.813+0000 7fc56f7fe640 1 --2- 172.21.15.176:0/3864144027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc57006aeb0 0x7fc570157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.813 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.813+0000 7fc56f7fe640 1 -- 172.21.15.176:0/3864144027 >> v1:172.21.15.176:6789/0 conn(0x7fc5700c54f0 legacy=0x7fc570071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:56.813 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.813+0000 7fc56f7fe640 1 -- 172.21.15.176:0/3864144027 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc570157f00 con 0x7fc5700c58d0 2023-12-12T23:59:56.813 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.813+0000 7fc574d5b640 1 --2- 172.21.15.176:0/3864144027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc57006aeb0 0x7fc570157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T23:59:56.814 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.815+0000 7fc56f7fe640 1 --2- 172.21.15.176:0/3864144027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5700c58d0 0x7fc570157300 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc5600097d0 tx=0x7fc56002b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea67146f014477a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:56.818 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.818+0000 7fc56effd640 1 -- 172.21.15.176:0/3864144027 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560031890 con 0x7fc5700c58d0 2023-12-12T23:59:56.818 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.818+0000 7fc56effd640 1 -- 172.21.15.176:0/3864144027 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5600319f0 con 0x7fc5700c58d0 2023-12-12T23:59:56.818 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.818+0000 7fc56effd640 1 -- 172.21.15.176:0/3864144027 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560031d80 con 0x7fc5700c58d0 2023-12-12T23:59:56.819 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.819+0000 7fc5767be640 1 -- 172.21.15.176:0/3864144027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5700c58d0 msgr2=0x7fc570157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:56.819 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.819+0000 7fc5767be640 1 --2- 172.21.15.176:0/3864144027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5700c58d0 0x7fc570157300 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc5600097d0 tx=0x7fc56002b930 comp rx=0 tx=0).stop 2023-12-12T23:59:56.819 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.819+0000 7fc5767be640 1 -- 172.21.15.176:0/3864144027 shutdown_connections 2023-12-12T23:59:56.819 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.819+0000 7fc5767be640 1 --2- 172.21.15.176:0/3864144027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc57006aeb0 0x7fc570157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.819 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.819+0000 7fc5767be640 1 --2- 172.21.15.176:0/3864144027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5700c58d0 0x7fc570157300 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.820 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.819+0000 7fc5767be640 1 -- 172.21.15.176:0/3864144027 >> 172.21.15.176:0/3864144027 conn(0x7fc57006b5c0 msgr2=0x7fc57006b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:56.820 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.819+0000 7fc5767be640 1 -- 172.21.15.176:0/3864144027 shutdown_connections 2023-12-12T23:59:56.820 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.819+0000 7fc5767be640 1 -- 172.21.15.176:0/3864144027 wait complete. 2023-12-12T23:59:56.820 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.820+0000 7fc5767be640 1 Processor -- start 2023-12-12T23:59:56.820 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.821+0000 7fc5767be640 1 -- start start 2023-12-12T23:59:56.821 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.821+0000 7fc5767be640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc57006aeb0 0x7fc5700c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:56.821 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.821+0000 7fc5767be640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5700c54f0 0x7fc5701501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:56.821 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.821+0000 7fc5767be640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5700c58d0 0x7fc57014ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:56.821 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.821+0000 7fc5767be640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5701ef5e0 con 0x7fc5700c54f0 2023-12-12T23:59:56.821 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.821+0000 7fc5767be640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5701eecd0 con 0x7fc5700c58d0 2023-12-12T23:59:56.821 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.821+0000 7fc5767be640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5701508a0 con 0x7fc57006aeb0 2023-12-12T23:59:56.822 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.822+0000 7fc56f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5700c54f0 0x7fc5701501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:56.822 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.822+0000 7fc574d5b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5700c58d0 0x7fc57014ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:56.822 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.822+0000 7fc56ffff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc57006aeb0 0x7fc5700c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:56.822 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.822+0000 7fc574d5b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5700c58d0 0x7fc57014ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:44360/0 (socket says 172.21.15.176:44360) 2023-12-12T23:59:56.822 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.822+0000 7fc574d5b640 1 -- 172.21.15.176:0/3187951500 learned_addr learned my addr 172.21.15.176:0/3187951500 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-12-12T23:59:56.825 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.825+0000 7fc56f7fe640 1 -- 172.21.15.176:0/3187951500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc57006aeb0 msgr2=0x7fc5700c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:56.825 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.825+0000 7fc56f7fe640 1 --2- 172.21.15.176:0/3187951500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc57006aeb0 0x7fc5700c4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.825 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.825+0000 7fc56f7fe640 1 -- 172.21.15.176:0/3187951500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5700c58d0 msgr2=0x7fc57014ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:56.825 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.825+0000 7fc56f7fe640 1 --2- 172.21.15.176:0/3187951500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5700c58d0 0x7fc57014ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:56.825 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.825+0000 7fc56f7fe640 1 -- 172.21.15.176:0/3187951500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc568009a70 con 0x7fc5700c54f0 2023-12-12T23:59:56.827 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.827+0000 7fc56f7fe640 1 --2- 172.21.15.176:0/3187951500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5700c54f0 0x7fc5701501f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc560033000 tx=0x7fc5600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:56.830 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.831+0000 7fc56cff9640 1 -- 172.21.15.176:0/3187951500 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56003bd00 con 0x7fc5700c54f0 2023-12-12T23:59:56.831 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.831+0000 7fc56cff9640 1 -- 172.21.15.176:0/3187951500 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5600453f0 con 0x7fc5700c54f0 2023-12-12T23:59:56.831 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.831+0000 7fc56cff9640 1 -- 172.21.15.176:0/3187951500 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56003bea0 con 0x7fc5700c54f0 2023-12-12T23:59:56.831 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.831+0000 7fc5767be640 1 -- 172.21.15.176:0/3187951500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc560009400 con 0x7fc5700c54f0 2023-12-12T23:59:56.831 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.831+0000 7fc5767be640 1 -- 172.21.15.176:0/3187951500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5701eef90 con 0x7fc5700c54f0 2023-12-12T23:59:56.831 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.832+0000 7fc5767be640 1 -- 172.21.15.176:0/3187951500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc570151920 con 0x7fc5700c54f0 2023-12-12T23:59:56.833 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.833+0000 7fc56cff9640 1 -- 172.21.15.176:0/3187951500 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fc5600457a0 con 0x7fc5700c54f0 2023-12-12T23:59:56.833 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.834+0000 7fc56cff9640 1 -- 172.21.15.176:0/3187951500 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fc56004ea90 con 0x7fc5700c54f0 2023-12-12T23:59:56.931 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:56.932+0000 7fc56cff9640 1 -- 172.21.15.176:0/3187951500 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fc560035020 con 0x7fc5700c54f0 2023-12-12T23:59:57.003 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.003+0000 7fc5767be640 1 -- 172.21.15.176:0/3187951500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5bef04ae-8b8c-4033-b92e-af2f2287e462", "id": 5} v 0) v1 -- 0x7fc570073dc0 con 0x7fc5700c54f0 2023-12-12T23:59:57.047 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.047+0000 7fc56cff9640 1 -- 172.21.15.176:0/3187951500 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5bef04ae-8b8c-4033-b92e-af2f2287e462", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc56004e450 con 0x7fc5700c54f0 2023-12-12T23:59:57.047 INFO:teuthology.orchestra.run.smithi176.stdout:5 2023-12-12T23:59:57.048 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.048+0000 7fc5767be640 1 -- 172.21.15.176:0/3187951500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5700c54f0 msgr2=0x7fc5701501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:57.049 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.048+0000 7fc5767be640 1 --2- 172.21.15.176:0/3187951500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5700c54f0 0x7fc5701501f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc560033000 tx=0x7fc5600046c0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.049 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.048+0000 7fc5767be640 1 -- 172.21.15.176:0/3187951500 shutdown_connections 2023-12-12T23:59:57.049 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.048+0000 7fc5767be640 1 --2- 172.21.15.176:0/3187951500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5700c58d0 0x7fc57014ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.049 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.048+0000 7fc5767be640 1 --2- 172.21.15.176:0/3187951500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5700c54f0 0x7fc5701501f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.049 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.048+0000 7fc5767be640 1 --2- 172.21.15.176:0/3187951500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc57006aeb0 0x7fc5700c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.049 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.049+0000 7fc5767be640 1 -- 172.21.15.176:0/3187951500 >> 172.21.15.176:0/3187951500 conn(0x7fc57006b5c0 msgr2=0x7fc5700c9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:57.049 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.049+0000 7fc5767be640 1 -- 172.21.15.176:0/3187951500 shutdown_connections 2023-12-12T23:59:57.049 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.049+0000 7fc5767be640 1 -- 172.21.15.176:0/3187951500 wait complete. 2023-12-12T23:59:57.059 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 269c276f-130b-4e32-96f9-026acf7eed06 6 2023-12-12T23:59:57.158 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.159+0000 7f14da883640 1 Processor -- start 2023-12-12T23:59:57.159 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.159+0000 7f14da883640 1 -- start start 2023-12-12T23:59:57.159 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.159+0000 7f14da883640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f14d4157690 0x7f14d40cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:57.159 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.159+0000 7f14da883640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d40c1cd0 con 0x7f14d40c0ed0 2023-12-12T23:59:57.159 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.159+0000 7f14da883640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d40c1430 con 0x7f14d4150210 2023-12-12T23:59:57.160 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.159+0000 7f14da883640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d41561a0 con 0x7f14d4157690 2023-12-12T23:59:57.160 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.160+0000 7f14d3fff640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f14d4150210 0x7f14d4156b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:60968/0 (socket says 172.21.15.176:60968) 2023-12-12T23:59:57.160 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.160+0000 7f14d3fff640 1 -- 172.21.15.176:0/516822796 learned_addr learned my addr 172.21.15.176:0/516822796 (peer_addr_for_me v1:172.21.15.176:0/0) 2023-12-12T23:59:57.160 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.160+0000 7f14d37fe640 1 --2- 172.21.15.176:0/516822796 >> v2:172.21.15.72:3300/0 conn(0x7f14d4157690 0x7f14d40cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:57.163 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.163+0000 7f14d2ffd640 1 -- 172.21.15.176:0/516822796 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036430967 0 0) 0x7f14d40c1430 con 0x7f14d4150210 2023-12-12T23:59:57.163 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.163+0000 7f14d2ffd640 1 -- 172.21.15.176:0/516822796 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14bc005730 con 0x7f14d4150210 2023-12-12T23:59:57.163 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.163+0000 7f14d37fe640 1 -- 172.21.15.176:0/516822796 >> v1:172.21.15.176:6789/0 conn(0x7f14d4150210 legacy=0x7f14d4156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:57.163 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.163+0000 7f14d37fe640 1 -- 172.21.15.176:0/516822796 >> v1:172.21.15.72:6789/0 conn(0x7f14d40c0ed0 legacy=0x7f14d40720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:57.164 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.163+0000 7f14d37fe640 1 -- 172.21.15.176:0/516822796 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d40c1710 con 0x7f14d4157690 2023-12-12T23:59:57.168 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.169+0000 7f14d37fe640 1 --2- 172.21.15.176:0/516822796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d4157690 0x7f14d40cbae0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f14c80097a0 tx=0x7f14c802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f86a9aac5e99a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:57.173 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.173+0000 7f14d2ffd640 1 -- 172.21.15.176:0/516822796 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8030610 con 0x7f14d4157690 2023-12-12T23:59:57.173 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.173+0000 7f14d2ffd640 1 -- 172.21.15.176:0/516822796 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c8030770 con 0x7f14d4157690 2023-12-12T23:59:57.173 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.173+0000 7f14d2ffd640 1 -- 172.21.15.176:0/516822796 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8030b00 con 0x7f14d4157690 2023-12-12T23:59:57.174 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.174+0000 7f14da883640 1 -- 172.21.15.176:0/516822796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d4157690 msgr2=0x7f14d40cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:57.174 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.174+0000 7f14da883640 1 --2- 172.21.15.176:0/516822796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d4157690 0x7f14d40cbae0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f14c80097a0 tx=0x7f14c802b960 comp rx=0 tx=0).stop 2023-12-12T23:59:57.174 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.174+0000 7f14da883640 1 -- 172.21.15.176:0/516822796 shutdown_connections 2023-12-12T23:59:57.174 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.174+0000 7f14da883640 1 --2- 172.21.15.176:0/516822796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d4157690 0x7f14d40cbae0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.174 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.174+0000 7f14da883640 1 -- 172.21.15.176:0/516822796 >> 172.21.15.176:0/516822796 conn(0x7f14d40700e0 msgr2=0x7f14d406b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:57.174 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.174+0000 7f14da883640 1 -- 172.21.15.176:0/516822796 shutdown_connections 2023-12-12T23:59:57.175 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.174+0000 7f14da883640 1 -- 172.21.15.176:0/516822796 wait complete. 2023-12-12T23:59:57.175 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.175+0000 7f14da883640 1 Processor -- start 2023-12-12T23:59:57.175 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.176+0000 7f14da883640 1 -- start start 2023-12-12T23:59:57.177 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.176+0000 7f14da883640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14d40c0ed0 0x7f14d41489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:57.177 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.176+0000 7f14da883640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14d4150210 0x7f14d4154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:57.177 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.176+0000 7f14da883640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d4157690 0x7f14d40c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:57.177 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.176+0000 7f14da883640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d41ee3e0 con 0x7f14d4157690 2023-12-12T23:59:57.177 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.176+0000 7f14da883640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d40c6550 con 0x7f14d4150210 2023-12-12T23:59:57.177 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.176+0000 7f14da883640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d41ee870 con 0x7f14d40c0ed0 2023-12-12T23:59:57.178 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.177+0000 7f14d37fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14d4150210 0x7f14d4154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:57.178 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.177+0000 7f14d8e20640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d4157690 0x7f14d40c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:57.178 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.177+0000 7f14d3fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14d40c0ed0 0x7f14d41489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:57.178 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.177+0000 7f14d37fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14d4150210 0x7f14d4154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:44368/0 (socket says 172.21.15.176:44368) 2023-12-12T23:59:57.178 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.177+0000 7f14d37fe640 1 -- 172.21.15.176:0/1574673971 learned_addr learned my addr 172.21.15.176:0/1574673971 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-12-12T23:59:57.180 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.180+0000 7f14d8e20640 1 -- 172.21.15.176:0/1574673971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14d40c0ed0 msgr2=0x7f14d41489f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:57.180 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.180+0000 7f14d8e20640 1 --2- 172.21.15.176:0/1574673971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14d40c0ed0 0x7f14d41489f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.180 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.180+0000 7f14d8e20640 1 -- 172.21.15.176:0/1574673971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14d4150210 msgr2=0x7f14d4154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:57.180 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.180+0000 7f14d8e20640 1 --2- 172.21.15.176:0/1574673971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14d4150210 0x7f14d4154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.180 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.180+0000 7f14d8e20640 1 -- 172.21.15.176:0/1574673971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c8009400 con 0x7f14d4157690 2023-12-12T23:59:57.182 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.182+0000 7f14d8e20640 1 --2- 172.21.15.176:0/1574673971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d4157690 0x7f14d40c44c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00c730 tx=0x7f14cc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:57.186 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.187+0000 7f14d0ff9640 1 -- 172.21.15.176:0/1574673971 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc003b70 con 0x7f14d4157690 2023-12-12T23:59:57.187 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.187+0000 7f14d0ff9640 1 -- 172.21.15.176:0/1574673971 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc003cd0 con 0x7f14d4157690 2023-12-12T23:59:57.187 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.187+0000 7f14d0ff9640 1 -- 172.21.15.176:0/1574673971 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc005310 con 0x7f14d4157690 2023-12-12T23:59:57.187 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.187+0000 7f14da883640 1 -- 172.21.15.176:0/1574673971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d40c6290 con 0x7f14d4157690 2023-12-12T23:59:57.187 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.187+0000 7f14da883640 1 -- 172.21.15.176:0/1574673971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d41edd90 con 0x7f14d4157690 2023-12-12T23:59:57.187 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.188+0000 7f14da883640 1 -- 172.21.15.176:0/1574673971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d41ee590 con 0x7f14d4157690 2023-12-12T23:59:57.190 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.191+0000 7f14d0ff9640 1 -- 172.21.15.176:0/1574673971 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f14cc00a9c0 con 0x7f14d4157690 2023-12-12T23:59:57.190 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.191+0000 7f14d0ff9640 1 -- 172.21.15.176:0/1574673971 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f14cc012420 con 0x7f14d4157690 2023-12-12T23:59:57.358 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.358+0000 7f14d0ff9640 1 -- 172.21.15.176:0/1574673971 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f14d41ee590 con 0x7f14d4157690 2023-12-12T23:59:57.395 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:57.395+0000 7f779063c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-12T23:59:57.456 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.456+0000 7f14da883640 1 -- 172.21.15.176:0/1574673971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "269c276f-130b-4e32-96f9-026acf7eed06", "id": 6} v 0) v1 -- 0x7f14d4073dc0 con 0x7f14d4157690 2023-12-12T23:59:57.488 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.488+0000 7f14d0ff9640 1 -- 172.21.15.176:0/1574673971 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "269c276f-130b-4e32-96f9-026acf7eed06", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f14d40c1cd0 con 0x7f14d4157690 2023-12-12T23:59:57.488 INFO:teuthology.orchestra.run.smithi176.stdout:6 2023-12-12T23:59:57.490 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.490+0000 7f14da883640 1 -- 172.21.15.176:0/1574673971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d4157690 msgr2=0x7f14d40c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:57.490 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.490+0000 7f14da883640 1 --2- 172.21.15.176:0/1574673971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d4157690 0x7f14d40c44c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00c730 tx=0x7f14cc00cbf0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.490 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.490+0000 7f14da883640 1 -- 172.21.15.176:0/1574673971 shutdown_connections 2023-12-12T23:59:57.490 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.490+0000 7f14da883640 1 --2- 172.21.15.176:0/1574673971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d4157690 0x7f14d40c44c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.490 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.490+0000 7f14da883640 1 --2- 172.21.15.176:0/1574673971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14d4150210 0x7f14d4154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.490 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.490+0000 7f14da883640 1 --2- 172.21.15.176:0/1574673971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14d40c0ed0 0x7f14d41489f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.490 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.490+0000 7f14da883640 1 -- 172.21.15.176:0/1574673971 >> 172.21.15.176:0/1574673971 conn(0x7f14d40700e0 msgr2=0x7f14d40cbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:57.490 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.490+0000 7f14da883640 1 -- 172.21.15.176:0/1574673971 shutdown_connections 2023-12-12T23:59:57.490 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.490+0000 7f14da883640 1 -- 172.21.15.176:0/1574673971 wait complete. 2023-12-12T23:59:57.504 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new e3ae5768-010b-46d0-9637-8ecc58a87ba9 7 2023-12-12T23:59:57.607 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.608+0000 7f737933c640 1 Processor -- start 2023-12-12T23:59:57.608 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.608+0000 7f737933c640 1 -- start start 2023-12-12T23:59:57.609 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.608+0000 7f737933c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f737406aeb0 0x7f7374157e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:57.609 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.608+0000 7f737933c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f737415a880 0x7f73740c5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:57.609 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.608+0000 7f737933c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737415acb0 con 0x7f7374151220 2023-12-12T23:59:57.609 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.608+0000 7f737933c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7374072220 con 0x7f737415a880 2023-12-12T23:59:57.609 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.608+0000 7f737933c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73740c2df0 con 0x7f737406aeb0 2023-12-12T23:59:57.609 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.609+0000 7f73727fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f737406aeb0 0x7f7374157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:57.609 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.609+0000 7f73737fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f737415a880 0x7f73740c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:57.609 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.609+0000 7f73727fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f737406aeb0 0x7f7374157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:44370/0 (socket says 172.21.15.176:44370) 2023-12-12T23:59:57.609 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.609+0000 7f73727fc640 1 -- 172.21.15.176:0/1940870862 learned_addr learned my addr 172.21.15.176:0/1940870862 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-12-12T23:59:57.611 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.611+0000 7f73727fc640 1 -- 172.21.15.176:0/1940870862 >> v2:172.21.15.72:3300/0 conn(0x7f737415a880 msgr2=0x7f73740c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T23:59:57.611 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.611+0000 7f73727fc640 1 --2- 172.21.15.176:0/1940870862 >> v2:172.21.15.72:3300/0 conn(0x7f737415a880 0x7f73740c5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.611 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.611+0000 7f73727fc640 1 -- 172.21.15.176:0/1940870862 >> v1:172.21.15.72:6789/0 conn(0x7f7374151220 legacy=0x7f7374071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:57.611 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.611+0000 7f73727fc640 1 -- 172.21.15.176:0/1940870862 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73740729d0 con 0x7f737406aeb0 2023-12-12T23:59:57.613 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.613+0000 7f73727fc640 1 --2- 172.21.15.176:0/1940870862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f737406aeb0 0x7f7374157e80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7374072bc0 tx=0x7f736802ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a5869019b4c2652 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:57.616 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.617+0000 7f7371ffb640 1 -- 172.21.15.176:0/1940870862 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736802f840 con 0x7f737406aeb0 2023-12-12T23:59:57.616 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.617+0000 7f7371ffb640 1 -- 172.21.15.176:0/1940870862 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736802f9a0 con 0x7f737406aeb0 2023-12-12T23:59:57.616 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.617+0000 7f7371ffb640 1 -- 172.21.15.176:0/1940870862 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736802fd30 con 0x7f737406aeb0 2023-12-12T23:59:57.618 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.618+0000 7f737933c640 1 -- 172.21.15.176:0/1940870862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f737406aeb0 msgr2=0x7f7374157e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:57.618 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.618+0000 7f737933c640 1 --2- 172.21.15.176:0/1940870862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f737406aeb0 0x7f7374157e80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7374072bc0 tx=0x7f736802ba20 comp rx=0 tx=0).stop 2023-12-12T23:59:57.618 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.618+0000 7f737933c640 1 -- 172.21.15.176:0/1940870862 shutdown_connections 2023-12-12T23:59:57.618 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.618+0000 7f737933c640 1 --2- 172.21.15.176:0/1940870862 >> v2:172.21.15.72:3300/0 conn(0x7f737415a880 0x7f73740c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.618 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.618+0000 7f737933c640 1 --2- 172.21.15.176:0/1940870862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f737406aeb0 0x7f7374157e80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.618 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.618+0000 7f737933c640 1 -- 172.21.15.176:0/1940870862 >> 172.21.15.176:0/1940870862 conn(0x7f737406b5c0 msgr2=0x7f737406b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:57.618 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.618+0000 7f737933c640 1 -- 172.21.15.176:0/1940870862 shutdown_connections 2023-12-12T23:59:57.618 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.618+0000 7f737933c640 1 -- 172.21.15.176:0/1940870862 wait complete. 2023-12-12T23:59:57.619 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.619+0000 7f737933c640 1 Processor -- start 2023-12-12T23:59:57.619 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.619+0000 7f737933c640 1 -- start start 2023-12-12T23:59:57.620 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.620+0000 7f737933c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f737406aeb0 0x7f737414bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:57.620 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.620+0000 7f737933c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7374151220 0x7f7374158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:57.620 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.620+0000 7f737933c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f737415a880 0x7f73741593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:57.620 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.620+0000 7f737933c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737415a090 con 0x7f737406aeb0 2023-12-12T23:59:57.620 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.620+0000 7f737933c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73740c92c0 con 0x7f7374151220 2023-12-12T23:59:57.620 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.620+0000 7f737933c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73741ef060 con 0x7f737415a880 2023-12-12T23:59:57.620 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.620+0000 7f73727fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7374151220 0x7f7374158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:57.620 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.620+0000 7f7372ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f737406aeb0 0x7f737414bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:57.621 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.621+0000 7f73737fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f737415a880 0x7f73741593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:57.621 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.621+0000 7f73727fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7374151220 0x7f7374158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:44374/0 (socket says 172.21.15.176:44374) 2023-12-12T23:59:57.621 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.621+0000 7f73727fc640 1 -- 172.21.15.176:0/1570292921 learned_addr learned my addr 172.21.15.176:0/1570292921 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-12-12T23:59:57.624 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.624+0000 7f7372ffd640 1 -- 172.21.15.176:0/1570292921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f737415a880 msgr2=0x7f73741593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:57.624 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.624+0000 7f7372ffd640 1 --2- 172.21.15.176:0/1570292921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f737415a880 0x7f73741593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.624 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.624+0000 7f7372ffd640 1 -- 172.21.15.176:0/1570292921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7374151220 msgr2=0x7f7374158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:57.624 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.624+0000 7f7372ffd640 1 --2- 172.21.15.176:0/1570292921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7374151220 0x7f7374158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.624 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.624+0000 7f7372ffd640 1 -- 172.21.15.176:0/1570292921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73680094d0 con 0x7f737406aeb0 2023-12-12T23:59:57.625 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.626+0000 7f7372ffd640 1 --2- 172.21.15.176:0/1570292921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f737406aeb0 0x7f737414bd60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f736400c390 tx=0x7f736400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:57.628 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.628+0000 7f735b7fe640 1 -- 172.21.15.176:0/1570292921 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73640052d0 con 0x7f737406aeb0 2023-12-12T23:59:57.628 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.628+0000 7f737933c640 1 -- 172.21.15.176:0/1570292921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73741ef320 con 0x7f737406aeb0 2023-12-12T23:59:57.628 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.628+0000 7f737933c640 1 -- 172.21.15.176:0/1570292921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73741ef8e0 con 0x7f737406aeb0 2023-12-12T23:59:57.629 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.629+0000 7f737933c640 1 -- 172.21.15.176:0/1570292921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7374073dc0 con 0x7f737406aeb0 2023-12-12T23:59:57.671 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:57.671+0000 7fb236432040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-12T23:59:57.705 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:57.704+0000 7f779063c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-12T23:59:57.749 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.749+0000 7f735b7fe640 1 -- 172.21.15.176:0/1570292921 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7364005430 con 0x7f737406aeb0 2023-12-12T23:59:57.749 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.750+0000 7f735b7fe640 1 -- 172.21.15.176:0/1570292921 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364007250 con 0x7f737406aeb0 2023-12-12T23:59:57.750 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.750+0000 7f735b7fe640 1 -- 172.21.15.176:0/1570292921 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f73640067d0 con 0x7f737406aeb0 2023-12-12T23:59:57.750 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.750+0000 7f735b7fe640 1 -- 172.21.15.176:0/1570292921 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f7364003d20 con 0x7f737406aeb0 2023-12-12T23:59:57.757 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.757+0000 7f735b7fe640 1 -- 172.21.15.176:0/1570292921 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f7364017070 con 0x7f737406aeb0 2023-12-12T23:59:57.762 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:57.761+0000 7f779063c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-12T23:59:57.840 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.840+0000 7f737933c640 1 -- 172.21.15.176:0/1570292921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e3ae5768-010b-46d0-9637-8ecc58a87ba9", "id": 7} v 0) v1 -- 0x7f73740c9040 con 0x7f737406aeb0 2023-12-12T23:59:57.872 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:57.871+0000 7f779063c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-12T23:59:57.874 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.875+0000 7f735b7fe640 1 -- 172.21.15.176:0/1570292921 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e3ae5768-010b-46d0-9637-8ecc58a87ba9", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f73640035f0 con 0x7f737406aeb0 2023-12-12T23:59:57.875 INFO:teuthology.orchestra.run.smithi176.stdout:7 2023-12-12T23:59:57.876 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.876+0000 7f737933c640 1 -- 172.21.15.176:0/1570292921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f737406aeb0 msgr2=0x7f737414bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:57.876 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.876+0000 7f737933c640 1 --2- 172.21.15.176:0/1570292921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f737406aeb0 0x7f737414bd60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f736400c390 tx=0x7f736400c850 comp rx=0 tx=0).stop 2023-12-12T23:59:57.876 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.876+0000 7f737933c640 1 -- 172.21.15.176:0/1570292921 shutdown_connections 2023-12-12T23:59:57.876 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.876+0000 7f737933c640 1 --2- 172.21.15.176:0/1570292921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f737415a880 0x7f73741593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.876 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.876+0000 7f737933c640 1 --2- 172.21.15.176:0/1570292921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7374151220 0x7f7374158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.876 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.876+0000 7f737933c640 1 --2- 172.21.15.176:0/1570292921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f737406aeb0 0x7f737414bd60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:57.876 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.876+0000 7f737933c640 1 -- 172.21.15.176:0/1570292921 >> 172.21.15.176:0/1570292921 conn(0x7f737406b5c0 msgr2=0x7f737406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:57.876 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.876+0000 7f737933c640 1 -- 172.21.15.176:0/1570292921 shutdown_connections 2023-12-12T23:59:57.876 INFO:teuthology.orchestra.run.smithi176.stderr:2023-12-12T23:59:57.876+0000 7f737933c640 1 -- 172.21.15.176:0/1570292921 wait complete. 2023-12-12T23:59:57.888 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-12T23:59:57.888 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2023-12-12T23:59:57.890 INFO:tasks.ceph.osd.0:Started 2023-12-12T23:59:57.890 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-12T23:59:57.890 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2023-12-12T23:59:57.892 INFO:tasks.ceph.osd.1:Started 2023-12-12T23:59:57.892 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-12T23:59:57.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2023-12-12T23:59:57.894 INFO:tasks.ceph.osd.2:Started 2023-12-12T23:59:57.894 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-12T23:59:57.895 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2023-12-12T23:59:57.896 INFO:tasks.ceph.osd.3:Started 2023-12-12T23:59:57.897 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-12T23:59:57.897 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2023-12-12T23:59:57.899 INFO:tasks.ceph.osd.4:Started 2023-12-12T23:59:57.899 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-12T23:59:57.899 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2023-12-12T23:59:57.901 INFO:tasks.ceph.osd.5:Started 2023-12-12T23:59:57.901 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-12T23:59:57.901 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2023-12-12T23:59:57.904 INFO:tasks.ceph.osd.6:Started 2023-12-12T23:59:57.904 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-12T23:59:57.904 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2023-12-12T23:59:57.906 INFO:tasks.ceph.osd.7:Started 2023-12-12T23:59:57.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T23:59:57.966 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:57.966+0000 7fb236432040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-12T23:59:58.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.013+0000 7f9db4539640 1 Processor -- start 2023-12-12T23:59:58.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.013+0000 7f9db4539640 1 -- start start 2023-12-12T23:59:58.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.014+0000 7f9db4539640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9dac0cc420 0x7f9dac159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:58.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.014+0000 7f9db4539640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9dac159b50 0x7f9dac0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:58.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.015+0000 7f9db4539640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dac0cbda0 con 0x7f9dac0cda70 2023-12-12T23:59:58.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.015+0000 7f9db4539640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dac0cc230 con 0x7f9dac159b50 2023-12-12T23:59:58.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.015+0000 7f9db4539640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dac0cea60 con 0x7f9dac0cc420 2023-12-12T23:59:58.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.027+0000 7f9db1ad4640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9dac0cc420 0x7f9dac159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:58.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.031+0000 7f9db1ad4640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9dac0cc420 0x7f9dac159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:48646/0 (socket says 172.21.15.72:48646) 2023-12-12T23:59:58.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.031+0000 7f9db1ad4640 1 -- 172.21.15.72:0/1491068653 learned_addr learned my addr 172.21.15.72:0/1491068653 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-12T23:59:58.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.038+0000 7f9db1ad4640 1 -- 172.21.15.72:0/1491068653 >> v2:172.21.15.72:3300/0 conn(0x7f9dac159b50 msgr2=0x7f9dac0c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T23:59:58.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.038+0000 7f9db1ad4640 1 --2- 172.21.15.72:0/1491068653 >> v2:172.21.15.72:3300/0 conn(0x7f9dac159b50 0x7f9dac0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:58.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.038+0000 7f9db1ad4640 1 -- 172.21.15.72:0/1491068653 >> v1:172.21.15.176:6789/0 conn(0x7f9dac0cda70 legacy=0x7f9dac0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:58.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.038+0000 7f9db1ad4640 1 -- 172.21.15.72:0/1491068653 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac0cb4e0 con 0x7f9dac0cc420 2023-12-12T23:59:58.039 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:58.040+0000 7fb236432040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-12T23:59:58.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.052+0000 7f9db1ad4640 1 --2- 172.21.15.72:0/1491068653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dac0cc420 0x7f9dac159610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0cfda0 tx=0x7f9da802ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7880632707db621f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:58.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.061+0000 7f9db12d3640 1 -- 172.21.15.72:0/1491068653 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da802f850 con 0x7f9dac0cc420 2023-12-12T23:59:58.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.062+0000 7f9db12d3640 1 -- 172.21.15.72:0/1491068653 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da802f9b0 con 0x7f9dac0cc420 2023-12-12T23:59:58.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.062+0000 7f9db12d3640 1 -- 172.21.15.72:0/1491068653 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da802fd40 con 0x7f9dac0cc420 2023-12-12T23:59:58.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.062+0000 7f9db4539640 1 -- 172.21.15.72:0/1491068653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dac0cc420 msgr2=0x7f9dac159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:58.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.062+0000 7f9db4539640 1 --2- 172.21.15.72:0/1491068653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dac0cc420 0x7f9dac159610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0cfda0 tx=0x7f9da802ba30 comp rx=0 tx=0).stop 2023-12-12T23:59:58.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.062+0000 7f9db4539640 1 -- 172.21.15.72:0/1491068653 shutdown_connections 2023-12-12T23:59:58.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.062+0000 7f9db4539640 1 --2- 172.21.15.72:0/1491068653 >> v2:172.21.15.72:3300/0 conn(0x7f9dac159b50 0x7f9dac0c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:58.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.062+0000 7f9db4539640 1 --2- 172.21.15.72:0/1491068653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dac0cc420 0x7f9dac159610 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:58.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.062+0000 7f9db4539640 1 -- 172.21.15.72:0/1491068653 >> 172.21.15.72:0/1491068653 conn(0x7f9dac0b07b0 msgr2=0x7f9dac0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:58.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.062+0000 7f9db4539640 1 -- 172.21.15.72:0/1491068653 shutdown_connections 2023-12-12T23:59:58.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.062+0000 7f9db4539640 1 -- 172.21.15.72:0/1491068653 wait complete. 2023-12-12T23:59:58.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.064+0000 7f9db4539640 1 Processor -- start 2023-12-12T23:59:58.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.064+0000 7f9db4539640 1 -- start start 2023-12-12T23:59:58.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.064+0000 7f9db4539640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dac0cc420 0x7f9dac1f0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:58.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.064+0000 7f9db4539640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dac0cda70 0x7f9dac1f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:58.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.064+0000 7f9db4539640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dac159b50 0x7f9dac1efaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:58.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.064+0000 7f9db4539640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0adbf0 con 0x7f9dac0cda70 2023-12-12T23:59:58.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.064+0000 7f9db4539640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0ae420 con 0x7f9dac159b50 2023-12-12T23:59:58.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.064+0000 7f9db4539640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac1f2c60 con 0x7f9dac0cc420 2023-12-12T23:59:58.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.065+0000 7f9db22d5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dac0cc420 0x7f9dac1f0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:58.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.065+0000 7f9db22d5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dac0cc420 0x7f9dac1f0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:53298/0 (socket says 172.21.15.72:53298) 2023-12-12T23:59:58.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.065+0000 7f9db22d5640 1 -- 172.21.15.72:0/3502329729 learned_addr learned my addr 172.21.15.72:0/3502329729 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-12T23:59:58.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.069+0000 7f9db22d5640 1 -- 172.21.15.72:0/3502329729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dac159b50 msgr2=0x7f9dac1efaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:58.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.069+0000 7f9db22d5640 1 --2- 172.21.15.72:0/3502329729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dac159b50 0x7f9dac1efaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:58.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.069+0000 7f9db22d5640 1 -- 172.21.15.72:0/3502329729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dac0cda70 msgr2=0x7f9dac1f30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:58.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.069+0000 7f9db22d5640 1 --2- 172.21.15.72:0/3502329729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dac0cda70 0x7f9dac1f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:58.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.069+0000 7f9db22d5640 1 -- 172.21.15.72:0/3502329729 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da80094d0 con 0x7f9dac0cc420 2023-12-12T23:59:58.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.072+0000 7f9db22d5640 1 --2- 172.21.15.72:0/3502329729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dac0cc420 0x7f9dac1f0510 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c00c4b0 tx=0x7f9d9c00c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.075+0000 7f9da2ffd640 1 -- 172.21.15.72:0/3502329729 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c0052d0 con 0x7f9dac0cc420 2023-12-12T23:59:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.075+0000 7f9da2ffd640 1 -- 172.21.15.72:0/3502329729 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c005430 con 0x7f9dac0cc420 2023-12-12T23:59:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.075+0000 7f9db4539640 1 -- 172.21.15.72:0/3502329729 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dac1effe0 con 0x7f9dac0cc420 2023-12-12T23:59:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.075+0000 7f9da2ffd640 1 -- 172.21.15.72:0/3502329729 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c012870 con 0x7f9dac0cc420 2023-12-12T23:59:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.075+0000 7f9db4539640 1 -- 172.21.15.72:0/3502329729 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dac0c5550 con 0x7f9dac0cc420 2023-12-12T23:59:58.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.076+0000 7f9db4539640 1 -- 172.21.15.72:0/3502329729 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dac067470 con 0x7f9dac0cc420 2023-12-12T23:59:58.146 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-12-12T23:59:58.146+0000 7fb236432040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-12T23:59:58.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.175+0000 7f9da2ffd640 1 -- 172.21.15.72:0/3502329729 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f9d9c012d50 con 0x7f9dac0cc420 2023-12-12T23:59:58.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.179+0000 7f9da2ffd640 1 -- 172.21.15.72:0/3502329729 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9d9c01be20 con 0x7f9dac0cc420 2023-12-12T23:59:58.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.179+0000 7f9da2ffd640 1 -- 172.21.15.72:0/3502329729 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f9d9c01b750 con 0x7f9dac0cc420 2023-12-12T23:59:58.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.237+0000 7f9db4539640 1 -- 172.21.15.72:0/3502329729 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9dac0b4c20 con 0x7f9dac0cc420 2023-12-12T23:59:58.520 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-12-12T23:59:58.519+0000 7fb797612500 -1 Falling back to public interface 2023-12-12T23:59:58.527 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-12-12T23:59:58.527+0000 7f8f53c22500 -1 Falling back to public interface 2023-12-12T23:59:58.535 INFO:tasks.ceph.osd.5.smithi176.stderr:2023-12-12T23:59:58.535+0000 7fe04f61f500 -1 Falling back to public interface 2023-12-12T23:59:58.536 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-12-12T23:59:58.536+0000 7f1169eb6500 -1 Falling back to public interface 2023-12-12T23:59:58.550 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-12-12T23:59:58.549+0000 7f5e94acd500 -1 Falling back to public interface 2023-12-12T23:59:58.559 INFO:tasks.ceph.osd.4.smithi176.stderr:2023-12-12T23:59:58.559+0000 7ff4e6148500 -1 Falling back to public interface 2023-12-12T23:59:58.572 INFO:tasks.ceph.osd.7.smithi176.stderr:2023-12-12T23:59:58.572+0000 7f034c60d500 -1 Falling back to public interface 2023-12-12T23:59:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.576+0000 7f9da2ffd640 1 -- 172.21.15.72:0/3502329729 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mgrmap(e 2) v1 ==== 44706+0+0 (secure 0 0 0) 0x7f9d9c01b8f0 con 0x7f9dac0cc420 2023-12-12T23:59:58.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.581+0000 7f9da2ffd640 1 -- 172.21.15.72:0/3502329729 <== mon.2 v2:172.21.15.176:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f9d9c01a950 con 0x7f9dac0cc420 2023-12-12T23:59:58.582 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-12T23:59:58.582 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":10,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-12T23:59:57.846142+0000","last_up_change":"0.000000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T23:59:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.582+0000 7f9db4539640 1 -- 172.21.15.72:0/3502329729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dac0cc420 msgr2=0x7f9dac1f0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.582+0000 7f9db4539640 1 --2- 172.21.15.72:0/3502329729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dac0cc420 0x7f9dac1f0510 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c00c4b0 tx=0x7f9d9c00c970 comp rx=0 tx=0).stop 2023-12-12T23:59:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.582+0000 7f9db4539640 1 -- 172.21.15.72:0/3502329729 shutdown_connections 2023-12-12T23:59:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.582+0000 7f9db4539640 1 --2- 172.21.15.72:0/3502329729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dac159b50 0x7f9dac1efaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.582+0000 7f9db4539640 1 --2- 172.21.15.72:0/3502329729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dac0cda70 0x7f9dac1f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.582+0000 7f9db4539640 1 --2- 172.21.15.72:0/3502329729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dac0cc420 0x7f9dac1f0510 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.582+0000 7f9db4539640 1 -- 172.21.15.72:0/3502329729 >> 172.21.15.72:0/3502329729 conn(0x7f9dac0b07b0 msgr2=0x7f9dac0c6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.582+0000 7f9db4539640 1 -- 172.21.15.72:0/3502329729 shutdown_connections 2023-12-12T23:59:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-12T23:59:58.582+0000 7f9db4539640 1 -- 172.21.15.72:0/3502329729 wait complete. 2023-12-12T23:59:58.593 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-12T23:59:58.593 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-12T23:59:58.594 INFO:tasks.ceph.osd.6.smithi176.stderr:2023-12-12T23:59:58.593+0000 7fc08791a500 -1 Falling back to public interface 2023-12-12T23:59:59.354 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T23:59:59.357 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T23:59:59.398 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-12T23:59:59.490 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.486+0000 7f79ce690640 1 Processor -- start 2023-12-12T23:59:59.490 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.487+0000 7f79ce690640 1 -- start start 2023-12-12T23:59:59.490 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.487+0000 7f79ce690640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79c80cdc10 0x7f79c80cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:59.490 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.487+0000 7f79ce690640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c8159b80 con 0x7f79c81538b0 2023-12-12T23:59:59.490 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.487+0000 7f79ce690640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c80cc050 con 0x7f79c80cd710 2023-12-12T23:59:59.490 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.487+0000 7f79ce690640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c80cb4d0 con 0x7f79c80cdc10 2023-12-12T23:59:59.490 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.488+0000 7f79c77fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79c80cdc10 0x7f79c80cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:59.490 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.488+0000 7f79ccc2d640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f79c80cd710 0x7f79c80ce0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:44242/0 (socket says 172.21.15.72:44242) 2023-12-12T23:59:59.490 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.488+0000 7f79ccc2d640 1 -- 172.21.15.72:0/1501192383 learned_addr learned my addr 172.21.15.72:0/1501192383 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-12T23:59:59.491 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.491+0000 7f79c77fe640 1 -- 172.21.15.72:0/1501192383 >> v1:172.21.15.176:6789/0 conn(0x7f79c80cd710 legacy=0x7f79c80ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:59.491 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.491+0000 7f79c77fe640 1 -- 172.21.15.72:0/1501192383 >> v1:172.21.15.72:6789/0 conn(0x7f79c81538b0 legacy=0x7f79c815a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T23:59:59.491 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.491+0000 7f79c77fe640 1 -- 172.21.15.72:0/1501192383 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c80cb7b0 con 0x7f79c80cdc10 2023-12-12T23:59:59.493 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.493+0000 7f79c77fe640 1 --2- 172.21.15.72:0/1501192383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79c80cdc10 0x7f79c80cd1d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f79b80097d0 tx=0x7f79b802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0598003c664d5d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:59.497 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.496+0000 7f79c6ffd640 1 -- 172.21.15.72:0/1501192383 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8031800 con 0x7f79c80cdc10 2023-12-12T23:59:59.497 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.496+0000 7f79c6ffd640 1 -- 172.21.15.72:0/1501192383 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b8031960 con 0x7f79c80cdc10 2023-12-12T23:59:59.497 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.496+0000 7f79c6ffd640 1 -- 172.21.15.72:0/1501192383 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8031cf0 con 0x7f79c80cdc10 2023-12-12T23:59:59.498 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.497+0000 7f79ce690640 1 -- 172.21.15.72:0/1501192383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79c80cdc10 msgr2=0x7f79c80cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:59.498 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.497+0000 7f79ce690640 1 --2- 172.21.15.72:0/1501192383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79c80cdc10 0x7f79c80cd1d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f79b80097d0 tx=0x7f79b802b8a0 comp rx=0 tx=0).stop 2023-12-12T23:59:59.498 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.497+0000 7f79ce690640 1 -- 172.21.15.72:0/1501192383 shutdown_connections 2023-12-12T23:59:59.498 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.497+0000 7f79ce690640 1 --2- 172.21.15.72:0/1501192383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79c80cdc10 0x7f79c80cd1d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:59.498 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.497+0000 7f79ce690640 1 -- 172.21.15.72:0/1501192383 >> 172.21.15.72:0/1501192383 conn(0x7f79c80b0810 msgr2=0x7f79c80b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:59.498 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.497+0000 7f79ce690640 1 -- 172.21.15.72:0/1501192383 shutdown_connections 2023-12-12T23:59:59.498 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.497+0000 7f79ce690640 1 -- 172.21.15.72:0/1501192383 wait complete. 2023-12-12T23:59:59.499 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.498+0000 7f79ce690640 1 Processor -- start 2023-12-12T23:59:59.499 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.498+0000 7f79ce690640 1 -- start start 2023-12-12T23:59:59.500 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.499+0000 7f79ce690640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79c80cd710 0x7f79c81f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:59.500 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.499+0000 7f79ce690640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79c80cdc10 0x7f79c814bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:59.500 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.499+0000 7f79ce690640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79c81538b0 0x7f79c814fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:59.500 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.499+0000 7f79ce690640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c81f3690 con 0x7f79c80cd710 2023-12-12T23:59:59.500 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.499+0000 7f79ce690640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c81507d0 con 0x7f79c81538b0 2023-12-12T23:59:59.500 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.499+0000 7f79ce690640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c81f0130 con 0x7f79c80cdc10 2023-12-12T23:59:59.500 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.499+0000 7f79c77fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79c80cdc10 0x7f79c814bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:59.500 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.499+0000 7f79ccc2d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79c81538b0 0x7f79c814fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:59.500 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.500+0000 7f79c77fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79c80cdc10 0x7f79c814bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:53404/0 (socket says 172.21.15.72:53404) 2023-12-12T23:59:59.501 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.500+0000 7f79c77fe640 1 -- 172.21.15.72:0/1454687177 learned_addr learned my addr 172.21.15.72:0/1454687177 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-12T23:59:59.503 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.502+0000 7f79c77fe640 1 -- 172.21.15.72:0/1454687177 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79c81538b0 msgr2=0x7f79c814fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:59.503 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.502+0000 7f79c77fe640 1 --2- 172.21.15.72:0/1454687177 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79c81538b0 0x7f79c814fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:59.503 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.502+0000 7f79c77fe640 1 -- 172.21.15.72:0/1454687177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79c80cd710 msgr2=0x7f79c81f3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:59.503 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.503+0000 7f79c77fe640 1 --2- 172.21.15.72:0/1454687177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79c80cd710 0x7f79c81f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:59.503 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.503+0000 7f79c77fe640 1 -- 172.21.15.72:0/1454687177 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b8009400 con 0x7f79c80cdc10 2023-12-12T23:59:59.505 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.505+0000 7f79c77fe640 1 --2- 172.21.15.72:0/1454687177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79c80cdc10 0x7f79c814bc00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f79b80098f0 tx=0x7f79b80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:59.509 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.508+0000 7f79c4ff9640 1 -- 172.21.15.72:0/1454687177 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b803bd80 con 0x7f79c80cdc10 2023-12-12T23:59:59.509 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.508+0000 7f79c4ff9640 1 -- 172.21.15.72:0/1454687177 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b80453f0 con 0x7f79c80cdc10 2023-12-12T23:59:59.509 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.508+0000 7f79c4ff9640 1 -- 172.21.15.72:0/1454687177 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b80457a0 con 0x7f79c80cdc10 2023-12-12T23:59:59.509 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.508+0000 7f79ce690640 1 -- 172.21.15.72:0/1454687177 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c81504f0 con 0x7f79c80cdc10 2023-12-12T23:59:59.509 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.508+0000 7f79ce690640 1 -- 172.21.15.72:0/1454687177 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c81ef650 con 0x7f79c80cdc10 2023-12-12T23:59:59.509 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.509+0000 7f79ce690640 1 -- 172.21.15.72:0/1454687177 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c8067470 con 0x7f79c80cdc10 2023-12-12T23:59:59.619 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.618+0000 7f79c4ff9640 1 -- 172.21.15.72:0/1454687177 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 2) v1 ==== 44706+0+0 (secure 0 0 0) 0x7f79b804e450 con 0x7f79c80cdc10 2023-12-12T23:59:59.622 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.621+0000 7f79c4ff9640 1 -- 172.21.15.72:0/1454687177 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f79b802e070 con 0x7f79c80cdc10 2023-12-12T23:59:59.629 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.628+0000 7f79c4ff9640 1 -- 172.21.15.72:0/1454687177 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f79b80443a0 con 0x7f79c80cdc10 2023-12-12T23:59:59.690 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.690+0000 7f79ce690640 1 -- 172.21.15.72:0/1454687177 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79c80cc5e0 con 0x7f79c80cdc10 2023-12-12T23:59:59.808 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:59.808+0000 7f773110c640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-12T23:59:59.851 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.850+0000 7f79c4ff9640 1 -- 172.21.15.72:0/1454687177 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mgrmap(e 3) v1 ==== 89208+0+0 (secure 0 0 0) 0x7f79b804e940 con 0x7f79c80cdc10 2023-12-12T23:59:59.851 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.850+0000 7f79c4ff9640 1 --2- 172.21.15.72:0/1454687177 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f79b406b840 0x7f79b406dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T23:59:59.851 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.850+0000 7f79c7fff640 1 --2- 172.21.15.72:0/1454687177 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f79b406b840 0x7f79b406dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T23:59:59.851 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.851+0000 7f79c7fff640 1 --2- 172.21.15.72:0/1454687177 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f79b406b840 0x7f79b406dc30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009650 tx=0x7f79bc006ba0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T23:59:59.917 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-12T23:59:59.916+0000 7f773110c640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-12T23:59:59.979 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.979+0000 7f79c4ff9640 1 -- 172.21.15.72:0/1454687177 <== mon.2 v2:172.21.15.176:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f79b80647f0 con 0x7f79c80cdc10 2023-12-12T23:59:59.980 INFO:teuthology.misc.health.smithi072.stdout: 2023-12-12T23:59:59.980 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":10,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-12T23:59:57.846142+0000","last_up_change":"0.000000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T23:59:59.981 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.980+0000 7f79ce690640 1 -- 172.21.15.72:0/1454687177 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f79b406b840 msgr2=0x7f79b406dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:59.981 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.980+0000 7f79ce690640 1 --2- 172.21.15.72:0/1454687177 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f79b406b840 0x7f79b406dc30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009650 tx=0x7f79bc006ba0 comp rx=0 tx=0).stop 2023-12-12T23:59:59.981 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.980+0000 7f79ce690640 1 -- 172.21.15.72:0/1454687177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79c80cdc10 msgr2=0x7f79c814bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T23:59:59.981 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.980+0000 7f79ce690640 1 --2- 172.21.15.72:0/1454687177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79c80cdc10 0x7f79c814bc00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f79b80098f0 tx=0x7f79b80046c0 comp rx=0 tx=0).stop 2023-12-12T23:59:59.981 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.980+0000 7f79ce690640 1 -- 172.21.15.72:0/1454687177 shutdown_connections 2023-12-12T23:59:59.981 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.980+0000 7f79ce690640 1 --2- 172.21.15.72:0/1454687177 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f79b406b840 0x7f79b406dc30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:59.981 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.980+0000 7f79ce690640 1 --2- 172.21.15.72:0/1454687177 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79c81538b0 0x7f79c814fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:59.982 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.980+0000 7f79ce690640 1 --2- 172.21.15.72:0/1454687177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79c80cdc10 0x7f79c814bc00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:59.982 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.980+0000 7f79ce690640 1 --2- 172.21.15.72:0/1454687177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79c80cd710 0x7f79c81f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T23:59:59.982 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.980+0000 7f79ce690640 1 -- 172.21.15.72:0/1454687177 >> 172.21.15.72:0/1454687177 conn(0x7f79c80b0810 msgr2=0x7f79c81528b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T23:59:59.982 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.980+0000 7f79ce690640 1 -- 172.21.15.72:0/1454687177 shutdown_connections 2023-12-12T23:59:59.982 INFO:teuthology.misc.health.smithi072.stderr:2023-12-12T23:59:59.980+0000 7f79ce690640 1 -- 172.21.15.72:0/1454687177 wait complete. 2023-12-12T23:59:59.989 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-13T00:00:02.002 INFO:tasks.ceph.osd.5.smithi176.stderr:2023-12-13T00:00:02.002+0000 7fe04f61f500 -1 osd.5 0 log_to_monitors true 2023-12-13T00:00:02.007 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-12-13T00:00:02.007+0000 7fb797612500 -1 osd.2 0 log_to_monitors true 2023-12-13T00:00:02.040 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-12-13T00:00:02.039+0000 7f8f53c22500 -1 osd.3 0 log_to_monitors true 2023-12-13T00:00:02.053 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-12-13T00:00:02.052+0000 7f1169eb6500 -1 osd.0 0 log_to_monitors true 2023-12-13T00:00:02.065 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-12-13T00:00:02.064+0000 7f5e94acd500 -1 osd.1 0 log_to_monitors true 2023-12-13T00:00:02.085 INFO:tasks.ceph.osd.7.smithi176.stderr:2023-12-13T00:00:02.084+0000 7f034c60d500 -1 osd.7 0 log_to_monitors true 2023-12-13T00:00:02.085 INFO:tasks.ceph.osd.4.smithi176.stderr:2023-12-13T00:00:02.084+0000 7ff4e6148500 -1 osd.4 0 log_to_monitors true 2023-12-13T00:00:02.103 INFO:tasks.ceph.osd.6.smithi176.stderr:2023-12-13T00:00:02.103+0000 7fc08791a500 -1 osd.6 0 log_to_monitors true 2023-12-13T00:00:04.172 INFO:tasks.ceph.osd.5.smithi176.stderr:2023-12-13T00:00:04.171+0000 7fe04b00c640 -1 osd.5 0 waiting for initial osdmap 2023-12-13T00:00:04.235 INFO:tasks.ceph.osd.5.smithi176.stderr:2023-12-13T00:00:04.235+0000 7fe042e33640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-13T00:00:04.738 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-12-13T00:00:04.737+0000 7f1165e46640 -1 osd.0 0 waiting for initial osdmap 2023-12-13T00:00:04.793 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-12-13T00:00:04.793+0000 7fb793756640 -1 osd.2 0 waiting for initial osdmap 2023-12-13T00:00:04.806 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-12-13T00:00:04.805+0000 7f115dc6d640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-13T00:00:04.986 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-12-13T00:00:04.986+0000 7fb78ad69640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-13T00:00:05.957 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-12-13T00:00:05.956+0000 7f5e90a5b640 -1 osd.1 0 waiting for initial osdmap 2023-12-13T00:00:05.967 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-12-13T00:00:05.967+0000 7f8f4fd79640 -1 osd.3 0 waiting for initial osdmap 2023-12-13T00:00:06.052 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-12-13T00:00:06.052+0000 7f8f4738c640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-13T00:00:06.053 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-12-13T00:00:06.053+0000 7f5e88882640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-13T00:00:06.373 INFO:tasks.ceph.osd.6.smithi176.stderr:2023-12-13T00:00:06.372+0000 7fc0838a8640 -1 osd.6 0 waiting for initial osdmap 2023-12-13T00:00:06.397 INFO:tasks.ceph.osd.6.smithi176.stderr:2023-12-13T00:00:06.397+0000 7fc07b6cf640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-13T00:00:06.416 INFO:tasks.ceph.osd.4.smithi176.stderr:2023-12-13T00:00:06.415+0000 7ff4e20d6640 -1 osd.4 0 waiting for initial osdmap 2023-12-13T00:00:06.481 INFO:tasks.ceph.osd.4.smithi176.stderr:2023-12-13T00:00:06.481+0000 7ff4d9efd640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-13T00:00:06.695 INFO:tasks.ceph.osd.7.smithi176.stderr:2023-12-13T00:00:06.695+0000 7f0347fdc640 -1 osd.7 0 waiting for initial osdmap 2023-12-13T00:00:06.720 INFO:tasks.ceph.osd.7.smithi176.stderr:2023-12-13T00:00:06.719+0000 7f033fe03640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-13T00:00:06.795 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-13T00:00:06.887 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.886+0000 7f115d690640 1 Processor -- start 2023-12-13T00:00:06.887 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.886+0000 7f115d690640 1 -- start start 2023-12-13T00:00:06.888 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.887+0000 7f115d690640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f115815a3f0 0x7f11581560d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:06.888 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.887+0000 7f115d690640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11581508a0 con 0x7f11581504c0 2023-12-13T00:00:06.888 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.887+0000 7f115d690640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11581596c0 con 0x7f11580c82b0 2023-12-13T00:00:06.888 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.887+0000 7f115d690640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11580c1550 con 0x7f115815a3f0 2023-12-13T00:00:06.923 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.922+0000 7f1156ffd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f11581504c0 0x7f115806c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50472/0 (socket says 172.21.15.72:50472) 2023-12-13T00:00:06.923 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.922+0000 7f1156ffd640 1 -- 172.21.15.72:0/2714587896 learned_addr learned my addr 172.21.15.72:0/2714587896 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:06.923 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.922+0000 7f11567fc640 1 --2- 172.21.15.72:0/2714587896 >> v2:172.21.15.72:3300/0 conn(0x7f115815a3f0 0x7f11581560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:06.928 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.927+0000 7f11567fc640 1 -- 172.21.15.72:0/2714587896 >> v1:172.21.15.176:6789/0 conn(0x7f11580c82b0 legacy=0x7f1158071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:06.928 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.927+0000 7f11567fc640 1 -- 172.21.15.72:0/2714587896 >> v1:172.21.15.72:6789/0 conn(0x7f11581504c0 legacy=0x7f115806c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:06.928 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.927+0000 7f11567fc640 1 -- 172.21.15.72:0/2714587896 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1158156bf0 con 0x7f115815a3f0 2023-12-13T00:00:06.936 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.935+0000 7f11567fc640 1 --2- 172.21.15.72:0/2714587896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f115815a3f0 0x7f11581560d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f114c009d90 tx=0x7f114c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c758c16e0c5d14 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:06.940 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.939+0000 7f1155ffb640 1 -- 172.21.15.72:0/2714587896 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c02cc60 con 0x7f115815a3f0 2023-12-13T00:00:06.940 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.939+0000 7f1155ffb640 1 -- 172.21.15.72:0/2714587896 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c02cdc0 con 0x7f115815a3f0 2023-12-13T00:00:06.940 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.939+0000 7f1155ffb640 1 -- 172.21.15.72:0/2714587896 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c034660 con 0x7f115815a3f0 2023-12-13T00:00:06.941 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.940+0000 7f115d690640 1 -- 172.21.15.72:0/2714587896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f115815a3f0 msgr2=0x7f11581560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:06.941 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.940+0000 7f115d690640 1 --2- 172.21.15.72:0/2714587896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f115815a3f0 0x7f11581560d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f114c009d90 tx=0x7f114c02beb0 comp rx=0 tx=0).stop 2023-12-13T00:00:06.941 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.940+0000 7f115d690640 1 -- 172.21.15.72:0/2714587896 shutdown_connections 2023-12-13T00:00:06.941 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.940+0000 7f115d690640 1 --2- 172.21.15.72:0/2714587896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f115815a3f0 0x7f11581560d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:06.941 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.940+0000 7f115d690640 1 -- 172.21.15.72:0/2714587896 >> 172.21.15.72:0/2714587896 conn(0x7f11580c7790 msgr2=0x7f11580c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:06.941 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.940+0000 7f115d690640 1 -- 172.21.15.72:0/2714587896 shutdown_connections 2023-12-13T00:00:06.941 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.940+0000 7f115d690640 1 -- 172.21.15.72:0/2714587896 wait complete. 2023-12-13T00:00:06.942 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.941+0000 7f115d690640 1 Processor -- start 2023-12-13T00:00:06.942 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.941+0000 7f115d690640 1 -- start start 2023-12-13T00:00:06.943 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.942+0000 7f115d690640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11580c82b0 0x7f11580ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:06.943 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.942+0000 7f115d690640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11581504c0 0x7f1158155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:06.943 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.942+0000 7f115d690640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f115815a3f0 0x7f1158155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:06.943 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.942+0000 7f115d690640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1158154d70 con 0x7f11580c82b0 2023-12-13T00:00:06.943 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.942+0000 7f115d690640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11581ed5a0 con 0x7f115815a3f0 2023-12-13T00:00:06.943 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.942+0000 7f115d690640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11581ed880 con 0x7f11581504c0 2023-12-13T00:00:06.943 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.943+0000 7f1156ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11580c82b0 0x7f11580ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:06.944 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.943+0000 7f11567fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11581504c0 0x7f1158155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:06.944 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.943+0000 7f1156ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11580c82b0 0x7f11580ca480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42844/0 (socket says 172.21.15.72:42844) 2023-12-13T00:00:06.944 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.943+0000 7f1156ffd640 1 -- 172.21.15.72:0/2732902099 learned_addr learned my addr 172.21.15.72:0/2732902099 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:06.947 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.946+0000 7f1156ffd640 1 -- 172.21.15.72:0/2732902099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11581504c0 msgr2=0x7f1158155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:06.947 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.946+0000 7f1156ffd640 1 --2- 172.21.15.72:0/2732902099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11581504c0 0x7f1158155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:06.947 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.946+0000 7f1156ffd640 1 -- 172.21.15.72:0/2732902099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f115815a3f0 msgr2=0x7f1158155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:06.947 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.946+0000 7f1156ffd640 1 --2- 172.21.15.72:0/2732902099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f115815a3f0 0x7f1158155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:06.947 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.946+0000 7f1156ffd640 1 -- 172.21.15.72:0/2732902099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114c009a70 con 0x7f11580c82b0 2023-12-13T00:00:06.949 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.948+0000 7f1156ffd640 1 --2- 172.21.15.72:0/2732902099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11580c82b0 0x7f11580ca480 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f115000c400 tx=0x7f115000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:06.953 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.952+0000 7f113f7fe640 1 -- 172.21.15.72:0/2732902099 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1150005ce0 con 0x7f11580c82b0 2023-12-13T00:00:06.953 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.952+0000 7f113f7fe640 1 -- 172.21.15.72:0/2732902099 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1150005e40 con 0x7f11580c82b0 2023-12-13T00:00:06.953 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.952+0000 7f115d690640 1 -- 172.21.15.72:0/2732902099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11581edb60 con 0x7f11580c82b0 2023-12-13T00:00:06.953 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.952+0000 7f113f7fe640 1 -- 172.21.15.72:0/2732902099 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11500072d0 con 0x7f11580c82b0 2023-12-13T00:00:06.953 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.952+0000 7f115d690640 1 -- 172.21.15.72:0/2732902099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11581ee120 con 0x7f11580c82b0 2023-12-13T00:00:06.954 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:06.953+0000 7f115d690640 1 -- 172.21.15.72:0/2732902099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11581ee310 con 0x7f11580c82b0 2023-12-13T00:00:07.203 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.203+0000 7f113f7fe640 1 -- 172.21.15.72:0/2732902099 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 89314+0+0 (secure 0 0 0) 0x7f1150007430 con 0x7f11580c82b0 2023-12-13T00:00:07.204 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.203+0000 7f113f7fe640 1 --2- 172.21.15.72:0/2732902099 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f114406b1b0 0x7f114406d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:07.204 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.203+0000 7f11567fc640 1 --2- 172.21.15.72:0/2732902099 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f114406b1b0 0x7f114406d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:07.204 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.204+0000 7f11567fc640 1 --2- 172.21.15.72:0/2732902099 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f114406b1b0 0x7f114406d670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f114c036000 tx=0x7f114c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:07.223 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.222+0000 7f113f7fe640 1 -- 172.21.15.72:0/2732902099 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3071+0+0 (secure 0 0 0) 0x7f1150057cd0 con 0x7f11580c82b0 2023-12-13T00:00:07.223 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.222+0000 7f113f7fe640 1 -- 172.21.15.72:0/2732902099 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1150054010 con 0x7f11580c82b0 2023-12-13T00:00:07.396 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.395+0000 7f115d690640 1 -- 172.21.15.72:0/2732902099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11581508a0 con 0x7f11580c82b0 2023-12-13T00:00:07.441 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.440+0000 7f113f7fe640 1 -- 172.21.15.72:0/2732902099 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8514 (secure 0 0 0) 0x7f11581508a0 con 0x7f11580c82b0 2023-12-13T00:00:07.441 INFO:teuthology.misc.health.smithi072.stdout: 2023-12-13T00:00:07.442 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":14,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:00:05.617889+0000","last_up_change":"2023-12-13T00:00:05.617889+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:00:07.443 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.443+0000 7f115d690640 1 -- 172.21.15.72:0/2732902099 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f114406b1b0 msgr2=0x7f114406d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:07.444 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.443+0000 7f115d690640 1 --2- 172.21.15.72:0/2732902099 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f114406b1b0 0x7f114406d670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f114c036000 tx=0x7f114c030000 comp rx=0 tx=0).stop 2023-12-13T00:00:07.444 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.443+0000 7f115d690640 1 -- 172.21.15.72:0/2732902099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11580c82b0 msgr2=0x7f11580ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:07.444 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.443+0000 7f115d690640 1 --2- 172.21.15.72:0/2732902099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11580c82b0 0x7f11580ca480 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f115000c400 tx=0x7f115000c8c0 comp rx=0 tx=0).stop 2023-12-13T00:00:07.444 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.443+0000 7f115d690640 1 -- 172.21.15.72:0/2732902099 shutdown_connections 2023-12-13T00:00:07.444 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.443+0000 7f115d690640 1 --2- 172.21.15.72:0/2732902099 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f114406b1b0 0x7f114406d670 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:07.444 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.443+0000 7f115d690640 1 --2- 172.21.15.72:0/2732902099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f115815a3f0 0x7f1158155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:07.444 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.443+0000 7f115d690640 1 --2- 172.21.15.72:0/2732902099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11581504c0 0x7f1158155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:07.444 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.443+0000 7f115d690640 1 --2- 172.21.15.72:0/2732902099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11580c82b0 0x7f11580ca480 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:07.444 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.443+0000 7f115d690640 1 -- 172.21.15.72:0/2732902099 >> 172.21.15.72:0/2732902099 conn(0x7f11580c7790 msgr2=0x7f1158146940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:07.444 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.443+0000 7f115d690640 1 -- 172.21.15.72:0/2732902099 shutdown_connections 2023-12-13T00:00:07.444 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:07.443+0000 7f115d690640 1 -- 172.21.15.72:0/2732902099 wait complete. 2023-12-13T00:00:07.453 DEBUG:teuthology.misc:3 of 8 OSDs are up 2023-12-13T00:00:14.260 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-13T00:00:14.359 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.358+0000 7f0f07539640 1 Processor -- start 2023-12-13T00:00:14.359 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.358+0000 7f0f07539640 1 -- start start 2023-12-13T00:00:14.359 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.359+0000 7f0f07539640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0f001504c0 0x7f0f0006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:14.360 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.359+0000 7f0f07539640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0f0015a3f0 0x7f0f001560d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:14.360 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.359+0000 7f0f07539640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f001508a0 con 0x7f0f000c82b0 2023-12-13T00:00:14.360 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.359+0000 7f0f07539640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f000c1550 con 0x7f0f001504c0 2023-12-13T00:00:14.360 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.359+0000 7f0f07539640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0006de20 con 0x7f0f0015a3f0 2023-12-13T00:00:14.360 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.359+0000 7f0f052d5640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0f001504c0 0x7f0f0006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:14.360 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.360+0000 7f0f04ad4640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0f0015a3f0 0x7f0f001560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:14.361 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.360+0000 7f0f052d5640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0f001504c0 0x7f0f0006c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42888/0 (socket says 172.21.15.72:42888) 2023-12-13T00:00:14.361 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.360+0000 7f0f052d5640 1 -- 172.21.15.72:0/3608950942 learned_addr learned my addr 172.21.15.72:0/3608950942 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:14.363 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.362+0000 7f0f052d5640 1 -- 172.21.15.72:0/3608950942 >> v2:172.21.15.176:3300/0 conn(0x7f0f0015a3f0 msgr2=0x7f0f001560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:14.363 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.362+0000 7f0f052d5640 1 --2- 172.21.15.72:0/3608950942 >> v2:172.21.15.176:3300/0 conn(0x7f0f0015a3f0 0x7f0f001560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:14.363 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.362+0000 7f0f052d5640 1 -- 172.21.15.72:0/3608950942 >> v1:172.21.15.176:6789/0 conn(0x7f0f000c82b0 legacy=0x7f0f00071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:14.363 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.362+0000 7f0f052d5640 1 -- 172.21.15.72:0/3608950942 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f001596c0 con 0x7f0f001504c0 2023-12-13T00:00:14.364 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.364+0000 7f0f052d5640 1 --2- 172.21.15.72:0/3608950942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f001504c0 0x7f0f0006c9d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0f000704a0 tx=0x7f0efc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f733e331027cb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:14.368 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.368+0000 7f0ef7fff640 1 -- 172.21.15.72:0/3608950942 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc031870 con 0x7f0f001504c0 2023-12-13T00:00:14.368 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.368+0000 7f0ef7fff640 1 -- 172.21.15.72:0/3608950942 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc0319d0 con 0x7f0f001504c0 2023-12-13T00:00:14.368 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.368+0000 7f0ef7fff640 1 -- 172.21.15.72:0/3608950942 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc031d60 con 0x7f0f001504c0 2023-12-13T00:00:14.369 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.368+0000 7f0f07539640 1 -- 172.21.15.72:0/3608950942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f001504c0 msgr2=0x7f0f0006c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:14.369 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.368+0000 7f0f07539640 1 --2- 172.21.15.72:0/3608950942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f001504c0 0x7f0f0006c9d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0f000704a0 tx=0x7f0efc02b910 comp rx=0 tx=0).stop 2023-12-13T00:00:14.369 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.368+0000 7f0f07539640 1 -- 172.21.15.72:0/3608950942 shutdown_connections 2023-12-13T00:00:14.369 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.368+0000 7f0f07539640 1 --2- 172.21.15.72:0/3608950942 >> v2:172.21.15.176:3300/0 conn(0x7f0f0015a3f0 0x7f0f001560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:14.369 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.368+0000 7f0f07539640 1 --2- 172.21.15.72:0/3608950942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f001504c0 0x7f0f0006c9d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:14.370 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.368+0000 7f0f07539640 1 -- 172.21.15.72:0/3608950942 >> 172.21.15.72:0/3608950942 conn(0x7f0f000c7790 msgr2=0x7f0f000c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:14.370 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.369+0000 7f0f07539640 1 -- 172.21.15.72:0/3608950942 shutdown_connections 2023-12-13T00:00:14.370 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.369+0000 7f0f07539640 1 -- 172.21.15.72:0/3608950942 wait complete. 2023-12-13T00:00:14.370 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.370+0000 7f0f07539640 1 Processor -- start 2023-12-13T00:00:14.370 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.370+0000 7f0f07539640 1 -- start start 2023-12-13T00:00:14.371 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.370+0000 7f0f07539640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f000c82b0 0x7f0f00158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:14.371 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.370+0000 7f0f07539640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f001504c0 0x7f0f0014b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:14.371 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.370+0000 7f0f07539640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0015a3f0 0x7f0f0014bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:14.371 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.370+0000 7f0f07539640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f001f0600 con 0x7f0f0015a3f0 2023-12-13T00:00:14.371 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.370+0000 7f0f07539640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f001ef7a0 con 0x7f0f001504c0 2023-12-13T00:00:14.372 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.370+0000 7f0f07539640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f001efa80 con 0x7f0f000c82b0 2023-12-13T00:00:14.372 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.371+0000 7f0f05ad6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0015a3f0 0x7f0f0014bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:14.372 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.371+0000 7f0f052d5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f000c82b0 0x7f0f00158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:14.372 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.371+0000 7f0f04ad4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f001504c0 0x7f0f0014b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:14.372 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.371+0000 7f0f05ad6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0015a3f0 0x7f0f0014bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42894/0 (socket says 172.21.15.72:42894) 2023-12-13T00:00:14.372 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.371+0000 7f0f05ad6640 1 -- 172.21.15.72:0/485961631 learned_addr learned my addr 172.21.15.72:0/485961631 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:14.375 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.375+0000 7f0f05ad6640 1 -- 172.21.15.72:0/485961631 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f000c82b0 msgr2=0x7f0f00158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:14.375 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.375+0000 7f0f05ad6640 1 --2- 172.21.15.72:0/485961631 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f000c82b0 0x7f0f00158c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:14.375 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.375+0000 7f0f05ad6640 1 -- 172.21.15.72:0/485961631 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f001504c0 msgr2=0x7f0f0014b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:14.375 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.375+0000 7f0f05ad6640 1 --2- 172.21.15.72:0/485961631 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f001504c0 0x7f0f0014b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:14.375 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.375+0000 7f0f05ad6640 1 -- 172.21.15.72:0/485961631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc0094d0 con 0x7f0f0015a3f0 2023-12-13T00:00:14.377 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.377+0000 7f0f05ad6640 1 --2- 172.21.15.72:0/485961631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0015a3f0 0x7f0f0014bb80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ef800c710 tx=0x7f0ef800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:14.381 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.381+0000 7f0ef5ffb640 1 -- 172.21.15.72:0/485961631 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8006d50 con 0x7f0f0015a3f0 2023-12-13T00:00:14.382 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.381+0000 7f0ef5ffb640 1 -- 172.21.15.72:0/485961631 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef800ce20 con 0x7f0f0015a3f0 2023-12-13T00:00:14.382 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.381+0000 7f0f07539640 1 -- 172.21.15.72:0/485961631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f001efd60 con 0x7f0f0015a3f0 2023-12-13T00:00:14.382 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.381+0000 7f0ef5ffb640 1 -- 172.21.15.72:0/485961631 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8003bb0 con 0x7f0f0015a3f0 2023-12-13T00:00:14.382 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.381+0000 7f0f07539640 1 -- 172.21.15.72:0/485961631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f001f0320 con 0x7f0f0015a3f0 2023-12-13T00:00:14.382 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.382+0000 7f0f07539640 1 -- 172.21.15.72:0/485961631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f001533c0 con 0x7f0f0015a3f0 2023-12-13T00:00:14.624 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.623+0000 7f0ef5ffb640 1 -- 172.21.15.72:0/485961631 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0ef8003d10 con 0x7f0f0015a3f0 2023-12-13T00:00:14.624 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.623+0000 7f0ef5ffb640 1 --2- 172.21.15.72:0/485961631 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0ee406b1f0 0x7f0ee406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:14.624 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.624+0000 7f0f052d5640 1 --2- 172.21.15.72:0/485961631 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0ee406b1f0 0x7f0ee406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:14.624 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.624+0000 7f0f052d5640 1 --2- 172.21.15.72:0/485961631 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0ee406b1f0 0x7f0ee406d6b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0efc036000 tx=0x7f0efc03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:14.637 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.637+0000 7f0ef5ffb640 1 -- 172.21.15.72:0/485961631 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0ef80589d0 con 0x7f0f0015a3f0 2023-12-13T00:00:14.637 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.637+0000 7f0ef5ffb640 1 -- 172.21.15.72:0/485961631 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0ef80587a0 con 0x7f0f0015a3f0 2023-12-13T00:00:14.814 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.813+0000 7f0f07539640 1 -- 172.21.15.72:0/485961631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f001533c0 con 0x7f0f0015a3f0 2023-12-13T00:00:14.912 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.912+0000 7f0ef5ffb640 1 -- 172.21.15.72:0/485961631 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12827 (secure 0 0 0) 0x7f0f001533c0 con 0x7f0f0015a3f0 2023-12-13T00:00:14.913 INFO:teuthology.misc.health.smithi072.stdout: 2023-12-13T00:00:14.913 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":17,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:00:09.501625+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:00:14.915 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.914+0000 7f0f07539640 1 -- 172.21.15.72:0/485961631 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0ee406b1f0 msgr2=0x7f0ee406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:14.915 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.914+0000 7f0f07539640 1 --2- 172.21.15.72:0/485961631 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0ee406b1f0 0x7f0ee406d6b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0efc036000 tx=0x7f0efc03c040 comp rx=0 tx=0).stop 2023-12-13T00:00:14.915 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.914+0000 7f0f07539640 1 -- 172.21.15.72:0/485961631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0015a3f0 msgr2=0x7f0f0014bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:14.915 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.914+0000 7f0f07539640 1 --2- 172.21.15.72:0/485961631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0015a3f0 0x7f0f0014bb80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ef800c710 tx=0x7f0ef800cbd0 comp rx=0 tx=0).stop 2023-12-13T00:00:14.915 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.914+0000 7f0f07539640 1 -- 172.21.15.72:0/485961631 shutdown_connections 2023-12-13T00:00:14.915 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.914+0000 7f0f07539640 1 --2- 172.21.15.72:0/485961631 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0ee406b1f0 0x7f0ee406d6b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:14.915 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.914+0000 7f0f07539640 1 --2- 172.21.15.72:0/485961631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0015a3f0 0x7f0f0014bb80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:14.915 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.914+0000 7f0f07539640 1 --2- 172.21.15.72:0/485961631 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f001504c0 0x7f0f0014b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:14.915 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.914+0000 7f0f07539640 1 --2- 172.21.15.72:0/485961631 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f000c82b0 0x7f0f00158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:14.915 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.914+0000 7f0f07539640 1 -- 172.21.15.72:0/485961631 >> 172.21.15.72:0/485961631 conn(0x7f0f000c7790 msgr2=0x7f0f000c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:14.915 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.914+0000 7f0f07539640 1 -- 172.21.15.72:0/485961631 shutdown_connections 2023-12-13T00:00:14.916 INFO:teuthology.misc.health.smithi072.stderr:2023-12-13T00:00:14.914+0000 7f0f07539640 1 -- 172.21.15.72:0/485961631 wait complete. 2023-12-13T00:00:14.924 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-13T00:00:14.924 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-13T00:00:14.925 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-13T00:00:14.925 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-13T00:00:14.925 DEBUG:teuthology.orchestra.run.smithi072:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2023-12-13T00:00:14.927 INFO:tasks.ceph.mds.a:Started 2023-12-13T00:00:14.927 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-13T00:00:14.928 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-13T00:00:14.928 DEBUG:teuthology.orchestra.run.smithi072:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2023-12-13T00:00:14.929 INFO:tasks.ceph.mds.c:Started 2023-12-13T00:00:14.930 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-13T00:00:14.930 INFO:tasks.ceph.mds.e:Restarting daemon 2023-12-13T00:00:14.930 DEBUG:teuthology.orchestra.run.smithi072:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2023-12-13T00:00:14.932 INFO:tasks.ceph.mds.e:Started 2023-12-13T00:00:14.932 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-13T00:00:14.932 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-13T00:00:14.932 DEBUG:teuthology.orchestra.run.smithi176:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2023-12-13T00:00:14.935 INFO:tasks.ceph.mds.b:Started 2023-12-13T00:00:14.935 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-13T00:00:14.935 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-13T00:00:14.936 DEBUG:teuthology.orchestra.run.smithi176:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2023-12-13T00:00:14.938 INFO:tasks.ceph.mds.d:Started 2023-12-13T00:00:14.938 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-13T00:00:14.938 INFO:tasks.ceph.mds.f:Restarting daemon 2023-12-13T00:00:14.938 DEBUG:teuthology.orchestra.run.smithi176:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2023-12-13T00:00:14.940 INFO:tasks.ceph.mds.f:Started 2023-12-13T00:00:14.940 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-13T00:00:14.940 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:00:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.044+0000 7ff7c45c9640 1 Processor -- start 2023-12-13T00:00:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.044+0000 7ff7c45c9640 1 -- start start 2023-12-13T00:00:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.045+0000 7ff7c45c9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7bc0c91d0 0x7ff7bc06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.045+0000 7ff7c45c9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7bc15a0c0 0x7ff7bc0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.045+0000 7ff7c45c9640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc06f090 con 0x7ff7bc153730 2023-12-13T00:00:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.045+0000 7ff7c45c9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7bc0c38f0 con 0x7ff7bc15a0c0 2023-12-13T00:00:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.045+0000 7ff7c45c9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc1593d0 con 0x7ff7bc0c91d0 2023-12-13T00:00:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.046+0000 7ff7c1b64640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7bc0c91d0 0x7ff7bc06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.046+0000 7ff7c2b66640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7bc15a0c0 0x7ff7bc0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.046+0000 7ff7c2365640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7ff7bc153730 0x7ff7bc0c2b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:38154/0 (socket says 172.21.15.72:38154) 2023-12-13T00:00:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.046+0000 7ff7c2365640 1 -- 172.21.15.72:0/1385745729 learned_addr learned my addr 172.21.15.72:0/1385745729 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.049+0000 7ff7c2b66640 1 -- 172.21.15.72:0/1385745729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7bc0c91d0 msgr2=0x7ff7bc06eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.049+0000 7ff7c2b66640 1 --2- 172.21.15.72:0/1385745729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7bc0c91d0 0x7ff7bc06eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.049+0000 7ff7c2b66640 1 -- 172.21.15.72:0/1385745729 >> v1:172.21.15.176:6789/0 conn(0x7ff7bc153730 legacy=0x7ff7bc0c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.049+0000 7ff7c2b66640 1 -- 172.21.15.72:0/1385745729 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc153b10 con 0x7ff7bc15a0c0 2023-12-13T00:00:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.051+0000 7ff7c2b66640 1 --2- 172.21.15.72:0/1385745729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7bc15a0c0 0x7ff7bc0ccac0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009d90 tx=0x7ff7b402bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31da85b6bb980256 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:15.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.056+0000 7ff7c1363640 1 -- 172.21.15.72:0/1385745729 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b402cce0 con 0x7ff7bc15a0c0 2023-12-13T00:00:15.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.056+0000 7ff7c1363640 1 -- 172.21.15.72:0/1385745729 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b402ce40 con 0x7ff7bc15a0c0 2023-12-13T00:00:15.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.056+0000 7ff7c1363640 1 -- 172.21.15.72:0/1385745729 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4034660 con 0x7ff7bc15a0c0 2023-12-13T00:00:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.057+0000 7ff7c45c9640 1 -- 172.21.15.72:0/1385745729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7bc15a0c0 msgr2=0x7ff7bc0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.057+0000 7ff7c45c9640 1 --2- 172.21.15.72:0/1385745729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7bc15a0c0 0x7ff7bc0ccac0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009d90 tx=0x7ff7b402bf30 comp rx=0 tx=0).stop 2023-12-13T00:00:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.058+0000 7ff7c45c9640 1 -- 172.21.15.72:0/1385745729 shutdown_connections 2023-12-13T00:00:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.058+0000 7ff7c45c9640 1 --2- 172.21.15.72:0/1385745729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7bc15a0c0 0x7ff7bc0ccac0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.058+0000 7ff7c45c9640 1 --2- 172.21.15.72:0/1385745729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7bc0c91d0 0x7ff7bc06eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.058+0000 7ff7c45c9640 1 -- 172.21.15.72:0/1385745729 >> 172.21.15.72:0/1385745729 conn(0x7ff7bc0707f0 msgr2=0x7ff7bc070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.058+0000 7ff7c45c9640 1 -- 172.21.15.72:0/1385745729 shutdown_connections 2023-12-13T00:00:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.058+0000 7ff7c45c9640 1 -- 172.21.15.72:0/1385745729 wait complete. 2023-12-13T00:00:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.059+0000 7ff7c45c9640 1 Processor -- start 2023-12-13T00:00:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.059+0000 7ff7c45c9640 1 -- start start 2023-12-13T00:00:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.060+0000 7ff7c45c9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7bc0c91d0 0x7ff7bc0c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.060+0000 7ff7c45c9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7bc153730 0x7ff7bc0cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:15.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.060+0000 7ff7c45c9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7bc15a0c0 0x7ff7bc1f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:15.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.060+0000 7ff7c45c9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0c53b0 con 0x7ff7bc0c91d0 2023-12-13T00:00:15.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.060+0000 7ff7c45c9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc1500c0 con 0x7ff7bc15a0c0 2023-12-13T00:00:15.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.060+0000 7ff7c45c9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc1efaf0 con 0x7ff7bc153730 2023-12-13T00:00:15.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.061+0000 7ff7c2365640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7bc0c91d0 0x7ff7bc0c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:15.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.061+0000 7ff7c1b64640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7bc153730 0x7ff7bc0cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:15.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.061+0000 7ff7c2b66640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7bc15a0c0 0x7ff7bc1f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:15.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.061+0000 7ff7c2365640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7bc0c91d0 0x7ff7bc0c4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42906/0 (socket says 172.21.15.72:42906) 2023-12-13T00:00:15.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.061+0000 7ff7c2365640 1 -- 172.21.15.72:0/3286134360 learned_addr learned my addr 172.21.15.72:0/3286134360 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:15.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.065+0000 7ff7c1b64640 1 -- 172.21.15.72:0/3286134360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7bc15a0c0 msgr2=0x7ff7bc1f2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:15.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.065+0000 7ff7c1b64640 1 --2- 172.21.15.72:0/3286134360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7bc15a0c0 0x7ff7bc1f2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:15.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.065+0000 7ff7c1b64640 1 -- 172.21.15.72:0/3286134360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7bc0c91d0 msgr2=0x7ff7bc0c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:15.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.065+0000 7ff7c1b64640 1 --2- 172.21.15.72:0/3286134360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7bc0c91d0 0x7ff7bc0c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:15.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.065+0000 7ff7c1b64640 1 -- 172.21.15.72:0/3286134360 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b4009a70 con 0x7ff7bc153730 2023-12-13T00:00:15.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.068+0000 7ff7c1b64640 1 --2- 172.21.15.72:0/3286134360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7bc153730 0x7ff7bc0cc0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00e8b0 tx=0x7ff7ac00ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:15.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.071+0000 7ff7b2ffd640 1 -- 172.21.15.72:0/3286134360 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac00c940 con 0x7ff7bc153730 2023-12-13T00:00:15.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.071+0000 7ff7c45c9640 1 -- 172.21.15.72:0/3286134360 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc1eff80 con 0x7ff7bc153730 2023-12-13T00:00:15.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.071+0000 7ff7c45c9640 1 -- 172.21.15.72:0/3286134360 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc0c6f00 con 0x7ff7bc153730 2023-12-13T00:00:15.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.071+0000 7ff7b2ffd640 1 -- 172.21.15.72:0/3286134360 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac00caa0 con 0x7ff7bc153730 2023-12-13T00:00:15.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.072+0000 7ff7b2ffd640 1 -- 172.21.15.72:0/3286134360 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac00ce10 con 0x7ff7bc153730 2023-12-13T00:00:15.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.072+0000 7ff7b0ff9640 1 -- 172.21.15.72:0/3286134360 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff798005250 con 0x7ff7bc153730 2023-12-13T00:00:15.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.326+0000 7ff7b2ffd640 1 -- 172.21.15.72:0/3286134360 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff7ac026480 con 0x7ff7bc153730 2023-12-13T00:00:15.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.327+0000 7ff7b2ffd640 1 --2- 172.21.15.72:0/3286134360 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff7a006b1f0 0x7ff7a006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:15.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.327+0000 7ff7c2365640 1 --2- 172.21.15.72:0/3286134360 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff7a006b1f0 0x7ff7a006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:15.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.327+0000 7ff7c2365640 1 --2- 172.21.15.72:0/3286134360 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff7a006b1f0 0x7ff7a006d6b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8004e40 tx=0x7ff7b8007f10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:15.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.331+0000 7ff7b2ffd640 1 -- 172.21.15.72:0/3286134360 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff7ac058de0 con 0x7ff7bc153730 2023-12-13T00:00:15.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.344+0000 7ff7b2ffd640 1 -- 172.21.15.72:0/3286134360 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff7ac055120 con 0x7ff7bc153730 2023-12-13T00:00:15.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.524+0000 7ff7b0ff9640 1 -- 172.21.15.72:0/3286134360 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7980057d0 con 0x7ff7bc153730 2023-12-13T00:00:15.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.619+0000 7ff7b2ffd640 1 -- 172.21.15.72:0/3286134360 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12827 (secure 0 0 0) 0x7ff7ac017090 con 0x7ff7bc153730 2023-12-13T00:00:15.620 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:00:15.620 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:00:09.501625+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:00:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.621+0000 7ff7b0ff9640 1 -- 172.21.15.72:0/3286134360 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff7a006b1f0 msgr2=0x7ff7a006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.621+0000 7ff7b0ff9640 1 --2- 172.21.15.72:0/3286134360 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff7a006b1f0 0x7ff7a006d6b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8004e40 tx=0x7ff7b8007f10 comp rx=0 tx=0).stop 2023-12-13T00:00:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.621+0000 7ff7b0ff9640 1 -- 172.21.15.72:0/3286134360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7bc153730 msgr2=0x7ff7bc0cc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.621+0000 7ff7b0ff9640 1 --2- 172.21.15.72:0/3286134360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7bc153730 0x7ff7bc0cc0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00e8b0 tx=0x7ff7ac00ed70 comp rx=0 tx=0).stop 2023-12-13T00:00:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.621+0000 7ff7b0ff9640 1 -- 172.21.15.72:0/3286134360 shutdown_connections 2023-12-13T00:00:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.621+0000 7ff7b0ff9640 1 --2- 172.21.15.72:0/3286134360 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff7a006b1f0 0x7ff7a006d6b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:15.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.621+0000 7ff7b0ff9640 1 --2- 172.21.15.72:0/3286134360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7bc15a0c0 0x7ff7bc1f2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:15.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.621+0000 7ff7b0ff9640 1 --2- 172.21.15.72:0/3286134360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7bc153730 0x7ff7bc0cc0b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:15.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.621+0000 7ff7b0ff9640 1 --2- 172.21.15.72:0/3286134360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7bc0c91d0 0x7ff7bc0c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:15.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.621+0000 7ff7b0ff9640 1 -- 172.21.15.72:0/3286134360 >> 172.21.15.72:0/3286134360 conn(0x7ff7bc0707f0 msgr2=0x7ff7bc150fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:15.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.621+0000 7ff7b0ff9640 1 -- 172.21.15.72:0/3286134360 shutdown_connections 2023-12-13T00:00:15.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.623+0000 7ff7b0ff9640 1 -- 172.21.15.72:0/3286134360 wait complete. 2023-12-13T00:00:15.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-13T00:00:06.839153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-13T00:00:15.636 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-13T00:00:15.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.740+0000 7fe1d7807640 1 Processor -- start 2023-12-13T00:00:15.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.740+0000 7fe1d7807640 1 -- start start 2023-12-13T00:00:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.741+0000 7fe1d7807640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1d013c210 0x7fe1d015b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.741+0000 7fe1d7807640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d015a750 con 0x7fe1d00cc5b0 2023-12-13T00:00:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.741+0000 7fe1d7807640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d00cca00 con 0x7fe1d00c28a0 2023-12-13T00:00:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.741+0000 7fe1d7807640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d013c680 con 0x7fe1d013c210 2023-12-13T00:00:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.742+0000 7fe1d55a3640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fe1d00c28a0 0x7fe1d0157160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:38166/0 (socket says 172.21.15.72:38166) 2023-12-13T00:00:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.742+0000 7fe1d55a3640 1 -- 172.21.15.72:0/1216928975 learned_addr learned my addr 172.21.15.72:0/1216928975 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.743+0000 7fe1d4da2640 1 --2- 172.21.15.72:0/1216928975 >> v2:172.21.15.72:3300/0 conn(0x7fe1d013c210 0x7fe1d015b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:15.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.745+0000 7fe1c7fff640 1 -- 172.21.15.72:0/1216928975 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014971668 0 0) 0x7fe1d00cca00 con 0x7fe1d00c28a0 2023-12-13T00:00:15.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.745+0000 7fe1c7fff640 1 -- 172.21.15.72:0/1216928975 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1bc003520 con 0x7fe1d00c28a0 2023-12-13T00:00:15.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.747+0000 7fe1c7fff640 1 -- 172.21.15.72:0/1216928975 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372517254 0 0) 0x7fe1d015a750 con 0x7fe1d00cc5b0 2023-12-13T00:00:15.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.747+0000 7fe1c7fff640 1 -- 172.21.15.72:0/1216928975 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d00cca00 con 0x7fe1d00cc5b0 2023-12-13T00:00:15.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.748+0000 7fe1d4da2640 1 -- 172.21.15.72:0/1216928975 >> v1:172.21.15.176:6789/0 conn(0x7fe1d00c28a0 legacy=0x7fe1d0157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:15.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.748+0000 7fe1d4da2640 1 -- 172.21.15.72:0/1216928975 >> v1:172.21.15.72:6789/0 conn(0x7fe1d00cc5b0 legacy=0x7fe1d00c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:15.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.748+0000 7fe1d4da2640 1 -- 172.21.15.72:0/1216928975 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d0157960 con 0x7fe1d013c210 2023-12-13T00:00:15.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.752+0000 7fe1d4da2640 1 --2- 172.21.15.72:0/1216928975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1d013c210 0x7fe1d015b1a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00097a0 tx=0x7fe1c002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9eea80dfeff1dab server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:15.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.757+0000 7fe1c7fff640 1 -- 172.21.15.72:0/1216928975 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0030610 con 0x7fe1d013c210 2023-12-13T00:00:15.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.757+0000 7fe1c7fff640 1 -- 172.21.15.72:0/1216928975 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c0030770 con 0x7fe1d013c210 2023-12-13T00:00:15.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.757+0000 7fe1c7fff640 1 -- 172.21.15.72:0/1216928975 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0030b00 con 0x7fe1d013c210 2023-12-13T00:00:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.758+0000 7fe1d7807640 1 -- 172.21.15.72:0/1216928975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1d013c210 msgr2=0x7fe1d015b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.758+0000 7fe1d7807640 1 --2- 172.21.15.72:0/1216928975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1d013c210 0x7fe1d015b1a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00097a0 tx=0x7fe1c002b960 comp rx=0 tx=0).stop 2023-12-13T00:00:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.758+0000 7fe1d7807640 1 -- 172.21.15.72:0/1216928975 shutdown_connections 2023-12-13T00:00:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.758+0000 7fe1d7807640 1 --2- 172.21.15.72:0/1216928975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1d013c210 0x7fe1d015b1a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.758+0000 7fe1d7807640 1 -- 172.21.15.72:0/1216928975 >> 172.21.15.72:0/1216928975 conn(0x7fe1d006f5d0 msgr2=0x7fe1d006f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.758+0000 7fe1d7807640 1 -- 172.21.15.72:0/1216928975 shutdown_connections 2023-12-13T00:00:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.758+0000 7fe1d7807640 1 -- 172.21.15.72:0/1216928975 wait complete. 2023-12-13T00:00:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.759+0000 7fe1d7807640 1 Processor -- start 2023-12-13T00:00:15.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.760+0000 7fe1d7807640 1 -- start start 2023-12-13T00:00:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.760+0000 7fe1d7807640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1d00c28a0 0x7fe1d0138410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.760+0000 7fe1d7807640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1d00cc5b0 0x7fe1d01560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.760+0000 7fe1d7807640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1d013c210 0x7fe1d01ef3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.760+0000 7fe1d7807640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d0138e70 con 0x7fe1d00c28a0 2023-12-13T00:00:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.760+0000 7fe1d7807640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d01573f0 con 0x7fe1d00cc5b0 2023-12-13T00:00:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.760+0000 7fe1d7807640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d01f34e0 con 0x7fe1d013c210 2023-12-13T00:00:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.761+0000 7fe1d55a3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1d00c28a0 0x7fe1d0138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.761+0000 7fe1d4da2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1d00cc5b0 0x7fe1d01560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.761+0000 7fe1d5da4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1d013c210 0x7fe1d01ef3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.761+0000 7fe1d55a3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1d00c28a0 0x7fe1d0138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42928/0 (socket says 172.21.15.72:42928) 2023-12-13T00:00:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.761+0000 7fe1d55a3640 1 -- 172.21.15.72:0/3098601235 learned_addr learned my addr 172.21.15.72:0/3098601235 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.765+0000 7fe1d55a3640 1 -- 172.21.15.72:0/3098601235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1d013c210 msgr2=0x7fe1d01ef3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.765+0000 7fe1d55a3640 1 --2- 172.21.15.72:0/3098601235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1d013c210 0x7fe1d01ef3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:15.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.765+0000 7fe1d55a3640 1 -- 172.21.15.72:0/3098601235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1d00cc5b0 msgr2=0x7fe1d01560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:15.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.765+0000 7fe1d55a3640 1 --2- 172.21.15.72:0/3098601235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1d00cc5b0 0x7fe1d01560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:15.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.765+0000 7fe1d55a3640 1 -- 172.21.15.72:0/3098601235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c0009400 con 0x7fe1d00c28a0 2023-12-13T00:00:15.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.768+0000 7fe1d55a3640 1 --2- 172.21.15.72:0/3098601235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1d00c28a0 0x7fe1d0138410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00c410 tx=0x7fe1cc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.773+0000 7fe1c5ffb640 1 -- 172.21.15.72:0/3098601235 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc005ce0 con 0x7fe1d00c28a0 2023-12-13T00:00:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.773+0000 7fe1c5ffb640 1 -- 172.21.15.72:0/3098601235 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc005e40 con 0x7fe1d00c28a0 2023-12-13T00:00:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.773+0000 7fe1d7807640 1 -- 172.21.15.72:0/3098601235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d01f2910 con 0x7fe1d00c28a0 2023-12-13T00:00:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.773+0000 7fe1c5ffb640 1 -- 172.21.15.72:0/3098601235 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0072f0 con 0x7fe1d00c28a0 2023-12-13T00:00:15.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.773+0000 7fe1d7807640 1 -- 172.21.15.72:0/3098601235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d01f2e90 con 0x7fe1d00c28a0 2023-12-13T00:00:15.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.774+0000 7fe1d7807640 1 -- 172.21.15.72:0/3098601235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d013cb20 con 0x7fe1d00c28a0 2023-12-13T00:00:15.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.809+0000 7fe1c5ffb640 1 -- 172.21.15.72:0/3098601235 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe1cc007450 con 0x7fe1d00c28a0 2023-12-13T00:00:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.809+0000 7fe1c5ffb640 1 --2- 172.21.15.72:0/3098601235 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe1b406b210 0x7fe1b406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.810+0000 7fe1d4da2640 1 --2- 172.21.15.72:0/3098601235 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe1b406b210 0x7fe1b406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:15.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.810+0000 7fe1d4da2640 1 --2- 172.21.15.72:0/3098601235 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe1b406b210 0x7fe1b406d6d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0036000 tx=0x7fe1c003b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:15.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:15.819+0000 7fe1c5ffb640 1 -- 172.21.15.72:0/3098601235 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe1cc057fe0 con 0x7fe1d00c28a0 2023-12-13T00:00:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.080+0000 7fe1c5ffb640 1 -- 172.21.15.72:0/3098601235 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe1cc054320 con 0x7fe1d00c28a0 2023-12-13T00:00:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.300+0000 7fe1d7807640 1 -- 172.21.15.72:0/3098601235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1d0151510 con 0x7fe1d00c28a0 2023-12-13T00:00:16.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.348+0000 7fe1c5ffb640 1 -- 172.21.15.72:0/3098601235 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1cc017020 con 0x7fe1d00c28a0 2023-12-13T00:00:16.349 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-12-13T00:00:16.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.350+0000 7fe1d7807640 1 -- 172.21.15.72:0/3098601235 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe1b406b210 msgr2=0x7fe1b406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:16.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.350+0000 7fe1d7807640 1 --2- 172.21.15.72:0/3098601235 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe1b406b210 0x7fe1b406d6d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0036000 tx=0x7fe1c003b040 comp rx=0 tx=0).stop 2023-12-13T00:00:16.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.350+0000 7fe1d7807640 1 -- 172.21.15.72:0/3098601235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1d00c28a0 msgr2=0x7fe1d0138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:16.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.350+0000 7fe1d7807640 1 --2- 172.21.15.72:0/3098601235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1d00c28a0 0x7fe1d0138410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00c410 tx=0x7fe1cc00c8d0 comp rx=0 tx=0).stop 2023-12-13T00:00:16.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.351+0000 7fe1d7807640 1 -- 172.21.15.72:0/3098601235 shutdown_connections 2023-12-13T00:00:16.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.351+0000 7fe1d7807640 1 --2- 172.21.15.72:0/3098601235 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe1b406b210 0x7fe1b406d6d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:16.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.351+0000 7fe1d7807640 1 --2- 172.21.15.72:0/3098601235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1d013c210 0x7fe1d01ef3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:16.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.351+0000 7fe1d7807640 1 --2- 172.21.15.72:0/3098601235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1d00cc5b0 0x7fe1d01560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:16.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.351+0000 7fe1d7807640 1 --2- 172.21.15.72:0/3098601235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1d00c28a0 0x7fe1d0138410 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:16.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.351+0000 7fe1d7807640 1 -- 172.21.15.72:0/3098601235 >> 172.21.15.72:0/3098601235 conn(0x7fe1d006f5d0 msgr2=0x7fe1d015afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:16.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.351+0000 7fe1d7807640 1 -- 172.21.15.72:0/3098601235 shutdown_connections 2023-12-13T00:00:16.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.351+0000 7fe1d7807640 1 -- 172.21.15.72:0/3098601235 wait complete. 2023-12-13T00:00:16.362 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T00:00:16.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.468+0000 7f1004661640 1 Processor -- start 2023-12-13T00:00:16.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.468+0000 7f1004661640 1 -- start start 2023-12-13T00:00:16.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.469+0000 7f1004661640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ffc0c8660 0x7f0ffc15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:16.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.469+0000 7f1004661640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc0728b0 0x7f0ffc0c4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:16.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.469+0000 7f1004661640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0ffc0c8a40 0x7f0ffc0c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:16.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.469+0000 7f1004661640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ffc071e10 con 0x7f0ffc0c8660 2023-12-13T00:00:16.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.469+0000 7f1004661640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ffc15d970 con 0x7f0ffc0c8a40 2023-12-13T00:00:16.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.469+0000 7f1004661640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0cc7a0 con 0x7f0ffc0728b0 2023-12-13T00:00:16.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.470+0000 7f1001bfc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc0728b0 0x7f0ffc0c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:16.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.470+0000 7f10023fd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ffc0c8660 0x7f0ffc15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:16.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.470+0000 7f1002bfe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0ffc0c8a40 0x7f0ffc0c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:16.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.470+0000 7f1001bfc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc0728b0 0x7f0ffc0c4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:57890/0 (socket says 172.21.15.72:57890) 2023-12-13T00:00:16.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.470+0000 7f1001bfc640 1 -- 172.21.15.72:0/2942426939 learned_addr learned my addr 172.21.15.72:0/2942426939 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:16.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.473+0000 7f1002bfe640 1 -- 172.21.15.72:0/2942426939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc0728b0 msgr2=0x7f0ffc0c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:16.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.473+0000 7f1002bfe640 1 --2- 172.21.15.72:0/2942426939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc0728b0 0x7f0ffc0c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:16.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.473+0000 7f1002bfe640 1 -- 172.21.15.72:0/2942426939 >> v2:172.21.15.72:3300/0 conn(0x7f0ffc0c8660 msgr2=0x7f0ffc15d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:16.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.473+0000 7f1002bfe640 1 --2- 172.21.15.72:0/2942426939 >> v2:172.21.15.72:3300/0 conn(0x7f0ffc0c8660 0x7f0ffc15d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:16.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.473+0000 7f1002bfe640 1 -- 172.21.15.72:0/2942426939 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc159430 con 0x7f0ffc0c8a40 2023-12-13T00:00:16.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.475+0000 7f1002bfe640 1 --2- 172.21.15.72:0/2942426939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ffc0c8a40 0x7f0ffc0c4670 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc159620 tx=0x7f0ff402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc7a81926bbade7e server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.480+0000 7f10013fb640 1 -- 172.21.15.72:0/2942426939 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff402cc50 con 0x7f0ffc0c8a40 2023-12-13T00:00:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.480+0000 7f10013fb640 1 -- 172.21.15.72:0/2942426939 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff402cdb0 con 0x7f0ffc0c8a40 2023-12-13T00:00:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.480+0000 7f10013fb640 1 -- 172.21.15.72:0/2942426939 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4034660 con 0x7f0ffc0c8a40 2023-12-13T00:00:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.480+0000 7f1004661640 1 -- 172.21.15.72:0/2942426939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ffc0c8a40 msgr2=0x7f0ffc0c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.480+0000 7f1004661640 1 --2- 172.21.15.72:0/2942426939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ffc0c8a40 0x7f0ffc0c4670 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc159620 tx=0x7f0ff402bea0 comp rx=0 tx=0).stop 2023-12-13T00:00:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.480+0000 7f1004661640 1 -- 172.21.15.72:0/2942426939 shutdown_connections 2023-12-13T00:00:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.480+0000 7f1004661640 1 --2- 172.21.15.72:0/2942426939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ffc0c8a40 0x7f0ffc0c4670 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.480+0000 7f1004661640 1 --2- 172.21.15.72:0/2942426939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc0728b0 0x7f0ffc0c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.480+0000 7f1004661640 1 --2- 172.21.15.72:0/2942426939 >> v2:172.21.15.72:3300/0 conn(0x7f0ffc0c8660 0x7f0ffc15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.480+0000 7f1004661640 1 -- 172.21.15.72:0/2942426939 >> 172.21.15.72:0/2942426939 conn(0x7f0ffc06b5c0 msgr2=0x7f0ffc06b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.480+0000 7f1004661640 1 -- 172.21.15.72:0/2942426939 shutdown_connections 2023-12-13T00:00:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.481+0000 7f1004661640 1 -- 172.21.15.72:0/2942426939 wait complete. 2023-12-13T00:00:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.482+0000 7f1004661640 1 Processor -- start 2023-12-13T00:00:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.482+0000 7f1004661640 1 -- start start 2023-12-13T00:00:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.482+0000 7f1004661640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ffc0728b0 0x7f0ffc1efd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.482+0000 7f1004661640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc0c8660 0x7f0ffc14fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.482+0000 7f1004661640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ffc0c8a40 0x7f0ffc153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.482+0000 7f1004661640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc1f02a0 con 0x7f0ffc0728b0 2023-12-13T00:00:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.482+0000 7f1004661640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc155ae0 con 0x7f0ffc0c8a40 2023-12-13T00:00:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.482+0000 7f1004661640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc155dc0 con 0x7f0ffc0c8660 2023-12-13T00:00:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.483+0000 7f1001bfc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc0c8660 0x7f0ffc14fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.483+0000 7f10023fd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ffc0728b0 0x7f0ffc1efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.483+0000 7f1002bfe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ffc0c8a40 0x7f0ffc153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:16.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.484+0000 7f1001bfc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc0c8660 0x7f0ffc14fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:57900/0 (socket says 172.21.15.72:57900) 2023-12-13T00:00:16.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.484+0000 7f1001bfc640 1 -- 172.21.15.72:0/2076148188 learned_addr learned my addr 172.21.15.72:0/2076148188 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.487+0000 7f1001bfc640 1 -- 172.21.15.72:0/2076148188 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ffc0c8a40 msgr2=0x7f0ffc153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.487+0000 7f1001bfc640 1 --2- 172.21.15.72:0/2076148188 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ffc0c8a40 0x7f0ffc153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.487+0000 7f1001bfc640 1 -- 172.21.15.72:0/2076148188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ffc0728b0 msgr2=0x7f0ffc1efd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.487+0000 7f1001bfc640 1 --2- 172.21.15.72:0/2076148188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ffc0728b0 0x7f0ffc1efd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.487+0000 7f1001bfc640 1 -- 172.21.15.72:0/2076148188 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff4009a70 con 0x7f0ffc0c8660 2023-12-13T00:00:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.489+0000 7f1001bfc640 1 --2- 172.21.15.72:0/2076148188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc0c8660 0x7f0ffc14fd40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0fec00e870 tx=0x7f0fec00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.495+0000 7f0ff2ffd640 1 -- 172.21.15.72:0/2076148188 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec00c940 con 0x7f0ffc0c8660 2023-12-13T00:00:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.495+0000 7f0ff2ffd640 1 -- 172.21.15.72:0/2076148188 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec00caa0 con 0x7f0ffc0c8660 2023-12-13T00:00:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.495+0000 7f1004661640 1 -- 172.21.15.72:0/2076148188 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ffc1560a0 con 0x7f0ffc0c8660 2023-12-13T00:00:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.495+0000 7f0ff2ffd640 1 -- 172.21.15.72:0/2076148188 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec00ce50 con 0x7f0ffc0c8660 2023-12-13T00:00:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.495+0000 7f1004661640 1 -- 172.21.15.72:0/2076148188 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ffc156660 con 0x7f0ffc0c8660 2023-12-13T00:00:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.496+0000 7f1004661640 1 -- 172.21.15.72:0/2076148188 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ffc073dc0 con 0x7f0ffc0c8660 2023-12-13T00:00:16.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.516+0000 7f0ff2ffd640 1 -- 172.21.15.72:0/2076148188 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0fec013470 con 0x7f0ffc0c8660 2023-12-13T00:00:16.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.516+0000 7f0ff2ffd640 1 --2- 172.21.15.72:0/2076148188 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0fe006b1c0 0x7f0fe006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:16.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.516+0000 7f10023fd640 1 --2- 172.21.15.72:0/2076148188 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0fe006b1c0 0x7f0fe006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:16.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.517+0000 7f10023fd640 1 --2- 172.21.15.72:0/2076148188 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0fe006b1c0 0x7f0fe006d680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009a20 tx=0x7f0ff8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:16.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.518+0000 7f0ff2ffd640 1 -- 172.21.15.72:0/2076148188 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0fec058d20 con 0x7f0ffc0c8660 2023-12-13T00:00:16.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:16.774+0000 7f0ff2ffd640 1 -- 172.21.15.72:0/2076148188 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0fec055060 con 0x7f0ffc0c8660 2023-12-13T00:00:17.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:17.029+0000 7f1004661640 1 -- 172.21.15.72:0/2076148188 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ffc156e50 con 0x7f0ffc0c8660 2023-12-13T00:00:17.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:17.047+0000 7f0ff2ffd640 1 -- 172.21.15.72:0/2076148188 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f0fec021020 con 0x7f0ffc0c8660 2023-12-13T00:00:17.048 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:00:17.048 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-12-13T00:00:17.048 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 1 2023-12-13T00:00:17.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:17.049+0000 7f1004661640 1 -- 172.21.15.72:0/2076148188 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0fe006b1c0 msgr2=0x7f0fe006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:17.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:17.049+0000 7f1004661640 1 --2- 172.21.15.72:0/2076148188 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0fe006b1c0 0x7f0fe006d680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009a20 tx=0x7f0ff8009190 comp rx=0 tx=0).stop 2023-12-13T00:00:17.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:17.049+0000 7f1004661640 1 -- 172.21.15.72:0/2076148188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc0c8660 msgr2=0x7f0ffc14fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:17.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:17.049+0000 7f1004661640 1 --2- 172.21.15.72:0/2076148188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc0c8660 0x7f0ffc14fd40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0fec00e870 tx=0x7f0fec00ed30 comp rx=0 tx=0).stop 2023-12-13T00:00:17.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:17.049+0000 7f1004661640 1 -- 172.21.15.72:0/2076148188 shutdown_connections 2023-12-13T00:00:17.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:17.049+0000 7f1004661640 1 --2- 172.21.15.72:0/2076148188 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0fe006b1c0 0x7f0fe006d680 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:17.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:17.049+0000 7f1004661640 1 --2- 172.21.15.72:0/2076148188 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ffc0c8a40 0x7f0ffc153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:17.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:17.049+0000 7f1004661640 1 --2- 172.21.15.72:0/2076148188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ffc0c8660 0x7f0ffc14fd40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:17.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:17.050+0000 7f1004661640 1 --2- 172.21.15.72:0/2076148188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ffc0728b0 0x7f0ffc1efd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:17.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:17.050+0000 7f1004661640 1 -- 172.21.15.72:0/2076148188 >> 172.21.15.72:0/2076148188 conn(0x7f0ffc06b5c0 msgr2=0x7f0ffc157c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:17.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:17.050+0000 7f1004661640 1 -- 172.21.15.72:0/2076148188 shutdown_connections 2023-12-13T00:00:17.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:17.050+0000 7f1004661640 1 -- 172.21.15.72:0/2076148188 wait complete. 2023-12-13T00:00:19.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T00:00:19.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.164+0000 7f8377e23640 1 Processor -- start 2023-12-13T00:00:19.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.164+0000 7f8377e23640 1 -- start start 2023-12-13T00:00:19.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.165+0000 7f8377e23640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83700cda70 0x7f83700ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:19.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.165+0000 7f8377e23640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83700cbda0 con 0x7f83700cc420 2023-12-13T00:00:19.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.165+0000 7f8377e23640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83700cb4e0 con 0x7f83700c9620 2023-12-13T00:00:19.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.165+0000 7f8377e23640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83700cc230 con 0x7f83700cda70 2023-12-13T00:00:19.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.166+0000 7f8375bbf640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83700cda70 0x7f83700ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:19.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.166+0000 7f83763c0640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f83700c9620 0x7f8370163eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:40664/0 (socket says 172.21.15.72:40664) 2023-12-13T00:00:19.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.166+0000 7f83763c0640 1 -- 172.21.15.72:0/1054266137 learned_addr learned my addr 172.21.15.72:0/1054266137 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.169+0000 7f8375bbf640 1 -- 172.21.15.72:0/1054266137 >> v1:172.21.15.176:6789/0 conn(0x7f83700c9620 legacy=0x7f8370163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.169+0000 7f8375bbf640 1 -- 172.21.15.72:0/1054266137 >> v1:172.21.15.72:6789/0 conn(0x7f83700cc420 legacy=0x7f8370159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.169+0000 7f8375bbf640 1 -- 172.21.15.72:0/1054266137 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83700cce00 con 0x7f83700cda70 2023-12-13T00:00:19.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.173+0000 7f8375bbf640 1 --2- 172.21.15.72:0/1054266137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83700cda70 0x7f83700ce350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f836c0097a0 tx=0x7f836c02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0d72e727b0c168 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:19.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.178+0000 7f8374bbd640 1 -- 172.21.15.72:0/1054266137 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c02f810 con 0x7f83700cda70 2023-12-13T00:00:19.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.178+0000 7f8374bbd640 1 -- 172.21.15.72:0/1054266137 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c02f970 con 0x7f83700cda70 2023-12-13T00:00:19.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.178+0000 7f8374bbd640 1 -- 172.21.15.72:0/1054266137 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c02fd00 con 0x7f83700cda70 2023-12-13T00:00:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.179+0000 7f8377e23640 1 -- 172.21.15.72:0/1054266137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83700cda70 msgr2=0x7f83700ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.179+0000 7f8377e23640 1 --2- 172.21.15.72:0/1054266137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83700cda70 0x7f83700ce350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f836c0097a0 tx=0x7f836c02b9f0 comp rx=0 tx=0).stop 2023-12-13T00:00:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.179+0000 7f8377e23640 1 -- 172.21.15.72:0/1054266137 shutdown_connections 2023-12-13T00:00:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.179+0000 7f8377e23640 1 --2- 172.21.15.72:0/1054266137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83700cda70 0x7f83700ce350 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.179+0000 7f8377e23640 1 -- 172.21.15.72:0/1054266137 >> 172.21.15.72:0/1054266137 conn(0x7f83700b07b0 msgr2=0x7f83700b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.179+0000 7f8377e23640 1 -- 172.21.15.72:0/1054266137 shutdown_connections 2023-12-13T00:00:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.179+0000 7f8377e23640 1 -- 172.21.15.72:0/1054266137 wait complete. 2023-12-13T00:00:19.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.181+0000 7f8377e23640 1 Processor -- start 2023-12-13T00:00:19.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.181+0000 7f8377e23640 1 -- start start 2023-12-13T00:00:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.182+0000 7f8377e23640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83700c9620 0x7f83701ecdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.182+0000 7f8377e23640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83700cc420 0x7f83700b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.182+0000 7f8377e23640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83700cda70 0x7f83700b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.182+0000 7f8377e23640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83700b4080 con 0x7f83700cda70 2023-12-13T00:00:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.182+0000 7f8377e23640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83700b2a00 con 0x7f83700cc420 2023-12-13T00:00:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.182+0000 7f8377e23640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83700b33d0 con 0x7f83700c9620 2023-12-13T00:00:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.183+0000 7f83753be640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83700cc420 0x7f83700b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.183+0000 7f83763c0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83700cda70 0x7f83700b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.183+0000 7f8375bbf640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83700c9620 0x7f83701ecdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.183+0000 7f83753be640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83700cc420 0x7f83700b4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:37134/0 (socket says 172.21.15.72:37134) 2023-12-13T00:00:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.183+0000 7f83753be640 1 -- 172.21.15.72:0/3422157172 learned_addr learned my addr 172.21.15.72:0/3422157172 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:19.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.186+0000 7f83753be640 1 -- 172.21.15.72:0/3422157172 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83700c9620 msgr2=0x7f83701ecdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:19.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.186+0000 7f83753be640 1 --2- 172.21.15.72:0/3422157172 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83700c9620 0x7f83701ecdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:19.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.186+0000 7f83753be640 1 -- 172.21.15.72:0/3422157172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83700cda70 msgr2=0x7f83700b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:19.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.186+0000 7f83753be640 1 --2- 172.21.15.72:0/3422157172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83700cda70 0x7f83700b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:19.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.186+0000 7f83753be640 1 -- 172.21.15.72:0/3422157172 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c009400 con 0x7f83700cc420 2023-12-13T00:00:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.189+0000 7f83753be640 1 --2- 172.21.15.72:0/3422157172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83700cc420 0x7f83700b4410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f836000c4a0 tx=0x7f8360001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:19.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.193+0000 7f83667fc640 1 -- 172.21.15.72:0/3422157172 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83600052d0 con 0x7f83700cc420 2023-12-13T00:00:19.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.193+0000 7f83667fc640 1 -- 172.21.15.72:0/3422157172 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8360005430 con 0x7f83700cc420 2023-12-13T00:00:19.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.193+0000 7f83667fc640 1 -- 172.21.15.72:0/3422157172 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360007260 con 0x7f83700cc420 2023-12-13T00:00:19.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.194+0000 7f8377e23640 1 -- 172.21.15.72:0/3422157172 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83700c58b0 con 0x7f83700cc420 2023-12-13T00:00:19.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.194+0000 7f8377e23640 1 -- 172.21.15.72:0/3422157172 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83700b23f0 con 0x7f83700cc420 2023-12-13T00:00:19.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.195+0000 7f8377e23640 1 -- 172.21.15.72:0/3422157172 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83700b2250 con 0x7f83700cc420 2023-12-13T00:00:19.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.462+0000 7f83667fc640 1 -- 172.21.15.72:0/3422157172 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f83600073c0 con 0x7f83700cc420 2023-12-13T00:00:19.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.462+0000 7f83667fc640 1 --2- 172.21.15.72:0/3422157172 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f835406b210 0x7f835406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:19.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.463+0000 7f8375bbf640 1 --2- 172.21.15.72:0/3422157172 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f835406b210 0x7f835406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:19.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.463+0000 7f8375bbf640 1 --2- 172.21.15.72:0/3422157172 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f835406b210 0x7f835406d6d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f836c036000 tx=0x7f836c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:19.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.465+0000 7f83667fc640 1 -- 172.21.15.72:0/3422157172 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8360007670 con 0x7f83700cc420 2023-12-13T00:00:19.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.478+0000 7f83667fc640 1 -- 172.21.15.72:0/3422157172 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8360054270 con 0x7f83700cc420 2023-12-13T00:00:19.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.777+0000 7f8377e23640 1 -- 172.21.15.72:0/3422157172 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83700b2250 con 0x7f83700cc420 2023-12-13T00:00:19.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.843+0000 7f83667fc640 1 -- 172.21.15.72:0/3422157172 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f83700b2250 con 0x7f83700cc420 2023-12-13T00:00:19.844 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:00:19.844 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-12-13T00:00:19.845 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 1 2023-12-13T00:00:19.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.845+0000 7f8377e23640 1 -- 172.21.15.72:0/3422157172 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f835406b210 msgr2=0x7f835406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:19.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.845+0000 7f8377e23640 1 --2- 172.21.15.72:0/3422157172 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f835406b210 0x7f835406d6d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f836c036000 tx=0x7f836c008030 comp rx=0 tx=0).stop 2023-12-13T00:00:19.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.845+0000 7f8377e23640 1 -- 172.21.15.72:0/3422157172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83700cc420 msgr2=0x7f83700b4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.845+0000 7f8377e23640 1 --2- 172.21.15.72:0/3422157172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83700cc420 0x7f83700b4410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f836000c4a0 tx=0x7f8360001e70 comp rx=0 tx=0).stop 2023-12-13T00:00:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.845+0000 7f8377e23640 1 -- 172.21.15.72:0/3422157172 shutdown_connections 2023-12-13T00:00:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.845+0000 7f8377e23640 1 --2- 172.21.15.72:0/3422157172 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f835406b210 0x7f835406d6d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.845+0000 7f8377e23640 1 --2- 172.21.15.72:0/3422157172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83700cda70 0x7f83700b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.845+0000 7f8377e23640 1 --2- 172.21.15.72:0/3422157172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83700cc420 0x7f83700b4410 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.845+0000 7f8377e23640 1 --2- 172.21.15.72:0/3422157172 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83700c9620 0x7f83701ecdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.845+0000 7f8377e23640 1 -- 172.21.15.72:0/3422157172 >> 172.21.15.72:0/3422157172 conn(0x7f83700b07b0 msgr2=0x7f83700ae800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.846+0000 7f8377e23640 1 -- 172.21.15.72:0/3422157172 shutdown_connections 2023-12-13T00:00:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:19.846+0000 7f8377e23640 1 -- 172.21.15.72:0/3422157172 wait complete. 2023-12-13T00:00:21.128 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-12-13T00:00:21.157 INFO:tasks.ceph.mds.e.smithi072.stdout:starting mds.e at 2023-12-13T00:00:21.165 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2023-12-13T00:00:21.229 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2023-12-13T00:00:21.252 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-12-13T00:00:21.266 INFO:tasks.ceph.mds.f.smithi176.stdout:starting mds.f at 2023-12-13T00:00:21.858 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T00:00:21.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:21.961+0000 7fa88ae94640 1 Processor -- start 2023-12-13T00:00:21.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:21.961+0000 7fa88ae94640 1 -- start start 2023-12-13T00:00:21.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:21.962+0000 7fa88ae94640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa884151680 0x7fa8841571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:21.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:21.962+0000 7fa88ae94640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8840c8240 con 0x7fa88406f810 2023-12-13T00:00:21.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:21.962+0000 7fa88ae94640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa884157880 con 0x7fa88406f3f0 2023-12-13T00:00:21.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:21.962+0000 7fa88ae94640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa884157b60 con 0x7fa884151680 2023-12-13T00:00:21.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:21.963+0000 7fa888c30640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa884151680 0x7fa8841571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:21.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:21.963+0000 7fa883fff640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fa88406f3f0 0x7fa8840c7b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:40674/0 (socket says 172.21.15.72:40674) 2023-12-13T00:00:21.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:21.963+0000 7fa883fff640 1 -- 172.21.15.72:0/1339675212 learned_addr learned my addr 172.21.15.72:0/1339675212 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:21.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:21.967+0000 7fa888c30640 1 -- 172.21.15.72:0/1339675212 >> v1:172.21.15.176:6789/0 conn(0x7fa88406f3f0 legacy=0x7fa8840c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:21.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:21.967+0000 7fa888c30640 1 -- 172.21.15.72:0/1339675212 >> v1:172.21.15.72:6789/0 conn(0x7fa88406f810 legacy=0x7fa8840ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:21.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:21.967+0000 7fa888c30640 1 -- 172.21.15.72:0/1339675212 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa884157e40 con 0x7fa884151680 2023-12-13T00:00:21.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:21.970+0000 7fa888c30640 1 --2- 172.21.15.72:0/1339675212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa884151680 0x7fa8841571d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa8780097a0 tx=0x7fa87802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2457cbf96f1627 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:22.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.019+0000 7fa8837fe640 1 -- 172.21.15.72:0/1339675212 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878030610 con 0x7fa884151680 2023-12-13T00:00:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.037+0000 7fa8837fe640 1 -- 172.21.15.72:0/1339675212 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa878030770 con 0x7fa884151680 2023-12-13T00:00:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.037+0000 7fa8837fe640 1 -- 172.21.15.72:0/1339675212 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878030b00 con 0x7fa884151680 2023-12-13T00:00:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.038+0000 7fa88ae94640 1 -- 172.21.15.72:0/1339675212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa884151680 msgr2=0x7fa8841571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.038+0000 7fa88ae94640 1 --2- 172.21.15.72:0/1339675212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa884151680 0x7fa8841571d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa8780097a0 tx=0x7fa87802b960 comp rx=0 tx=0).stop 2023-12-13T00:00:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.038+0000 7fa88ae94640 1 -- 172.21.15.72:0/1339675212 shutdown_connections 2023-12-13T00:00:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.038+0000 7fa88ae94640 1 --2- 172.21.15.72:0/1339675212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa884151680 0x7fa8841571d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.038+0000 7fa88ae94640 1 -- 172.21.15.72:0/1339675212 >> 172.21.15.72:0/1339675212 conn(0x7fa8840707f0 msgr2=0x7fa884070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.038+0000 7fa88ae94640 1 -- 172.21.15.72:0/1339675212 shutdown_connections 2023-12-13T00:00:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.038+0000 7fa88ae94640 1 -- 172.21.15.72:0/1339675212 wait complete. 2023-12-13T00:00:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.039+0000 7fa88ae94640 1 Processor -- start 2023-12-13T00:00:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.039+0000 7fa88ae94640 1 -- start start 2023-12-13T00:00:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.040+0000 7fa88ae94640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa88406f3f0 0x7fa884156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.040+0000 7fa88ae94640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa88406f810 0x7fa884156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.040+0000 7fa88ae94640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa884151680 0x7fa88414f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.040+0000 7fa88ae94640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8841f0130 con 0x7fa884151680 2023-12-13T00:00:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.040+0000 7fa88ae94640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8840c4350 con 0x7fa88406f3f0 2023-12-13T00:00:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.040+0000 7fa88ae94640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8841f0360 con 0x7fa88406f810 2023-12-13T00:00:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.041+0000 7fa888c30640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa88406f3f0 0x7fa884156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.041+0000 7fa883fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa88406f810 0x7fa884156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.041+0000 7fa888c30640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa88406f3f0 0x7fa884156d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:37228/0 (socket says 172.21.15.72:37228) 2023-12-13T00:00:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.041+0000 7fa888c30640 1 -- 172.21.15.72:0/1382778096 learned_addr learned my addr 172.21.15.72:0/1382778096 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.045+0000 7fa889431640 1 --2- 172.21.15.72:0/1382778096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa884151680 0x7fa88414f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.045+0000 7fa888c30640 1 -- 172.21.15.72:0/1382778096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa88406f810 msgr2=0x7fa884156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.045+0000 7fa888c30640 1 --2- 172.21.15.72:0/1382778096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa88406f810 0x7fa884156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.045+0000 7fa888c30640 1 -- 172.21.15.72:0/1382778096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa884151680 msgr2=0x7fa88414f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.045+0000 7fa888c30640 1 --2- 172.21.15.72:0/1382778096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa884151680 0x7fa88414f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.045+0000 7fa888c30640 1 -- 172.21.15.72:0/1382778096 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa878009400 con 0x7fa88406f3f0 2023-12-13T00:00:22.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.051+0000 7fa888c30640 1 --2- 172.21.15.72:0/1382778096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa88406f3f0 0x7fa884156d20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8780098c0 tx=0x7fa8780046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:22.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.110+0000 7fa8817fa640 1 -- 172.21.15.72:0/1382778096 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87803e070 con 0x7fa88406f3f0 2023-12-13T00:00:22.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.110+0000 7fa8817fa640 1 -- 172.21.15.72:0/1382778096 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa878039a10 con 0x7fa88406f3f0 2023-12-13T00:00:22.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.110+0000 7fa88ae94640 1 -- 172.21.15.72:0/1382778096 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8841f0640 con 0x7fa88406f3f0 2023-12-13T00:00:22.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.110+0000 7fa8817fa640 1 -- 172.21.15.72:0/1382778096 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878039da0 con 0x7fa88406f3f0 2023-12-13T00:00:22.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.110+0000 7fa88ae94640 1 -- 172.21.15.72:0/1382778096 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8841f0c00 con 0x7fa88406f3f0 2023-12-13T00:00:22.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.112+0000 7fa88ae94640 1 -- 172.21.15.72:0/1382778096 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa884073dc0 con 0x7fa88406f3f0 2023-12-13T00:00:22.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.355+0000 7fa8817fa640 1 -- 172.21.15.72:0/1382778096 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa8780423f0 con 0x7fa88406f3f0 2023-12-13T00:00:22.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.356+0000 7fa8817fa640 1 --2- 172.21.15.72:0/1382778096 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa86806b1c0 0x7fa86806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:22.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.356+0000 7fa883fff640 1 --2- 172.21.15.72:0/1382778096 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa86806b1c0 0x7fa86806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:22.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.356+0000 7fa883fff640 1 --2- 172.21.15.72:0/1382778096 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa86806b1c0 0x7fa86806d680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa8840cb700 tx=0x7fa870009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:22.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.359+0000 7fa8817fa640 1 -- 172.21.15.72:0/1382778096 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa87807a640 con 0x7fa88406f3f0 2023-12-13T00:00:22.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.368+0000 7fa8817fa640 1 -- 172.21.15.72:0/1382778096 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa878076980 con 0x7fa88406f3f0 2023-12-13T00:00:22.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.570+0000 7fa88ae94640 1 -- 172.21.15.72:0/1382778096 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8840af8c0 con 0x7fa88406f3f0 2023-12-13T00:00:22.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.581+0000 7fa8817fa640 1 -- 172.21.15.72:0/1382778096 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7fa878048020 con 0x7fa88406f3f0 2023-12-13T00:00:22.581 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:00:22.581 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3954648997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3954648997},{"type":"v1","addr":"172.21.15.72:6835","nonce":3954648997}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-13T00:00:22.582 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 2 2023-12-13T00:00:22.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.582+0000 7fa88ae94640 1 -- 172.21.15.72:0/1382778096 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa86806b1c0 msgr2=0x7fa86806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:22.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.582+0000 7fa88ae94640 1 --2- 172.21.15.72:0/1382778096 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa86806b1c0 0x7fa86806d680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa8840cb700 tx=0x7fa870009040 comp rx=0 tx=0).stop 2023-12-13T00:00:22.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.582+0000 7fa88ae94640 1 -- 172.21.15.72:0/1382778096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa88406f3f0 msgr2=0x7fa884156d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:22.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.582+0000 7fa88ae94640 1 --2- 172.21.15.72:0/1382778096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa88406f3f0 0x7fa884156d20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8780098c0 tx=0x7fa8780046c0 comp rx=0 tx=0).stop 2023-12-13T00:00:22.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.582+0000 7fa88ae94640 1 -- 172.21.15.72:0/1382778096 shutdown_connections 2023-12-13T00:00:22.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.582+0000 7fa88ae94640 1 --2- 172.21.15.72:0/1382778096 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa86806b1c0 0x7fa86806d680 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:22.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.582+0000 7fa88ae94640 1 --2- 172.21.15.72:0/1382778096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa884151680 0x7fa88414f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:22.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.582+0000 7fa88ae94640 1 --2- 172.21.15.72:0/1382778096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa88406f810 0x7fa884156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:22.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.582+0000 7fa88ae94640 1 --2- 172.21.15.72:0/1382778096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa88406f3f0 0x7fa884156d20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:22.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.582+0000 7fa88ae94640 1 -- 172.21.15.72:0/1382778096 >> 172.21.15.72:0/1382778096 conn(0x7fa8840707f0 msgr2=0x7fa8840ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:22.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.582+0000 7fa88ae94640 1 -- 172.21.15.72:0/1382778096 shutdown_connections 2023-12-13T00:00:22.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:22.582+0000 7fa88ae94640 1 -- 172.21.15.72:0/1382778096 wait complete. 2023-12-13T00:00:24.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T00:00:24.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.697+0000 7f3801a4b640 1 Processor -- start 2023-12-13T00:00:24.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.697+0000 7f3801a4b640 1 -- start start 2023-12-13T00:00:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.698+0000 7f3801a4b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f37fc0c91d0 0x7f37fc06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.698+0000 7f3801a4b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37fc15a0c0 0x7f37fc0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.698+0000 7f3801a4b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37fc06f090 con 0x7f37fc153730 2023-12-13T00:00:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.698+0000 7f3801a4b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37fc0c38f0 con 0x7f37fc0c91d0 2023-12-13T00:00:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.698+0000 7f3801a4b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc1593d0 con 0x7f37fc15a0c0 2023-12-13T00:00:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.699+0000 7f37f3fff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f37fc0c91d0 0x7f37fc06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.699+0000 7f37fb7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37fc15a0c0 0x7f37fc0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.699+0000 7f37f3fff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f37fc0c91d0 0x7f37fc06eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:37232/0 (socket says 172.21.15.72:37232) 2023-12-13T00:00:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.699+0000 7f37f3fff640 1 -- 172.21.15.72:0/2612416111 learned_addr learned my addr 172.21.15.72:0/2612416111 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.701+0000 7f37f3fff640 1 -- 172.21.15.72:0/2612416111 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37fc15a0c0 msgr2=0x7f37fc0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.701+0000 7f37f3fff640 1 --2- 172.21.15.72:0/2612416111 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37fc15a0c0 0x7f37fc0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.701+0000 7f37f3fff640 1 -- 172.21.15.72:0/2612416111 >> v1:172.21.15.72:6789/0 conn(0x7f37fc153730 legacy=0x7f37fc0c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.701+0000 7f37f3fff640 1 -- 172.21.15.72:0/2612416111 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc153b10 con 0x7f37fc0c91d0 2023-12-13T00:00:24.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.703+0000 7f37f3fff640 1 --2- 172.21.15.72:0/2612416111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37fc0c91d0 0x7f37fc06eb50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009870 tx=0x7f37e402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a198ff8b8100f3c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:24.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.707+0000 7f37fa7fc640 1 -- 172.21.15.72:0/2612416111 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4030840 con 0x7f37fc0c91d0 2023-12-13T00:00:24.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.707+0000 7f37fa7fc640 1 -- 172.21.15.72:0/2612416111 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e40309a0 con 0x7f37fc0c91d0 2023-12-13T00:00:24.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.707+0000 7f37fa7fc640 1 -- 172.21.15.72:0/2612416111 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4030d30 con 0x7f37fc0c91d0 2023-12-13T00:00:24.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.707+0000 7f3801a4b640 1 -- 172.21.15.72:0/2612416111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37fc0c91d0 msgr2=0x7f37fc06eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:24.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.707+0000 7f3801a4b640 1 --2- 172.21.15.72:0/2612416111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37fc0c91d0 0x7f37fc06eb50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009870 tx=0x7f37e402b980 comp rx=0 tx=0).stop 2023-12-13T00:00:24.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.708+0000 7f3801a4b640 1 -- 172.21.15.72:0/2612416111 shutdown_connections 2023-12-13T00:00:24.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.708+0000 7f3801a4b640 1 --2- 172.21.15.72:0/2612416111 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37fc15a0c0 0x7f37fc0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:24.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.708+0000 7f3801a4b640 1 --2- 172.21.15.72:0/2612416111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37fc0c91d0 0x7f37fc06eb50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:24.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.708+0000 7f3801a4b640 1 -- 172.21.15.72:0/2612416111 >> 172.21.15.72:0/2612416111 conn(0x7f37fc0707f0 msgr2=0x7f37fc070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:24.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.708+0000 7f3801a4b640 1 -- 172.21.15.72:0/2612416111 shutdown_connections 2023-12-13T00:00:24.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.708+0000 7f3801a4b640 1 -- 172.21.15.72:0/2612416111 wait complete. 2023-12-13T00:00:24.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.709+0000 7f3801a4b640 1 Processor -- start 2023-12-13T00:00:24.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.709+0000 7f3801a4b640 1 -- start start 2023-12-13T00:00:24.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.709+0000 7f3801a4b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37fc0c91d0 0x7f37fc149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:24.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.709+0000 7f3801a4b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37fc153730 0x7f37fc14a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:24.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.709+0000 7f3801a4b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37fc15a0c0 0x7f37fc0c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:24.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.709+0000 7f3801a4b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc157b00 con 0x7f37fc15a0c0 2023-12-13T00:00:24.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.709+0000 7f3801a4b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc14c760 con 0x7f37fc153730 2023-12-13T00:00:24.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.709+0000 7f3801a4b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc0c4c10 con 0x7f37fc0c91d0 2023-12-13T00:00:24.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.710+0000 7f37f3fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37fc153730 0x7f37fc14a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:24.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.710+0000 7f37faffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37fc0c91d0 0x7f37fc149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:24.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.710+0000 7f37f3fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37fc153730 0x7f37fc14a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:37234/0 (socket says 172.21.15.72:37234) 2023-12-13T00:00:24.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.710+0000 7f37f3fff640 1 -- 172.21.15.72:0/4135131927 learned_addr learned my addr 172.21.15.72:0/4135131927 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:24.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.714+0000 7f37f3fff640 1 -- 172.21.15.72:0/4135131927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37fc0c91d0 msgr2=0x7f37fc149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:24.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.714+0000 7f37f3fff640 1 --2- 172.21.15.72:0/4135131927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37fc0c91d0 0x7f37fc149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:24.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.714+0000 7f37f3fff640 1 -- 172.21.15.72:0/4135131927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37fc15a0c0 msgr2=0x7f37fc0c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:24.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.714+0000 7f37f3fff640 1 --2- 172.21.15.72:0/4135131927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37fc15a0c0 0x7f37fc0c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:24.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.714+0000 7f37f3fff640 1 -- 172.21.15.72:0/4135131927 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e40094d0 con 0x7f37fc153730 2023-12-13T00:00:24.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.716+0000 7f37f3fff640 1 --2- 172.21.15.72:0/4135131927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37fc153730 0x7f37fc14a4c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f37e4000c00 tx=0x7f37e4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:24.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.720+0000 7f37f8ff9640 1 -- 172.21.15.72:0/4135131927 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4039c10 con 0x7f37fc153730 2023-12-13T00:00:24.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.720+0000 7f37f8ff9640 1 -- 172.21.15.72:0/4135131927 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e4039d70 con 0x7f37fc153730 2023-12-13T00:00:24.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.720+0000 7f37f8ff9640 1 -- 172.21.15.72:0/4135131927 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4043640 con 0x7f37fc153730 2023-12-13T00:00:24.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.720+0000 7f3801a4b640 1 -- 172.21.15.72:0/4135131927 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37fc157d10 con 0x7f37fc153730 2023-12-13T00:00:24.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.720+0000 7f3801a4b640 1 -- 172.21.15.72:0/4135131927 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37fc1582d0 con 0x7f37fc153730 2023-12-13T00:00:24.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.721+0000 7f3801a4b640 1 -- 172.21.15.72:0/4135131927 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37fc0c4da0 con 0x7f37fc153730 2023-12-13T00:00:24.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.741+0000 7f37f8ff9640 1 -- 172.21.15.72:0/4135131927 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f37e40437a0 con 0x7f37fc153730 2023-12-13T00:00:24.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.741+0000 7f37f8ff9640 1 --2- 172.21.15.72:0/4135131927 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f37dc06b210 0x7f37dc06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:24.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.741+0000 7f37faffd640 1 --2- 172.21.15.72:0/4135131927 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f37dc06b210 0x7f37dc06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:24.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.742+0000 7f37faffd640 1 --2- 172.21.15.72:0/4135131927 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f37dc06b210 0x7f37dc06d6d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f37ec0017f0 tx=0x7f37ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:24.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.744+0000 7f37f8ff9640 1 -- 172.21.15.72:0/4135131927 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f37e403e070 con 0x7f37fc153730 2023-12-13T00:00:24.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:24.978+0000 7f37f8ff9640 1 -- 172.21.15.72:0/4135131927 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f37e4078160 con 0x7f37fc153730 2023-12-13T00:00:25.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.180+0000 7f3801a4b640 1 -- 172.21.15.72:0/4135131927 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37fc1532e0 con 0x7f37fc153730 2023-12-13T00:00:25.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.286+0000 7f37f8ff9640 1 -- 172.21.15.72:0/4135131927 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5280 (secure 0 0 0) 0x7f37e4034090 con 0x7f37fc153730 2023-12-13T00:00:25.287 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:00:25.287 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/541435124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":541435124},{"type":"v1","addr":"172.21.15.72:6837","nonce":541435124}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4190692049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4190692049},{"type":"v1","addr":"172.21.15.176:6835","nonce":4190692049}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1780646034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1780646034},{"type":"v1","addr":"172.21.15.176:6833","nonce":1780646034}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6839/3632161953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":3632161953},{"type":"v1","addr":"172.21.15.72:6839","nonce":3632161953}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3954648997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3954648997},{"type":"v1","addr":"172.21.15.72:6835","nonce":3954648997}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3968747607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":3968747607},{"type":"v1","addr":"172.21.15.176:6837","nonce":3968747607}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-13T00:00:25.287 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 3 2023-12-13T00:00:25.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.288+0000 7f3801a4b640 1 -- 172.21.15.72:0/4135131927 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f37dc06b210 msgr2=0x7f37dc06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:25.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.288+0000 7f3801a4b640 1 --2- 172.21.15.72:0/4135131927 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f37dc06b210 0x7f37dc06d6d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f37ec0017f0 tx=0x7f37ec009040 comp rx=0 tx=0).stop 2023-12-13T00:00:25.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.288+0000 7f3801a4b640 1 -- 172.21.15.72:0/4135131927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37fc153730 msgr2=0x7f37fc14a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:25.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.288+0000 7f3801a4b640 1 --2- 172.21.15.72:0/4135131927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37fc153730 0x7f37fc14a4c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f37e4000c00 tx=0x7f37e4004730 comp rx=0 tx=0).stop 2023-12-13T00:00:25.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.288+0000 7f3801a4b640 1 -- 172.21.15.72:0/4135131927 shutdown_connections 2023-12-13T00:00:25.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.288+0000 7f3801a4b640 1 --2- 172.21.15.72:0/4135131927 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f37dc06b210 0x7f37dc06d6d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:25.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.288+0000 7f3801a4b640 1 --2- 172.21.15.72:0/4135131927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37fc15a0c0 0x7f37fc0c50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:25.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.288+0000 7f3801a4b640 1 --2- 172.21.15.72:0/4135131927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37fc153730 0x7f37fc14a4c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:25.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.288+0000 7f3801a4b640 1 --2- 172.21.15.72:0/4135131927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37fc0c91d0 0x7f37fc149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:25.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.288+0000 7f3801a4b640 1 -- 172.21.15.72:0/4135131927 >> 172.21.15.72:0/4135131927 conn(0x7f37fc0707f0 msgr2=0x7f37fc150ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:25.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.288+0000 7f3801a4b640 1 -- 172.21.15.72:0/4135131927 shutdown_connections 2023-12-13T00:00:25.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.288+0000 7f3801a4b640 1 -- 172.21.15.72:0/4135131927 wait complete. 2023-12-13T00:00:25.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:00:25.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.399+0000 7f97db583640 1 Processor -- start 2023-12-13T00:00:25.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.399+0000 7f97db583640 1 -- start start 2023-12-13T00:00:25.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.400+0000 7f97db583640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97d406a4b0 0x7f97d406a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:25.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.400+0000 7f97db583640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f97d415c9c0 0x7f97d415ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:25.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.400+0000 7f97db583640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d4159f80 con 0x7f97d40c59e0 2023-12-13T00:00:25.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.400+0000 7f97db583640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d406adf0 con 0x7f97d415c9c0 2023-12-13T00:00:25.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.400+0000 7f97db583640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d415d350 con 0x7f97d406a4b0 2023-12-13T00:00:25.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.400+0000 7f97d8b1e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97d406a4b0 0x7f97d406a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:25.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.401+0000 7f97d931f640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f97d40c59e0 0x7f97d406d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:40686/0 (socket says 172.21.15.72:40686) 2023-12-13T00:00:25.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.401+0000 7f97d931f640 1 -- 172.21.15.72:0/3105591513 learned_addr learned my addr 172.21.15.72:0/3105591513 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:25.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.401+0000 7f97d9b20640 1 --2- 172.21.15.72:0/3105591513 >> v2:172.21.15.176:3300/0 conn(0x7f97d415c9c0 0x7f97d415ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:25.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.403+0000 7f97d8b1e640 1 -- 172.21.15.72:0/3105591513 >> v2:172.21.15.176:3300/0 conn(0x7f97d415c9c0 msgr2=0x7f97d415ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:25.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.403+0000 7f97d8b1e640 1 --2- 172.21.15.72:0/3105591513 >> v2:172.21.15.176:3300/0 conn(0x7f97d415c9c0 0x7f97d415ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:25.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.403+0000 7f97d8b1e640 1 -- 172.21.15.72:0/3105591513 >> v1:172.21.15.176:6789/0 conn(0x7f97d40c59e0 legacy=0x7f97d406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:25.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.403+0000 7f97d8b1e640 1 -- 172.21.15.72:0/3105591513 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d41593d0 con 0x7f97d406a4b0 2023-12-13T00:00:25.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.405+0000 7f97d8b1e640 1 --2- 172.21.15.72:0/3105591513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97d406a4b0 0x7f97d406a8b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f97c40097a0 tx=0x7f97c402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=200370910399610d server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:25.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.410+0000 7f97cbfff640 1 -- 172.21.15.72:0/3105591513 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4030610 con 0x7f97d406a4b0 2023-12-13T00:00:25.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.410+0000 7f97cbfff640 1 -- 172.21.15.72:0/3105591513 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c4030770 con 0x7f97d406a4b0 2023-12-13T00:00:25.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.410+0000 7f97cbfff640 1 -- 172.21.15.72:0/3105591513 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4030b00 con 0x7f97d406a4b0 2023-12-13T00:00:25.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.410+0000 7f97db583640 1 -- 172.21.15.72:0/3105591513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97d406a4b0 msgr2=0x7f97d406a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:25.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.410+0000 7f97db583640 1 --2- 172.21.15.72:0/3105591513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97d406a4b0 0x7f97d406a8b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f97c40097a0 tx=0x7f97c402b960 comp rx=0 tx=0).stop 2023-12-13T00:00:25.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.411+0000 7f97db583640 1 -- 172.21.15.72:0/3105591513 shutdown_connections 2023-12-13T00:00:25.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.411+0000 7f97db583640 1 --2- 172.21.15.72:0/3105591513 >> v2:172.21.15.176:3300/0 conn(0x7f97d415c9c0 0x7f97d415ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:25.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.411+0000 7f97db583640 1 --2- 172.21.15.72:0/3105591513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97d406a4b0 0x7f97d406a8b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:25.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.411+0000 7f97db583640 1 -- 172.21.15.72:0/3105591513 >> 172.21.15.72:0/3105591513 conn(0x7f97d406f6d0 msgr2=0x7f97d406fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:25.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.411+0000 7f97db583640 1 -- 172.21.15.72:0/3105591513 shutdown_connections 2023-12-13T00:00:25.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.411+0000 7f97db583640 1 -- 172.21.15.72:0/3105591513 wait complete. 2023-12-13T00:00:25.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.412+0000 7f97db583640 1 Processor -- start 2023-12-13T00:00:25.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.412+0000 7f97db583640 1 -- start start 2023-12-13T00:00:25.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.412+0000 7f97db583640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97d406a4b0 0x7f97d4149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:25.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.412+0000 7f97db583640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97d40c59e0 0x7f97d41ef460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:25.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.412+0000 7f97db583640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97d415c9c0 0x7f97d41ef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:25.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.412+0000 7f97db583640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d41ef040 con 0x7f97d415c9c0 2023-12-13T00:00:25.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.412+0000 7f97db583640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d4149e60 con 0x7f97d40c59e0 2023-12-13T00:00:25.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.412+0000 7f97db583640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d415c2f0 con 0x7f97d406a4b0 2023-12-13T00:00:25.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.413+0000 7f97d9b20640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97d415c9c0 0x7f97d41ef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:25.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.413+0000 7f97d8b1e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97d40c59e0 0x7f97d41ef460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:25.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.413+0000 7f97d931f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97d406a4b0 0x7f97d4149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:25.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.413+0000 7f97d8b1e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97d40c59e0 0x7f97d41ef460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:37256/0 (socket says 172.21.15.72:37256) 2023-12-13T00:00:25.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.413+0000 7f97d8b1e640 1 -- 172.21.15.72:0/494935925 learned_addr learned my addr 172.21.15.72:0/494935925 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:25.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.416+0000 7f97d8b1e640 1 -- 172.21.15.72:0/494935925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97d406a4b0 msgr2=0x7f97d4149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:25.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.416+0000 7f97d8b1e640 1 --2- 172.21.15.72:0/494935925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97d406a4b0 0x7f97d4149110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:25.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.416+0000 7f97d8b1e640 1 -- 172.21.15.72:0/494935925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97d415c9c0 msgr2=0x7f97d41ef9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:25.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.416+0000 7f97d8b1e640 1 --2- 172.21.15.72:0/494935925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97d415c9c0 0x7f97d41ef9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:25.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.416+0000 7f97d8b1e640 1 -- 172.21.15.72:0/494935925 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c4009400 con 0x7f97d40c59e0 2023-12-13T00:00:25.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.419+0000 7f97d8b1e640 1 --2- 172.21.15.72:0/494935925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97d40c59e0 0x7f97d41ef460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009890 tx=0x7f97c40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:25.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.421+0000 7f97c9ffb640 1 -- 172.21.15.72:0/494935925 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c403e070 con 0x7f97d40c59e0 2023-12-13T00:00:25.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.421+0000 7f97db583640 1 -- 172.21.15.72:0/494935925 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d415c590 con 0x7f97d40c59e0 2023-12-13T00:00:25.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.421+0000 7f97db583640 1 -- 172.21.15.72:0/494935925 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d414a070 con 0x7f97d40c59e0 2023-12-13T00:00:25.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.422+0000 7f97db583640 1 -- 172.21.15.72:0/494935925 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d41ef180 con 0x7f97d40c59e0 2023-12-13T00:00:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.422+0000 7f97c9ffb640 1 -- 172.21.15.72:0/494935925 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c40397a0 con 0x7f97d40c59e0 2023-12-13T00:00:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.422+0000 7f97c9ffb640 1 -- 172.21.15.72:0/494935925 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4039b10 con 0x7f97d40c59e0 2023-12-13T00:00:25.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.667+0000 7f97c9ffb640 1 -- 172.21.15.72:0/494935925 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f97c4039c70 con 0x7f97d40c59e0 2023-12-13T00:00:25.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.668+0000 7f97c9ffb640 1 --2- 172.21.15.72:0/494935925 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f97b806b1c0 0x7f97b806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:25.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.668+0000 7f97d931f640 1 --2- 172.21.15.72:0/494935925 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f97b806b1c0 0x7f97b806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:25.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.668+0000 7f97d931f640 1 --2- 172.21.15.72:0/494935925 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f97b806b1c0 0x7f97b806d680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f97d0007fd0 tx=0x7f97d0007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:25.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.672+0000 7f97c9ffb640 1 -- 172.21.15.72:0/494935925 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f97c407ac50 con 0x7f97d40c59e0 2023-12-13T00:00:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.682+0000 7f97c9ffb640 1 -- 172.21.15.72:0/494935925 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f97c4076f90 con 0x7f97d40c59e0 2023-12-13T00:00:25.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.853+0000 7f97db583640 1 -- 172.21.15.72:0/494935925 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97d41ef180 con 0x7f97d40c59e0 2023-12-13T00:00:25.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.969+0000 7f97c9ffb640 1 -- 172.21.15.72:0/494935925 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12827 (secure 0 0 0) 0x7f97d41ef180 con 0x7f97d40c59e0 2023-12-13T00:00:25.969 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:00:25.970 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:00:09.501625+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:00:25.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.971+0000 7f97db583640 1 -- 172.21.15.72:0/494935925 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f97b806b1c0 msgr2=0x7f97b806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:25.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.971+0000 7f97db583640 1 --2- 172.21.15.72:0/494935925 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f97b806b1c0 0x7f97b806d680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f97d0007fd0 tx=0x7f97d0007e80 comp rx=0 tx=0).stop 2023-12-13T00:00:25.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.971+0000 7f97db583640 1 -- 172.21.15.72:0/494935925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97d40c59e0 msgr2=0x7f97d41ef460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:25.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.971+0000 7f97db583640 1 --2- 172.21.15.72:0/494935925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97d40c59e0 0x7f97d41ef460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009890 tx=0x7f97c40046c0 comp rx=0 tx=0).stop 2023-12-13T00:00:25.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.971+0000 7f97db583640 1 -- 172.21.15.72:0/494935925 shutdown_connections 2023-12-13T00:00:25.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.971+0000 7f97db583640 1 --2- 172.21.15.72:0/494935925 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f97b806b1c0 0x7f97b806d680 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:25.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.971+0000 7f97db583640 1 --2- 172.21.15.72:0/494935925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97d415c9c0 0x7f97d41ef9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:25.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.971+0000 7f97db583640 1 --2- 172.21.15.72:0/494935925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97d40c59e0 0x7f97d41ef460 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:25.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.971+0000 7f97db583640 1 --2- 172.21.15.72:0/494935925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97d406a4b0 0x7f97d4149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:25.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.971+0000 7f97db583640 1 -- 172.21.15.72:0/494935925 >> 172.21.15.72:0/494935925 conn(0x7f97d406f6d0 msgr2=0x7f97d406fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:25.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.971+0000 7f97db583640 1 -- 172.21.15.72:0/494935925 shutdown_connections 2023-12-13T00:00:25.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:25.971+0000 7f97db583640 1 -- 172.21.15.72:0/494935925 wait complete. 2023-12-13T00:00:25.982 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-13T00:00:06.839153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-13T00:00:25.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-13T00:00:26.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.084+0000 7fd40dbe5640 1 Processor -- start 2023-12-13T00:00:26.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.084+0000 7fd40dbe5640 1 -- start start 2023-12-13T00:00:26.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.085+0000 7fd40dbe5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd4080c8ee0 0x7fd40806e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:26.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.085+0000 7fd40dbe5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40806ed80 0x7fd40806ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:26.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.085+0000 7fd40dbe5640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080c7640 con 0x7fd4081538d0 2023-12-13T00:00:26.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.085+0000 7fd40dbe5640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806d130 con 0x7fd4080c8ee0 2023-12-13T00:00:26.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.085+0000 7fd40dbe5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40806b5c0 con 0x7fd40806ed80 2023-12-13T00:00:26.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.086+0000 7fd407fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40806ed80 0x7fd40806ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:26.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.086+0000 7fd4077fe640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fd4081538d0 0x7fd40815a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:40692/0 (socket says 172.21.15.72:40692) 2023-12-13T00:00:26.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.086+0000 7fd4077fe640 1 -- 172.21.15.72:0/3793327475 learned_addr learned my addr 172.21.15.72:0/3793327475 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:26.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.086+0000 7fd406ffd640 1 --2- 172.21.15.72:0/3793327475 >> v2:172.21.15.176:3300/0 conn(0x7fd4080c8ee0 0x7fd40806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:26.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.089+0000 7fd407fff640 1 -- 172.21.15.72:0/3793327475 >> v2:172.21.15.176:3300/0 conn(0x7fd4080c8ee0 msgr2=0x7fd40806e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:26.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.089+0000 7fd407fff640 1 --2- 172.21.15.72:0/3793327475 >> v2:172.21.15.176:3300/0 conn(0x7fd4080c8ee0 0x7fd40806e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:26.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.089+0000 7fd407fff640 1 -- 172.21.15.72:0/3793327475 >> v1:172.21.15.176:6789/0 conn(0x7fd4081538d0 legacy=0x7fd40815a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:26.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.089+0000 7fd407fff640 1 -- 172.21.15.72:0/3793327475 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4080cd750 con 0x7fd40806ed80 2023-12-13T00:00:26.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.091+0000 7fd407fff640 1 --2- 172.21.15.72:0/3793327475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40806ed80 0x7fd40806ba50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd400009d90 tx=0x7fd40002be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=157badaeffa11946 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:26.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.095+0000 7fd4067fc640 1 -- 172.21.15.72:0/3793327475 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40002cbc0 con 0x7fd40806ed80 2023-12-13T00:00:26.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.095+0000 7fd4067fc640 1 -- 172.21.15.72:0/3793327475 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40002cd20 con 0x7fd40806ed80 2023-12-13T00:00:26.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.095+0000 7fd4067fc640 1 -- 172.21.15.72:0/3793327475 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd400034660 con 0x7fd40806ed80 2023-12-13T00:00:26.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.095+0000 7fd40dbe5640 1 -- 172.21.15.72:0/3793327475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40806ed80 msgr2=0x7fd40806ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:26.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.095+0000 7fd40dbe5640 1 --2- 172.21.15.72:0/3793327475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40806ed80 0x7fd40806ba50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd400009d90 tx=0x7fd40002be10 comp rx=0 tx=0).stop 2023-12-13T00:00:26.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.095+0000 7fd40dbe5640 1 -- 172.21.15.72:0/3793327475 shutdown_connections 2023-12-13T00:00:26.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.095+0000 7fd40dbe5640 1 --2- 172.21.15.72:0/3793327475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40806ed80 0x7fd40806ba50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:26.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.095+0000 7fd40dbe5640 1 --2- 172.21.15.72:0/3793327475 >> v2:172.21.15.176:3300/0 conn(0x7fd4080c8ee0 0x7fd40806e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:26.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.095+0000 7fd40dbe5640 1 -- 172.21.15.72:0/3793327475 >> 172.21.15.72:0/3793327475 conn(0x7fd408060f20 msgr2=0x7fd408061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:26.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.095+0000 7fd40dbe5640 1 -- 172.21.15.72:0/3793327475 shutdown_connections 2023-12-13T00:00:26.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.095+0000 7fd40dbe5640 1 -- 172.21.15.72:0/3793327475 wait complete. 2023-12-13T00:00:26.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.096+0000 7fd40dbe5640 1 Processor -- start 2023-12-13T00:00:26.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.096+0000 7fd40dbe5640 1 -- start start 2023-12-13T00:00:26.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.097+0000 7fd40dbe5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40806ed80 0x7fd4080c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:26.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.097+0000 7fd40dbe5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4080c8ee0 0x7fd4080aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:26.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.097+0000 7fd40dbe5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4081538d0 0x7fd4080af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:26.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.097+0000 7fd40dbe5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4081ef100 con 0x7fd4081538d0 2023-12-13T00:00:26.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.097+0000 7fd40dbe5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4080ad7b0 con 0x7fd4080c8ee0 2023-12-13T00:00:26.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.097+0000 7fd40dbe5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4080ac8c0 con 0x7fd40806ed80 2023-12-13T00:00:26.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.097+0000 7fd407fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4081538d0 0x7fd4080af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:26.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.098+0000 7fd406ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4080c8ee0 0x7fd4080aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:26.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.098+0000 7fd4077fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40806ed80 0x7fd4080c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:26.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.098+0000 7fd407fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4081538d0 0x7fd4080af1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56266/0 (socket says 172.21.15.72:56266) 2023-12-13T00:00:26.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.098+0000 7fd407fff640 1 -- 172.21.15.72:0/1919430063 learned_addr learned my addr 172.21.15.72:0/1919430063 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:26.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.101+0000 7fd406ffd640 1 -- 172.21.15.72:0/1919430063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40806ed80 msgr2=0x7fd4080c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:26.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.101+0000 7fd406ffd640 1 --2- 172.21.15.72:0/1919430063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40806ed80 0x7fd4080c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:26.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.101+0000 7fd406ffd640 1 -- 172.21.15.72:0/1919430063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4081538d0 msgr2=0x7fd4080af1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:26.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.101+0000 7fd406ffd640 1 --2- 172.21.15.72:0/1919430063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4081538d0 0x7fd4080af1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:26.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.101+0000 7fd406ffd640 1 -- 172.21.15.72:0/1919430063 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd400009a70 con 0x7fd4080c8ee0 2023-12-13T00:00:26.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.101+0000 7fd407fff640 1 --2- 172.21.15.72:0/1919430063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4081538d0 0x7fd4080af1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T00:00:26.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.103+0000 7fd406ffd640 1 --2- 172.21.15.72:0/1919430063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4080c8ee0 0x7fd4080aec80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00d520 tx=0x7fd3fc00d9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:26.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.108+0000 7fd3effff640 1 -- 172.21.15.72:0/1919430063 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc0125f0 con 0x7fd4080c8ee0 2023-12-13T00:00:26.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.108+0000 7fd3effff640 1 -- 172.21.15.72:0/1919430063 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc012750 con 0x7fd4080c8ee0 2023-12-13T00:00:26.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.108+0000 7fd3effff640 1 -- 172.21.15.72:0/1919430063 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc012ae0 con 0x7fd4080c8ee0 2023-12-13T00:00:26.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.108+0000 7fd40dbe5640 1 -- 172.21.15.72:0/1919430063 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4080acba0 con 0x7fd4080c8ee0 2023-12-13T00:00:26.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.108+0000 7fd40dbe5640 1 -- 172.21.15.72:0/1919430063 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4080ad160 con 0x7fd4080c8ee0 2023-12-13T00:00:26.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.108+0000 7fd40dbe5640 1 -- 172.21.15.72:0/1919430063 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd408067470 con 0x7fd4080c8ee0 2023-12-13T00:00:26.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.350+0000 7fd3effff640 1 -- 172.21.15.72:0/1919430063 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd3fc012c40 con 0x7fd4080c8ee0 2023-12-13T00:00:26.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.350+0000 7fd3effff640 1 --2- 172.21.15.72:0/1919430063 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd3f406b240 0x7fd3f406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:26.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.350+0000 7fd4077fe640 1 --2- 172.21.15.72:0/1919430063 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd3f406b240 0x7fd3f406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:26.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.351+0000 7fd4077fe640 1 --2- 172.21.15.72:0/1919430063 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd3f406b240 0x7fd3f406d700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8007fd0 tx=0x7fd3f8007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:26.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.352+0000 7fd3effff640 1 -- 172.21.15.72:0/1919430063 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd3fc059230 con 0x7fd4080c8ee0 2023-12-13T00:00:26.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.364+0000 7fd3effff640 1 -- 172.21.15.72:0/1919430063 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd3fc055570 con 0x7fd4080c8ee0 2023-12-13T00:00:26.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.535+0000 7fd40dbe5640 1 -- 172.21.15.72:0/1919430063 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd408157060 con 0x7fd4080c8ee0 2023-12-13T00:00:26.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.557+0000 7fd3effff640 1 -- 172.21.15.72:0/1919430063 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3fc058b90 con 0x7fd4080c8ee0 2023-12-13T00:00:26.557 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-12-13T00:00:26.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.560+0000 7fd40dbe5640 1 -- 172.21.15.72:0/1919430063 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd3f406b240 msgr2=0x7fd3f406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:26.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.560+0000 7fd40dbe5640 1 --2- 172.21.15.72:0/1919430063 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd3f406b240 0x7fd3f406d700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8007fd0 tx=0x7fd3f8007e80 comp rx=0 tx=0).stop 2023-12-13T00:00:26.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.560+0000 7fd40dbe5640 1 -- 172.21.15.72:0/1919430063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4080c8ee0 msgr2=0x7fd4080aec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:26.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.560+0000 7fd40dbe5640 1 --2- 172.21.15.72:0/1919430063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4080c8ee0 0x7fd4080aec80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00d520 tx=0x7fd3fc00d9e0 comp rx=0 tx=0).stop 2023-12-13T00:00:26.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.560+0000 7fd40dbe5640 1 -- 172.21.15.72:0/1919430063 shutdown_connections 2023-12-13T00:00:26.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.560+0000 7fd40dbe5640 1 --2- 172.21.15.72:0/1919430063 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd3f406b240 0x7fd3f406d700 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:26.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.560+0000 7fd40dbe5640 1 --2- 172.21.15.72:0/1919430063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4081538d0 0x7fd4080af1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:26.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.560+0000 7fd40dbe5640 1 --2- 172.21.15.72:0/1919430063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4080c8ee0 0x7fd4080aec80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:26.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.560+0000 7fd40dbe5640 1 --2- 172.21.15.72:0/1919430063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40806ed80 0x7fd4080c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:26.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.560+0000 7fd40dbe5640 1 -- 172.21.15.72:0/1919430063 >> 172.21.15.72:0/1919430063 conn(0x7fd408060f20 msgr2=0x7fd4081514d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:26.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.560+0000 7fd40dbe5640 1 -- 172.21.15.72:0/1919430063 shutdown_connections 2023-12-13T00:00:26.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.560+0000 7fd40dbe5640 1 -- 172.21.15.72:0/1919430063 wait complete. 2023-12-13T00:00:26.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-13T00:00:26.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.669+0000 7fc7388d4640 1 Processor -- start 2023-12-13T00:00:26.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.669+0000 7fc7388d4640 1 -- start start 2023-12-13T00:00:26.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.670+0000 7fc7388d4640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc734151720 0x7fc73406e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:26.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.670+0000 7fc7388d4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc7340c8de0 0x7fc73406ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:26.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.670+0000 7fc7388d4640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7340c9330 con 0x7fc7340c2570 2023-12-13T00:00:26.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.670+0000 7fc7388d4640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7340cdbc0 con 0x7fc7340c8de0 2023-12-13T00:00:26.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.670+0000 7fc7388d4640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7340cd620 con 0x7fc734151720 2023-12-13T00:00:26.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.670+0000 7fc72bfff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc7340c8de0 0x7fc73406ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:26.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.670+0000 7fc73259c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc734151720 0x7fc73406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:26.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.671+0000 7fc732d9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc7340c2570 0x7fc73415aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57588/0 (socket says 172.21.15.72:57588) 2023-12-13T00:00:26.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.671+0000 7fc732d9d640 1 -- 172.21.15.72:0/1402712983 learned_addr learned my addr 172.21.15.72:0/1402712983 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:26.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.673+0000 7fc73259c640 1 -- 172.21.15.72:0/1402712983 >> v2:172.21.15.72:3300/0 conn(0x7fc7340c8de0 msgr2=0x7fc73406ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:26.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.673+0000 7fc73259c640 1 --2- 172.21.15.72:0/1402712983 >> v2:172.21.15.72:3300/0 conn(0x7fc7340c8de0 0x7fc73406ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:26.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.673+0000 7fc73259c640 1 -- 172.21.15.72:0/1402712983 >> v1:172.21.15.72:6789/0 conn(0x7fc7340c2570 legacy=0x7fc73415aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:26.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.673+0000 7fc73259c640 1 -- 172.21.15.72:0/1402712983 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc734158380 con 0x7fc734151720 2023-12-13T00:00:26.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.675+0000 7fc73259c640 1 --2- 172.21.15.72:0/1402712983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc734151720 0x7fc73406e840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7340cd340 tx=0x7fc72402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b15aeef4ccb384b server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:26.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.679+0000 7fc731d9b640 1 -- 172.21.15.72:0/1402712983 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc724030610 con 0x7fc734151720 2023-12-13T00:00:26.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.679+0000 7fc731d9b640 1 -- 172.21.15.72:0/1402712983 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc724030770 con 0x7fc734151720 2023-12-13T00:00:26.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.679+0000 7fc731d9b640 1 -- 172.21.15.72:0/1402712983 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc724030b00 con 0x7fc734151720 2023-12-13T00:00:26.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.679+0000 7fc7388d4640 1 -- 172.21.15.72:0/1402712983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc734151720 msgr2=0x7fc73406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:26.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.679+0000 7fc7388d4640 1 --2- 172.21.15.72:0/1402712983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc734151720 0x7fc73406e840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7340cd340 tx=0x7fc72402b960 comp rx=0 tx=0).stop 2023-12-13T00:00:26.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.679+0000 7fc7388d4640 1 -- 172.21.15.72:0/1402712983 shutdown_connections 2023-12-13T00:00:26.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.679+0000 7fc7388d4640 1 --2- 172.21.15.72:0/1402712983 >> v2:172.21.15.72:3300/0 conn(0x7fc7340c8de0 0x7fc73406ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:26.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.679+0000 7fc7388d4640 1 --2- 172.21.15.72:0/1402712983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc734151720 0x7fc73406e840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:26.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.679+0000 7fc7388d4640 1 -- 172.21.15.72:0/1402712983 >> 172.21.15.72:0/1402712983 conn(0x7fc734060f20 msgr2=0x7fc734061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:26.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.679+0000 7fc7388d4640 1 -- 172.21.15.72:0/1402712983 shutdown_connections 2023-12-13T00:00:26.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.679+0000 7fc7388d4640 1 -- 172.21.15.72:0/1402712983 wait complete. 2023-12-13T00:00:26.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.680+0000 7fc7388d4640 1 Processor -- start 2023-12-13T00:00:26.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.680+0000 7fc7388d4640 1 -- start start 2023-12-13T00:00:26.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.681+0000 7fc7388d4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7340c2570 0x7fc7340b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:26.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.681+0000 7fc7388d4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7340c8de0 0x7fc734147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:26.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.681+0000 7fc7388d4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc734151720 0x7fc73406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:26.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.681+0000 7fc7388d4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340acf20 con 0x7fc7340c8de0 2023-12-13T00:00:26.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.681+0000 7fc7388d4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340ae100 con 0x7fc7340c2570 2023-12-13T00:00:26.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.681+0000 7fc7388d4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340b1020 con 0x7fc734151720 2023-12-13T00:00:26.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.682+0000 7fc72bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7340c8de0 0x7fc734147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:26.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.682+0000 7fc73259c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7340c2570 0x7fc7340b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:26.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.682+0000 7fc732d9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc734151720 0x7fc73406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:26.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.682+0000 7fc73259c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7340c2570 0x7fc7340b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:33172/0 (socket says 172.21.15.72:33172) 2023-12-13T00:00:26.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.682+0000 7fc73259c640 1 -- 172.21.15.72:0/2480800220 learned_addr learned my addr 172.21.15.72:0/2480800220 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:26.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.685+0000 7fc73259c640 1 -- 172.21.15.72:0/2480800220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc734151720 msgr2=0x7fc73406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:26.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.685+0000 7fc73259c640 1 --2- 172.21.15.72:0/2480800220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc734151720 0x7fc73406b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:26.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.685+0000 7fc73259c640 1 -- 172.21.15.72:0/2480800220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7340c8de0 msgr2=0x7fc734147540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:26.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.685+0000 7fc73259c640 1 --2- 172.21.15.72:0/2480800220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7340c8de0 0x7fc734147540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:26.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.685+0000 7fc73259c640 1 -- 172.21.15.72:0/2480800220 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc724009400 con 0x7fc7340c2570 2023-12-13T00:00:26.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.685+0000 7fc72bfff640 1 --2- 172.21.15.72:0/2480800220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7340c8de0 0x7fc734147540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T00:00:26.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.687+0000 7fc73259c640 1 --2- 172.21.15.72:0/2480800220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7340c2570 0x7fc7340b0ae0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc72402bf70 tx=0x7fc724004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:26.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.692+0000 7fc72affd640 1 -- 172.21.15.72:0/2480800220 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72403e040 con 0x7fc7340c2570 2023-12-13T00:00:26.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.692+0000 7fc72affd640 1 -- 172.21.15.72:0/2480800220 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc724039b90 con 0x7fc7340c2570 2023-12-13T00:00:26.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.692+0000 7fc72affd640 1 -- 172.21.15.72:0/2480800220 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc724043440 con 0x7fc7340c2570 2023-12-13T00:00:26.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.692+0000 7fc7388d4640 1 -- 172.21.15.72:0/2480800220 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7340af600 con 0x7fc7340c2570 2023-12-13T00:00:26.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.692+0000 7fc7388d4640 1 -- 172.21.15.72:0/2480800220 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73413ea40 con 0x7fc7340c2570 2023-12-13T00:00:26.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.692+0000 7fc7388d4640 1 -- 172.21.15.72:0/2480800220 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc734067470 con 0x7fc7340c2570 2023-12-13T00:00:26.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.932+0000 7fc72affd640 1 -- 172.21.15.72:0/2480800220 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc7240423e0 con 0x7fc7340c2570 2023-12-13T00:00:26.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.933+0000 7fc72affd640 1 --2- 172.21.15.72:0/2480800220 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc71406b210 0x7fc71406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:26.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.933+0000 7fc72bfff640 1 --2- 172.21.15.72:0/2480800220 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc71406b210 0x7fc71406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:26.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.933+0000 7fc72bfff640 1 --2- 172.21.15.72:0/2480800220 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc71406b210 0x7fc71406d6d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc7341426c0 tx=0x7fc71c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:26.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.938+0000 7fc72affd640 1 -- 172.21.15.72:0/2480800220 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc72407a8f0 con 0x7fc7340c2570 2023-12-13T00:00:26.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:26.948+0000 7fc72affd640 1 -- 172.21.15.72:0/2480800220 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc724076c30 con 0x7fc7340c2570 2023-12-13T00:00:27.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.117+0000 7fc7388d4640 1 -- 172.21.15.72:0/2480800220 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc73414b7a0 con 0x7fc7340c2570 2023-12-13T00:00:27.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.124+0000 7fc72affd640 1 -- 172.21.15.72:0/2480800220 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc724048090 con 0x7fc7340c2570 2023-12-13T00:00:27.124 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:00:27.124 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-12-13T00:00:27.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-12-13T00:00:27.124 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-12-13T00:00:27.124 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2023-12-13T00:00:27.124 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-12-13T00:00:27.124 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-12-13T00:00:27.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.125+0000 7fc7388d4640 1 -- 172.21.15.72:0/2480800220 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc71406b210 msgr2=0x7fc71406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:27.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.125+0000 7fc7388d4640 1 --2- 172.21.15.72:0/2480800220 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc71406b210 0x7fc71406d6d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc7341426c0 tx=0x7fc71c009190 comp rx=0 tx=0).stop 2023-12-13T00:00:27.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.125+0000 7fc7388d4640 1 -- 172.21.15.72:0/2480800220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7340c2570 msgr2=0x7fc7340b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:27.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.125+0000 7fc7388d4640 1 --2- 172.21.15.72:0/2480800220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7340c2570 0x7fc7340b0ae0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc72402bf70 tx=0x7fc724004730 comp rx=0 tx=0).stop 2023-12-13T00:00:27.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.125+0000 7fc7388d4640 1 -- 172.21.15.72:0/2480800220 shutdown_connections 2023-12-13T00:00:27.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.125+0000 7fc7388d4640 1 --2- 172.21.15.72:0/2480800220 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc71406b210 0x7fc71406d6d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:27.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.125+0000 7fc7388d4640 1 --2- 172.21.15.72:0/2480800220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc734151720 0x7fc73406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:27.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.125+0000 7fc7388d4640 1 --2- 172.21.15.72:0/2480800220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7340c8de0 0x7fc734147540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:27.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.125+0000 7fc7388d4640 1 --2- 172.21.15.72:0/2480800220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7340c2570 0x7fc7340b0ae0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:27.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.125+0000 7fc7388d4640 1 -- 172.21.15.72:0/2480800220 >> 172.21.15.72:0/2480800220 conn(0x7fc734060f20 msgr2=0x7fc7340cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:27.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.125+0000 7fc7388d4640 1 -- 172.21.15.72:0/2480800220 shutdown_connections 2023-12-13T00:00:27.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.125+0000 7fc7388d4640 1 -- 172.21.15.72:0/2480800220 wait complete. 2023-12-13T00:00:27.136 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-13T00:00:27.137 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-13T00:00:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.239+0000 7f189adb6640 1 Processor -- start 2023-12-13T00:00:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.239+0000 7f189adb6640 1 -- start start 2023-12-13T00:00:27.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.240+0000 7f189adb6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18940cda70 0x7f18940ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:27.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.240+0000 7f189adb6640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f18940c9620 0x7f18940c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:27.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.240+0000 7f189adb6640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18940cbda0 con 0x7f18940cc420 2023-12-13T00:00:27.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.240+0000 7f189adb6640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18940cc230 con 0x7f18940c9620 2023-12-13T00:00:27.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.240+0000 7f189adb6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18940cb4e0 con 0x7f18940cda70 2023-12-13T00:00:27.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.241+0000 7f1893fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f18940cc420 0x7f1894159610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57594/0 (socket says 172.21.15.72:57594) 2023-12-13T00:00:27.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.241+0000 7f1893fff640 1 -- 172.21.15.72:0/278259512 learned_addr learned my addr 172.21.15.72:0/278259512 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:27.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.241+0000 7f1899353640 1 --2- 172.21.15.72:0/278259512 >> v2:172.21.15.176:3300/0 conn(0x7f18940c9620 0x7f18940c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:27.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.241+0000 7f1898b52640 1 --2- 172.21.15.72:0/278259512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18940cda70 0x7f18940ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:27.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.243+0000 7f18937fe640 1 -- 172.21.15.72:0/278259512 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581234270 0 0) 0x7f18940cbda0 con 0x7f18940cc420 2023-12-13T00:00:27.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.243+0000 7f18937fe640 1 -- 172.21.15.72:0/278259512 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f187c003520 con 0x7f18940cc420 2023-12-13T00:00:27.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.243+0000 7f1899353640 1 -- 172.21.15.72:0/278259512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18940cda70 msgr2=0x7f18940ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:27.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.243+0000 7f1899353640 1 --2- 172.21.15.72:0/278259512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18940cda70 0x7f18940ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:27.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.243+0000 7f1899353640 1 -- 172.21.15.72:0/278259512 >> v1:172.21.15.72:6789/0 conn(0x7f18940cc420 legacy=0x7f1894159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:27.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.243+0000 7f1899353640 1 -- 172.21.15.72:0/278259512 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18940cce00 con 0x7f18940c9620 2023-12-13T00:00:27.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.245+0000 7f1899353640 1 --2- 172.21.15.72:0/278259512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18940c9620 0x7f18940c9a90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f188c009d90 tx=0x7f188c02bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f18e992bcba1f0b server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:27.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.250+0000 7f18937fe640 1 -- 172.21.15.72:0/278259512 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c02cce0 con 0x7f18940c9620 2023-12-13T00:00:27.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.250+0000 7f18937fe640 1 -- 172.21.15.72:0/278259512 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c02ce40 con 0x7f18940c9620 2023-12-13T00:00:27.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.250+0000 7f18937fe640 1 -- 172.21.15.72:0/278259512 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c034660 con 0x7f18940c9620 2023-12-13T00:00:27.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.250+0000 7f189adb6640 1 -- 172.21.15.72:0/278259512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18940c9620 msgr2=0x7f18940c9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:27.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.250+0000 7f189adb6640 1 --2- 172.21.15.72:0/278259512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18940c9620 0x7f18940c9a90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f188c009d90 tx=0x7f188c02bf30 comp rx=0 tx=0).stop 2023-12-13T00:00:27.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.250+0000 7f189adb6640 1 -- 172.21.15.72:0/278259512 shutdown_connections 2023-12-13T00:00:27.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.250+0000 7f189adb6640 1 --2- 172.21.15.72:0/278259512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18940c9620 0x7f18940c9a90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:27.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.250+0000 7f189adb6640 1 --2- 172.21.15.72:0/278259512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18940cda70 0x7f18940ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:27.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.250+0000 7f189adb6640 1 -- 172.21.15.72:0/278259512 >> 172.21.15.72:0/278259512 conn(0x7f18940b07b0 msgr2=0x7f18940b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:27.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.250+0000 7f189adb6640 1 -- 172.21.15.72:0/278259512 shutdown_connections 2023-12-13T00:00:27.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.250+0000 7f189adb6640 1 -- 172.21.15.72:0/278259512 wait complete. 2023-12-13T00:00:27.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.251+0000 7f189adb6640 1 Processor -- start 2023-12-13T00:00:27.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.251+0000 7f189adb6640 1 -- start start 2023-12-13T00:00:27.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.253+0000 7f189adb6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18940c9620 0x7f18940abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:27.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.253+0000 7f189adb6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18940cc420 0x7f18940b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:27.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.253+0000 7f189adb6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18940cda70 0x7f189414f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:27.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.253+0000 7f189adb6640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18940ac4b0 con 0x7f18940cda70 2023-12-13T00:00:27.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.253+0000 7f189adb6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18940c4710 con 0x7f18940cc420 2023-12-13T00:00:27.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.253+0000 7f189adb6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18940c49f0 con 0x7f18940c9620 2023-12-13T00:00:27.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.253+0000 7f1899353640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18940cda70 0x7f189414f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:27.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.253+0000 7f1893fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18940cc420 0x7f18940b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:27.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.253+0000 7f1898b52640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18940c9620 0x7f18940abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:27.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.253+0000 7f1899353640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18940cda70 0x7f189414f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43668/0 (socket says 172.21.15.72:43668) 2023-12-13T00:00:27.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.253+0000 7f1899353640 1 -- 172.21.15.72:0/71204185 learned_addr learned my addr 172.21.15.72:0/71204185 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:27.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.255+0000 7f1899353640 1 -- 172.21.15.72:0/71204185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18940c9620 msgr2=0x7f18940abf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:27.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.255+0000 7f1899353640 1 --2- 172.21.15.72:0/71204185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18940c9620 0x7f18940abf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:27.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.255+0000 7f1899353640 1 -- 172.21.15.72:0/71204185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18940cc420 msgr2=0x7f18940b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:27.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.256+0000 7f1899353640 1 --2- 172.21.15.72:0/71204185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18940cc420 0x7f18940b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:27.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.256+0000 7f1899353640 1 -- 172.21.15.72:0/71204185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c009a70 con 0x7f18940cda70 2023-12-13T00:00:27.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.258+0000 7f1899353640 1 --2- 172.21.15.72:0/71204185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18940cda70 0x7f189414f0e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f188c009d90 tx=0x7f188c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:27.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.262+0000 7f18917fa640 1 -- 172.21.15.72:0/71204185 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c03d600 con 0x7f18940cda70 2023-12-13T00:00:27.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.262+0000 7f18917fa640 1 -- 172.21.15.72:0/71204185 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c03d780 con 0x7f18940cda70 2023-12-13T00:00:27.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.262+0000 7f18917fa640 1 -- 172.21.15.72:0/71204185 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c03db30 con 0x7f18940cda70 2023-12-13T00:00:27.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.262+0000 7f189adb6640 1 -- 172.21.15.72:0/71204185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18940c4cd0 con 0x7f18940cda70 2023-12-13T00:00:27.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.262+0000 7f189adb6640 1 -- 172.21.15.72:0/71204185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18941ef830 con 0x7f18940cda70 2023-12-13T00:00:27.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.262+0000 7f189adb6640 1 -- 172.21.15.72:0/71204185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18940c51f0 con 0x7f18940cda70 2023-12-13T00:00:27.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.505+0000 7f18917fa640 1 -- 172.21.15.72:0/71204185 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f188c03b040 con 0x7f18940cda70 2023-12-13T00:00:27.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.505+0000 7f18917fa640 1 --2- 172.21.15.72:0/71204185 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f188006b210 0x7f188006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:27.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.505+0000 7f1898b52640 1 --2- 172.21.15.72:0/71204185 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f188006b210 0x7f188006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:27.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.506+0000 7f1898b52640 1 --2- 172.21.15.72:0/71204185 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f188006b210 0x7f188006d6d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1884009b40 tx=0x7f1884009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:27.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.518+0000 7f18917fa640 1 -- 172.21.15.72:0/71204185 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f188c07af10 con 0x7f18940cda70 2023-12-13T00:00:27.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.518+0000 7f18917fa640 1 -- 172.21.15.72:0/71204185 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f188c077250 con 0x7f18940cda70 2023-12-13T00:00:27.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:27.692+0000 7f189adb6640 1 -- 172.21.15.72:0/71204185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f18940aa580 con 0x7f18940cda70 2023-12-13T00:00:28.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.740+0000 7f18917fa640 1 -- 172.21.15.72:0/71204185 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f188c009450 con 0x7f18940cda70 2023-12-13T00:00:28.740 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-12-13T00:00:28.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.742+0000 7f189adb6640 1 -- 172.21.15.72:0/71204185 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f188006b210 msgr2=0x7f188006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:28.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.742+0000 7f189adb6640 1 --2- 172.21.15.72:0/71204185 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f188006b210 0x7f188006d6d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1884009b40 tx=0x7f1884009190 comp rx=0 tx=0).stop 2023-12-13T00:00:28.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.742+0000 7f189adb6640 1 -- 172.21.15.72:0/71204185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18940cda70 msgr2=0x7f189414f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:28.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.742+0000 7f189adb6640 1 --2- 172.21.15.72:0/71204185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18940cda70 0x7f189414f0e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f188c009d90 tx=0x7f188c004a40 comp rx=0 tx=0).stop 2023-12-13T00:00:28.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.742+0000 7f189adb6640 1 -- 172.21.15.72:0/71204185 shutdown_connections 2023-12-13T00:00:28.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.742+0000 7f189adb6640 1 --2- 172.21.15.72:0/71204185 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f188006b210 0x7f188006d6d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:28.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.742+0000 7f189adb6640 1 --2- 172.21.15.72:0/71204185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18940cda70 0x7f189414f0e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:28.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.742+0000 7f189adb6640 1 --2- 172.21.15.72:0/71204185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18940cc420 0x7f18940b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:28.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.742+0000 7f189adb6640 1 --2- 172.21.15.72:0/71204185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18940c9620 0x7f18940abf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:28.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.742+0000 7f189adb6640 1 -- 172.21.15.72:0/71204185 >> 172.21.15.72:0/71204185 conn(0x7f18940b07b0 msgr2=0x7f18940ae720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:28.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.742+0000 7f189adb6640 1 -- 172.21.15.72:0/71204185 shutdown_connections 2023-12-13T00:00:28.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.742+0000 7f189adb6640 1 -- 172.21.15.72:0/71204185 wait complete. 2023-12-13T00:00:28.752 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-13T00:00:28.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.869+0000 7f9a5399e640 1 Processor -- start 2023-12-13T00:00:28.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.869+0000 7f9a5399e640 1 -- start start 2023-12-13T00:00:28.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.870+0000 7f9a5399e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a4c15c390 0x7f9a4c15a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:28.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.870+0000 7f9a5399e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9a4c0cc430 0x7f9a4c06c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:28.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.870+0000 7f9a5399e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4c15a550 con 0x7f9a4c0cb4f0 2023-12-13T00:00:28.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.870+0000 7f9a5399e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4c0cc250 con 0x7f9a4c0cc430 2023-12-13T00:00:28.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.870+0000 7f9a5399e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0c9ae0 con 0x7f9a4c15c390 2023-12-13T00:00:28.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.871+0000 7f9a5173a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a4c15c390 0x7f9a4c15a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:28.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.871+0000 7f9a50f39640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9a4c0cc430 0x7f9a4c06c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:28.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.871+0000 7f9a51f3b640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f9a4c0cb4f0 0x7f9a4c15cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:55470/0 (socket says 172.21.15.72:55470) 2023-12-13T00:00:28.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.871+0000 7f9a51f3b640 1 -- 172.21.15.72:0/1111623444 learned_addr learned my addr 172.21.15.72:0/1111623444 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:28.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.873+0000 7f9a5173a640 1 -- 172.21.15.72:0/1111623444 >> v2:172.21.15.176:3300/0 conn(0x7f9a4c0cc430 msgr2=0x7f9a4c06c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:28.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.873+0000 7f9a5173a640 1 --2- 172.21.15.72:0/1111623444 >> v2:172.21.15.176:3300/0 conn(0x7f9a4c0cc430 0x7f9a4c06c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:28.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.873+0000 7f9a5173a640 1 -- 172.21.15.72:0/1111623444 >> v1:172.21.15.176:6789/0 conn(0x7f9a4c0cb4f0 legacy=0x7f9a4c15cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:28.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.873+0000 7f9a5173a640 1 -- 172.21.15.72:0/1111623444 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c0c9dc0 con 0x7f9a4c15c390 2023-12-13T00:00:28.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.875+0000 7f9a5173a640 1 --2- 172.21.15.72:0/1111623444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a4c15c390 0x7f9a4c15a010 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9a440097a0 tx=0x7f9a4402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6afc8cfaa926a5e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:28.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.879+0000 7f9a4bfff640 1 -- 172.21.15.72:0/1111623444 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a44030610 con 0x7f9a4c15c390 2023-12-13T00:00:28.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.879+0000 7f9a4bfff640 1 -- 172.21.15.72:0/1111623444 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a44030770 con 0x7f9a4c15c390 2023-12-13T00:00:28.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.879+0000 7f9a4bfff640 1 -- 172.21.15.72:0/1111623444 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a44030b00 con 0x7f9a4c15c390 2023-12-13T00:00:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.879+0000 7f9a5399e640 1 -- 172.21.15.72:0/1111623444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a4c15c390 msgr2=0x7f9a4c15a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.879+0000 7f9a5399e640 1 --2- 172.21.15.72:0/1111623444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a4c15c390 0x7f9a4c15a010 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9a440097a0 tx=0x7f9a4402b960 comp rx=0 tx=0).stop 2023-12-13T00:00:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.880+0000 7f9a5399e640 1 -- 172.21.15.72:0/1111623444 shutdown_connections 2023-12-13T00:00:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.880+0000 7f9a5399e640 1 --2- 172.21.15.72:0/1111623444 >> v2:172.21.15.176:3300/0 conn(0x7f9a4c0cc430 0x7f9a4c06c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.880+0000 7f9a5399e640 1 --2- 172.21.15.72:0/1111623444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a4c15c390 0x7f9a4c15a010 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.880+0000 7f9a5399e640 1 -- 172.21.15.72:0/1111623444 >> 172.21.15.72:0/1111623444 conn(0x7f9a4c0ced20 msgr2=0x7f9a4c0cf130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.880+0000 7f9a5399e640 1 -- 172.21.15.72:0/1111623444 shutdown_connections 2023-12-13T00:00:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.880+0000 7f9a5399e640 1 -- 172.21.15.72:0/1111623444 wait complete. 2023-12-13T00:00:28.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.881+0000 7f9a5399e640 1 Processor -- start 2023-12-13T00:00:28.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.881+0000 7f9a5399e640 1 -- start start 2023-12-13T00:00:28.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.881+0000 7f9a5399e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a4c0cb4f0 0x7f9a4c14d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:28.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.881+0000 7f9a5399e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a4c0cc430 0x7f9a4c1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:28.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.881+0000 7f9a5399e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a4c15c390 0x7f9a4c1eed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:28.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.881+0000 7f9a5399e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c14dcd0 con 0x7f9a4c15c390 2023-12-13T00:00:28.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.881+0000 7f9a5399e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c1f2c70 con 0x7f9a4c0cc430 2023-12-13T00:00:28.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.881+0000 7f9a5399e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c14df10 con 0x7f9a4c0cb4f0 2023-12-13T00:00:28.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.882+0000 7f9a51f3b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a4c15c390 0x7f9a4c1eed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:28.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.882+0000 7f9a51f3b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a4c15c390 0x7f9a4c1eed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43684/0 (socket says 172.21.15.72:43684) 2023-12-13T00:00:28.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.882+0000 7f9a51f3b640 1 -- 172.21.15.72:0/491972717 learned_addr learned my addr 172.21.15.72:0/491972717 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:28.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.882+0000 7f9a50f39640 1 --2- 172.21.15.72:0/491972717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a4c0cc430 0x7f9a4c1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:28.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.882+0000 7f9a5173a640 1 --2- 172.21.15.72:0/491972717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a4c0cb4f0 0x7f9a4c14d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:28.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.886+0000 7f9a51f3b640 1 -- 172.21.15.72:0/491972717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a4c0cb4f0 msgr2=0x7f9a4c14d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:28.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.886+0000 7f9a51f3b640 1 --2- 172.21.15.72:0/491972717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a4c0cb4f0 0x7f9a4c14d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:28.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.886+0000 7f9a51f3b640 1 -- 172.21.15.72:0/491972717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a4c0cc430 msgr2=0x7f9a4c1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:28.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.886+0000 7f9a51f3b640 1 --2- 172.21.15.72:0/491972717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a4c0cc430 0x7f9a4c1580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:28.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.886+0000 7f9a51f3b640 1 -- 172.21.15.72:0/491972717 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a44009400 con 0x7f9a4c15c390 2023-12-13T00:00:28.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.888+0000 7f9a51f3b640 1 --2- 172.21.15.72:0/491972717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a4c15c390 0x7f9a4c1eed30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00c9f0 tx=0x7f9a3c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.891+0000 7f9a49ffb640 1 -- 172.21.15.72:0/491972717 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c00ab70 con 0x7f9a4c15c390 2023-12-13T00:00:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.892+0000 7f9a49ffb640 1 -- 172.21.15.72:0/491972717 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c00acd0 con 0x7f9a4c15c390 2023-12-13T00:00:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.892+0000 7f9a49ffb640 1 -- 172.21.15.72:0/491972717 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c012600 con 0x7f9a4c15c390 2023-12-13T00:00:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.892+0000 7f9a5399e640 1 -- 172.21.15.72:0/491972717 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4c1f2340 con 0x7f9a4c15c390 2023-12-13T00:00:28.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.892+0000 7f9a5399e640 1 -- 172.21.15.72:0/491972717 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4c1f2900 con 0x7f9a4c15c390 2023-12-13T00:00:28.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.893+0000 7f9a5399e640 1 -- 172.21.15.72:0/491972717 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a4c067470 con 0x7f9a4c15c390 2023-12-13T00:00:28.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.910+0000 7f9a49ffb640 1 -- 172.21.15.72:0/491972717 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9a3c007070 con 0x7f9a4c15c390 2023-12-13T00:00:28.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.911+0000 7f9a49ffb640 1 --2- 172.21.15.72:0/491972717 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9a3806b240 0x7f9a3806d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:28.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.911+0000 7f9a5173a640 1 --2- 172.21.15.72:0/491972717 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9a3806b240 0x7f9a3806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:28.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.911+0000 7f9a5173a640 1 --2- 172.21.15.72:0/491972717 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9a3806b240 0x7f9a3806d700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9a44036000 tx=0x7f9a44008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:28.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:28.914+0000 7f9a49ffb640 1 -- 172.21.15.72:0/491972717 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f9a3c058540 con 0x7f9a4c15c390 2023-12-13T00:00:29.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:29.150+0000 7f9a49ffb640 1 -- 172.21.15.72:0/491972717 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9a3c0b4e90 con 0x7f9a4c15c390 2023-12-13T00:00:29.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:29.317+0000 7f9a5399e640 1 -- 172.21.15.72:0/491972717 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f9a4c15a550 con 0x7f9a4c15c390 2023-12-13T00:00:29.635 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:00:29.639 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:00:29.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:29.913+0000 7f9a49ffb640 1 -- 172.21.15.72:0/491972717 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f9a4c15a550 con 0x7f9a4c15c390 2023-12-13T00:00:29.913 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-12-13T00:00:29.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:29.915+0000 7f9a5399e640 1 -- 172.21.15.72:0/491972717 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9a3806b240 msgr2=0x7f9a3806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:29.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:29.915+0000 7f9a5399e640 1 --2- 172.21.15.72:0/491972717 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9a3806b240 0x7f9a3806d700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9a44036000 tx=0x7f9a44008030 comp rx=0 tx=0).stop 2023-12-13T00:00:29.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:29.915+0000 7f9a5399e640 1 -- 172.21.15.72:0/491972717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a4c15c390 msgr2=0x7f9a4c1eed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:29.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:29.915+0000 7f9a5399e640 1 --2- 172.21.15.72:0/491972717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a4c15c390 0x7f9a4c1eed30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00c9f0 tx=0x7f9a3c00ceb0 comp rx=0 tx=0).stop 2023-12-13T00:00:29.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:29.915+0000 7f9a5399e640 1 -- 172.21.15.72:0/491972717 shutdown_connections 2023-12-13T00:00:29.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:29.915+0000 7f9a5399e640 1 --2- 172.21.15.72:0/491972717 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9a3806b240 0x7f9a3806d700 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:29.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:29.915+0000 7f9a5399e640 1 --2- 172.21.15.72:0/491972717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a4c15c390 0x7f9a4c1eed30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:29.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:29.915+0000 7f9a5399e640 1 --2- 172.21.15.72:0/491972717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a4c0cc430 0x7f9a4c1580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:29.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:29.915+0000 7f9a5399e640 1 --2- 172.21.15.72:0/491972717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a4c0cb4f0 0x7f9a4c14d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:29.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:29.915+0000 7f9a5399e640 1 -- 172.21.15.72:0/491972717 >> 172.21.15.72:0/491972717 conn(0x7f9a4c0ced20 msgr2=0x7f9a4c158d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:29.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:29.915+0000 7f9a5399e640 1 -- 172.21.15.72:0/491972717 shutdown_connections 2023-12-13T00:00:29.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:29.915+0000 7f9a5399e640 1 -- 172.21.15.72:0/491972717 wait complete. 2023-12-13T00:00:29.926 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-13T00:00:30.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.043+0000 7fe89202b640 1 Processor -- start 2023-12-13T00:00:30.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.043+0000 7fe89202b640 1 -- start start 2023-12-13T00:00:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.044+0000 7fe89202b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe88c150460 0x7fe88c0c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.044+0000 7fe89202b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe88c0c76f0 con 0x7fe88c0c46c0 2023-12-13T00:00:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.044+0000 7fe89202b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe88c0c2bc0 con 0x7fe88c0c4aa0 2023-12-13T00:00:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.044+0000 7fe89202b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0c6dc0 con 0x7fe88c150460 2023-12-13T00:00:30.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.044+0000 7fe88b7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe88c0c46c0 0x7fe88c0c53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57604/0 (socket says 172.21.15.72:57604) 2023-12-13T00:00:30.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.044+0000 7fe88b7fe640 1 -- 172.21.15.72:0/3921646908 learned_addr learned my addr 172.21.15.72:0/3921646908 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:30.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.046+0000 7fe88a7fc640 1 -- 172.21.15.72:0/3921646908 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75293741 0 0) 0x7fe88c0c76f0 con 0x7fe88c0c46c0 2023-12-13T00:00:30.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.047+0000 7fe88a7fc640 1 -- 172.21.15.72:0/3921646908 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe874005730 con 0x7fe88c0c46c0 2023-12-13T00:00:30.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.051+0000 7fe88a7fc640 1 -- 172.21.15.72:0/3921646908 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 481025146 0 0) 0x7fe874005730 con 0x7fe88c0c46c0 2023-12-13T00:00:30.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.051+0000 7fe88a7fc640 1 -- 172.21.15.72:0/3921646908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe88c150460 msgr2=0x7fe88c0c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:30.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.051+0000 7fe88a7fc640 1 --2- 172.21.15.72:0/3921646908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe88c150460 0x7fe88c0c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:30.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.051+0000 7fe88a7fc640 1 -- 172.21.15.72:0/3921646908 >> v1:172.21.15.176:6789/0 conn(0x7fe88c0c4aa0 legacy=0x7fe88c14fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:30.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.051+0000 7fe88a7fc640 1 -- 172.21.15.72:0/3921646908 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c0c70a0 con 0x7fe88c0c46c0 2023-12-13T00:00:30.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.051+0000 7fe88a7fc640 1 -- 172.21.15.72:0/3921646908 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1233568696 0 0) 0x7fe87c001670 con 0x7fe88c0c46c0 2023-12-13T00:00:30.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.051+0000 7fe88a7fc640 1 -- 172.21.15.72:0/3921646908 >> v1:172.21.15.72:6789/0 conn(0x7fe88c0c46c0 legacy=0x7fe88c0c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:30.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.051+0000 7fe88a7fc640 1 --2- 172.21.15.72:0/3921646908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe874005c20 0x7fe874006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:30.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.051+0000 7fe88a7fc640 1 --2- 172.21.15.72:0/3921646908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe88c150460 0x7fe8740069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:30.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.051+0000 7fe88a7fc640 1 --2- 172.21.15.72:0/3921646908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe874007030 0x7fe87400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:30.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.051+0000 7fe88a7fc640 1 -- 172.21.15.72:0/3921646908 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0c6dc0 con 0x7fe874007030 2023-12-13T00:00:30.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.051+0000 7fe88a7fc640 1 -- 172.21.15.72:0/3921646908 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe874007750 con 0x7fe874005c20 2023-12-13T00:00:30.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.051+0000 7fe88a7fc640 1 -- 172.21.15.72:0/3921646908 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87400e0d0 con 0x7fe88c150460 2023-12-13T00:00:30.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.054+0000 7fe88bfff640 1 --2- 172.21.15.72:0/3921646908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe874007030 0x7fe87400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:30.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.058+0000 7fe88bfff640 1 -- 172.21.15.72:0/3921646908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe88c150460 msgr2=0x7fe8740069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:30.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.058+0000 7fe88bfff640 1 --2- 172.21.15.72:0/3921646908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe88c150460 0x7fe8740069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:30.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.058+0000 7fe88bfff640 1 -- 172.21.15.72:0/3921646908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe874005c20 msgr2=0x7fe874006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:30.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.058+0000 7fe88bfff640 1 --2- 172.21.15.72:0/3921646908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe874005c20 0x7fe874006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:30.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.058+0000 7fe88bfff640 1 -- 172.21.15.72:0/3921646908 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe874005730 con 0x7fe874007030 2023-12-13T00:00:30.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.105+0000 7fe88bfff640 1 --2- 172.21.15.72:0/3921646908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe874007030 0x7fe87400db90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe884009e40 tx=0x7fe874007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54046a568bb21bb server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:30.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.177+0000 7fe88a7fc640 1 -- 172.21.15.72:0/3921646908 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88402cd90 con 0x7fe874007030 2023-12-13T00:00:30.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.177+0000 7fe88a7fc640 1 -- 172.21.15.72:0/3921646908 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe884034440 con 0x7fe874007030 2023-12-13T00:00:30.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.177+0000 7fe88a7fc640 1 -- 172.21.15.72:0/3921646908 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884034830 con 0x7fe874007030 2023-12-13T00:00:30.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.178+0000 7fe89202b640 1 -- 172.21.15.72:0/3921646908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe874007030 msgr2=0x7fe87400db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:30.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.178+0000 7fe89202b640 1 --2- 172.21.15.72:0/3921646908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe874007030 0x7fe87400db90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe884009e40 tx=0x7fe874007a00 comp rx=0 tx=0).stop 2023-12-13T00:00:30.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.178+0000 7fe88bfff640 1 -- 172.21.15.72:0/3921646908 reap_dead start 2023-12-13T00:00:30.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.178+0000 7fe89202b640 1 -- 172.21.15.72:0/3921646908 shutdown_connections 2023-12-13T00:00:30.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.178+0000 7fe89202b640 1 -- 172.21.15.72:0/3921646908 >> 172.21.15.72:0/3921646908 conn(0x7fe88c06c5f0 msgr2=0x7fe88c06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:30.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.178+0000 7fe89202b640 1 -- 172.21.15.72:0/3921646908 shutdown_connections 2023-12-13T00:00:30.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.178+0000 7fe89202b640 1 -- 172.21.15.72:0/3921646908 wait complete. 2023-12-13T00:00:30.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.179+0000 7fe89202b640 1 Processor -- start 2023-12-13T00:00:30.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.179+0000 7fe89202b640 1 -- start start 2023-12-13T00:00:30.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.180+0000 7fe89202b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe88c142570 0x7fe88c14d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:30.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.180+0000 7fe89202b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe88c142950 0x7fe88c13f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:30.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.180+0000 7fe89202b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe88c14dad0 0x7fe88c13f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:30.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.180+0000 7fe89202b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0721d0 con 0x7fe88c14dad0 2023-12-13T00:00:30.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.180+0000 7fe89202b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c1eabf0 con 0x7fe88c142570 2023-12-13T00:00:30.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.180+0000 7fe89202b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c1ebbc0 con 0x7fe88c142950 2023-12-13T00:00:30.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.181+0000 7fe88b7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe88c142570 0x7fe88c14d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:30.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.181+0000 7fe88affd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe88c142950 0x7fe88c13f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:30.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.181+0000 7fe88b7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe88c142570 0x7fe88c14d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:33216/0 (socket says 172.21.15.72:33216) 2023-12-13T00:00:30.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.181+0000 7fe88b7fe640 1 -- 172.21.15.72:0/879723671 learned_addr learned my addr 172.21.15.72:0/879723671 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:30.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.185+0000 7fe88b7fe640 1 -- 172.21.15.72:0/879723671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe88c142950 msgr2=0x7fe88c13f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:30.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.185+0000 7fe88b7fe640 1 --2- 172.21.15.72:0/879723671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe88c142950 0x7fe88c13f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:30.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.185+0000 7fe88b7fe640 1 -- 172.21.15.72:0/879723671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe88c14dad0 msgr2=0x7fe88c13f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:30.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.185+0000 7fe88b7fe640 1 --2- 172.21.15.72:0/879723671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe88c14dad0 0x7fe88c13f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:30.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.185+0000 7fe88b7fe640 1 -- 172.21.15.72:0/879723671 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c13fcf0 con 0x7fe88c142570 2023-12-13T00:00:30.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.188+0000 7fe88b7fe640 1 --2- 172.21.15.72:0/879723671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe88c142570 0x7fe88c14d590 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00c790 tx=0x7fe87c00cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:30.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.192+0000 7fe873fff640 1 -- 172.21.15.72:0/879723671 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c004cb0 con 0x7fe88c142570 2023-12-13T00:00:30.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.192+0000 7fe873fff640 1 -- 172.21.15.72:0/879723671 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87c004e10 con 0x7fe88c142570 2023-12-13T00:00:30.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.192+0000 7fe873fff640 1 -- 172.21.15.72:0/879723671 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c007310 con 0x7fe88c142570 2023-12-13T00:00:30.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.192+0000 7fe89202b640 1 -- 172.21.15.72:0/879723671 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88c0c8b90 con 0x7fe88c142570 2023-12-13T00:00:30.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.192+0000 7fe89202b640 1 -- 172.21.15.72:0/879723671 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88c1eb0e0 con 0x7fe88c142570 2023-12-13T00:00:30.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.193+0000 7fe89202b640 1 -- 172.21.15.72:0/879723671 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88c067470 con 0x7fe88c142570 2023-12-13T00:00:30.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.451+0000 7fe873fff640 1 -- 172.21.15.72:0/879723671 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe87c007470 con 0x7fe88c142570 2023-12-13T00:00:30.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.451+0000 7fe873fff640 1 --2- 172.21.15.72:0/879723671 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe87806b240 0x7fe87806d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:30.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.451+0000 7fe88affd640 1 --2- 172.21.15.72:0/879723671 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe87806b240 0x7fe87806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:30.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.452+0000 7fe88affd640 1 --2- 172.21.15.72:0/879723671 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe87806b240 0x7fe87806d700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe88c06d0b0 tx=0x7fe880009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:30.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.454+0000 7fe873fff640 1 -- 172.21.15.72:0/879723671 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fe87c00ce40 con 0x7fe88c142570 2023-12-13T00:00:30.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.464+0000 7fe873fff640 1 -- 172.21.15.72:0/879723671 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe87c0543b0 con 0x7fe88c142570 2023-12-13T00:00:30.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:30.665+0000 7fe89202b640 1 -- 172.21.15.72:0/879723671 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe88c0c1820 con 0x7fe88c142570 2023-12-13T00:00:31.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.289+0000 7fe873fff640 1 -- 172.21.15.72:0/879723671 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe87c018020 con 0x7fe88c142570 2023-12-13T00:00:31.289 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 2 and data pool 3 2023-12-13T00:00:31.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.291+0000 7fe89202b640 1 -- 172.21.15.72:0/879723671 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe87806b240 msgr2=0x7fe87806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:31.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.291+0000 7fe89202b640 1 --2- 172.21.15.72:0/879723671 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe87806b240 0x7fe87806d700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe88c06d0b0 tx=0x7fe880009040 comp rx=0 tx=0).stop 2023-12-13T00:00:31.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.291+0000 7fe89202b640 1 -- 172.21.15.72:0/879723671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe88c142570 msgr2=0x7fe88c14d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.291+0000 7fe89202b640 1 --2- 172.21.15.72:0/879723671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe88c142570 0x7fe88c14d590 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00c790 tx=0x7fe87c00cc50 comp rx=0 tx=0).stop 2023-12-13T00:00:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.291+0000 7fe89202b640 1 -- 172.21.15.72:0/879723671 shutdown_connections 2023-12-13T00:00:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.291+0000 7fe89202b640 1 --2- 172.21.15.72:0/879723671 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe87806b240 0x7fe87806d700 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.291+0000 7fe89202b640 1 --2- 172.21.15.72:0/879723671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe88c14dad0 0x7fe88c13f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.291+0000 7fe89202b640 1 --2- 172.21.15.72:0/879723671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe88c142950 0x7fe88c13f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.291+0000 7fe89202b640 1 --2- 172.21.15.72:0/879723671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe88c142570 0x7fe88c14d590 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.291+0000 7fe89202b640 1 -- 172.21.15.72:0/879723671 >> 172.21.15.72:0/879723671 conn(0x7fe88c06c5f0 msgr2=0x7fe88c153cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.291+0000 7fe89202b640 1 -- 172.21.15.72:0/879723671 shutdown_connections 2023-12-13T00:00:31.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.291+0000 7fe89202b640 1 -- 172.21.15.72:0/879723671 wait complete. 2023-12-13T00:00:31.301 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-13T00:00:31.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-13T00:00:31.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.408+0000 7ff5a54bb640 1 Processor -- start 2023-12-13T00:00:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.408+0000 7ff5a54bb640 1 -- start start 2023-12-13T00:00:31.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.409+0000 7ff5a54bb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0151680 0x7ff5a01571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:31.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.409+0000 7ff5a54bb640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff5a006f810 0x7ff5a00ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:31.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.409+0000 7ff5a54bb640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a00c8240 con 0x7ff5a006f3f0 2023-12-13T00:00:31.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.409+0000 7ff5a54bb640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a0157880 con 0x7ff5a006f810 2023-12-13T00:00:31.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.409+0000 7ff5a54bb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0157b60 con 0x7ff5a0151680 2023-12-13T00:00:31.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.410+0000 7ff59effd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0151680 0x7ff5a01571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:31.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.410+0000 7ff59effd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0151680 0x7ff5a01571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:38744/0 (socket says 172.21.15.72:38744) 2023-12-13T00:00:31.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.410+0000 7ff59f7fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff5a006f810 0x7ff5a00ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:31.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.410+0000 7ff59effd640 1 -- 172.21.15.72:0/370925293 learned_addr learned my addr 172.21.15.72:0/370925293 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:31.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.413+0000 7ff59effd640 1 -- 172.21.15.72:0/370925293 >> v2:172.21.15.176:3300/0 conn(0x7ff5a006f810 msgr2=0x7ff5a00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:31.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.413+0000 7ff59effd640 1 --2- 172.21.15.72:0/370925293 >> v2:172.21.15.176:3300/0 conn(0x7ff5a006f810 0x7ff5a00ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:31.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.413+0000 7ff59effd640 1 -- 172.21.15.72:0/370925293 >> v1:172.21.15.176:6789/0 conn(0x7ff5a006f3f0 legacy=0x7ff5a00c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:31.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.414+0000 7ff59effd640 1 -- 172.21.15.72:0/370925293 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a0157e40 con 0x7ff5a0151680 2023-12-13T00:00:31.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.416+0000 7ff59effd640 1 --2- 172.21.15.72:0/370925293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0151680 0x7ff5a01571d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff590009870 tx=0x7ff59002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b155098bc68fb41 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:31.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.419+0000 7ff59e7fc640 1 -- 172.21.15.72:0/370925293 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59002f840 con 0x7ff5a0151680 2023-12-13T00:00:31.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.422+0000 7ff59e7fc640 1 -- 172.21.15.72:0/370925293 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59002f9a0 con 0x7ff5a0151680 2023-12-13T00:00:31.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.422+0000 7ff59e7fc640 1 -- 172.21.15.72:0/370925293 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59002fd30 con 0x7ff5a0151680 2023-12-13T00:00:31.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.423+0000 7ff5a54bb640 1 -- 172.21.15.72:0/370925293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0151680 msgr2=0x7ff5a01571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:31.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.423+0000 7ff5a54bb640 1 --2- 172.21.15.72:0/370925293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0151680 0x7ff5a01571d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff590009870 tx=0x7ff59002ba20 comp rx=0 tx=0).stop 2023-12-13T00:00:31.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.423+0000 7ff5a54bb640 1 -- 172.21.15.72:0/370925293 shutdown_connections 2023-12-13T00:00:31.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.423+0000 7ff5a54bb640 1 --2- 172.21.15.72:0/370925293 >> v2:172.21.15.176:3300/0 conn(0x7ff5a006f810 0x7ff5a00ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:31.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.423+0000 7ff5a54bb640 1 --2- 172.21.15.72:0/370925293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0151680 0x7ff5a01571d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:31.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.423+0000 7ff5a54bb640 1 -- 172.21.15.72:0/370925293 >> 172.21.15.72:0/370925293 conn(0x7ff5a00707f0 msgr2=0x7ff5a0070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:31.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.423+0000 7ff5a54bb640 1 -- 172.21.15.72:0/370925293 shutdown_connections 2023-12-13T00:00:31.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.423+0000 7ff5a54bb640 1 -- 172.21.15.72:0/370925293 wait complete. 2023-12-13T00:00:31.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.425+0000 7ff5a54bb640 1 Processor -- start 2023-12-13T00:00:31.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.425+0000 7ff5a54bb640 1 -- start start 2023-12-13T00:00:31.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.426+0000 7ff5a54bb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5a006f3f0 0x7ff5a01596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:31.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.426+0000 7ff5a54bb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5a006f810 0x7ff5a014c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:31.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.426+0000 7ff5a54bb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0151680 0x7ff5a01463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:31.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.426+0000 7ff5a54bb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0158d20 con 0x7ff5a006f810 2023-12-13T00:00:31.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.426+0000 7ff5a54bb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0159c10 con 0x7ff5a006f3f0 2023-12-13T00:00:31.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.426+0000 7ff5a54bb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0158430 con 0x7ff5a0151680 2023-12-13T00:00:31.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.426+0000 7ff59effd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5a006f3f0 0x7ff5a01596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:31.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.426+0000 7ff59f7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0151680 0x7ff5a01463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:31.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.427+0000 7ff59effd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5a006f3f0 0x7ff5a01596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:33232/0 (socket says 172.21.15.72:33232) 2023-12-13T00:00:31.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.427+0000 7ff59effd640 1 -- 172.21.15.72:0/1657743099 learned_addr learned my addr 172.21.15.72:0/1657743099 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:31.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.431+0000 7ff59f7fe640 1 -- 172.21.15.72:0/1657743099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5a006f3f0 msgr2=0x7ff5a01596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:31.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.431+0000 7ff59f7fe640 1 --2- 172.21.15.72:0/1657743099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5a006f3f0 0x7ff5a01596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:31.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.431+0000 7ff59f7fe640 1 -- 172.21.15.72:0/1657743099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5a006f810 msgr2=0x7ff5a014c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:31.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.431+0000 7ff59f7fe640 1 --2- 172.21.15.72:0/1657743099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5a006f810 0x7ff5a014c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:31.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.431+0000 7ff59f7fe640 1 -- 172.21.15.72:0/1657743099 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5900094d0 con 0x7ff5a0151680 2023-12-13T00:00:31.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.433+0000 7ff59f7fe640 1 --2- 172.21.15.72:0/1657743099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0151680 0x7ff5a01463f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff59800eba0 tx=0x7ff59800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:31.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.436+0000 7ff5977fe640 1 -- 172.21.15.72:0/1657743099 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59800cd20 con 0x7ff5a0151680 2023-12-13T00:00:31.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.436+0000 7ff5a54bb640 1 -- 172.21.15.72:0/1657743099 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a01ed8c0 con 0x7ff5a0151680 2023-12-13T00:00:31.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.436+0000 7ff5a54bb640 1 -- 172.21.15.72:0/1657743099 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a01589b0 con 0x7ff5a0151680 2023-12-13T00:00:31.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.437+0000 7ff5a54bb640 1 -- 172.21.15.72:0/1657743099 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a0158ed0 con 0x7ff5a0151680 2023-12-13T00:00:31.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.439+0000 7ff5977fe640 1 -- 172.21.15.72:0/1657743099 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59800f040 con 0x7ff5a0151680 2023-12-13T00:00:31.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.439+0000 7ff5977fe640 1 -- 172.21.15.72:0/1657743099 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff598014680 con 0x7ff5a0151680 2023-12-13T00:00:31.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.705+0000 7ff5977fe640 1 -- 172.21.15.72:0/1657743099 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff5980147e0 con 0x7ff5a0151680 2023-12-13T00:00:31.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.706+0000 7ff5977fe640 1 --2- 172.21.15.72:0/1657743099 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff58006b1f0 0x7ff58006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:31.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.706+0000 7ff59effd640 1 --2- 172.21.15.72:0/1657743099 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff58006b1f0 0x7ff58006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:31.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.706+0000 7ff59effd640 1 --2- 172.21.15.72:0/1657743099 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff58006b1f0 0x7ff58006d6b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff590009870 tx=0x7ff590008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:31.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.714+0000 7ff5977fe640 1 -- 172.21.15.72:0/1657743099 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff59800ce80 con 0x7ff5a0151680 2023-12-13T00:00:31.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.734+0000 7ff5977fe640 1 -- 172.21.15.72:0/1657743099 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff598055740 con 0x7ff5a0151680 2023-12-13T00:00:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:31.918+0000 7ff5a54bb640 1 -- 172.21.15.72:0/1657743099 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7ff5a0158ed0 con 0x7ff5a0151680 2023-12-13T00:00:32.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.099+0000 7ff5977fe640 1 -- 172.21.15.72:0/1657743099 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7ff5a0158ed0 con 0x7ff5a0151680 2023-12-13T00:00:32.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.101+0000 7ff5a54bb640 1 -- 172.21.15.72:0/1657743099 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff58006b1f0 msgr2=0x7ff58006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:32.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.101+0000 7ff5a54bb640 1 --2- 172.21.15.72:0/1657743099 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff58006b1f0 0x7ff58006d6b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff590009870 tx=0x7ff590008030 comp rx=0 tx=0).stop 2023-12-13T00:00:32.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.101+0000 7ff5a54bb640 1 -- 172.21.15.72:0/1657743099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0151680 msgr2=0x7ff5a01463f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:32.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.101+0000 7ff5a54bb640 1 --2- 172.21.15.72:0/1657743099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0151680 0x7ff5a01463f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff59800eba0 tx=0x7ff59800c490 comp rx=0 tx=0).stop 2023-12-13T00:00:32.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.101+0000 7ff5a54bb640 1 -- 172.21.15.72:0/1657743099 shutdown_connections 2023-12-13T00:00:32.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.101+0000 7ff5a54bb640 1 --2- 172.21.15.72:0/1657743099 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff58006b1f0 0x7ff58006d6b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:32.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.101+0000 7ff5a54bb640 1 --2- 172.21.15.72:0/1657743099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5a0151680 0x7ff5a01463f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:32.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.101+0000 7ff5a54bb640 1 --2- 172.21.15.72:0/1657743099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5a006f810 0x7ff5a014c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:32.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.101+0000 7ff5a54bb640 1 --2- 172.21.15.72:0/1657743099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5a006f3f0 0x7ff5a01596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:32.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.101+0000 7ff5a54bb640 1 -- 172.21.15.72:0/1657743099 >> 172.21.15.72:0/1657743099 conn(0x7ff5a00707f0 msgr2=0x7ff5a00b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:32.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.101+0000 7ff5a54bb640 1 -- 172.21.15.72:0/1657743099 shutdown_connections 2023-12-13T00:00:32.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.101+0000 7ff5a54bb640 1 -- 172.21.15.72:0/1657743099 wait complete. 2023-12-13T00:00:32.112 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-13T00:00:32.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.226+0000 7f84f7c9b640 1 Processor -- start 2023-12-13T00:00:32.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.227+0000 7f84f7c9b640 1 -- start start 2023-12-13T00:00:32.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.227+0000 7f84f7c9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84f006ad20 0x7f84f00c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:32.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.227+0000 7f84f7c9b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f84f006b100 0x7f84f00c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:32.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.227+0000 7f84f7c9b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f00c25f0 con 0x7f84f015a1d0 2023-12-13T00:00:32.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.227+0000 7f84f7c9b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f0159520 con 0x7f84f006b100 2023-12-13T00:00:32.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.227+0000 7f84f7c9b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f00c2df0 con 0x7f84f006ad20 2023-12-13T00:00:32.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.228+0000 7f84f5236640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f84f006b100 0x7f84f00c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:32.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.228+0000 7f84f5236640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f84f006b100 0x7f84f00c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:33242/0 (socket says 172.21.15.72:33242) 2023-12-13T00:00:32.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.228+0000 7f84f5236640 1 -- 172.21.15.72:0/1853326688 learned_addr learned my addr 172.21.15.72:0/1853326688 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:32.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.228+0000 7f84f6238640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f84f015a1d0 0x7f84f0072510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57618/0 (socket says 172.21.15.72:57618) 2023-12-13T00:00:32.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.230+0000 7f84f5236640 1 -- 172.21.15.72:0/1853326688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84f006ad20 msgr2=0x7f84f00c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:32.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.230+0000 7f84f5236640 1 --2- 172.21.15.72:0/1853326688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84f006ad20 0x7f84f00c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:32.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.230+0000 7f84f5236640 1 -- 172.21.15.72:0/1853326688 >> v1:172.21.15.72:6789/0 conn(0x7f84f015a1d0 legacy=0x7f84f0072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:32.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.230+0000 7f84f5236640 1 -- 172.21.15.72:0/1853326688 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f00c8920 con 0x7f84f006b100 2023-12-13T00:00:32.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.233+0000 7f84f5236640 1 --2- 172.21.15.72:0/1853326688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84f006b100 0x7f84f00c83e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009870 tx=0x7f84e002ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f4497f603982704 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:32.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.237+0000 7f84f4a35640 1 -- 172.21.15.72:0/1853326688 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e002f840 con 0x7f84f006b100 2023-12-13T00:00:32.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.237+0000 7f84f4a35640 1 -- 172.21.15.72:0/1853326688 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e002f9a0 con 0x7f84f006b100 2023-12-13T00:00:32.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.237+0000 7f84f4a35640 1 -- 172.21.15.72:0/1853326688 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e002fd30 con 0x7f84f006b100 2023-12-13T00:00:32.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.238+0000 7f84f7c9b640 1 -- 172.21.15.72:0/1853326688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84f006b100 msgr2=0x7f84f00c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:32.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.238+0000 7f84f7c9b640 1 --2- 172.21.15.72:0/1853326688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84f006b100 0x7f84f00c83e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009870 tx=0x7f84e002ba20 comp rx=0 tx=0).stop 2023-12-13T00:00:32.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.238+0000 7f84f7c9b640 1 -- 172.21.15.72:0/1853326688 shutdown_connections 2023-12-13T00:00:32.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.238+0000 7f84f7c9b640 1 --2- 172.21.15.72:0/1853326688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84f006b100 0x7f84f00c83e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:32.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.238+0000 7f84f7c9b640 1 --2- 172.21.15.72:0/1853326688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84f006ad20 0x7f84f00c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:32.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.238+0000 7f84f7c9b640 1 -- 172.21.15.72:0/1853326688 >> 172.21.15.72:0/1853326688 conn(0x7f84f0070110 msgr2=0x7f84f006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:32.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.238+0000 7f84f7c9b640 1 -- 172.21.15.72:0/1853326688 shutdown_connections 2023-12-13T00:00:32.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.238+0000 7f84f7c9b640 1 -- 172.21.15.72:0/1853326688 wait complete. 2023-12-13T00:00:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.239+0000 7f84f7c9b640 1 Processor -- start 2023-12-13T00:00:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.239+0000 7f84f7c9b640 1 -- start start 2023-12-13T00:00:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.240+0000 7f84f7c9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84f006ad20 0x7f84f014b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.240+0000 7f84f7c9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84f006b100 0x7f84f014d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.240+0000 7f84f7c9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84f015a1d0 0x7f84f015c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.240+0000 7f84f7c9b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f015b650 con 0x7f84f015a1d0 2023-12-13T00:00:32.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.240+0000 7f84f7c9b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f00b1b20 con 0x7f84f006b100 2023-12-13T00:00:32.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.240+0000 7f84f7c9b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f01efae0 con 0x7f84f006ad20 2023-12-13T00:00:32.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.240+0000 7f84f6238640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84f015a1d0 0x7f84f015c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:32.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.240+0000 7f84f5236640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84f006b100 0x7f84f014d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:32.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.240+0000 7f84f6238640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84f015a1d0 0x7f84f015c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43714/0 (socket says 172.21.15.72:43714) 2023-12-13T00:00:32.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.240+0000 7f84f6238640 1 -- 172.21.15.72:0/3522773646 learned_addr learned my addr 172.21.15.72:0/3522773646 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.244+0000 7f84f6238640 1 -- 172.21.15.72:0/3522773646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84f006ad20 msgr2=0x7f84f014b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.244+0000 7f84f6238640 1 --2- 172.21.15.72:0/3522773646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84f006ad20 0x7f84f014b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.244+0000 7f84f6238640 1 -- 172.21.15.72:0/3522773646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84f006b100 msgr2=0x7f84f014d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.244+0000 7f84f6238640 1 --2- 172.21.15.72:0/3522773646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84f006b100 0x7f84f014d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.244+0000 7f84f6238640 1 -- 172.21.15.72:0/3522773646 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e00094d0 con 0x7f84f015a1d0 2023-12-13T00:00:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.246+0000 7f84f6238640 1 --2- 172.21.15.72:0/3522773646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84f015a1d0 0x7f84f015c7b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f84e800c730 tx=0x7f84e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.250+0000 7f84e67fc640 1 -- 172.21.15.72:0/3522773646 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e800ce40 con 0x7f84f015a1d0 2023-12-13T00:00:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.250+0000 7f84e67fc640 1 -- 172.21.15.72:0/3522773646 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e800a640 con 0x7f84f015a1d0 2023-12-13T00:00:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.250+0000 7f84e67fc640 1 -- 172.21.15.72:0/3522773646 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e800a9b0 con 0x7f84f015a1d0 2023-12-13T00:00:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.250+0000 7f84f7c9b640 1 -- 172.21.15.72:0/3522773646 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f00b2050 con 0x7f84f015a1d0 2023-12-13T00:00:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.250+0000 7f84f7c9b640 1 -- 172.21.15.72:0/3522773646 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f014be60 con 0x7f84f015a1d0 2023-12-13T00:00:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.250+0000 7f84f7c9b640 1 -- 172.21.15.72:0/3522773646 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f00cc040 con 0x7f84f015a1d0 2023-12-13T00:00:32.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.269+0000 7f84e67fc640 1 -- 172.21.15.72:0/3522773646 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f84e800ab10 con 0x7f84f015a1d0 2023-12-13T00:00:32.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.269+0000 7f84e67fc640 1 --2- 172.21.15.72:0/3522773646 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f84d406b1c0 0x7f84d406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:32.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.269+0000 7f84f5a37640 1 --2- 172.21.15.72:0/3522773646 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f84d406b1c0 0x7f84d406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:32.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.270+0000 7f84f5a37640 1 --2- 172.21.15.72:0/3522773646 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f84d406b1c0 0x7f84d406d680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009710 tx=0x7f84ec006c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:32.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.272+0000 7f84e67fc640 1 -- 172.21.15.72:0/3522773646 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f84e8058260 con 0x7f84f015a1d0 2023-12-13T00:00:32.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.506+0000 7f84e67fc640 1 -- 172.21.15.72:0/3522773646 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f84e80545a0 con 0x7f84f015a1d0 2023-12-13T00:00:32.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:32.675+0000 7f84f7c9b640 1 -- 172.21.15.72:0/3522773646 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f84f006a8d0 con 0x7f84f015a1d0 2023-12-13T00:00:34.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.469+0000 7f84e67fc640 1 -- 172.21.15.72:0/3522773646 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f84e8021100 con 0x7f84f015a1d0 2023-12-13T00:00:34.469 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data_ec' created 2023-12-13T00:00:34.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.471+0000 7f84f7c9b640 1 -- 172.21.15.72:0/3522773646 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f84d406b1c0 msgr2=0x7f84d406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:34.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.471+0000 7f84f7c9b640 1 --2- 172.21.15.72:0/3522773646 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f84d406b1c0 0x7f84d406d680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009710 tx=0x7f84ec006c90 comp rx=0 tx=0).stop 2023-12-13T00:00:34.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.471+0000 7f84f7c9b640 1 -- 172.21.15.72:0/3522773646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84f015a1d0 msgr2=0x7f84f015c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:34.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.471+0000 7f84f7c9b640 1 --2- 172.21.15.72:0/3522773646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84f015a1d0 0x7f84f015c7b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f84e800c730 tx=0x7f84e800cbf0 comp rx=0 tx=0).stop 2023-12-13T00:00:34.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.471+0000 7f84f7c9b640 1 -- 172.21.15.72:0/3522773646 shutdown_connections 2023-12-13T00:00:34.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.471+0000 7f84f7c9b640 1 --2- 172.21.15.72:0/3522773646 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f84d406b1c0 0x7f84d406d680 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:34.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.471+0000 7f84f7c9b640 1 --2- 172.21.15.72:0/3522773646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84f015a1d0 0x7f84f015c7b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:34.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.471+0000 7f84f7c9b640 1 --2- 172.21.15.72:0/3522773646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84f006b100 0x7f84f014d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:34.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.471+0000 7f84f7c9b640 1 --2- 172.21.15.72:0/3522773646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84f006ad20 0x7f84f014b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:34.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.471+0000 7f84f7c9b640 1 -- 172.21.15.72:0/3522773646 >> 172.21.15.72:0/3522773646 conn(0x7f84f0070110 msgr2=0x7f84f006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:34.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.471+0000 7f84f7c9b640 1 -- 172.21.15.72:0/3522773646 shutdown_connections 2023-12-13T00:00:34.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.471+0000 7f84f7c9b640 1 -- 172.21.15.72:0/3522773646 wait complete. 2023-12-13T00:00:34.482 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-13T00:00:34.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.591+0000 7f68a2690640 1 Processor -- start 2023-12-13T00:00:34.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.591+0000 7f68a2690640 1 -- start start 2023-12-13T00:00:34.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.592+0000 7f68a2690640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f689c151680 0x7f689c1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:34.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.592+0000 7f68a2690640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f689c06f3f0 0x7f689c0c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:34.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.592+0000 7f68a2690640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689c157880 con 0x7f689c06f810 2023-12-13T00:00:34.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.592+0000 7f68a2690640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689c157b60 con 0x7f689c151680 2023-12-13T00:00:34.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.592+0000 7f68a2690640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689c157e40 con 0x7f689c06f3f0 2023-12-13T00:00:34.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.593+0000 7f689b7fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f689c06f3f0 0x7f689c0c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:34.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.593+0000 7f689b7fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f689c06f3f0 0x7f689c0c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:33262/0 (socket says 172.21.15.72:33262) 2023-12-13T00:00:34.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.593+0000 7f689b7fe640 1 -- 172.21.15.72:0/4222969657 learned_addr learned my addr 172.21.15.72:0/4222969657 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:34.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.595+0000 7f689b7fe640 1 -- 172.21.15.72:0/4222969657 >> v2:172.21.15.72:3300/0 conn(0x7f689c151680 msgr2=0x7f689c1571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:34.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.595+0000 7f689b7fe640 1 --2- 172.21.15.72:0/4222969657 >> v2:172.21.15.72:3300/0 conn(0x7f689c151680 0x7f689c1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:34.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.595+0000 7f689b7fe640 1 -- 172.21.15.72:0/4222969657 >> v1:172.21.15.72:6789/0 conn(0x7f689c06f810 legacy=0x7f689c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:34.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.595+0000 7f689b7fe640 1 -- 172.21.15.72:0/4222969657 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c158120 con 0x7f689c06f3f0 2023-12-13T00:00:34.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.598+0000 7f689b7fe640 1 --2- 172.21.15.72:0/4222969657 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f689c06f3f0 0x7f689c0c7b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f689c0c7850 tx=0x7f689002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6251bfcdc0c946ff server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:34.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.603+0000 7f689affd640 1 -- 172.21.15.72:0/4222969657 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890030860 con 0x7f689c06f3f0 2023-12-13T00:00:34.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.603+0000 7f689affd640 1 -- 172.21.15.72:0/4222969657 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68900309c0 con 0x7f689c06f3f0 2023-12-13T00:00:34.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.603+0000 7f689affd640 1 -- 172.21.15.72:0/4222969657 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890030d50 con 0x7f689c06f3f0 2023-12-13T00:00:34.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.604+0000 7f68a2690640 1 -- 172.21.15.72:0/4222969657 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f689c06f3f0 msgr2=0x7f689c0c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:34.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.604+0000 7f68a2690640 1 --2- 172.21.15.72:0/4222969657 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f689c06f3f0 0x7f689c0c7b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f689c0c7850 tx=0x7f689002b9a0 comp rx=0 tx=0).stop 2023-12-13T00:00:34.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.604+0000 7f68a2690640 1 -- 172.21.15.72:0/4222969657 shutdown_connections 2023-12-13T00:00:34.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.604+0000 7f68a2690640 1 --2- 172.21.15.72:0/4222969657 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f689c06f3f0 0x7f689c0c7b30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:34.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.604+0000 7f68a2690640 1 --2- 172.21.15.72:0/4222969657 >> v2:172.21.15.72:3300/0 conn(0x7f689c151680 0x7f689c1571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:34.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.604+0000 7f68a2690640 1 -- 172.21.15.72:0/4222969657 >> 172.21.15.72:0/4222969657 conn(0x7f689c0707f0 msgr2=0x7f689c070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:34.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.604+0000 7f68a2690640 1 -- 172.21.15.72:0/4222969657 shutdown_connections 2023-12-13T00:00:34.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.604+0000 7f68a2690640 1 -- 172.21.15.72:0/4222969657 wait complete. 2023-12-13T00:00:34.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.605+0000 7f68a2690640 1 Processor -- start 2023-12-13T00:00:34.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.605+0000 7f68a2690640 1 -- start start 2023-12-13T00:00:34.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.606+0000 7f68a2690640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f689c06f3f0 0x7f689c148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:34.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.606+0000 7f68a2690640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f689c06f810 0x7f689c143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:34.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.606+0000 7f68a2690640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f689c151680 0x7f689c143970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.606+0000 7f68a2690640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c14aac0 con 0x7f689c151680 2023-12-13T00:00:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.606+0000 7f68a2690640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c1556e0 con 0x7f689c06f810 2023-12-13T00:00:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.606+0000 7f68a2690640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0cc0a0 con 0x7f689c06f3f0 2023-12-13T00:00:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.606+0000 7f68a0c2d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f689c151680 0x7f689c143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.606+0000 7f68a0c2d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f689c151680 0x7f689c143970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43736/0 (socket says 172.21.15.72:43736) 2023-12-13T00:00:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.606+0000 7f68a0c2d640 1 -- 172.21.15.72:0/4216056129 learned_addr learned my addr 172.21.15.72:0/4216056129 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.606+0000 7f689b7fe640 1 --2- 172.21.15.72:0/4216056129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f689c06f810 0x7f689c143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.607+0000 7f689bfff640 1 --2- 172.21.15.72:0/4216056129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f689c06f3f0 0x7f689c148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:34.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.610+0000 7f68a0c2d640 1 -- 172.21.15.72:0/4216056129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f689c06f3f0 msgr2=0x7f689c148f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:34.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.610+0000 7f68a0c2d640 1 --2- 172.21.15.72:0/4216056129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f689c06f3f0 0x7f689c148f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:34.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.610+0000 7f68a0c2d640 1 -- 172.21.15.72:0/4216056129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f689c06f810 msgr2=0x7f689c143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:34.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.610+0000 7f68a0c2d640 1 --2- 172.21.15.72:0/4216056129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f689c06f810 0x7f689c143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:34.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.610+0000 7f68a0c2d640 1 -- 172.21.15.72:0/4216056129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68900094d0 con 0x7f689c151680 2023-12-13T00:00:34.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.612+0000 7f68a0c2d640 1 --2- 172.21.15.72:0/4216056129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f689c151680 0x7f689c143970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f689400c780 tx=0x7f689400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:34.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.615+0000 7f6898ff9640 1 -- 172.21.15.72:0/4216056129 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894003d80 con 0x7f689c151680 2023-12-13T00:00:34.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.615+0000 7f6898ff9640 1 -- 172.21.15.72:0/4216056129 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689400ce90 con 0x7f689c151680 2023-12-13T00:00:34.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.615+0000 7f68a2690640 1 -- 172.21.15.72:0/4216056129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689c0cc380 con 0x7f689c151680 2023-12-13T00:00:34.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.615+0000 7f6898ff9640 1 -- 172.21.15.72:0/4216056129 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68940052b0 con 0x7f689c151680 2023-12-13T00:00:34.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.616+0000 7f68a2690640 1 -- 172.21.15.72:0/4216056129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689c14a750 con 0x7f689c151680 2023-12-13T00:00:34.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.616+0000 7f68a2690640 1 -- 172.21.15.72:0/4216056129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689c14ac30 con 0x7f689c151680 2023-12-13T00:00:34.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.638+0000 7f6898ff9640 1 -- 172.21.15.72:0/4216056129 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6894005410 con 0x7f689c151680 2023-12-13T00:00:34.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.638+0000 7f6898ff9640 1 --2- 172.21.15.72:0/4216056129 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f688806b240 0x7f688806d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:34.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.638+0000 7f689bfff640 1 --2- 172.21.15.72:0/4216056129 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f688806b240 0x7f688806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:34.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.639+0000 7f689bfff640 1 --2- 172.21.15.72:0/4216056129 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f688806b240 0x7f688806d700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f688c0098e0 tx=0x7f688c009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:34.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.879+0000 7f6898ff9640 1 -- 172.21.15.72:0/4216056129 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f68940580c0 con 0x7f689c151680 2023-12-13T00:00:34.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:34.879+0000 7f6898ff9640 1 -- 172.21.15.72:0/4216056129 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6894054400 con 0x7f689c151680 2023-12-13T00:00:35.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.050+0000 7f68a2690640 1 -- 172.21.15.72:0/4216056129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f689c073dc0 con 0x7f689c151680 2023-12-13T00:00:35.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.556+0000 7f6898ff9640 1 -- 172.21.15.72:0/4216056129 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6894017020 con 0x7f689c151680 2023-12-13T00:00:35.556 INFO:teuthology.orchestra.run.smithi072.stderr:set pool 4 allow_ec_overwrites to true 2023-12-13T00:00:35.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.558+0000 7f68a2690640 1 -- 172.21.15.72:0/4216056129 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f688806b240 msgr2=0x7f688806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:35.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.558+0000 7f68a2690640 1 --2- 172.21.15.72:0/4216056129 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f688806b240 0x7f688806d700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f688c0098e0 tx=0x7f688c009060 comp rx=0 tx=0).stop 2023-12-13T00:00:35.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.558+0000 7f68a2690640 1 -- 172.21.15.72:0/4216056129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f689c151680 msgr2=0x7f689c143970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:35.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.558+0000 7f68a2690640 1 --2- 172.21.15.72:0/4216056129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f689c151680 0x7f689c143970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f689400c780 tx=0x7f689400cc40 comp rx=0 tx=0).stop 2023-12-13T00:00:35.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.558+0000 7f68a2690640 1 -- 172.21.15.72:0/4216056129 shutdown_connections 2023-12-13T00:00:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.558+0000 7f68a2690640 1 --2- 172.21.15.72:0/4216056129 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f688806b240 0x7f688806d700 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.558+0000 7f68a2690640 1 --2- 172.21.15.72:0/4216056129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f689c151680 0x7f689c143970 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.558+0000 7f68a2690640 1 --2- 172.21.15.72:0/4216056129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f689c06f810 0x7f689c143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.558+0000 7f68a2690640 1 --2- 172.21.15.72:0/4216056129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f689c06f3f0 0x7f689c148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.558+0000 7f68a2690640 1 -- 172.21.15.72:0/4216056129 >> 172.21.15.72:0/4216056129 conn(0x7f689c0707f0 msgr2=0x7f689c0ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.558+0000 7f68a2690640 1 -- 172.21.15.72:0/4216056129 shutdown_connections 2023-12-13T00:00:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.558+0000 7f68a2690640 1 -- 172.21.15.72:0/4216056129 wait complete. 2023-12-13T00:00:35.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-13T00:00:35.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.688+0000 7fb1c54e0640 1 Processor -- start 2023-12-13T00:00:35.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.688+0000 7fb1c54e0640 1 -- start start 2023-12-13T00:00:35.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.689+0000 7fb1c54e0640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb1c0151220 0x7fb1c0157e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:35.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.689+0000 7fb1c54e0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb1c015a880 0x7fb1c00c5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:35.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.689+0000 7fb1c54e0640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c015ac90 con 0x7fb1c006aeb0 2023-12-13T00:00:35.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.689+0000 7fb1c54e0640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c0072220 con 0x7fb1c015a880 2023-12-13T00:00:35.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.689+0000 7fb1c54e0640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c00c2df0 con 0x7fb1c0151220 2023-12-13T00:00:35.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.690+0000 7fb1beffd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb1c0151220 0x7fb1c0157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:35.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.690+0000 7fb1beffd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb1c0151220 0x7fb1c0157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:33272/0 (socket says 172.21.15.72:33272) 2023-12-13T00:00:35.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.690+0000 7fb1beffd640 1 -- 172.21.15.72:0/1277200586 learned_addr learned my addr 172.21.15.72:0/1277200586 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:35.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.692+0000 7fb1beffd640 1 -- 172.21.15.72:0/1277200586 >> v2:172.21.15.72:3300/0 conn(0x7fb1c015a880 msgr2=0x7fb1c00c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:35.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.692+0000 7fb1beffd640 1 --2- 172.21.15.72:0/1277200586 >> v2:172.21.15.72:3300/0 conn(0x7fb1c015a880 0x7fb1c00c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:35.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.692+0000 7fb1beffd640 1 -- 172.21.15.72:0/1277200586 >> v1:172.21.15.72:6789/0 conn(0x7fb1c006aeb0 legacy=0x7fb1c0071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:35.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.692+0000 7fb1beffd640 1 -- 172.21.15.72:0/1277200586 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c00729d0 con 0x7fb1c0151220 2023-12-13T00:00:35.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.694+0000 7fb1beffd640 1 --2- 172.21.15.72:0/1277200586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c0151220 0x7fb1c0157e80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00c5ec0 tx=0x7fb1b802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d4871dec936c99f server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:35.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.697+0000 7fb1bdffb640 1 -- 172.21.15.72:0/1277200586 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8030860 con 0x7fb1c0151220 2023-12-13T00:00:35.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.697+0000 7fb1bdffb640 1 -- 172.21.15.72:0/1277200586 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b80309c0 con 0x7fb1c0151220 2023-12-13T00:00:35.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.697+0000 7fb1bdffb640 1 -- 172.21.15.72:0/1277200586 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8030d50 con 0x7fb1c0151220 2023-12-13T00:00:35.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.698+0000 7fb1c54e0640 1 -- 172.21.15.72:0/1277200586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c0151220 msgr2=0x7fb1c0157e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:35.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.698+0000 7fb1c54e0640 1 --2- 172.21.15.72:0/1277200586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c0151220 0x7fb1c0157e80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00c5ec0 tx=0x7fb1b802b9a0 comp rx=0 tx=0).stop 2023-12-13T00:00:35.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.698+0000 7fb1c54e0640 1 -- 172.21.15.72:0/1277200586 shutdown_connections 2023-12-13T00:00:35.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.698+0000 7fb1c54e0640 1 --2- 172.21.15.72:0/1277200586 >> v2:172.21.15.72:3300/0 conn(0x7fb1c015a880 0x7fb1c00c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:35.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.698+0000 7fb1c54e0640 1 --2- 172.21.15.72:0/1277200586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c0151220 0x7fb1c0157e80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:35.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.698+0000 7fb1c54e0640 1 -- 172.21.15.72:0/1277200586 >> 172.21.15.72:0/1277200586 conn(0x7fb1c006b5c0 msgr2=0x7fb1c006b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:35.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.698+0000 7fb1c54e0640 1 -- 172.21.15.72:0/1277200586 shutdown_connections 2023-12-13T00:00:35.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.698+0000 7fb1c54e0640 1 -- 172.21.15.72:0/1277200586 wait complete. 2023-12-13T00:00:35.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.700+0000 7fb1c54e0640 1 Processor -- start 2023-12-13T00:00:35.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.700+0000 7fb1c54e0640 1 -- start start 2023-12-13T00:00:35.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.700+0000 7fb1c54e0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c006aeb0 0x7fb1c014c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:35.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.700+0000 7fb1c54e0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c0151220 0x7fb1c014fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:35.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.700+0000 7fb1c54e0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1c015a880 0x7fb1c01f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:35.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.700+0000 7fb1c54e0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00cb140 con 0x7fb1c015a880 2023-12-13T00:00:35.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.700+0000 7fb1c54e0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c0150190 con 0x7fb1c0151220 2023-12-13T00:00:35.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.700+0000 7fb1c54e0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c0150450 con 0x7fb1c006aeb0 2023-12-13T00:00:35.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.701+0000 7fb1beffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c006aeb0 0x7fb1c014c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:35.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.701+0000 7fb1beffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c006aeb0 0x7fb1c014c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:38796/0 (socket says 172.21.15.72:38796) 2023-12-13T00:00:35.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.701+0000 7fb1beffd640 1 -- 172.21.15.72:0/344858969 learned_addr learned my addr 172.21.15.72:0/344858969 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:35.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.704+0000 7fb1be7fc640 1 --2- 172.21.15.72:0/344858969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c0151220 0x7fb1c014fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:35.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.705+0000 7fb1beffd640 1 -- 172.21.15.72:0/344858969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c0151220 msgr2=0x7fb1c014fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:35.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.705+0000 7fb1beffd640 1 --2- 172.21.15.72:0/344858969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c0151220 0x7fb1c014fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:35.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.705+0000 7fb1beffd640 1 -- 172.21.15.72:0/344858969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1c015a880 msgr2=0x7fb1c01f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:35.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.705+0000 7fb1beffd640 1 --2- 172.21.15.72:0/344858969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1c015a880 0x7fb1c01f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:35.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.705+0000 7fb1beffd640 1 -- 172.21.15.72:0/344858969 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b80094d0 con 0x7fb1c006aeb0 2023-12-13T00:00:35.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.707+0000 7fb1beffd640 1 --2- 172.21.15.72:0/344858969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c006aeb0 0x7fb1c014c660 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8000c00 tx=0x7fb1b8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:35.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.709+0000 7fb1a77fe640 1 -- 172.21.15.72:0/344858969 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8039d40 con 0x7fb1c006aeb0 2023-12-13T00:00:35.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.709+0000 7fb1c54e0640 1 -- 172.21.15.72:0/344858969 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c014bb80 con 0x7fb1c006aeb0 2023-12-13T00:00:35.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.709+0000 7fb1c54e0640 1 -- 172.21.15.72:0/344858969 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c014c140 con 0x7fb1c006aeb0 2023-12-13T00:00:35.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.710+0000 7fb1c54e0640 1 -- 172.21.15.72:0/344858969 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c014c380 con 0x7fb1c006aeb0 2023-12-13T00:00:35.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.711+0000 7fb1a77fe640 1 -- 172.21.15.72:0/344858969 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b804d460 con 0x7fb1c006aeb0 2023-12-13T00:00:35.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.711+0000 7fb1a77fe640 1 -- 172.21.15.72:0/344858969 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8039ea0 con 0x7fb1c006aeb0 2023-12-13T00:00:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.954+0000 7fb1a77fe640 1 -- 172.21.15.72:0/344858969 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb1b804d7d0 con 0x7fb1c006aeb0 2023-12-13T00:00:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.954+0000 7fb1a77fe640 1 --2- 172.21.15.72:0/344858969 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb1ac06b1c0 0x7fb1ac06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.954+0000 7fb1be7fc640 1 --2- 172.21.15.72:0/344858969 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb1ac06b1c0 0x7fb1ac06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.954+0000 7fb1be7fc640 1 --2- 172.21.15.72:0/344858969 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb1ac06b1c0 0x7fb1ac06d680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00c92c0 tx=0x7fb1b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:35.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.957+0000 7fb1a77fe640 1 -- 172.21.15.72:0/344858969 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fb1b803e070 con 0x7fb1c006aeb0 2023-12-13T00:00:35.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:35.969+0000 7fb1a77fe640 1 -- 172.21.15.72:0/344858969 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb1b8078490 con 0x7fb1c006aeb0 2023-12-13T00:00:36.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.173+0000 7fb1c54e0640 1 -- 172.21.15.72:0/344858969 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fb1c00b1dd0 con 0x7fb1c006aeb0 2023-12-13T00:00:36.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.776+0000 7fb1a77fe640 1 -- 172.21.15.72:0/344858969 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fb1b80340b0 con 0x7fb1c006aeb0 2023-12-13T00:00:36.776 INFO:teuthology.orchestra.run.smithi072.stderr:added data pool 4 to fsmap 2023-12-13T00:00:36.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.778+0000 7fb1c54e0640 1 -- 172.21.15.72:0/344858969 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb1ac06b1c0 msgr2=0x7fb1ac06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:36.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.778+0000 7fb1c54e0640 1 --2- 172.21.15.72:0/344858969 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb1ac06b1c0 0x7fb1ac06d680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00c92c0 tx=0x7fb1b4009040 comp rx=0 tx=0).stop 2023-12-13T00:00:36.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.778+0000 7fb1c54e0640 1 -- 172.21.15.72:0/344858969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c006aeb0 msgr2=0x7fb1c014c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:36.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.778+0000 7fb1c54e0640 1 --2- 172.21.15.72:0/344858969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c006aeb0 0x7fb1c014c660 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8000c00 tx=0x7fb1b8004730 comp rx=0 tx=0).stop 2023-12-13T00:00:36.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.778+0000 7fb1c54e0640 1 -- 172.21.15.72:0/344858969 shutdown_connections 2023-12-13T00:00:36.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.778+0000 7fb1c54e0640 1 --2- 172.21.15.72:0/344858969 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb1ac06b1c0 0x7fb1ac06d680 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:36.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.778+0000 7fb1c54e0640 1 --2- 172.21.15.72:0/344858969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1c015a880 0x7fb1c01f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:36.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.778+0000 7fb1c54e0640 1 --2- 172.21.15.72:0/344858969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c0151220 0x7fb1c014fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:36.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.778+0000 7fb1c54e0640 1 --2- 172.21.15.72:0/344858969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c006aeb0 0x7fb1c014c660 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:36.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.778+0000 7fb1c54e0640 1 -- 172.21.15.72:0/344858969 >> 172.21.15.72:0/344858969 conn(0x7fb1c006b5c0 msgr2=0x7fb1c0073530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:36.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.778+0000 7fb1c54e0640 1 -- 172.21.15.72:0/344858969 shutdown_connections 2023-12-13T00:00:36.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.778+0000 7fb1c54e0640 1 -- 172.21.15.72:0/344858969 wait complete. 2023-12-13T00:00:36.788 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T00:00:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.888+0000 7f5ddd4b4640 1 Processor -- start 2023-12-13T00:00:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.888+0000 7f5ddd4b4640 1 -- start start 2023-12-13T00:00:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.889+0000 7f5ddd4b4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dd8153730 0x7f5dd806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.889+0000 7f5ddd4b4640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd806f090 con 0x7f5dd80c91d0 2023-12-13T00:00:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.889+0000 7f5ddd4b4640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd8153b10 con 0x7f5dd815a0c0 2023-12-13T00:00:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.889+0000 7f5ddd4b4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd80c38f0 con 0x7f5dd8153730 2023-12-13T00:00:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.890+0000 7f5dcffff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5dd80c91d0 0x7f5dd80c2b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52352/0 (socket says 172.21.15.72:52352) 2023-12-13T00:00:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.890+0000 7f5dcffff640 1 -- 172.21.15.72:0/1677634911 learned_addr learned my addr 172.21.15.72:0/1677634911 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:36.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.891+0000 7f5dd6ffd640 1 --2- 172.21.15.72:0/1677634911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dd8153730 0x7f5dd806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:36.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.893+0000 7f5dd67fc640 1 -- 172.21.15.72:0/1677634911 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367973077 0 0) 0x7f5dd806f090 con 0x7f5dd80c91d0 2023-12-13T00:00:36.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.893+0000 7f5dd67fc640 1 -- 172.21.15.72:0/1677634911 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dc4003520 con 0x7f5dd80c91d0 2023-12-13T00:00:36.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.894+0000 7f5dd67fc640 1 -- 172.21.15.72:0/1677634911 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133300184 0 0) 0x7f5dd8153b10 con 0x7f5dd815a0c0 2023-12-13T00:00:36.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.894+0000 7f5dd67fc640 1 -- 172.21.15.72:0/1677634911 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dd806f090 con 0x7f5dd815a0c0 2023-12-13T00:00:36.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.895+0000 7f5dd6ffd640 1 -- 172.21.15.72:0/1677634911 >> v1:172.21.15.176:6789/0 conn(0x7f5dd815a0c0 legacy=0x7f5dd80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:36.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.895+0000 7f5dd6ffd640 1 -- 172.21.15.72:0/1677634911 >> v1:172.21.15.72:6789/0 conn(0x7f5dd80c91d0 legacy=0x7f5dd80c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:36.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.895+0000 7f5dd6ffd640 1 -- 172.21.15.72:0/1677634911 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd80c3330 con 0x7f5dd8153730 2023-12-13T00:00:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.897+0000 7f5dd6ffd640 1 --2- 172.21.15.72:0/1677634911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dd8153730 0x7f5dd806eb50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80097d0 tx=0x7f5dc802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d10a7232c59434b server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:36.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.901+0000 7f5dd67fc640 1 -- 172.21.15.72:0/1677634911 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8030880 con 0x7f5dd8153730 2023-12-13T00:00:36.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.901+0000 7f5dd67fc640 1 -- 172.21.15.72:0/1677634911 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc80309e0 con 0x7f5dd8153730 2023-12-13T00:00:36.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.901+0000 7f5dd67fc640 1 -- 172.21.15.72:0/1677634911 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8030d70 con 0x7f5dd8153730 2023-12-13T00:00:36.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.901+0000 7f5ddd4b4640 1 -- 172.21.15.72:0/1677634911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dd8153730 msgr2=0x7f5dd806eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:36.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.901+0000 7f5ddd4b4640 1 --2- 172.21.15.72:0/1677634911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dd8153730 0x7f5dd806eb50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80097d0 tx=0x7f5dc802b9c0 comp rx=0 tx=0).stop 2023-12-13T00:00:36.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.901+0000 7f5ddd4b4640 1 -- 172.21.15.72:0/1677634911 shutdown_connections 2023-12-13T00:00:36.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.901+0000 7f5ddd4b4640 1 --2- 172.21.15.72:0/1677634911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dd8153730 0x7f5dd806eb50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:36.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.901+0000 7f5ddd4b4640 1 -- 172.21.15.72:0/1677634911 >> 172.21.15.72:0/1677634911 conn(0x7f5dd80707f0 msgr2=0x7f5dd8070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:36.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.902+0000 7f5ddd4b4640 1 -- 172.21.15.72:0/1677634911 shutdown_connections 2023-12-13T00:00:36.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.902+0000 7f5ddd4b4640 1 -- 172.21.15.72:0/1677634911 wait complete. 2023-12-13T00:00:36.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.903+0000 7f5ddd4b4640 1 Processor -- start 2023-12-13T00:00:36.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.903+0000 7f5ddd4b4640 1 -- start start 2023-12-13T00:00:36.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.903+0000 7f5ddd4b4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dd80c91d0 0x7f5dd80cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:36.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.903+0000 7f5ddd4b4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8153730 0x7f5dd81e58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:36.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.903+0000 7f5ddd4b4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dd815a0c0 0x7f5dd81f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:36.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.903+0000 7f5ddd4b4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd80cb150 con 0x7f5dd8153730 2023-12-13T00:00:36.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.903+0000 7f5ddd4b4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd80cbab0 con 0x7f5dd815a0c0 2023-12-13T00:00:36.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.903+0000 7f5ddd4b4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd80caad0 con 0x7f5dd80c91d0 2023-12-13T00:00:36.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.904+0000 7f5dcffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8153730 0x7f5dd81e58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:36.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.904+0000 7f5dcffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8153730 0x7f5dd81e58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59864/0 (socket says 172.21.15.72:59864) 2023-12-13T00:00:36.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.904+0000 7f5dcffff640 1 -- 172.21.15.72:0/3137342745 learned_addr learned my addr 172.21.15.72:0/3137342745 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:36.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.904+0000 7f5dd77fe640 1 --2- 172.21.15.72:0/3137342745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dd815a0c0 0x7f5dd81f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:36.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.904+0000 7f5dd6ffd640 1 --2- 172.21.15.72:0/3137342745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dd80c91d0 0x7f5dd80cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:36.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.907+0000 7f5dcffff640 1 -- 172.21.15.72:0/3137342745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dd80c91d0 msgr2=0x7f5dd80cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:36.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.907+0000 7f5dcffff640 1 --2- 172.21.15.72:0/3137342745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dd80c91d0 0x7f5dd80cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:36.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.907+0000 7f5dcffff640 1 -- 172.21.15.72:0/3137342745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dd815a0c0 msgr2=0x7f5dd81f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:36.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.907+0000 7f5dcffff640 1 --2- 172.21.15.72:0/3137342745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dd815a0c0 0x7f5dd81f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:36.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.907+0000 7f5dcffff640 1 -- 172.21.15.72:0/3137342745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc8009400 con 0x7f5dd8153730 2023-12-13T00:00:36.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.909+0000 7f5dcffff640 1 --2- 172.21.15.72:0/3137342745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8153730 0x7f5dd81e58f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000c410 tx=0x7f5dc000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:36.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.913+0000 7f5dcf7fe640 1 -- 172.21.15.72:0/3137342745 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0005ce0 con 0x7f5dd8153730 2023-12-13T00:00:36.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.913+0000 7f5dcf7fe640 1 -- 172.21.15.72:0/3137342745 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc0005e40 con 0x7f5dd8153730 2023-12-13T00:00:36.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.913+0000 7f5dcf7fe640 1 -- 172.21.15.72:0/3137342745 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00072f0 con 0x7f5dd8153730 2023-12-13T00:00:36.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.913+0000 7f5ddd4b4640 1 -- 172.21.15.72:0/3137342745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd81efc60 con 0x7f5dd8153730 2023-12-13T00:00:36.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.913+0000 7f5ddd4b4640 1 -- 172.21.15.72:0/3137342745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd80cc670 con 0x7f5dd8153730 2023-12-13T00:00:36.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.914+0000 7f5ddd4b4640 1 -- 172.21.15.72:0/3137342745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd8073dc0 con 0x7f5dd8153730 2023-12-13T00:00:36.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.932+0000 7f5dcf7fe640 1 -- 172.21.15.72:0/3137342745 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5dc0007450 con 0x7f5dd8153730 2023-12-13T00:00:36.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.932+0000 7f5dcf7fe640 1 --2- 172.21.15.72:0/3137342745 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5db806b210 0x7f5db806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:36.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.933+0000 7f5dd6ffd640 1 --2- 172.21.15.72:0/3137342745 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5db806b210 0x7f5db806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:36.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:36.933+0000 7f5dd6ffd640 1 --2- 172.21.15.72:0/3137342745 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5db806b210 0x7f5db806d6d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8036000 tx=0x7f5dc8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:37.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.169+0000 7f5dcf7fe640 1 -- 172.21.15.72:0/3137342745 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5dc0057fa0 con 0x7f5dd8153730 2023-12-13T00:00:37.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.170+0000 7f5dcf7fe640 1 -- 172.21.15.72:0/3137342745 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5dc00542e0 con 0x7f5dd8153730 2023-12-13T00:00:37.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.375+0000 7f5ddd4b4640 1 -- 172.21.15.72:0/3137342745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5dd80cd000 con 0x7f5dd8153730 2023-12-13T00:00:37.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.403+0000 7f5dcf7fe640 1 -- 172.21.15.72:0/3137342745 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6495 (secure 0 0 0) 0x7f5dc0057900 con 0x7f5dd8153730 2023-12-13T00:00:37.404 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:00:37.405 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/541435124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":541435124},{"type":"v1","addr":"172.21.15.72:6837","nonce":541435124}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4190692049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4190692049},{"type":"v1","addr":"172.21.15.176:6835","nonce":4190692049}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1780646034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1780646034},{"type":"v1","addr":"172.21.15.176:6833","nonce":1780646034}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6839/3632161953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":3632161953},{"type":"v1","addr":"172.21.15.72:6839","nonce":3632161953}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3954648997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3954648997},{"type":"v1","addr":"172.21.15.72:6835","nonce":3954648997}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-13T00:00:30.722325+0000","modified":"2023-12-13T00:00:36.196537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6837/3968747607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":3968747607},{"type":"v1","addr":"172.21.15.176:6837","nonce":3968747607}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-13T00:00:37.405 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-12-13T00:00:37.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.406+0000 7f5ddd4b4640 1 -- 172.21.15.72:0/3137342745 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5db806b210 msgr2=0x7f5db806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:37.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.406+0000 7f5ddd4b4640 1 --2- 172.21.15.72:0/3137342745 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5db806b210 0x7f5db806d6d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8036000 tx=0x7f5dc8008030 comp rx=0 tx=0).stop 2023-12-13T00:00:37.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.406+0000 7f5ddd4b4640 1 -- 172.21.15.72:0/3137342745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8153730 msgr2=0x7f5dd81e58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:37.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.406+0000 7f5ddd4b4640 1 --2- 172.21.15.72:0/3137342745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8153730 0x7f5dd81e58f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000c410 tx=0x7f5dc000c8d0 comp rx=0 tx=0).stop 2023-12-13T00:00:37.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.406+0000 7f5ddd4b4640 1 -- 172.21.15.72:0/3137342745 shutdown_connections 2023-12-13T00:00:37.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.406+0000 7f5ddd4b4640 1 --2- 172.21.15.72:0/3137342745 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5db806b210 0x7f5db806d6d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:37.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.406+0000 7f5ddd4b4640 1 --2- 172.21.15.72:0/3137342745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dd815a0c0 0x7f5dd81f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:37.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.406+0000 7f5ddd4b4640 1 --2- 172.21.15.72:0/3137342745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8153730 0x7f5dd81e58f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:37.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.406+0000 7f5ddd4b4640 1 --2- 172.21.15.72:0/3137342745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dd80c91d0 0x7f5dd80cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:37.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.406+0000 7f5ddd4b4640 1 -- 172.21.15.72:0/3137342745 >> 172.21.15.72:0/3137342745 conn(0x7f5dd80707f0 msgr2=0x7f5dd8157ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:37.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.406+0000 7f5ddd4b4640 1 -- 172.21.15.72:0/3137342745 shutdown_connections 2023-12-13T00:00:37.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.406+0000 7f5ddd4b4640 1 -- 172.21.15.72:0/3137342745 wait complete. 2023-12-13T00:00:37.417 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:00:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.517+0000 7fd1ed153640 1 Processor -- start 2023-12-13T00:00:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.517+0000 7fd1ed153640 1 -- start start 2023-12-13T00:00:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.518+0000 7fd1ed153640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1e806efa0 0x7fd1e8159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.518+0000 7fd1ed153640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e815a340 con 0x7fd1e80c1fb0 2023-12-13T00:00:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.518+0000 7fd1ed153640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e806c270 con 0x7fd1e8153330 2023-12-13T00:00:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.518+0000 7fd1ed153640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e806f3c0 con 0x7fd1e806efa0 2023-12-13T00:00:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.518+0000 7fd1e759e640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd1e80c1fb0 0x7fd1e80c23e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52364/0 (socket says 172.21.15.72:52364) 2023-12-13T00:00:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.518+0000 7fd1e759e640 1 -- 172.21.15.72:0/2549797753 learned_addr learned my addr 172.21.15.72:0/2549797753 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.519+0000 7fd1e659c640 1 --2- 172.21.15.72:0/2549797753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1e806efa0 0x7fd1e8159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.521+0000 7fd1e5d9b640 1 -- 172.21.15.72:0/2549797753 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063834907 0 0) 0x7fd1e815a340 con 0x7fd1e80c1fb0 2023-12-13T00:00:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.521+0000 7fd1e5d9b640 1 -- 172.21.15.72:0/2549797753 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1d0003520 con 0x7fd1e80c1fb0 2023-12-13T00:00:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.521+0000 7fd1e5d9b640 1 -- 172.21.15.72:0/2549797753 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29173166 0 0) 0x7fd1e806c270 con 0x7fd1e8153330 2023-12-13T00:00:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.521+0000 7fd1e5d9b640 1 -- 172.21.15.72:0/2549797753 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1e815a340 con 0x7fd1e8153330 2023-12-13T00:00:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.521+0000 7fd1e659c640 1 -- 172.21.15.72:0/2549797753 >> v1:172.21.15.176:6789/0 conn(0x7fd1e8153330 legacy=0x7fd1e80cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.521+0000 7fd1e659c640 1 -- 172.21.15.72:0/2549797753 >> v1:172.21.15.72:6789/0 conn(0x7fd1e80c1fb0 legacy=0x7fd1e80c23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:37.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.521+0000 7fd1e659c640 1 -- 172.21.15.72:0/2549797753 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e806f630 con 0x7fd1e806efa0 2023-12-13T00:00:37.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.523+0000 7fd1e659c640 1 --2- 172.21.15.72:0/2549797753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1e806efa0 0x7fd1e8159e00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0097d0 tx=0x7fd1dc02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5685ff49945fc718 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:37.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.527+0000 7fd1e5d9b640 1 -- 172.21.15.72:0/2549797753 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc031890 con 0x7fd1e806efa0 2023-12-13T00:00:37.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.527+0000 7fd1e5d9b640 1 -- 172.21.15.72:0/2549797753 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc0319f0 con 0x7fd1e806efa0 2023-12-13T00:00:37.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.527+0000 7fd1e5d9b640 1 -- 172.21.15.72:0/2549797753 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc031d80 con 0x7fd1e806efa0 2023-12-13T00:00:37.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.528+0000 7fd1ed153640 1 -- 172.21.15.72:0/2549797753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1e806efa0 msgr2=0x7fd1e8159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:37.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.528+0000 7fd1ed153640 1 --2- 172.21.15.72:0/2549797753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1e806efa0 0x7fd1e8159e00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0097d0 tx=0x7fd1dc02b930 comp rx=0 tx=0).stop 2023-12-13T00:00:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.528+0000 7fd1ed153640 1 -- 172.21.15.72:0/2549797753 shutdown_connections 2023-12-13T00:00:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.528+0000 7fd1ed153640 1 --2- 172.21.15.72:0/2549797753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1e806efa0 0x7fd1e8159e00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.528+0000 7fd1ed153640 1 -- 172.21.15.72:0/2549797753 >> 172.21.15.72:0/2549797753 conn(0x7fd1e8070990 msgr2=0x7fd1e8070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.528+0000 7fd1ed153640 1 -- 172.21.15.72:0/2549797753 shutdown_connections 2023-12-13T00:00:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.528+0000 7fd1ed153640 1 -- 172.21.15.72:0/2549797753 wait complete. 2023-12-13T00:00:37.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.529+0000 7fd1ed153640 1 Processor -- start 2023-12-13T00:00:37.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.529+0000 7fd1ed153640 1 -- start start 2023-12-13T00:00:37.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.530+0000 7fd1ed153640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e806efa0 0x7fd1e81ef860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:37.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.530+0000 7fd1ed153640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1e80c1fb0 0x7fd1e81ecc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:37.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.530+0000 7fd1ed153640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1e8153330 0x7fd1e8145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:37.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.530+0000 7fd1ed153640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e815d540 con 0x7fd1e806efa0 2023-12-13T00:00:37.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.530+0000 7fd1ed153640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e815d260 con 0x7fd1e8153330 2023-12-13T00:00:37.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.530+0000 7fd1ed153640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e81eedc0 con 0x7fd1e80c1fb0 2023-12-13T00:00:37.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.530+0000 7fd1e6d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e806efa0 0x7fd1e81ef860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:37.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.531+0000 7fd1e759e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1e8153330 0x7fd1e8145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:37.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.531+0000 7fd1e6d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e806efa0 0x7fd1e81ef860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59876/0 (socket says 172.21.15.72:59876) 2023-12-13T00:00:37.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.531+0000 7fd1e659c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1e80c1fb0 0x7fd1e81ecc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:37.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.531+0000 7fd1e6d9d640 1 -- 172.21.15.72:0/855771152 learned_addr learned my addr 172.21.15.72:0/855771152 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:37.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.534+0000 7fd1e6d9d640 1 -- 172.21.15.72:0/855771152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1e80c1fb0 msgr2=0x7fd1e81ecc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:37.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.534+0000 7fd1e6d9d640 1 --2- 172.21.15.72:0/855771152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1e80c1fb0 0x7fd1e81ecc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:37.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.534+0000 7fd1e6d9d640 1 -- 172.21.15.72:0/855771152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1e8153330 msgr2=0x7fd1e8145f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:37.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.534+0000 7fd1e6d9d640 1 --2- 172.21.15.72:0/855771152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1e8153330 0x7fd1e8145f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:37.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.534+0000 7fd1e6d9d640 1 -- 172.21.15.72:0/855771152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc009400 con 0x7fd1e806efa0 2023-12-13T00:00:37.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.536+0000 7fd1e6d9d640 1 --2- 172.21.15.72:0/855771152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e806efa0 0x7fd1e81ef860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800c7a0 tx=0x7fd1d800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.540+0000 7fd1cf7fe640 1 -- 172.21.15.72:0/855771152 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8003b70 con 0x7fd1e806efa0 2023-12-13T00:00:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.540+0000 7fd1cf7fe640 1 -- 172.21.15.72:0/855771152 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d8003cd0 con 0x7fd1e806efa0 2023-12-13T00:00:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.540+0000 7fd1cf7fe640 1 -- 172.21.15.72:0/855771152 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800aa90 con 0x7fd1e806efa0 2023-12-13T00:00:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.540+0000 7fd1ed153640 1 -- 172.21.15.72:0/855771152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e81f2dd0 con 0x7fd1e806efa0 2023-12-13T00:00:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.540+0000 7fd1ed153640 1 -- 172.21.15.72:0/855771152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e81ef340 con 0x7fd1e806efa0 2023-12-13T00:00:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.541+0000 7fd1ed153640 1 -- 172.21.15.72:0/855771152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e8067470 con 0x7fd1e806efa0 2023-12-13T00:00:37.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.560+0000 7fd1cf7fe640 1 -- 172.21.15.72:0/855771152 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd1d800abf0 con 0x7fd1e806efa0 2023-12-13T00:00:37.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.561+0000 7fd1cf7fe640 1 --2- 172.21.15.72:0/855771152 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd1d406b1c0 0x7fd1d406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:37.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.561+0000 7fd1e659c640 1 --2- 172.21.15.72:0/855771152 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd1d406b1c0 0x7fd1d406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:37.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.561+0000 7fd1e659c640 1 --2- 172.21.15.72:0/855771152 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd1d406b1c0 0x7fd1d406d680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc036000 tx=0x7fd1dc03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:37.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.566+0000 7fd1cf7fe640 1 -- 172.21.15.72:0/855771152 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd1d8058d10 con 0x7fd1e806efa0 2023-12-13T00:00:37.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.804+0000 7fd1cf7fe640 1 -- 172.21.15.72:0/855771152 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd1d8055050 con 0x7fd1e806efa0 2023-12-13T00:00:37.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:37.981+0000 7fd1ed153640 1 -- 172.21.15.72:0/855771152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1e81f30b0 con 0x7fd1e806efa0 2023-12-13T00:00:38.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.029+0000 7fd1cf7fe640 1 -- 172.21.15.72:0/855771152 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18327 (secure 0 0 0) 0x7fd1d8058670 con 0x7fd1e806efa0 2023-12-13T00:00:38.030 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:00:38.031 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:00:36.191864+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T00:00:27.701252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T00:00:29.324356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T00:00:33.363089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:00:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.031+0000 7fd1ed153640 1 -- 172.21.15.72:0/855771152 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd1d406b1c0 msgr2=0x7fd1d406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.031+0000 7fd1ed153640 1 --2- 172.21.15.72:0/855771152 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd1d406b1c0 0x7fd1d406d680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc036000 tx=0x7fd1dc03c040 comp rx=0 tx=0).stop 2023-12-13T00:00:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.031+0000 7fd1ed153640 1 -- 172.21.15.72:0/855771152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e806efa0 msgr2=0x7fd1e81ef860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.031+0000 7fd1ed153640 1 --2- 172.21.15.72:0/855771152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e806efa0 0x7fd1e81ef860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800c7a0 tx=0x7fd1d800cc60 comp rx=0 tx=0).stop 2023-12-13T00:00:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.031+0000 7fd1ed153640 1 -- 172.21.15.72:0/855771152 shutdown_connections 2023-12-13T00:00:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.031+0000 7fd1ed153640 1 --2- 172.21.15.72:0/855771152 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd1d406b1c0 0x7fd1d406d680 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.031+0000 7fd1ed153640 1 --2- 172.21.15.72:0/855771152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1e8153330 0x7fd1e8145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.031+0000 7fd1ed153640 1 --2- 172.21.15.72:0/855771152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1e80c1fb0 0x7fd1e81ecc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.031+0000 7fd1ed153640 1 --2- 172.21.15.72:0/855771152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e806efa0 0x7fd1e81ef860 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.031+0000 7fd1ed153640 1 -- 172.21.15.72:0/855771152 >> 172.21.15.72:0/855771152 conn(0x7fd1e8070990 msgr2=0x7fd1e8157bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.031+0000 7fd1ed153640 1 -- 172.21.15.72:0/855771152 shutdown_connections 2023-12-13T00:00:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.031+0000 7fd1ed153640 1 -- 172.21.15.72:0/855771152 wait complete. 2023-12-13T00:00:38.043 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:00:38.074 INFO:tasks.ceph.mds.f.smithi176.stderr:2023-12-13T00:00:38.069+0000 f5b6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-13T00:00:38.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.142+0000 7f48e36e5640 1 Processor -- start 2023-12-13T00:00:38.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.143+0000 7f48e36e5640 1 -- start start 2023-12-13T00:00:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.143+0000 7f48e36e5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48dc0cb7a0 0x7f48dc0c9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.143+0000 7f48e36e5640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48dc0cfa10 con 0x7f48dc0cf630 2023-12-13T00:00:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.143+0000 7f48e36e5640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48dc15a390 con 0x7f48dc0cbba0 2023-12-13T00:00:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.143+0000 7f48e36e5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc0cc130 con 0x7f48dc0cb7a0 2023-12-13T00:00:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.144+0000 7f48e1c82640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f48dc0cbba0 0x7f48dc0ce460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:54854/0 (socket says 172.21.15.72:54854) 2023-12-13T00:00:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.144+0000 7f48e1c82640 1 -- 172.21.15.72:0/3008060362 learned_addr learned my addr 172.21.15.72:0/3008060362 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.144+0000 7f48e0c80640 1 --2- 172.21.15.72:0/3008060362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48dc0cb7a0 0x7f48dc0c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.147+0000 7f48e0c80640 1 -- 172.21.15.72:0/3008060362 >> v1:172.21.15.176:6789/0 conn(0x7f48dc0cbba0 legacy=0x7f48dc0ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.147+0000 7f48e0c80640 1 -- 172.21.15.72:0/3008060362 >> v1:172.21.15.72:6789/0 conn(0x7f48dc0cf630 legacy=0x7f48dc15d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.147+0000 7f48e0c80640 1 -- 172.21.15.72:0/3008060362 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc159780 con 0x7f48dc0cb7a0 2023-12-13T00:00:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.149+0000 7f48e0c80640 1 --2- 172.21.15.72:0/3008060362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48dc0cb7a0 0x7f48dc0c9580 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0097d0 tx=0x7f48cc02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9344193dea9c6886 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.154+0000 7f48d3fff640 1 -- 172.21.15.72:0/3008060362 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc031890 con 0x7f48dc0cb7a0 2023-12-13T00:00:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.154+0000 7f48d3fff640 1 -- 172.21.15.72:0/3008060362 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48cc0319f0 con 0x7f48dc0cb7a0 2023-12-13T00:00:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.154+0000 7f48d3fff640 1 -- 172.21.15.72:0/3008060362 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc031d80 con 0x7f48dc0cb7a0 2023-12-13T00:00:38.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.155+0000 7f48e36e5640 1 -- 172.21.15.72:0/3008060362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48dc0cb7a0 msgr2=0x7f48dc0c9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:38.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.155+0000 7f48e36e5640 1 --2- 172.21.15.72:0/3008060362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48dc0cb7a0 0x7f48dc0c9580 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0097d0 tx=0x7f48cc02b930 comp rx=0 tx=0).stop 2023-12-13T00:00:38.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.155+0000 7f48e36e5640 1 -- 172.21.15.72:0/3008060362 shutdown_connections 2023-12-13T00:00:38.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.155+0000 7f48e36e5640 1 --2- 172.21.15.72:0/3008060362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48dc0cb7a0 0x7f48dc0c9580 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:38.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.155+0000 7f48e36e5640 1 -- 172.21.15.72:0/3008060362 >> 172.21.15.72:0/3008060362 conn(0x7f48dc060f20 msgr2=0x7f48dc061330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:38.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.155+0000 7f48e36e5640 1 -- 172.21.15.72:0/3008060362 shutdown_connections 2023-12-13T00:00:38.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.155+0000 7f48e36e5640 1 -- 172.21.15.72:0/3008060362 wait complete. 2023-12-13T00:00:38.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.156+0000 7f48e36e5640 1 Processor -- start 2023-12-13T00:00:38.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.156+0000 7f48e36e5640 1 -- start start 2023-12-13T00:00:38.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.157+0000 7f48e36e5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48dc0cb7a0 0x7f48dc15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:38.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.157+0000 7f48e36e5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48dc0cbba0 0x7f48dc0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:38.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.157+0000 7f48e36e5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48dc0cf630 0x7f48dc156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:38.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.157+0000 7f48e36e5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc1f3740 con 0x7f48dc0cf630 2023-12-13T00:00:38.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.157+0000 7f48e36e5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc1ef220 con 0x7f48dc0cb7a0 2023-12-13T00:00:38.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.157+0000 7f48e36e5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc1f01f0 con 0x7f48dc0cbba0 2023-12-13T00:00:38.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.157+0000 7f48e1c82640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48dc0cf630 0x7f48dc156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:38.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.157+0000 7f48e0c80640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48dc0cbba0 0x7f48dc0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:38.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.157+0000 7f48e1481640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48dc0cb7a0 0x7f48dc15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:38.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.158+0000 7f48e1c82640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48dc0cf630 0x7f48dc156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59886/0 (socket says 172.21.15.72:59886) 2023-12-13T00:00:38.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.158+0000 7f48e1c82640 1 -- 172.21.15.72:0/2075061284 learned_addr learned my addr 172.21.15.72:0/2075061284 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:38.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.161+0000 7f48e1c82640 1 -- 172.21.15.72:0/2075061284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48dc0cbba0 msgr2=0x7f48dc0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:38.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.161+0000 7f48e1c82640 1 --2- 172.21.15.72:0/2075061284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48dc0cbba0 0x7f48dc0b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:38.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.161+0000 7f48e1c82640 1 -- 172.21.15.72:0/2075061284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48dc0cb7a0 msgr2=0x7f48dc15bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:38.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.161+0000 7f48e1c82640 1 --2- 172.21.15.72:0/2075061284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48dc0cb7a0 0x7f48dc15bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:38.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.161+0000 7f48e1c82640 1 -- 172.21.15.72:0/2075061284 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc009400 con 0x7f48dc0cf630 2023-12-13T00:00:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.163+0000 7f48e1c82640 1 --2- 172.21.15.72:0/2075061284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48dc0cf630 0x7f48dc156130 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f48d400cbf0 tx=0x7f48d400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:38.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.166+0000 7f48d1ffb640 1 -- 172.21.15.72:0/2075061284 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d400ad40 con 0x7f48dc0cf630 2023-12-13T00:00:38.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.166+0000 7f48d1ffb640 1 -- 172.21.15.72:0/2075061284 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d4012400 con 0x7f48dc0cf630 2023-12-13T00:00:38.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.166+0000 7f48d1ffb640 1 -- 172.21.15.72:0/2075061284 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d400aea0 con 0x7f48dc0cf630 2023-12-13T00:00:38.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.166+0000 7f48e36e5640 1 -- 172.21.15.72:0/2075061284 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48dc1efd60 con 0x7f48dc0cf630 2023-12-13T00:00:38.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.167+0000 7f48e36e5640 1 -- 172.21.15.72:0/2075061284 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48dc1f3460 con 0x7f48dc0cf630 2023-12-13T00:00:38.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.167+0000 7f48e36e5640 1 -- 172.21.15.72:0/2075061284 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48dc1efef0 con 0x7f48dc0cf630 2023-12-13T00:00:38.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.410+0000 7f48d1ffb640 1 -- 172.21.15.72:0/2075061284 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f48d4007070 con 0x7f48dc0cf630 2023-12-13T00:00:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.410+0000 7f48d1ffb640 1 --2- 172.21.15.72:0/2075061284 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f48c006b210 0x7f48c006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.411+0000 7f48e1481640 1 --2- 172.21.15.72:0/2075061284 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f48c006b210 0x7f48c006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.411+0000 7f48e1481640 1 --2- 172.21.15.72:0/2075061284 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f48c006b210 0x7f48c006d6d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f48d8006fd0 tx=0x7f48d8009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:38.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.423+0000 7f48d1ffb640 1 -- 172.21.15.72:0/2075061284 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f48d4058850 con 0x7f48dc0cf630 2023-12-13T00:00:38.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.423+0000 7f48d1ffb640 1 -- 172.21.15.72:0/2075061284 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f48d4054b90 con 0x7f48dc0cf630 2023-12-13T00:00:38.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.593+0000 7f48e36e5640 1 -- 172.21.15.72:0/2075061284 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48dc067470 con 0x7f48dc0cf630 2023-12-13T00:00:38.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.631+0000 7f48d1ffb640 1 -- 172.21.15.72:0/2075061284 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f48d4017090 con 0x7f48dc0cf630 2023-12-13T00:00:38.632 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:00:38.632 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:00:36.191864+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T00:00:27.701252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T00:00:29.324356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T00:00:33.363089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:00:38.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.633+0000 7f48e36e5640 1 -- 172.21.15.72:0/2075061284 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f48c006b210 msgr2=0x7f48c006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:38.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.633+0000 7f48e36e5640 1 --2- 172.21.15.72:0/2075061284 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f48c006b210 0x7f48c006d6d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f48d8006fd0 tx=0x7f48d8009060 comp rx=0 tx=0).stop 2023-12-13T00:00:38.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.633+0000 7f48e36e5640 1 -- 172.21.15.72:0/2075061284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48dc0cf630 msgr2=0x7f48dc156130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:38.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.633+0000 7f48e36e5640 1 --2- 172.21.15.72:0/2075061284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48dc0cf630 0x7f48dc156130 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f48d400cbf0 tx=0x7f48d400a430 comp rx=0 tx=0).stop 2023-12-13T00:00:38.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.633+0000 7f48e36e5640 1 -- 172.21.15.72:0/2075061284 shutdown_connections 2023-12-13T00:00:38.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.633+0000 7f48e36e5640 1 --2- 172.21.15.72:0/2075061284 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f48c006b210 0x7f48c006d6d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:38.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.633+0000 7f48e36e5640 1 --2- 172.21.15.72:0/2075061284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48dc0cf630 0x7f48dc156130 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:38.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.633+0000 7f48e36e5640 1 --2- 172.21.15.72:0/2075061284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48dc0cbba0 0x7f48dc0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:38.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.633+0000 7f48e36e5640 1 --2- 172.21.15.72:0/2075061284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48dc0cb7a0 0x7f48dc15bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:38.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.633+0000 7f48e36e5640 1 -- 172.21.15.72:0/2075061284 >> 172.21.15.72:0/2075061284 conn(0x7f48dc060f20 msgr2=0x7f48dc0c6000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:38.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.633+0000 7f48e36e5640 1 -- 172.21.15.72:0/2075061284 shutdown_connections 2023-12-13T00:00:38.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.633+0000 7f48e36e5640 1 -- 172.21.15.72:0/2075061284 wait complete. 2023-12-13T00:00:38.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T00:00:38.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.758+0000 7fe3a8741640 1 Processor -- start 2023-12-13T00:00:38.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.758+0000 7fe3a8741640 1 -- start start 2023-12-13T00:00:38.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.759+0000 7fe3a8741640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe3a0150530 0x7fe3a00c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:38.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.759+0000 7fe3a8741640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a0150910 con 0x7fe3a00c7180 2023-12-13T00:00:38.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.759+0000 7fe3a8741640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a00c1ec0 con 0x7fe3a01596e0 2023-12-13T00:00:38.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.759+0000 7fe3a8741640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a015a280 con 0x7fe3a0150530 2023-12-13T00:00:38.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.760+0000 7fe3a6cde640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fe3a01596e0 0x7fe3a0159b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:54856/0 (socket says 172.21.15.72:54856) 2023-12-13T00:00:38.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.760+0000 7fe3a6cde640 1 -- 172.21.15.72:0/2176957367 learned_addr learned my addr 172.21.15.72:0/2176957367 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:38.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.760+0000 7fe3a64dd640 1 --2- 172.21.15.72:0/2176957367 >> v2:172.21.15.72:3300/0 conn(0x7fe3a0150530 0x7fe3a00c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:38.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.763+0000 7fe3a54db640 1 -- 172.21.15.72:0/2176957367 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374473406 0 0) 0x7fe3a00c1ec0 con 0x7fe3a01596e0 2023-12-13T00:00:38.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.763+0000 7fe3a54db640 1 -- 172.21.15.72:0/2176957367 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe38c005730 con 0x7fe3a01596e0 2023-12-13T00:00:38.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.763+0000 7fe3a64dd640 1 -- 172.21.15.72:0/2176957367 >> v1:172.21.15.176:6789/0 conn(0x7fe3a01596e0 legacy=0x7fe3a0159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:38.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.763+0000 7fe3a64dd640 1 -- 172.21.15.72:0/2176957367 >> v1:172.21.15.72:6789/0 conn(0x7fe3a00c7180 legacy=0x7fe3a00c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:38.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.763+0000 7fe3a64dd640 1 -- 172.21.15.72:0/2176957367 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a015a4e0 con 0x7fe3a0150530 2023-12-13T00:00:38.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.766+0000 7fe3a64dd640 1 --2- 172.21.15.72:0/2176957367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3a0150530 0x7fe3a00c6c40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0097a0 tx=0x7fe39c02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d1aa615acb8a0d server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:38.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.769+0000 7fe3a54db640 1 -- 172.21.15.72:0/2176957367 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c02f810 con 0x7fe3a0150530 2023-12-13T00:00:38.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.769+0000 7fe3a54db640 1 -- 172.21.15.72:0/2176957367 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c02f970 con 0x7fe3a0150530 2023-12-13T00:00:38.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.770+0000 7fe3a54db640 1 -- 172.21.15.72:0/2176957367 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c02fd00 con 0x7fe3a0150530 2023-12-13T00:00:38.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.770+0000 7fe3a8741640 1 -- 172.21.15.72:0/2176957367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3a0150530 msgr2=0x7fe3a00c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:38.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.770+0000 7fe3a8741640 1 --2- 172.21.15.72:0/2176957367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3a0150530 0x7fe3a00c6c40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0097a0 tx=0x7fe39c02b9f0 comp rx=0 tx=0).stop 2023-12-13T00:00:38.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.770+0000 7fe3a8741640 1 -- 172.21.15.72:0/2176957367 shutdown_connections 2023-12-13T00:00:38.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.770+0000 7fe3a8741640 1 --2- 172.21.15.72:0/2176957367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3a0150530 0x7fe3a00c6c40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:38.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.770+0000 7fe3a8741640 1 -- 172.21.15.72:0/2176957367 >> 172.21.15.72:0/2176957367 conn(0x7fe3a006c5f0 msgr2=0x7fe3a006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:38.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.770+0000 7fe3a8741640 1 -- 172.21.15.72:0/2176957367 shutdown_connections 2023-12-13T00:00:38.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.770+0000 7fe3a8741640 1 -- 172.21.15.72:0/2176957367 wait complete. 2023-12-13T00:00:38.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.772+0000 7fe3a8741640 1 Processor -- start 2023-12-13T00:00:38.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.772+0000 7fe3a8741640 1 -- start start 2023-12-13T00:00:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.772+0000 7fe3a8741640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3a00c7180 0x7fe3a0155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.772+0000 7fe3a8741640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3a0150530 0x7fe3a013e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.772+0000 7fe3a8741640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3a01596e0 0x7fe3a013e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.772+0000 7fe3a8741640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a01561a0 con 0x7fe3a00c7180 2023-12-13T00:00:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.772+0000 7fe3a8741640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a01df570 con 0x7fe3a0150530 2023-12-13T00:00:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.772+0000 7fe3a8741640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a01dfaf0 con 0x7fe3a01596e0 2023-12-13T00:00:38.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.773+0000 7fe3a64dd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3a00c7180 0x7fe3a0155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:38.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.773+0000 7fe3a64dd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3a00c7180 0x7fe3a0155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59902/0 (socket says 172.21.15.72:59902) 2023-12-13T00:00:38.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.773+0000 7fe3a64dd640 1 -- 172.21.15.72:0/2449920164 learned_addr learned my addr 172.21.15.72:0/2449920164 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:38.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.773+0000 7fe3a5cdc640 1 --2- 172.21.15.72:0/2449920164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3a0150530 0x7fe3a013e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:38.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.773+0000 7fe3a6cde640 1 --2- 172.21.15.72:0/2449920164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3a01596e0 0x7fe3a013e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:38.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.776+0000 7fe3a64dd640 1 -- 172.21.15.72:0/2449920164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3a01596e0 msgr2=0x7fe3a013e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:38.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.776+0000 7fe3a64dd640 1 --2- 172.21.15.72:0/2449920164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3a01596e0 0x7fe3a013e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:38.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.776+0000 7fe3a64dd640 1 -- 172.21.15.72:0/2449920164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3a0150530 msgr2=0x7fe3a013e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:38.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.776+0000 7fe3a64dd640 1 --2- 172.21.15.72:0/2449920164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3a0150530 0x7fe3a013e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:38.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.776+0000 7fe3a64dd640 1 -- 172.21.15.72:0/2449920164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c009400 con 0x7fe3a00c7180 2023-12-13T00:00:38.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.778+0000 7fe3a64dd640 1 --2- 172.21.15.72:0/2449920164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3a00c7180 0x7fe3a0155140 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0098c0 tx=0x7fe39c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:38.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.782+0000 7fe396ffd640 1 -- 172.21.15.72:0/2449920164 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c046070 con 0x7fe3a00c7180 2023-12-13T00:00:38.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.782+0000 7fe396ffd640 1 -- 172.21.15.72:0/2449920164 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c0376d0 con 0x7fe3a00c7180 2023-12-13T00:00:38.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.782+0000 7fe396ffd640 1 -- 172.21.15.72:0/2449920164 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c03b040 con 0x7fe3a00c7180 2023-12-13T00:00:38.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.782+0000 7fe3a8741640 1 -- 172.21.15.72:0/2449920164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a01ef930 con 0x7fe3a00c7180 2023-12-13T00:00:38.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.782+0000 7fe3a8741640 1 -- 172.21.15.72:0/2449920164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a01efc10 con 0x7fe3a00c7180 2023-12-13T00:00:38.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.783+0000 7fe3a8741640 1 -- 172.21.15.72:0/2449920164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a0149250 con 0x7fe3a00c7180 2023-12-13T00:00:38.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.801+0000 7fe396ffd640 1 -- 172.21.15.72:0/2449920164 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe39c037a80 con 0x7fe3a00c7180 2023-12-13T00:00:38.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.801+0000 7fe396ffd640 1 --2- 172.21.15.72:0/2449920164 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe38406b1f0 0x7fe38406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:38.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.802+0000 7fe3a5cdc640 1 --2- 172.21.15.72:0/2449920164 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe38406b1f0 0x7fe38406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:38.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.802+0000 7fe3a5cdc640 1 --2- 172.21.15.72:0/2449920164 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe38406b1f0 0x7fe38406d6b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe3a006cdb0 tx=0x7fe390009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:38.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:38.805+0000 7fe396ffd640 1 -- 172.21.15.72:0/2449920164 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe39c043e20 con 0x7fe3a00c7180 2023-12-13T00:00:39.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.040+0000 7fe396ffd640 1 -- 172.21.15.72:0/2449920164 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe39c077970 con 0x7fe3a00c7180 2023-12-13T00:00:39.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.252+0000 7fe3a8741640 1 -- 172.21.15.72:0/2449920164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3a00727d0 con 0x7fe3a00c7180 2023-12-13T00:00:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.264+0000 7fe396ffd640 1 -- 172.21.15.72:0/2449920164 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6495 (secure 0 0 0) 0x7fe39c07af90 con 0x7fe3a00c7180 2023-12-13T00:00:39.265 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:00:39.265 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/541435124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":541435124},{"type":"v1","addr":"172.21.15.72:6837","nonce":541435124}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4190692049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4190692049},{"type":"v1","addr":"172.21.15.176:6835","nonce":4190692049}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1780646034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1780646034},{"type":"v1","addr":"172.21.15.176:6833","nonce":1780646034}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6839/3632161953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":3632161953},{"type":"v1","addr":"172.21.15.72:6839","nonce":3632161953}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3954648997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3954648997},{"type":"v1","addr":"172.21.15.72:6835","nonce":3954648997}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-13T00:00:30.722325+0000","modified":"2023-12-13T00:00:36.196537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6837/3968747607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":3968747607},{"type":"v1","addr":"172.21.15.176:6837","nonce":3968747607}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-13T00:00:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-12-13T00:00:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.266+0000 7fe3a8741640 1 -- 172.21.15.72:0/2449920164 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe38406b1f0 msgr2=0x7fe38406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.266+0000 7fe3a8741640 1 --2- 172.21.15.72:0/2449920164 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe38406b1f0 0x7fe38406d6b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe3a006cdb0 tx=0x7fe390009040 comp rx=0 tx=0).stop 2023-12-13T00:00:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.266+0000 7fe3a8741640 1 -- 172.21.15.72:0/2449920164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3a00c7180 msgr2=0x7fe3a0155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.266+0000 7fe3a8741640 1 --2- 172.21.15.72:0/2449920164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3a00c7180 0x7fe3a0155140 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0098c0 tx=0x7fe39c0046c0 comp rx=0 tx=0).stop 2023-12-13T00:00:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.266+0000 7fe3a8741640 1 -- 172.21.15.72:0/2449920164 shutdown_connections 2023-12-13T00:00:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.266+0000 7fe3a8741640 1 --2- 172.21.15.72:0/2449920164 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe38406b1f0 0x7fe38406d6b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.266+0000 7fe3a8741640 1 --2- 172.21.15.72:0/2449920164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3a01596e0 0x7fe3a013e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.266+0000 7fe3a8741640 1 --2- 172.21.15.72:0/2449920164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3a0150530 0x7fe3a013e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.266+0000 7fe3a8741640 1 --2- 172.21.15.72:0/2449920164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3a00c7180 0x7fe3a0155140 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.266+0000 7fe3a8741640 1 -- 172.21.15.72:0/2449920164 >> 172.21.15.72:0/2449920164 conn(0x7fe3a006c5f0 msgr2=0x7fe3a00c43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.267+0000 7fe3a8741640 1 -- 172.21.15.72:0/2449920164 shutdown_connections 2023-12-13T00:00:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.267+0000 7fe3a8741640 1 -- 172.21.15.72:0/2449920164 wait complete. 2023-12-13T00:00:39.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:00:39.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.376+0000 7fb25f53c640 1 Processor -- start 2023-12-13T00:00:39.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.376+0000 7fb25f53c640 1 -- start start 2023-12-13T00:00:39.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.377+0000 7fb25f53c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2581538d0 0x7fb25815a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:39.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.377+0000 7fb25f53c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2580c7640 con 0x7fb25806ba50 2023-12-13T00:00:39.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.377+0000 7fb25f53c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb25806b5c0 con 0x7fb2580c8ee0 2023-12-13T00:00:39.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.377+0000 7fb25f53c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25806d130 con 0x7fb2581538d0 2023-12-13T00:00:39.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.378+0000 7fb25dad9640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb25806ba50 0x7fb25806bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52410/0 (socket says 172.21.15.72:52410) 2023-12-13T00:00:39.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.378+0000 7fb25dad9640 1 -- 172.21.15.72:0/3002210419 learned_addr learned my addr 172.21.15.72:0/3002210419 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:39.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.378+0000 7fb25d2d8640 1 --2- 172.21.15.72:0/3002210419 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2581538d0 0x7fb25815a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.380+0000 7fb24ffff640 1 -- 172.21.15.72:0/3002210419 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4035631053 0 0) 0x7fb2580c7640 con 0x7fb25806ba50 2023-12-13T00:00:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.380+0000 7fb24ffff640 1 -- 172.21.15.72:0/3002210419 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb244003520 con 0x7fb25806ba50 2023-12-13T00:00:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.380+0000 7fb24ffff640 1 -- 172.21.15.72:0/3002210419 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543404031 0 0) 0x7fb25806b5c0 con 0x7fb2580c8ee0 2023-12-13T00:00:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.380+0000 7fb24ffff640 1 -- 172.21.15.72:0/3002210419 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2580c7640 con 0x7fb2580c8ee0 2023-12-13T00:00:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.380+0000 7fb25d2d8640 1 -- 172.21.15.72:0/3002210419 >> v1:172.21.15.176:6789/0 conn(0x7fb2580c8ee0 legacy=0x7fb25806e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:39.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.380+0000 7fb25d2d8640 1 -- 172.21.15.72:0/3002210419 >> v1:172.21.15.72:6789/0 conn(0x7fb25806ba50 legacy=0x7fb25806bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:39.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.380+0000 7fb25d2d8640 1 -- 172.21.15.72:0/3002210419 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25815a600 con 0x7fb2581538d0 2023-12-13T00:00:39.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.383+0000 7fb25d2d8640 1 --2- 172.21.15.72:0/3002210419 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2581538d0 0x7fb25815a0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb254009dc0 tx=0x7fb25402be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d8534db928ef010 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:39.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.385+0000 7fb24ffff640 1 -- 172.21.15.72:0/3002210419 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25402cc40 con 0x7fb2581538d0 2023-12-13T00:00:39.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.387+0000 7fb24ffff640 1 -- 172.21.15.72:0/3002210419 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25402cda0 con 0x7fb2581538d0 2023-12-13T00:00:39.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.387+0000 7fb24ffff640 1 -- 172.21.15.72:0/3002210419 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb254034640 con 0x7fb2581538d0 2023-12-13T00:00:39.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.387+0000 7fb25f53c640 1 -- 172.21.15.72:0/3002210419 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2581538d0 msgr2=0x7fb25815a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:39.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.387+0000 7fb25f53c640 1 --2- 172.21.15.72:0/3002210419 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2581538d0 0x7fb25815a0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb254009dc0 tx=0x7fb25402be90 comp rx=0 tx=0).stop 2023-12-13T00:00:39.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.387+0000 7fb25f53c640 1 -- 172.21.15.72:0/3002210419 shutdown_connections 2023-12-13T00:00:39.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.387+0000 7fb25f53c640 1 --2- 172.21.15.72:0/3002210419 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2581538d0 0x7fb25815a0c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:39.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.387+0000 7fb25f53c640 1 -- 172.21.15.72:0/3002210419 >> 172.21.15.72:0/3002210419 conn(0x7fb258060f20 msgr2=0x7fb258061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:39.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.387+0000 7fb25f53c640 1 -- 172.21.15.72:0/3002210419 shutdown_connections 2023-12-13T00:00:39.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.387+0000 7fb25f53c640 1 -- 172.21.15.72:0/3002210419 wait complete. 2023-12-13T00:00:39.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.389+0000 7fb25f53c640 1 Processor -- start 2023-12-13T00:00:39.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.389+0000 7fb25f53c640 1 -- start start 2023-12-13T00:00:39.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.389+0000 7fb25f53c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb25806ba50 0x7fb2580c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:39.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.389+0000 7fb25f53c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2580c8ee0 0x7fb2580c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:39.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.389+0000 7fb25f53c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2581538d0 0x7fb2581ef8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:39.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.389+0000 7fb25f53c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2581f08c0 con 0x7fb2581538d0 2023-12-13T00:00:39.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.389+0000 7fb25f53c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2580c5e90 con 0x7fb2580c8ee0 2023-12-13T00:00:39.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.389+0000 7fb25f53c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2581f0300 con 0x7fb25806ba50 2023-12-13T00:00:39.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.390+0000 7fb25dad9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2581538d0 0x7fb2581ef8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:39.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.390+0000 7fb25d2d8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb25806ba50 0x7fb2580c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:39.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.390+0000 7fb25cad7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2580c8ee0 0x7fb2580c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:39.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.390+0000 7fb25dad9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2581538d0 0x7fb2581ef8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59912/0 (socket says 172.21.15.72:59912) 2023-12-13T00:00:39.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.390+0000 7fb25dad9640 1 -- 172.21.15.72:0/1151878526 learned_addr learned my addr 172.21.15.72:0/1151878526 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:39.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.393+0000 7fb25dad9640 1 -- 172.21.15.72:0/1151878526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb25806ba50 msgr2=0x7fb2580c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:39.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.393+0000 7fb25dad9640 1 --2- 172.21.15.72:0/1151878526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb25806ba50 0x7fb2580c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:39.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.393+0000 7fb25dad9640 1 -- 172.21.15.72:0/1151878526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2580c8ee0 msgr2=0x7fb2580c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:39.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.393+0000 7fb25dad9640 1 --2- 172.21.15.72:0/1151878526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2580c8ee0 0x7fb2580c4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:39.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.393+0000 7fb25dad9640 1 -- 172.21.15.72:0/1151878526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb254009a70 con 0x7fb2581538d0 2023-12-13T00:00:39.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.395+0000 7fb25dad9640 1 --2- 172.21.15.72:0/1151878526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2581538d0 0x7fb2581ef8c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb25000c390 tx=0x7fb25000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:39.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.397+0000 7fb24dffb640 1 -- 172.21.15.72:0/1151878526 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb250005ce0 con 0x7fb2581538d0 2023-12-13T00:00:39.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.397+0000 7fb25f53c640 1 -- 172.21.15.72:0/1151878526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2581f05e0 con 0x7fb2581538d0 2023-12-13T00:00:39.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.398+0000 7fb25f53c640 1 -- 172.21.15.72:0/1151878526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2581f3290 con 0x7fb2581538d0 2023-12-13T00:00:39.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.399+0000 7fb25f53c640 1 -- 172.21.15.72:0/1151878526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb25806af40 con 0x7fb2581538d0 2023-12-13T00:00:39.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.638+0000 7fb24dffb640 1 -- 172.21.15.72:0/1151878526 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb250005e40 con 0x7fb2581538d0 2023-12-13T00:00:39.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.638+0000 7fb24dffb640 1 -- 172.21.15.72:0/1151878526 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb250007ea0 con 0x7fb2581538d0 2023-12-13T00:00:39.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.639+0000 7fb24dffb640 1 -- 172.21.15.72:0/1151878526 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb250007350 con 0x7fb2581538d0 2023-12-13T00:00:39.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.639+0000 7fb24dffb640 1 --2- 172.21.15.72:0/1151878526 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb23c06b1c0 0x7fb23c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:39.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.639+0000 7fb25d2d8640 1 --2- 172.21.15.72:0/1151878526 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb23c06b1c0 0x7fb23c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:39.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.640+0000 7fb25d2d8640 1 --2- 172.21.15.72:0/1151878526 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb23c06b1c0 0x7fb23c06d680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb254036000 tx=0x7fb254030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:39.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.652+0000 7fb24dffb640 1 -- 172.21.15.72:0/1151878526 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb2500581e0 con 0x7fb2581538d0 2023-12-13T00:00:39.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.652+0000 7fb24dffb640 1 -- 172.21.15.72:0/1151878526 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb250054520 con 0x7fb2581538d0 2023-12-13T00:00:39.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.821+0000 7fb25f53c640 1 -- 172.21.15.72:0/1151878526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb258067470 con 0x7fb2581538d0 2023-12-13T00:00:39.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.858+0000 7fb24dffb640 1 -- 172.21.15.72:0/1151878526 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18327 (secure 0 0 0) 0x7fb250021020 con 0x7fb2581538d0 2023-12-13T00:00:39.859 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:00:39.859 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:00:36.191864+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T00:00:27.701252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T00:00:29.324356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T00:00:33.363089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:00:39.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.860+0000 7fb25f53c640 1 -- 172.21.15.72:0/1151878526 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb23c06b1c0 msgr2=0x7fb23c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:39.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.860+0000 7fb25f53c640 1 --2- 172.21.15.72:0/1151878526 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb23c06b1c0 0x7fb23c06d680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb254036000 tx=0x7fb254030000 comp rx=0 tx=0).stop 2023-12-13T00:00:39.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.860+0000 7fb25f53c640 1 -- 172.21.15.72:0/1151878526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2581538d0 msgr2=0x7fb2581ef8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:39.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.860+0000 7fb25f53c640 1 --2- 172.21.15.72:0/1151878526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2581538d0 0x7fb2581ef8c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb25000c390 tx=0x7fb25000c850 comp rx=0 tx=0).stop 2023-12-13T00:00:39.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.861+0000 7fb25f53c640 1 -- 172.21.15.72:0/1151878526 shutdown_connections 2023-12-13T00:00:39.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.861+0000 7fb25f53c640 1 --2- 172.21.15.72:0/1151878526 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb23c06b1c0 0x7fb23c06d680 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:39.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.861+0000 7fb25f53c640 1 --2- 172.21.15.72:0/1151878526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2581538d0 0x7fb2581ef8c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:39.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.861+0000 7fb25f53c640 1 --2- 172.21.15.72:0/1151878526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2580c8ee0 0x7fb2580c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:39.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.861+0000 7fb25f53c640 1 --2- 172.21.15.72:0/1151878526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb25806ba50 0x7fb2580c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:39.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.861+0000 7fb25f53c640 1 -- 172.21.15.72:0/1151878526 >> 172.21.15.72:0/1151878526 conn(0x7fb258060f20 msgr2=0x7fb2580cb950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:39.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.861+0000 7fb25f53c640 1 -- 172.21.15.72:0/1151878526 shutdown_connections 2023-12-13T00:00:39.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:39.861+0000 7fb25f53c640 1 -- 172.21.15.72:0/1151878526 wait complete. 2023-12-13T00:00:40.476 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-13T00:00:30.722325+0000', 'modified': '2023-12-13T00:00:36.196537+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.176:6837/3968747607', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6836', 'nonce': 3968747607}, {'type': 'v1', 'addr': '172.21.15.176:6837', 'nonce': 3968747607}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-13T00:00:40.476 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-13T00:00:40.476 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-12-13T00:00:40.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.576+0000 7f6c6c3fb640 1 Processor -- start 2023-12-13T00:00:40.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.576+0000 7f6c6c3fb640 1 -- start start 2023-12-13T00:00:40.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.577+0000 7f6c6c3fb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c640cda70 0x7f6c640ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.577+0000 7f6c6c3fb640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c640cbda0 con 0x7f6c640c9620 2023-12-13T00:00:40.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.577+0000 7f6c6c3fb640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c640cb4e0 con 0x7f6c640cc420 2023-12-13T00:00:40.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.577+0000 7f6c6c3fb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c640cc230 con 0x7f6c640cda70 2023-12-13T00:00:40.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.578+0000 7f6c69996640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f6c640cc420 0x7f6c64159610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:54870/0 (socket says 172.21.15.72:54870) 2023-12-13T00:00:40.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.578+0000 7f6c69996640 1 -- 172.21.15.72:0/2243798957 learned_addr learned my addr 172.21.15.72:0/2243798957 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:40.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.578+0000 7f6c6a197640 1 --2- 172.21.15.72:0/2243798957 >> v2:172.21.15.72:3300/0 conn(0x7f6c640cda70 0x7f6c640ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:40.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.580+0000 7f6c69195640 1 -- 172.21.15.72:0/2243798957 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996542635 0 0) 0x7f6c640cb4e0 con 0x7f6c640cc420 2023-12-13T00:00:40.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.581+0000 7f6c69195640 1 -- 172.21.15.72:0/2243798957 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c50003520 con 0x7f6c640cc420 2023-12-13T00:00:40.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.581+0000 7f6c6a197640 1 -- 172.21.15.72:0/2243798957 >> v1:172.21.15.176:6789/0 conn(0x7f6c640cc420 legacy=0x7f6c64159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:40.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.581+0000 7f6c6a197640 1 -- 172.21.15.72:0/2243798957 >> v1:172.21.15.72:6789/0 conn(0x7f6c640c9620 legacy=0x7f6c64163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:40.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.582+0000 7f6c6a197640 1 -- 172.21.15.72:0/2243798957 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c640cce00 con 0x7f6c640cda70 2023-12-13T00:00:40.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.585+0000 7f6c6a197640 1 --2- 172.21.15.72:0/2243798957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c640cda70 0x7f6c640ce350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009d90 tx=0x7f6c6002bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcf3fbcff86e862 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:40.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.588+0000 7f6c69195640 1 -- 172.21.15.72:0/2243798957 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6002cd80 con 0x7f6c640cda70 2023-12-13T00:00:40.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.588+0000 7f6c69195640 1 -- 172.21.15.72:0/2243798957 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c60034440 con 0x7f6c640cda70 2023-12-13T00:00:40.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.589+0000 7f6c69195640 1 -- 172.21.15.72:0/2243798957 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c600347d0 con 0x7f6c640cda70 2023-12-13T00:00:40.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.589+0000 7f6c6c3fb640 1 -- 172.21.15.72:0/2243798957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c640cda70 msgr2=0x7f6c640ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:40.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.589+0000 7f6c6c3fb640 1 --2- 172.21.15.72:0/2243798957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c640cda70 0x7f6c640ce350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009d90 tx=0x7f6c6002bfd0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.589+0000 7f6c6c3fb640 1 -- 172.21.15.72:0/2243798957 shutdown_connections 2023-12-13T00:00:40.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.589+0000 7f6c6c3fb640 1 --2- 172.21.15.72:0/2243798957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c640cda70 0x7f6c640ce350 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.589+0000 7f6c6c3fb640 1 -- 172.21.15.72:0/2243798957 >> 172.21.15.72:0/2243798957 conn(0x7f6c640b07b0 msgr2=0x7f6c640b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:40.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.589+0000 7f6c6c3fb640 1 -- 172.21.15.72:0/2243798957 shutdown_connections 2023-12-13T00:00:40.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.589+0000 7f6c6c3fb640 1 -- 172.21.15.72:0/2243798957 wait complete. 2023-12-13T00:00:40.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.591+0000 7f6c6c3fb640 1 Processor -- start 2023-12-13T00:00:40.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.591+0000 7f6c6c3fb640 1 -- start start 2023-12-13T00:00:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.591+0000 7f6c6c3fb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c640c9620 0x7f6c640b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.591+0000 7f6c6c3fb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c640cc420 0x7f6c640aa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.591+0000 7f6c6c3fb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c640cda70 0x7f6c641f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.591+0000 7f6c6c3fb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c641ef830 con 0x7f6c640cda70 2023-12-13T00:00:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.591+0000 7f6c6c3fb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c640ac700 con 0x7f6c640cc420 2023-12-13T00:00:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.591+0000 7f6c6c3fb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c640c3df0 con 0x7f6c640c9620 2023-12-13T00:00:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.592+0000 7f6c6a998640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c640cda70 0x7f6c641f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.592+0000 7f6c69996640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c640cc420 0x7f6c640aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.592+0000 7f6c6a998640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c640cda70 0x7f6c641f2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59926/0 (socket says 172.21.15.72:59926) 2023-12-13T00:00:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.592+0000 7f6c6a998640 1 -- 172.21.15.72:0/66346436 learned_addr learned my addr 172.21.15.72:0/66346436 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.592+0000 7f6c6a197640 1 --2- 172.21.15.72:0/66346436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c640c9620 0x7f6c640b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:40.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.595+0000 7f6c6a998640 1 -- 172.21.15.72:0/66346436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c640c9620 msgr2=0x7f6c640b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:40.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.595+0000 7f6c6a998640 1 --2- 172.21.15.72:0/66346436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c640c9620 0x7f6c640b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.595+0000 7f6c6a998640 1 -- 172.21.15.72:0/66346436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c640cc420 msgr2=0x7f6c640aa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:40.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.595+0000 7f6c6a998640 1 --2- 172.21.15.72:0/66346436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c640cc420 0x7f6c640aa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.595+0000 7f6c6a998640 1 -- 172.21.15.72:0/66346436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60009a70 con 0x7f6c640cda70 2023-12-13T00:00:40.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.599+0000 7f6c6a998640 1 --2- 172.21.15.72:0/66346436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c640cda70 0x7f6c641f2360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00c3c0 tx=0x7f6c5c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:40.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.603+0000 7f6c5affd640 1 -- 172.21.15.72:0/66346436 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c0052d0 con 0x7f6c640cda70 2023-12-13T00:00:40.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.603+0000 7f6c5affd640 1 -- 172.21.15.72:0/66346436 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c005430 con 0x7f6c640cda70 2023-12-13T00:00:40.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.603+0000 7f6c5affd640 1 -- 172.21.15.72:0/66346436 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c003830 con 0x7f6c640cda70 2023-12-13T00:00:40.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.603+0000 7f6c6c3fb640 1 -- 172.21.15.72:0/66346436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c641efcc0 con 0x7f6c640cda70 2023-12-13T00:00:40.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.603+0000 7f6c6c3fb640 1 -- 172.21.15.72:0/66346436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c640c4390 con 0x7f6c640cda70 2023-12-13T00:00:40.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.605+0000 7f6c6ef8d740 1 Processor -- start 2023-12-13T00:00:40.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.606+0000 7f6c6ef8d740 1 -- start start 2023-12-13T00:00:40.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.606+0000 7f6c6ef8d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be6653a290 0x55be6653a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.606+0000 7f6c6ef8d740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be66584110 0x55be6653abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.606+0000 7f6c6ef8d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be66538cf0 0x55be66579af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.606+0000 7f6c6ef8d740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be664a8020 con 0x55be66584110 2023-12-13T00:00:40.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.606+0000 7f6c6ef8d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be664a5710 con 0x55be66538cf0 2023-12-13T00:00:40.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.606+0000 7f6c6ef8d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be664a1000 con 0x55be6653a290 2023-12-13T00:00:40.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.607+0000 7f6c69996640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be66538cf0 0x55be66579af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:40.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.607+0000 7f6c69996640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be6653a290 0x55be6653a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:40.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.607+0000 7f6c69996640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be66538cf0 0x55be66579af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:41712/0 (socket says 172.21.15.72:41712) 2023-12-13T00:00:40.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.607+0000 7f6c69996640 1 -- 172.21.15.72:0/2205319629 learned_addr learned my addr 172.21.15.72:0/2205319629 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:40.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.609+0000 7f6c69996640 1 -- 172.21.15.72:0/2205319629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be6653a290 msgr2=0x55be6653a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:40.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.609+0000 7f6c69996640 1 --2- 172.21.15.72:0/2205319629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be6653a290 0x55be6653a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.609+0000 7f6c69996640 1 -- 172.21.15.72:0/2205319629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be66584110 msgr2=0x55be6653abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:40.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.609+0000 7f6c69996640 1 --2- 172.21.15.72:0/2205319629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be66584110 0x55be6653abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.609+0000 7f6c69996640 1 -- 172.21.15.72:0/2205319629 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be66463c90 con 0x55be66538cf0 2023-12-13T00:00:40.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.611+0000 7f6c69996640 1 --2- 172.21.15.72:0/2205319629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be66538cf0 0x55be66579af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6c640c5270 tx=0x7f6c54000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e6e69694bdbd5dd server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:40.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.616+0000 7f6c47fff640 1 -- 172.21.15.72:0/2205319629 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c54018e60 con 0x55be66538cf0 2023-12-13T00:00:40.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.616+0000 7f6c47fff640 1 -- 172.21.15.72:0/2205319629 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c54005a60 con 0x55be66538cf0 2023-12-13T00:00:40.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.616+0000 7f6c47fff640 1 -- 172.21.15.72:0/2205319629 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c54005dd0 con 0x55be66538cf0 2023-12-13T00:00:40.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.616+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/2205319629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be66538cf0 msgr2=0x55be66579af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:40.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.616+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/2205319629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be66538cf0 0x55be66579af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6c640c5270 tx=0x7f6c54000ed0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.616+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/2205319629 shutdown_connections 2023-12-13T00:00:40.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.616+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/2205319629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be66538cf0 0x55be66579af0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.616+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/2205319629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be66584110 0x55be6653abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.616+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/2205319629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be6653a290 0x55be6653a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.616+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/2205319629 >> 172.21.15.72:0/2205319629 conn(0x55be66536c90 msgr2=0x55be66539340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:40.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.616+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/2205319629 shutdown_connections 2023-12-13T00:00:40.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.616+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/2205319629 wait complete. 2023-12-13T00:00:40.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.617+0000 7f6c6ef8d740 1 -- start start 2023-12-13T00:00:40.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.617+0000 7f6c6ef8d740 1 Processor -- start 2023-12-13T00:00:40.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.618+0000 7f6c6ef8d740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be6653a290 0x55be66558e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.618+0000 7f6c6ef8d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be66584110 0x55be6658b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.618+0000 7f6c6ef8d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be6657ee30 0x55be66553300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.618+0000 7f6c6ef8d740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be6645ae00 con 0x55be6653a290 2023-12-13T00:00:40.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.618+0000 7f6c6ef8d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be6645aaa0 con 0x55be6657ee30 2023-12-13T00:00:40.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.618+0000 7f6c6ef8d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be66420270 con 0x55be66584110 2023-12-13T00:00:40.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.618+0000 7f6c6ef8d740 10 client.0 _ll_register_callbacks cb 0x55be661b2ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-13T00:00:40.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.619+0000 7f6c6a197640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be66584110 0x55be6658b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:40.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.619+0000 7f6c69996640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be6657ee30 0x55be66553300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:40.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.619+0000 7f6c69996640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be6657ee30 0x55be66553300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:41718/0 (socket says 172.21.15.72:41718) 2023-12-13T00:00:40.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.619+0000 7f6c69996640 1 -- 172.21.15.72:0/1339577299 learned_addr learned my addr 172.21.15.72:0/1339577299 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.622+0000 7f6c69996640 1 -- 172.21.15.72:0/1339577299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be66584110 msgr2=0x55be6658b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.622+0000 7f6c69996640 1 --2- 172.21.15.72:0/1339577299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be66584110 0x55be6658b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.622+0000 7f6c69996640 1 -- 172.21.15.72:0/1339577299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be6653a290 msgr2=0x55be66558e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.622+0000 7f6c69996640 1 --2- 172.21.15.72:0/1339577299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be6653a290 0x55be66558e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.622+0000 7f6c69996640 1 -- 172.21.15.72:0/1339577299 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5400f040 con 0x55be6657ee30 2023-12-13T00:00:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.622+0000 7f6c6a197640 1 --2- 172.21.15.72:0/1339577299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be66584110 0x55be6658b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T00:00:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.624+0000 7f6c5affd640 1 -- 172.21.15.72:0/66346436 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6c5c003990 con 0x7f6c640cda70 2023-12-13T00:00:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.624+0000 7f6c5affd640 1 --2- 172.21.15.72:0/66346436 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f6c4806b180 0x7f6c4806d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.624+0000 7f6c6a197640 1 --2- 172.21.15.72:0/66346436 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f6c4806b180 0x7f6c4806d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.625+0000 7f6c6a197640 1 --2- 172.21.15.72:0/66346436 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f6c4806b180 0x7f6c4806d640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6c60036000 tx=0x7f6c6002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.625+0000 7f6c69996640 1 --2- 172.21.15.72:0/1339577299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be6657ee30 0x55be66553300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c54001120 tx=0x7f6c54001150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=232c670ee392dd11 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:40.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.625+0000 7f6c457fa640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2023-12-13T00:00:40.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.628+0000 7f6c5affd640 1 -- 172.21.15.72:0/66346436 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6c5c0578e0 con 0x7f6c640cda70 2023-12-13T00:00:40.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.629+0000 7f6c457fa640 1 -- 172.21.15.72:0/1339577299 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c540012d0 con 0x55be6657ee30 2023-12-13T00:00:40.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.629+0000 7f6c457fa640 1 -- 172.21.15.72:0/1339577299 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6c54018e60 con 0x55be6657ee30 2023-12-13T00:00:40.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.629+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/1339577299 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be66499e90 con 0x55be6657ee30 2023-12-13T00:00:40.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.631+0000 7f6c457fa640 1 -- 172.21.15.72:0/1339577299 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c54005e00 con 0x55be6657ee30 2023-12-13T00:00:40.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.631+0000 7f6c6ef8d740 10 client.4399 fetch_fsmap learned FSMap version 7 2023-12-13T00:00:40.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.631+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/1339577299 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55be6649f680 con 0x55be6657ee30 2023-12-13T00:00:40.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.635+0000 7f6c457fa640 1 -- 172.21.15.72:0/1339577299 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be66499e90 con 0x55be6657ee30 2023-12-13T00:00:40.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.635+0000 7f6c457fa640 1 -- 172.21.15.72:0/1339577299 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f6c54007260 con 0x55be6657ee30 2023-12-13T00:00:40.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.635+0000 7f6c6ef8d740 10 client.4399 fetch_fsmap finished waiting for FSMap version 7 2023-12-13T00:00:40.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.635+0000 7f6c6ef8d740 10 client.4399 resolve_mds: resolved name 'f' to daemon mds.f 2023-12-13T00:00:40.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.635+0000 7f6c6ef8d740 20 client.4399 populate_metadata read hostname 'smithi072' 2023-12-13T00:00:40.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.635+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/1339577299 >> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] conn(0x55be66584d70 0x55be66599880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.636+0000 7f6c6ef8d740 4 client.4399 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-13T00:00:40.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.636+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/1339577299 --> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be66499bb0 con 0x55be66584d70 2023-12-13T00:00:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.644+0000 7f6c69996640 1 --2- 172.21.15.72:0/1339577299 >> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] conn(0x55be66584d70 0x55be66599880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.729+0000 7f6c69996640 1 --2- 172.21.15.72:0/1339577299 >> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] conn(0x55be66584d70 0x55be66599880 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c8a0c662441d11f server_cookie=e205b3c040a4ef7a in_seq=0 out_seq=0 2023-12-13T00:00:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.729+0000 7f6c457fa640 10 client.4399 ms_handle_connect on v2:172.21.15.176:6836/3968747607 2023-12-13T00:00:40.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.843+0000 7f6c457fa640 1 -- 172.21.15.72:0/1339577299 <== mds.0 v2:172.21.15.176:6836/3968747607 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55be66499bb0 con 0x55be66584d70 2023-12-13T00:00:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.843+0000 7f6c457fa640 10 client.4399 handle_command_reply: tid=0 2023-12-13T00:00:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.843+0000 7f6c6ef8d740 1 client.4399 shutdown 2023-12-13T00:00:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.843+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/1339577299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be6657ee30 msgr2=0x55be66553300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.843+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/1339577299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be6657ee30 0x55be66553300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c54001120 tx=0x7f6c54001150 comp rx=0 tx=0).stop 2023-12-13T00:00:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.843+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/1339577299 shutdown_connections 2023-12-13T00:00:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.843+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/1339577299 >> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] conn(0x55be66584d70 0x55be66599880 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.843+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/1339577299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be6657ee30 0x55be66553300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.843+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/1339577299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be66584110 0x55be6658b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.843+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/1339577299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be6653a290 0x55be66558e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.843+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/1339577299 >> 172.21.15.72:0/1339577299 conn(0x55be66538cf0 msgr2=0x55be6657a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.843+0000 7f6c457fa640 0 client.4399 ms_handle_reset on v2:172.21.15.176:6836/3968747607 2023-12-13T00:00:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.843+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/1339577299 shutdown_connections 2023-12-13T00:00:40.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.843+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/1339577299 wait complete. 2023-12-13T00:00:40.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.844+0000 7f6c6ef8d740 20 client.4399 trim_cache size 0 max 16384 2023-12-13T00:00:40.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.859+0000 7f6c6ef8d740 1 Processor -- start 2023-12-13T00:00:40.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.859+0000 7f6c6ef8d740 1 -- start start 2023-12-13T00:00:40.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.860+0000 7f6c6ef8d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be6653a290 0x55be66538260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.860+0000 7f6c6ef8d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be6657ee30 0x55be66539200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.860+0000 7f6c6ef8d740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be66584110 0x55be66539740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.860+0000 7f6c6ef8d740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be66583fd0 con 0x55be66584110 2023-12-13T00:00:40.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.860+0000 7f6c6ef8d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be6653a8a0 con 0x55be6653a290 2023-12-13T00:00:40.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.860+0000 7f6c6ef8d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be6657c900 con 0x55be6657ee30 2023-12-13T00:00:40.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.860+0000 7f6c6a998640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be66584110 0x55be66539740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:40.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.860+0000 7f6c6a197640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be6653a290 0x55be66538260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:40.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.861+0000 7f6c6a998640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be66584110 0x55be66539740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59944/0 (socket says 172.21.15.72:59944) 2023-12-13T00:00:40.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.861+0000 7f6c6a998640 1 -- 172.21.15.72:0/1703337166 learned_addr learned my addr 172.21.15.72:0/1703337166 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:40.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.861+0000 7f6c69996640 1 --2- 172.21.15.72:0/1703337166 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be6657ee30 0x55be66539200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:40.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.863+0000 7f6c6a998640 1 -- 172.21.15.72:0/1703337166 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be6657ee30 msgr2=0x55be66539200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:40.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.863+0000 7f6c6a998640 1 --2- 172.21.15.72:0/1703337166 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be6657ee30 0x55be66539200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.863+0000 7f6c6a998640 1 -- 172.21.15.72:0/1703337166 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be6653a290 msgr2=0x55be66538260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:40.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.863+0000 7f6c6a998640 1 --2- 172.21.15.72:0/1703337166 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be6653a290 0x55be66538260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.863+0000 7f6c6a998640 1 -- 172.21.15.72:0/1703337166 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be6643cd00 con 0x55be66584110 2023-12-13T00:00:40.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.865+0000 7f6c6a998640 1 --2- 172.21.15.72:0/1703337166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be66584110 0x55be66539740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c05f600 tx=0x7f6c5c05b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13cc9a48ec184a10 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:40.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.868+0000 7f6c58dff640 1 -- 172.21.15.72:0/1703337166 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c055ae0 con 0x55be66584110 2023-12-13T00:00:40.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.868+0000 7f6c58dff640 1 -- 172.21.15.72:0/1703337166 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c05f6a0 con 0x55be66584110 2023-12-13T00:00:40.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.868+0000 7f6c58dff640 1 -- 172.21.15.72:0/1703337166 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c058b60 con 0x55be66584110 2023-12-13T00:00:40.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.869+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/1703337166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be66584110 msgr2=0x55be66539740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:40.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.869+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/1703337166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be66584110 0x55be66539740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c05f600 tx=0x7f6c5c05b980 comp rx=0 tx=0).stop 2023-12-13T00:00:40.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.869+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/1703337166 shutdown_connections 2023-12-13T00:00:40.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.869+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/1703337166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be66584110 0x55be66539740 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.869+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/1703337166 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be6657ee30 0x55be66539200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.869+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/1703337166 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be6653a290 0x55be66538260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.869+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/1703337166 >> 172.21.15.72:0/1703337166 conn(0x55be66538cf0 msgr2=0x55be665786f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:40.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.869+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/1703337166 shutdown_connections 2023-12-13T00:00:40.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.869+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/1703337166 wait complete. 2023-12-13T00:00:40.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.870+0000 7f6c6ef8d740 1 -- start start 2023-12-13T00:00:40.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.870+0000 7f6c6ef8d740 1 Processor -- start 2023-12-13T00:00:40.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.871+0000 7f6c6ef8d740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be6653a290 0x55be66554040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.871+0000 7f6c6ef8d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be6657ee30 0x55be6654fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.871+0000 7f6c6ef8d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be66584110 0x55be66587700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.871+0000 7f6c6ef8d740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be6659e500 con 0x55be6653a290 2023-12-13T00:00:40.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.871+0000 7f6c6ef8d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be6657b090 con 0x55be66584110 2023-12-13T00:00:40.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.871+0000 7f6c6ef8d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be6655ce40 con 0x55be6657ee30 2023-12-13T00:00:40.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.871+0000 7f6c6ef8d740 10 client.0 _ll_register_callbacks cb 0x7f6c540016b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-13T00:00:40.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.871+0000 7f6c6a197640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be6653a290 0x55be66554040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:40.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.871+0000 7f6c6a998640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be66584110 0x55be66587700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:40.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.871+0000 7f6c69996640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be6657ee30 0x55be6654fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:40.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.872+0000 7f6c6a197640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be6653a290 0x55be66554040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59952/0 (socket says 172.21.15.72:59952) 2023-12-13T00:00:40.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.872+0000 7f6c6a197640 1 -- 172.21.15.72:0/2112310277 learned_addr learned my addr 172.21.15.72:0/2112310277 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:40.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.874+0000 7f6c6a998640 1 -- 172.21.15.72:0/2112310277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be6657ee30 msgr2=0x55be6654fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:40.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.874+0000 7f6c6a998640 1 --2- 172.21.15.72:0/2112310277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be6657ee30 0x55be6654fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.874+0000 7f6c6a998640 1 -- 172.21.15.72:0/2112310277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be6653a290 msgr2=0x55be66554040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:40.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.874+0000 7f6c6a998640 1 --2- 172.21.15.72:0/2112310277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be6653a290 0x55be66554040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.874+0000 7f6c6a998640 1 -- 172.21.15.72:0/2112310277 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c640c4390 con 0x55be66584110 2023-12-13T00:00:40.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.877+0000 7f6c6a998640 1 --2- 172.21.15.72:0/2112310277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be66584110 0x55be66587700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0575e0 tx=0x7f6c5c01e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df49f193e202064f server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:40.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.877+0000 7f6c457fa640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2023-12-13T00:00:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.880+0000 7f6c457fa640 1 -- 172.21.15.72:0/2112310277 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c058d60 con 0x55be66584110 2023-12-13T00:00:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.880+0000 7f6c457fa640 1 -- 172.21.15.72:0/2112310277 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6c5c071d90 con 0x55be66584110 2023-12-13T00:00:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.880+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/2112310277 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6c54005a60 con 0x55be66584110 2023-12-13T00:00:40.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.882+0000 7f6c457fa640 1 -- 172.21.15.72:0/2112310277 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c5c055ae0 con 0x55be66584110 2023-12-13T00:00:40.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.882+0000 7f6c6ef8d740 10 client.4405 fetch_fsmap learned FSMap version 7 2023-12-13T00:00:40.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.882+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/2112310277 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55be664624f0 con 0x55be66584110 2023-12-13T00:00:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.886+0000 7f6c457fa640 1 -- 172.21.15.72:0/2112310277 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c54005a60 con 0x55be66584110 2023-12-13T00:00:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.886+0000 7f6c457fa640 1 -- 172.21.15.72:0/2112310277 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f6c5c0536d0 con 0x55be66584110 2023-12-13T00:00:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.886+0000 7f6c6ef8d740 10 client.4405 fetch_fsmap finished waiting for FSMap version 7 2023-12-13T00:00:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.886+0000 7f6c6ef8d740 10 client.4405 resolve_mds: resolved name 'f' to daemon mds.f 2023-12-13T00:00:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.886+0000 7f6c6ef8d740 20 client.4405 populate_metadata read hostname 'smithi072' 2023-12-13T00:00:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.886+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/2112310277 >> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] conn(0x55be665dee50 0x55be665df230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.886+0000 7f6c6ef8d740 4 client.4405 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-13T00:00:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.886+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/2112310277 --> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55be661a16c0 con 0x55be665dee50 2023-12-13T00:00:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.887+0000 7f6c6a197640 1 --2- 172.21.15.72:0/2112310277 >> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] conn(0x55be665dee50 0x55be665df230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:40.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.890+0000 7f6c457fa640 10 client.4405 ms_handle_connect on v2:172.21.15.176:6836/3968747607 2023-12-13T00:00:40.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.890+0000 7f6c6a197640 1 --2- 172.21.15.72:0/2112310277 >> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] conn(0x55be665dee50 0x55be665df230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5d36c7a9fa2c232 server_cookie=6895309993004c64 in_seq=0 out_seq=0 2023-12-13T00:00:40.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c457fa640 1 -- 172.21.15.72:0/2112310277 <== mds.0 v2:172.21.15.176:6836/3968747607 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55be661a16c0 con 0x55be665dee50 2023-12-13T00:00:40.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c457fa640 10 client.4405 handle_command_reply: tid=0 2023-12-13T00:00:40.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c6ef8d740 1 client.4405 shutdown 2023-12-13T00:00:40.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/2112310277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be66584110 msgr2=0x55be66587700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:40.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/2112310277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be66584110 0x55be66587700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0575e0 tx=0x7f6c5c01e040 comp rx=0 tx=0).stop 2023-12-13T00:00:40.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/2112310277 shutdown_connections 2023-12-13T00:00:40.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/2112310277 >> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] conn(0x55be665dee50 0x55be665df230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/2112310277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55be66584110 0x55be66587700 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/2112310277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55be6657ee30 0x55be6654fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c457fa640 0 client.4405 ms_handle_reset on v2:172.21.15.176:6836/3968747607 2023-12-13T00:00:40.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c6ef8d740 1 --2- 172.21.15.72:0/2112310277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55be6653a290 0x55be66554040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/2112310277 >> 172.21.15.72:0/2112310277 conn(0x55be66538cf0 msgr2=0x55be66530160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:40.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/2112310277 shutdown_connections 2023-12-13T00:00:40.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c6ef8d740 1 -- 172.21.15.72:0/2112310277 wait complete. 2023-12-13T00:00:40.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c6ef8d740 20 client.4405 trim_cache size 0 max 16384 2023-12-13T00:00:40.910 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-12-13T00:00:40.910 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d", 2023-12-13T00:00:40.911 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-12-13T00:00:40.911 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4266, 2023-12-13T00:00:40.911 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-12-13T00:00:40.911 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-12-13T00:00:40.911 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-12-13T00:00:40.911 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 9.6454058889999992, 2023-12-13T00:00:40.911 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 7, 2023-12-13T00:00:40.911 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 25, 2023-12-13T00:00:40.911 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 25, 2023-12-13T00:00:40.911 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 19.574366354999999 2023-12-13T00:00:40.911 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-12-13T00:00:40.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c6c3fb640 1 -- 172.21.15.72:0/66346436 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f6c4806b180 msgr2=0x7f6c4806d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:40.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c6c3fb640 1 --2- 172.21.15.72:0/66346436 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f6c4806b180 0x7f6c4806d640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6c60036000 tx=0x7f6c6002e000 comp rx=0 tx=0).stop 2023-12-13T00:00:40.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c6c3fb640 1 -- 172.21.15.72:0/66346436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c640cda70 msgr2=0x7f6c641f2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:40.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.908+0000 7f6c6c3fb640 1 --2- 172.21.15.72:0/66346436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c640cda70 0x7f6c641f2360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00c3c0 tx=0x7f6c5c00c880 comp rx=0 tx=0).stop 2023-12-13T00:00:40.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.909+0000 7f6c6c3fb640 1 -- 172.21.15.72:0/66346436 shutdown_connections 2023-12-13T00:00:40.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.909+0000 7f6c6c3fb640 1 --2- 172.21.15.72:0/66346436 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f6c4806b180 0x7f6c4806d640 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.909+0000 7f6c6c3fb640 1 --2- 172.21.15.72:0/66346436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c640cda70 0x7f6c641f2360 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.909+0000 7f6c6c3fb640 1 --2- 172.21.15.72:0/66346436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c640cc420 0x7f6c640aa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.909+0000 7f6c6c3fb640 1 --2- 172.21.15.72:0/66346436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c640c9620 0x7f6c640b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:40.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.909+0000 7f6c6c3fb640 1 -- 172.21.15.72:0/66346436 >> 172.21.15.72:0/66346436 conn(0x7f6c640b07b0 msgr2=0x7f6c64151b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:40.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.909+0000 7f6c6c3fb640 1 -- 172.21.15.72:0/66346436 shutdown_connections 2023-12-13T00:00:40.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:40.909+0000 7f6c6c3fb640 1 -- 172.21.15.72:0/66346436 wait complete. 2023-12-13T00:00:40.920 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-13T00:00:40.920 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-13T00:00:40.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-13T00:00:41.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.018+0000 7f0fdc2ad640 1 Processor -- start 2023-12-13T00:00:41.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.018+0000 7f0fdc2ad640 1 -- start start 2023-12-13T00:00:41.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.019+0000 7f0fdc2ad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fd415a0c0 0x7f0fd406eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:41.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.019+0000 7f0fdc2ad640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd406f090 con 0x7f0fd4153730 2023-12-13T00:00:41.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.019+0000 7f0fdc2ad640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd4153b10 con 0x7f0fd40c91d0 2023-12-13T00:00:41.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.019+0000 7f0fdc2ad640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40c38f0 con 0x7f0fd415a0c0 2023-12-13T00:00:41.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.020+0000 7f0fda049640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0fd4153730 0x7f0fd40c2b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52438/0 (socket says 172.21.15.72:52438) 2023-12-13T00:00:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.020+0000 7f0fda049640 1 -- 172.21.15.72:0/4044952143 learned_addr learned my addr 172.21.15.72:0/4044952143 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.020+0000 7f0fda84a640 1 --2- 172.21.15.72:0/4044952143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fd415a0c0 0x7f0fd406eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.022+0000 7f0fd9047640 1 -- 172.21.15.72:0/4044952143 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960511855 0 0) 0x7f0fd406f090 con 0x7f0fd4153730 2023-12-13T00:00:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.022+0000 7f0fd9047640 1 -- 172.21.15.72:0/4044952143 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc0003520 con 0x7f0fd4153730 2023-12-13T00:00:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.022+0000 7f0fd9047640 1 -- 172.21.15.72:0/4044952143 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3712653660 0 0) 0x7f0fd4153b10 con 0x7f0fd40c91d0 2023-12-13T00:00:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.022+0000 7f0fd9047640 1 -- 172.21.15.72:0/4044952143 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fd406f090 con 0x7f0fd40c91d0 2023-12-13T00:00:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.023+0000 7f0fda84a640 1 -- 172.21.15.72:0/4044952143 >> v1:172.21.15.176:6789/0 conn(0x7f0fd40c91d0 legacy=0x7f0fd40ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.023+0000 7f0fda84a640 1 -- 172.21.15.72:0/4044952143 >> v1:172.21.15.72:6789/0 conn(0x7f0fd4153730 legacy=0x7f0fd40c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.023+0000 7f0fda84a640 1 -- 172.21.15.72:0/4044952143 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd40c3330 con 0x7f0fd415a0c0 2023-12-13T00:00:41.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.024+0000 7f0fda84a640 1 --2- 172.21.15.72:0/4044952143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fd415a0c0 0x7f0fd406eb50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0097d0 tx=0x7f0fcc02b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3cafca917faed96 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:41.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.028+0000 7f0fd9047640 1 -- 172.21.15.72:0/4044952143 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc030890 con 0x7f0fd415a0c0 2023-12-13T00:00:41.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.028+0000 7f0fd9047640 1 -- 172.21.15.72:0/4044952143 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fcc0309f0 con 0x7f0fd415a0c0 2023-12-13T00:00:41.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.028+0000 7f0fd9047640 1 -- 172.21.15.72:0/4044952143 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc030d80 con 0x7f0fd415a0c0 2023-12-13T00:00:41.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.029+0000 7f0fdc2ad640 1 -- 172.21.15.72:0/4044952143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fd415a0c0 msgr2=0x7f0fd406eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:41.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.029+0000 7f0fdc2ad640 1 --2- 172.21.15.72:0/4044952143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fd415a0c0 0x7f0fd406eb50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0097d0 tx=0x7f0fcc02b9d0 comp rx=0 tx=0).stop 2023-12-13T00:00:41.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.029+0000 7f0fdc2ad640 1 -- 172.21.15.72:0/4044952143 shutdown_connections 2023-12-13T00:00:41.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.029+0000 7f0fdc2ad640 1 --2- 172.21.15.72:0/4044952143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fd415a0c0 0x7f0fd406eb50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:41.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.029+0000 7f0fdc2ad640 1 -- 172.21.15.72:0/4044952143 >> 172.21.15.72:0/4044952143 conn(0x7f0fd40707f0 msgr2=0x7f0fd4070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:41.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.029+0000 7f0fdc2ad640 1 -- 172.21.15.72:0/4044952143 shutdown_connections 2023-12-13T00:00:41.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.029+0000 7f0fdc2ad640 1 -- 172.21.15.72:0/4044952143 wait complete. 2023-12-13T00:00:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.030+0000 7f0fdc2ad640 1 Processor -- start 2023-12-13T00:00:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.030+0000 7f0fdc2ad640 1 -- start start 2023-12-13T00:00:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.031+0000 7f0fdc2ad640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd40c91d0 0x7f0fd41503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.031+0000 7f0fdc2ad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fd4153730 0x7f0fd414e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.031+0000 7f0fdc2ad640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fd415a0c0 0x7f0fd41f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.031+0000 7f0fdc2ad640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40c6070 con 0x7f0fd40c91d0 2023-12-13T00:00:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.031+0000 7f0fdc2ad640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd41efa50 con 0x7f0fd415a0c0 2023-12-13T00:00:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.031+0000 7f0fdc2ad640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd41508f0 con 0x7f0fd4153730 2023-12-13T00:00:41.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.032+0000 7f0fda049640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd40c91d0 0x7f0fd41503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:41.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.032+0000 7f0fda049640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd40c91d0 0x7f0fd41503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59966/0 (socket says 172.21.15.72:59966) 2023-12-13T00:00:41.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.032+0000 7f0fda049640 1 -- 172.21.15.72:0/494270301 learned_addr learned my addr 172.21.15.72:0/494270301 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:41.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.032+0000 7f0fd9848640 1 --2- 172.21.15.72:0/494270301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fd4153730 0x7f0fd414e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:41.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.032+0000 7f0fda84a640 1 --2- 172.21.15.72:0/494270301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fd415a0c0 0x7f0fd41f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:41.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.035+0000 7f0fda049640 1 -- 172.21.15.72:0/494270301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fd4153730 msgr2=0x7f0fd414e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:41.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.035+0000 7f0fda049640 1 --2- 172.21.15.72:0/494270301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fd4153730 0x7f0fd414e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:41.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.035+0000 7f0fda049640 1 -- 172.21.15.72:0/494270301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fd415a0c0 msgr2=0x7f0fd41f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:41.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.035+0000 7f0fda049640 1 --2- 172.21.15.72:0/494270301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fd415a0c0 0x7f0fd41f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:41.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.035+0000 7f0fda049640 1 -- 172.21.15.72:0/494270301 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc009400 con 0x7f0fd40c91d0 2023-12-13T00:00:41.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.038+0000 7f0fda049640 1 --2- 172.21.15.72:0/494270301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd40c91d0 0x7f0fd41503b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000cc20 tx=0x7f0fd000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:41.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.041+0000 7f0fcaffd640 1 -- 172.21.15.72:0/494270301 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd000ce30 con 0x7f0fd40c91d0 2023-12-13T00:00:41.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.041+0000 7f0fcaffd640 1 -- 172.21.15.72:0/494270301 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd0012400 con 0x7f0fd40c91d0 2023-12-13T00:00:41.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.041+0000 7f0fcaffd640 1 -- 172.21.15.72:0/494270301 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd00127b0 con 0x7f0fd40c91d0 2023-12-13T00:00:41.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.041+0000 7f0fdc2ad640 1 -- 172.21.15.72:0/494270301 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd41eee60 con 0x7f0fd40c91d0 2023-12-13T00:00:41.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.041+0000 7f0fdc2ad640 1 -- 172.21.15.72:0/494270301 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd41ef120 con 0x7f0fd40c91d0 2023-12-13T00:00:41.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.042+0000 7f0fdc2ad640 1 -- 172.21.15.72:0/494270301 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd4073dc0 con 0x7f0fd40c91d0 2023-12-13T00:00:41.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.061+0000 7f0fcaffd640 1 -- 172.21.15.72:0/494270301 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0fd0007070 con 0x7f0fd40c91d0 2023-12-13T00:00:41.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.061+0000 7f0fcaffd640 1 --2- 172.21.15.72:0/494270301 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0fb806b210 0x7f0fb806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:41.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.062+0000 7f0fd9848640 1 --2- 172.21.15.72:0/494270301 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0fb806b210 0x7f0fb806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:41.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.062+0000 7f0fd9848640 1 --2- 172.21.15.72:0/494270301 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0fb806b210 0x7f0fb806d6d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0fd41eca90 tx=0x7f0fc4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:41.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.065+0000 7f0fcaffd640 1 -- 172.21.15.72:0/494270301 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0fd0058960 con 0x7f0fd40c91d0 2023-12-13T00:00:41.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.299+0000 7f0fcaffd640 1 -- 172.21.15.72:0/494270301 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0fd0054ca0 con 0x7f0fd40c91d0 2023-12-13T00:00:41.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.516+0000 7f0fdc2ad640 1 -- 172.21.15.72:0/494270301 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0fd40c8400 con 0x7f0fd40c91d0 2023-12-13T00:00:41.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.522+0000 7f0fcaffd640 1 -- 172.21.15.72:0/494270301 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0fd0017070 con 0x7f0fd40c91d0 2023-12-13T00:00:41.523 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-13T00:00:41.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.524+0000 7f0fdc2ad640 1 -- 172.21.15.72:0/494270301 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0fb806b210 msgr2=0x7f0fb806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:41.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.524+0000 7f0fdc2ad640 1 --2- 172.21.15.72:0/494270301 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0fb806b210 0x7f0fb806d6d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0fd41eca90 tx=0x7f0fc4009040 comp rx=0 tx=0).stop 2023-12-13T00:00:41.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.524+0000 7f0fdc2ad640 1 -- 172.21.15.72:0/494270301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd40c91d0 msgr2=0x7f0fd41503b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:41.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.524+0000 7f0fdc2ad640 1 --2- 172.21.15.72:0/494270301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd40c91d0 0x7f0fd41503b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000cc20 tx=0x7f0fd000a430 comp rx=0 tx=0).stop 2023-12-13T00:00:41.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.525+0000 7f0fdc2ad640 1 -- 172.21.15.72:0/494270301 shutdown_connections 2023-12-13T00:00:41.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.525+0000 7f0fdc2ad640 1 --2- 172.21.15.72:0/494270301 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0fb806b210 0x7f0fb806d6d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:41.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.525+0000 7f0fdc2ad640 1 --2- 172.21.15.72:0/494270301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fd415a0c0 0x7f0fd41f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:41.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.525+0000 7f0fdc2ad640 1 --2- 172.21.15.72:0/494270301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fd4153730 0x7f0fd414e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:41.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.525+0000 7f0fdc2ad640 1 --2- 172.21.15.72:0/494270301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd40c91d0 0x7f0fd41503b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:41.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.525+0000 7f0fdc2ad640 1 -- 172.21.15.72:0/494270301 >> 172.21.15.72:0/494270301 conn(0x7f0fd40707f0 msgr2=0x7f0fd40c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:41.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.525+0000 7f0fdc2ad640 1 -- 172.21.15.72:0/494270301 shutdown_connections 2023-12-13T00:00:41.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:41.525+0000 7f0fdc2ad640 1 -- 172.21.15.72:0/494270301 wait complete. 2023-12-13T00:00:41.536 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-13T00:00:41.536 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-13T00:00:41.536 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-12-13T00:00:41.536 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-13T00:00:41.536 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-13T00:00:41.536 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-13T00:00:41.536 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-13T00:00:41.536 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-13T00:00:41.536 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-13T00:00:41.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:41.537 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-12-13T00:00:41.552 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-13T00:00:41.552 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-13T00:00:41.552 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-12-13T00:00:41.552 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-12-13T00:00:41.552 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-12-13T00:00:41.552 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-12-13T00:00:41.552 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-13T00:00:41.552 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-12-13T00:00:41.553 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-12-13T00:00:41.553 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-13T00:00:41.553 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-12-13T00:00:41.553 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-12-13T00:00:41.553 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-13T00:00:41.553 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-12-13T00:00:41.553 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-13T00:00:41.553 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-12-13T00:00:41.553 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-13T00:00:41.553 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42262sec preferred_lft 42262sec 2023-12-13T00:00:41.553 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-12-13T00:00:41.553 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-12-13T00:00:41.554 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-13T00:00:41.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:41.554 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-12-13T00:00:41.554 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-12-13T00:00:41.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2023-12-13T00:00:41.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2023-12-13T00:00:41.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2023-12-13T00:00:41.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-13T00:00:41.555 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-12-13T00:00:41.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:41.705 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-13T00:00:41.730 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-12-13T00:00:41.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:41.732 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-12-13T00:00:42.042 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-12-13T00:00:42.043 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-13T00:00:42.043 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-13T00:00:42.043 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-13T00:00:42.043 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-13T00:00:42.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:42.044 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-12-13T00:00:42.044 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-12-13T00:00:42.044 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-13T00:00:42.044 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-13T00:00:42.044 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-13T00:00:42.044 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-12-13T00:00:42.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:42.273 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-12-13T00:00:42.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:42.288 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-12-13T00:00:42.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:42.344 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-12-13T00:00:42.344 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-12-13T00:00:42.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-13T00:00:42.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-13T00:00:42.345 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-12-13T00:00:42.428 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-13T00:00:42.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:42.428 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-12-13T00:00:42.428 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-12-13T00:00:42.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-13T00:00:42.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-13T00:00:42.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-13T00:00:42.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-13T00:00:42.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-13T00:00:42.429 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-12-13T00:00:42.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:42.566 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-12-13T00:00:42.566 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-12-13T00:00:42.566 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-12-13T00:00:42.566 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2023-12-13T00:00:42.566 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-12-13T00:00:42.608 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-13T00:00:42.609 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-13T00:00:42.609 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-13T00:00:42.663 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-13T00:00:42.663 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-13T00:00:42.664 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-13T00:00:42.718 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-12-13T00:00:42.787 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T00:00:42.842 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2023-12-13T00:00:42.842 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2023-12-13T00:00:42.843 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2023-12-13T00:00:42.843 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2023-12-13T00:00:42.843 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2023-12-13T00:00:42.843 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2023-12-13T00:00:42.843 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2023-12-13T00:00:42.843 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2023-12-13T00:00:42.843 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2023-12-13T00:00:42.843 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2023-12-13T00:00:42.843 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2023-12-13T00:00:42.843 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2023-12-13T00:00:42.843 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T00:00:42.843 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2023-12-13T00:00:42.844 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2023-12-13T00:00:42.844 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2023-12-13T00:00:42.844 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2023-12-13T00:00:42.844 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2023-12-13T00:00:42.844 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2023-12-13T00:00:42.844 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-13T00:00:42.844 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2023-12-13T00:00:42.844 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-13T00:00:42.844 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2023-12-13T00:00:42.844 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2023-12-13T00:00:42.844 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2023-12-13T00:00:42.844 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T00:00:42.844 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T00:00:42.845 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T00:00:42.845 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T00:00:42.845 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2023-12-13T00:00:42.845 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-13T00:00:42.845 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-13T00:00:42.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:42.846 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-12-13T00:00:42.900 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-13T00:00:42.901 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-13T00:00:42.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-12-13T00:00:42.969 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T00:00:43.024 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2023-12-13T00:00:43.024 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2023-12-13T00:00:43.025 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2023-12-13T00:00:43.025 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2023-12-13T00:00:43.025 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2023-12-13T00:00:43.025 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2023-12-13T00:00:43.025 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2023-12-13T00:00:43.025 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2023-12-13T00:00:43.025 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2023-12-13T00:00:43.025 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2023-12-13T00:00:43.025 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2023-12-13T00:00:43.025 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2023-12-13T00:00:43.025 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T00:00:43.025 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2023-12-13T00:00:43.025 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2023-12-13T00:00:43.026 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2023-12-13T00:00:43.026 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2023-12-13T00:00:43.026 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2023-12-13T00:00:43.026 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2023-12-13T00:00:43.026 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-13T00:00:43.026 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2023-12-13T00:00:43.026 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-13T00:00:43.026 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2023-12-13T00:00:43.026 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2023-12-13T00:00:43.026 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2023-12-13T00:00:43.026 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T00:00:43.026 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T00:00:43.026 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T00:00:43.027 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T00:00:43.027 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2023-12-13T00:00:43.027 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-13T00:00:43.027 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-13T00:00:43.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:43.027 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-12-13T00:00:43.045 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:2023-12-13T00:00:43.044+0000 7fd219ed8480 -1 init, newargv = 0x5618546aa080 newargc=15 2023-12-13T00:00:43.045 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[95791]: starting ceph client 2023-12-13T00:00:43.288 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[95791]: starting fuse 2023-12-13T00:00:44.161 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-12-13T00:00:44.193 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T00:00:44.250 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2023-12-13T00:00:44.251 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2023-12-13T00:00:44.251 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2023-12-13T00:00:44.251 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2023-12-13T00:00:44.251 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2023-12-13T00:00:44.251 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2023-12-13T00:00:44.251 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2023-12-13T00:00:44.251 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2023-12-13T00:00:44.251 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2023-12-13T00:00:44.251 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2023-12-13T00:00:44.251 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2023-12-13T00:00:44.251 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2023-12-13T00:00:44.251 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T00:00:44.251 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2023-12-13T00:00:44.252 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2023-12-13T00:00:44.252 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2023-12-13T00:00:44.252 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2023-12-13T00:00:44.252 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2023-12-13T00:00:44.252 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2023-12-13T00:00:44.252 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-13T00:00:44.252 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2023-12-13T00:00:44.252 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-13T00:00:44.252 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2023-12-13T00:00:44.252 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2023-12-13T00:00:44.252 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2023-12-13T00:00:44.252 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T00:00:44.252 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T00:00:44.252 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T00:00:44.253 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T00:00:44.253 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2023-12-13T00:00:44.253 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-13T00:00:44.253 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-13T00:00:44.253 INFO:teuthology.orchestra.run.smithi072.stdout:/home/ubuntu/cephtest/mnt.admin 2023-12-13T00:00:44.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:44.253 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-12-13T00:00:44.306 INFO:teuthology.orchestra.run.smithi072.stdout:41 2023-12-13T00:00:44.306 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-13T00:00:44.307 DEBUG:teuthology.orchestra.run.smithi072:> sudo stdin-killer -- python3 -c ' 2023-12-13T00:00:44.307 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2023-12-13T00:00:44.307 DEBUG:teuthology.orchestra.run.smithi072:> import re 2023-12-13T00:00:44.307 DEBUG:teuthology.orchestra.run.smithi072:> import os 2023-12-13T00:00:44.307 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2023-12-13T00:00:44.307 DEBUG:teuthology.orchestra.run.smithi072:> 2023-12-13T00:00:44.307 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2023-12-13T00:00:44.307 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-13T00:00:44.307 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2023-12-13T00:00:44.307 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-13T00:00:44.308 DEBUG:teuthology.orchestra.run.smithi072:> 2023-12-13T00:00:44.308 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2023-12-13T00:00:44.308 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2023-12-13T00:00:44.308 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2023-12-13T00:00:44.308 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2023-12-13T00:00:44.308 DEBUG:teuthology.orchestra.run.smithi072:> 2023-12-13T00:00:44.308 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2023-12-13T00:00:44.308 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-13T00:00:44.308 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-13T00:00:44.308 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-13T00:00:44.308 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2023-12-13T00:00:44.308 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2023-12-13T00:00:44.308 DEBUG:teuthology.orchestra.run.smithi072:> return f 2023-12-13T00:00:44.308 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-13T00:00:44.308 DEBUG:teuthology.orchestra.run.smithi072:> 2023-12-13T00:00:44.309 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.admin")) 2023-12-13T00:00:44.309 DEBUG:teuthology.orchestra.run.smithi072:> ' 2023-12-13T00:00:44.427 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.admin.95791.asok 2023-12-13T00:00:44.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-13T00:00:44.438 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.95791.asok 2023-12-13T00:00:44.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:44.438 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.95791.asok status 2023-12-13T00:00:44.574 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-12-13T00:00:44.575 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2023-12-13T00:00:44.575 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "021ac1670a21c19759080c6da90baaeb42e7d175", 2023-12-13T00:00:44.575 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 19.0.0-157-g021ac167 (021ac1670a21c19759080c6da90baaeb42e7d175) squid (dev)", 2023-12-13T00:00:44.575 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "admin", 2023-12-13T00:00:44.575 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2023-12-13T00:00:44.575 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-13T00:00:44.575 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "95791", 2023-12-13T00:00:44.575 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2023-12-13T00:00:44.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-12-13T00:00:44.575 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2023-12-13T00:00:44.576 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2023-12-13T00:00:44.576 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4356, 2023-12-13T00:00:44.576 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2023-12-13T00:00:44.576 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2023-12-13T00:00:44.576 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2023-12-13T00:00:44.576 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 4356 2023-12-13T00:00:44.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-12-13T00:00:44.576 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-12-13T00:00:44.576 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-12-13T00:00:44.576 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-12-13T00:00:44.576 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 241034405 2023-12-13T00:00:44.577 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-12-13T00:00:44.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-12-13T00:00:44.577 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-12-13T00:00:44.577 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-12-13T00:00:44.577 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-12-13T00:00:44.577 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 241034405 2023-12-13T00:00:44.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-12-13T00:00:44.577 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.4356 192.168.0.1:0/241034405", 2023-12-13T00:00:44.577 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.1:0/241034405", 2023-12-13T00:00:44.577 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2023-12-13T00:00:44.577 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 7, 2023-12-13T00:00:44.577 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 25, 2023-12-13T00:00:44.578 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2023-12-13T00:00:44.578 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2023-12-13T00:00:44.578 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2023-12-13T00:00:44.578 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-12-13T00:00:44.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:44.586 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2023-12-13T00:00:44.586 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-13T00:00:44.633 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2023-12-13T00:00:44.633 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-13T00:00:44.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:44.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-13T00:00:44.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:44.730 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-13T00:00:44.936 INFO:teuthology.orchestra.run.smithi072.stdout:# file: . 2023-12-13T00:00:44.936 INFO:teuthology.orchestra.run.smithi072.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-13T00:00:44.937 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:00:44.937 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-13T00:00:44.937 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-13T00:00:44.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:00:45.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.093+0000 7fe0619fc640 1 Processor -- start 2023-12-13T00:00:45.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.093+0000 7fe0619fc640 1 -- start start 2023-12-13T00:00:45.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.094+0000 7fe0619fc640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe05c0cbf00 0x7fe05c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:45.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.094+0000 7fe0619fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe05c0cd000 0x7fe05c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:45.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.094+0000 7fe0619fc640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05c0cba70 con 0x7fe05c0c9c70 2023-12-13T00:00:45.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.094+0000 7fe0619fc640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05c153c60 con 0x7fe05c0cbf00 2023-12-13T00:00:45.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.094+0000 7fe0619fc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0cb490 con 0x7fe05c0cd000 2023-12-13T00:00:45.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.095+0000 7fe05affd640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fe05c0c9c70 0x7fe05c1594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:54886/0 (socket says 172.21.15.72:54886) 2023-12-13T00:00:45.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.095+0000 7fe05affd640 1 -- 172.21.15.72:0/3796623909 learned_addr learned my addr 172.21.15.72:0/3796623909 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:45.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.095+0000 7fe05b7fe640 1 --2- 172.21.15.72:0/3796623909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe05c0cd000 0x7fe05c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:45.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.095+0000 7fe05a7fc640 1 --2- 172.21.15.72:0/3796623909 >> v2:172.21.15.72:3300/0 conn(0x7fe05c0cbf00 0x7fe05c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:45.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.097+0000 7fe059ffb640 1 -- 172.21.15.72:0/3796623909 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951160142 0 0) 0x7fe05c0cba70 con 0x7fe05c0c9c70 2023-12-13T00:00:45.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.097+0000 7fe059ffb640 1 -- 172.21.15.72:0/3796623909 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe044003520 con 0x7fe05c0c9c70 2023-12-13T00:00:45.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.097+0000 7fe05b7fe640 1 -- 172.21.15.72:0/3796623909 >> v2:172.21.15.72:3300/0 conn(0x7fe05c0cbf00 msgr2=0x7fe05c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:45.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.097+0000 7fe05b7fe640 1 --2- 172.21.15.72:0/3796623909 >> v2:172.21.15.72:3300/0 conn(0x7fe05c0cbf00 0x7fe05c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:45.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.097+0000 7fe05b7fe640 1 -- 172.21.15.72:0/3796623909 >> v1:172.21.15.176:6789/0 conn(0x7fe05c0c9c70 legacy=0x7fe05c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:45.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.097+0000 7fe05b7fe640 1 -- 172.21.15.72:0/3796623909 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c0ce2f0 con 0x7fe05c0cd000 2023-12-13T00:00:45.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.099+0000 7fe05b7fe640 1 --2- 172.21.15.72:0/3796623909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe05c0cd000 0x7fe05c0cd430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe054009d90 tx=0x7fe05402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82ddf962eac9cfc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:45.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.103+0000 7fe059ffb640 1 -- 172.21.15.72:0/3796623909 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05402cc50 con 0x7fe05c0cd000 2023-12-13T00:00:45.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.103+0000 7fe059ffb640 1 -- 172.21.15.72:0/3796623909 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05402cdb0 con 0x7fe05c0cd000 2023-12-13T00:00:45.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.103+0000 7fe059ffb640 1 -- 172.21.15.72:0/3796623909 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054034660 con 0x7fe05c0cd000 2023-12-13T00:00:45.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.104+0000 7fe0619fc640 1 -- 172.21.15.72:0/3796623909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe05c0cd000 msgr2=0x7fe05c0cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:45.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.104+0000 7fe0619fc640 1 --2- 172.21.15.72:0/3796623909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe05c0cd000 0x7fe05c0cd430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe054009d90 tx=0x7fe05402bea0 comp rx=0 tx=0).stop 2023-12-13T00:00:45.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.104+0000 7fe0619fc640 1 -- 172.21.15.72:0/3796623909 shutdown_connections 2023-12-13T00:00:45.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.104+0000 7fe0619fc640 1 --2- 172.21.15.72:0/3796623909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe05c0cd000 0x7fe05c0cd430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:45.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.104+0000 7fe0619fc640 1 --2- 172.21.15.72:0/3796623909 >> v2:172.21.15.72:3300/0 conn(0x7fe05c0cbf00 0x7fe05c0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:45.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.104+0000 7fe0619fc640 1 -- 172.21.15.72:0/3796623909 >> 172.21.15.72:0/3796623909 conn(0x7fe05c0b07d0 msgr2=0x7fe05c0b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:45.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.104+0000 7fe0619fc640 1 -- 172.21.15.72:0/3796623909 shutdown_connections 2023-12-13T00:00:45.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.104+0000 7fe0619fc640 1 -- 172.21.15.72:0/3796623909 wait complete. 2023-12-13T00:00:45.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.105+0000 7fe0619fc640 1 Processor -- start 2023-12-13T00:00:45.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.105+0000 7fe0619fc640 1 -- start start 2023-12-13T00:00:45.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.106+0000 7fe0619fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe05c0c9c70 0x7fe05c15a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:45.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.106+0000 7fe0619fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c0cbf00 0x7fe05c0afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:45.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.106+0000 7fe0619fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe05c0cd000 0x7fe05c14fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:45.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.106+0000 7fe0619fc640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c153e30 con 0x7fe05c0cbf00 2023-12-13T00:00:45.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.106+0000 7fe0619fc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c154110 con 0x7fe05c0cd000 2023-12-13T00:00:45.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.106+0000 7fe0619fc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c1ef510 con 0x7fe05c0c9c70 2023-12-13T00:00:45.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.106+0000 7fe05a7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c0cbf00 0x7fe05c0afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:45.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.107+0000 7fe05b7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe05c0cd000 0x7fe05c14fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:45.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.107+0000 7fe05affd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe05c0c9c70 0x7fe05c15a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:45.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.107+0000 7fe05a7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c0cbf00 0x7fe05c0afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59980/0 (socket says 172.21.15.72:59980) 2023-12-13T00:00:45.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.107+0000 7fe05a7fc640 1 -- 172.21.15.72:0/1458638932 learned_addr learned my addr 172.21.15.72:0/1458638932 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:45.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.110+0000 7fe05a7fc640 1 -- 172.21.15.72:0/1458638932 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe05c0c9c70 msgr2=0x7fe05c15a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:45.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.110+0000 7fe05a7fc640 1 --2- 172.21.15.72:0/1458638932 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe05c0c9c70 0x7fe05c15a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:45.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.110+0000 7fe05a7fc640 1 -- 172.21.15.72:0/1458638932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe05c0cd000 msgr2=0x7fe05c14fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:45.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.110+0000 7fe05a7fc640 1 --2- 172.21.15.72:0/1458638932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe05c0cd000 0x7fe05c14fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:45.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.110+0000 7fe05a7fc640 1 -- 172.21.15.72:0/1458638932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe054009a70 con 0x7fe05c0cbf00 2023-12-13T00:00:45.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.114+0000 7fe05a7fc640 1 --2- 172.21.15.72:0/1458638932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c0cbf00 0x7fe05c0afb80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe05000e980 tx=0x7fe05000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:45.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.117+0000 7fe043fff640 1 -- 172.21.15.72:0/1458638932 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe050009670 con 0x7fe05c0cbf00 2023-12-13T00:00:45.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.117+0000 7fe043fff640 1 -- 172.21.15.72:0/1458638932 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05000ca00 con 0x7fe05c0cbf00 2023-12-13T00:00:45.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.117+0000 7fe043fff640 1 -- 172.21.15.72:0/1458638932 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05000cd90 con 0x7fe05c0cbf00 2023-12-13T00:00:45.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.117+0000 7fe0619fc640 1 -- 172.21.15.72:0/1458638932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05c1ef7f0 con 0x7fe05c0cbf00 2023-12-13T00:00:45.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.117+0000 7fe0619fc640 1 -- 172.21.15.72:0/1458638932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05c1efdb0 con 0x7fe05c0cbf00 2023-12-13T00:00:45.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.118+0000 7fe0619fc640 1 -- 172.21.15.72:0/1458638932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05c15a450 con 0x7fe05c0cbf00 2023-12-13T00:00:45.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.137+0000 7fe043fff640 1 -- 172.21.15.72:0/1458638932 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe050013470 con 0x7fe05c0cbf00 2023-12-13T00:00:45.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.137+0000 7fe043fff640 1 --2- 172.21.15.72:0/1458638932 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe04806b240 0x7fe04806d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:45.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.138+0000 7fe05affd640 1 --2- 172.21.15.72:0/1458638932 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe04806b240 0x7fe04806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:45.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.138+0000 7fe05affd640 1 --2- 172.21.15.72:0/1458638932 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe04806b240 0x7fe04806d700 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0011e0 tx=0x7fe04c007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:45.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.370+0000 7fe043fff640 1 -- 172.21.15.72:0/1458638932 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe050058df0 con 0x7fe05c0cbf00 2023-12-13T00:00:45.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.370+0000 7fe043fff640 1 -- 172.21.15.72:0/1458638932 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe050055130 con 0x7fe05c0cbf00 2023-12-13T00:00:45.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.540+0000 7fe0619fc640 1 -- 172.21.15.72:0/1458638932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe05c073dc0 con 0x7fe05c0cbf00 2023-12-13T00:00:45.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.577+0000 7fe043fff640 1 -- 172.21.15.72:0/1458638932 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18327 (secure 0 0 0) 0x7fe050017090 con 0x7fe05c0cbf00 2023-12-13T00:00:45.579 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:00:45.579 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:00:36.191864+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T00:00:27.701252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T00:00:29.324356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T00:00:33.363089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:00:45.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.580+0000 7fe0619fc640 1 -- 172.21.15.72:0/1458638932 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe04806b240 msgr2=0x7fe04806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:45.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.580+0000 7fe0619fc640 1 --2- 172.21.15.72:0/1458638932 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe04806b240 0x7fe04806d700 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0011e0 tx=0x7fe04c007d30 comp rx=0 tx=0).stop 2023-12-13T00:00:45.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.580+0000 7fe0619fc640 1 -- 172.21.15.72:0/1458638932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c0cbf00 msgr2=0x7fe05c0afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:45.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.580+0000 7fe0619fc640 1 --2- 172.21.15.72:0/1458638932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c0cbf00 0x7fe05c0afb80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe05000e980 tx=0x7fe05000ee40 comp rx=0 tx=0).stop 2023-12-13T00:00:45.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.580+0000 7fe0619fc640 1 -- 172.21.15.72:0/1458638932 shutdown_connections 2023-12-13T00:00:45.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.580+0000 7fe0619fc640 1 --2- 172.21.15.72:0/1458638932 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe04806b240 0x7fe04806d700 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:45.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.580+0000 7fe0619fc640 1 --2- 172.21.15.72:0/1458638932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe05c0cd000 0x7fe05c14fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:45.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.580+0000 7fe0619fc640 1 --2- 172.21.15.72:0/1458638932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c0cbf00 0x7fe05c0afb80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:45.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.580+0000 7fe0619fc640 1 --2- 172.21.15.72:0/1458638932 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe05c0c9c70 0x7fe05c15a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:45.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.580+0000 7fe0619fc640 1 -- 172.21.15.72:0/1458638932 >> 172.21.15.72:0/1458638932 conn(0x7fe05c0b07d0 msgr2=0x7fe05c0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:45.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.580+0000 7fe0619fc640 1 -- 172.21.15.72:0/1458638932 shutdown_connections 2023-12-13T00:00:45.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.580+0000 7fe0619fc640 1 -- 172.21.15.72:0/1458638932 wait complete. 2023-12-13T00:00:45.592 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-13T00:00:06.839153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-13T00:00:27.701252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-13T00:00:29.324356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-13T00:00:33.363089+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-13T00:00:45.593 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-13T00:00:45.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.694+0000 7f9531dde640 1 Processor -- start 2023-12-13T00:00:45.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.694+0000 7f9531dde640 1 -- start start 2023-12-13T00:00:45.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.695+0000 7f9531dde640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f952c151680 0x7f952c1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:45.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.695+0000 7f9531dde640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c0c8240 con 0x7f952c06f810 2023-12-13T00:00:45.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.695+0000 7f9531dde640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c157880 con 0x7f952c06f3f0 2023-12-13T00:00:45.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.695+0000 7f9531dde640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952c157b60 con 0x7f952c151680 2023-12-13T00:00:45.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.695+0000 7f952b7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f952c151680 0x7f952c1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:45.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.695+0000 7f952affd640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f952c06f3f0 0x7f952c0c7b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:54902/0 (socket says 172.21.15.72:54902) 2023-12-13T00:00:45.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.695+0000 7f952affd640 1 -- 172.21.15.72:0/2986430154 learned_addr learned my addr 172.21.15.72:0/2986430154 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:45.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.698+0000 7f952a7fc640 1 -- 172.21.15.72:0/2986430154 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651685808 0 0) 0x7f952c157880 con 0x7f952c06f3f0 2023-12-13T00:00:45.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.698+0000 7f952a7fc640 1 -- 172.21.15.72:0/2986430154 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9514003520 con 0x7f952c06f3f0 2023-12-13T00:00:45.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.700+0000 7f952b7fe640 1 -- 172.21.15.72:0/2986430154 >> v1:172.21.15.176:6789/0 conn(0x7f952c06f3f0 legacy=0x7f952c0c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:45.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.700+0000 7f952b7fe640 1 -- 172.21.15.72:0/2986430154 >> v1:172.21.15.72:6789/0 conn(0x7f952c06f810 legacy=0x7f952c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:45.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.700+0000 7f952b7fe640 1 -- 172.21.15.72:0/2986430154 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c157e40 con 0x7f952c151680 2023-12-13T00:00:45.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.703+0000 7f952b7fe640 1 --2- 172.21.15.72:0/2986430154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c151680 0x7f952c1571d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f951c0097a0 tx=0x7f951c02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f99ea688571efd5 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:45.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.705+0000 7f952a7fc640 1 -- 172.21.15.72:0/2986430154 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c02f810 con 0x7f952c151680 2023-12-13T00:00:45.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.707+0000 7f952a7fc640 1 -- 172.21.15.72:0/2986430154 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c02f970 con 0x7f952c151680 2023-12-13T00:00:45.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.707+0000 7f952a7fc640 1 -- 172.21.15.72:0/2986430154 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c02fce0 con 0x7f952c151680 2023-12-13T00:00:45.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.708+0000 7f9531dde640 1 -- 172.21.15.72:0/2986430154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c151680 msgr2=0x7f952c1571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:45.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.708+0000 7f9531dde640 1 --2- 172.21.15.72:0/2986430154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c151680 0x7f952c1571d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f951c0097a0 tx=0x7f951c02b9f0 comp rx=0 tx=0).stop 2023-12-13T00:00:45.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.708+0000 7f9531dde640 1 -- 172.21.15.72:0/2986430154 shutdown_connections 2023-12-13T00:00:45.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.708+0000 7f9531dde640 1 --2- 172.21.15.72:0/2986430154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c151680 0x7f952c1571d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:45.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.708+0000 7f9531dde640 1 -- 172.21.15.72:0/2986430154 >> 172.21.15.72:0/2986430154 conn(0x7f952c0707f0 msgr2=0x7f952c070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:45.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.708+0000 7f9531dde640 1 -- 172.21.15.72:0/2986430154 shutdown_connections 2023-12-13T00:00:45.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.708+0000 7f9531dde640 1 -- 172.21.15.72:0/2986430154 wait complete. 2023-12-13T00:00:45.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.709+0000 7f9531dde640 1 Processor -- start 2023-12-13T00:00:45.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.709+0000 7f9531dde640 1 -- start start 2023-12-13T00:00:45.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.710+0000 7f9531dde640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f952c06f3f0 0x7f952c1eec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:45.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.710+0000 7f9531dde640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c06f810 0x7f952c14bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:45.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.710+0000 7f9531dde640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f952c151680 0x7f952c1f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.710+0000 7f9531dde640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0ae2c0 con 0x7f952c06f810 2023-12-13T00:00:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.710+0000 7f9531dde640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0ad320 con 0x7f952c151680 2023-12-13T00:00:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.710+0000 7f9531dde640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c06cf70 con 0x7f952c06f3f0 2023-12-13T00:00:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.710+0000 7f952affd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c06f810 0x7f952c14bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.710+0000 7f952bfff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f952c151680 0x7f952c1f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:45.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.711+0000 7f952b7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f952c06f3f0 0x7f952c1eec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:45.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.711+0000 7f952bfff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f952c151680 0x7f952c1f21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:41768/0 (socket says 172.21.15.72:41768) 2023-12-13T00:00:45.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.711+0000 7f952bfff640 1 -- 172.21.15.72:0/3610543043 learned_addr learned my addr 172.21.15.72:0/3610543043 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:45.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.714+0000 7f952affd640 1 -- 172.21.15.72:0/3610543043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f952c06f3f0 msgr2=0x7f952c1eec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:45.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.714+0000 7f952affd640 1 --2- 172.21.15.72:0/3610543043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f952c06f3f0 0x7f952c1eec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:45.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.714+0000 7f952affd640 1 -- 172.21.15.72:0/3610543043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f952c151680 msgr2=0x7f952c1f21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:45.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.714+0000 7f952affd640 1 --2- 172.21.15.72:0/3610543043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f952c151680 0x7f952c1f21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:45.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.714+0000 7f952affd640 1 -- 172.21.15.72:0/3610543043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c009400 con 0x7f952c06f810 2023-12-13T00:00:45.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.714+0000 7f952bfff640 1 --2- 172.21.15.72:0/3610543043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f952c151680 0x7f952c1f21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T00:00:45.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.716+0000 7f952affd640 1 --2- 172.21.15.72:0/3610543043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c06f810 0x7f952c14bb50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f952000c460 tx=0x7f952000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:45.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.718+0000 7f9513fff640 1 -- 172.21.15.72:0/3610543043 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520005ce0 con 0x7f952c06f810 2023-12-13T00:00:45.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.718+0000 7f9531dde640 1 -- 172.21.15.72:0/3610543043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952c1559e0 con 0x7f952c06f810 2023-12-13T00:00:45.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.718+0000 7f9531dde640 1 -- 172.21.15.72:0/3610543043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c06d4a0 con 0x7f952c06f810 2023-12-13T00:00:45.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.719+0000 7f9531dde640 1 -- 172.21.15.72:0/3610543043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c070240 con 0x7f952c06f810 2023-12-13T00:00:45.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.720+0000 7f9513fff640 1 -- 172.21.15.72:0/3610543043 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9520005e40 con 0x7f952c06f810 2023-12-13T00:00:45.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.720+0000 7f9513fff640 1 -- 172.21.15.72:0/3610543043 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520007270 con 0x7f952c06f810 2023-12-13T00:00:45.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.962+0000 7f9513fff640 1 -- 172.21.15.72:0/3610543043 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f95200073d0 con 0x7f952c06f810 2023-12-13T00:00:45.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.962+0000 7f9513fff640 1 --2- 172.21.15.72:0/3610543043 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f951806b1f0 0x7f951806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:45.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.963+0000 7f952b7fe640 1 --2- 172.21.15.72:0/3610543043 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f951806b1f0 0x7f951806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:45.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.963+0000 7f952b7fe640 1 --2- 172.21.15.72:0/3610543043 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f951806b1f0 0x7f951806d6b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f951c036000 tx=0x7f951c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:45.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.977+0000 7f9513fff640 1 -- 172.21.15.72:0/3610543043 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9520058110 con 0x7f952c06f810 2023-12-13T00:00:45.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:45.977+0000 7f9513fff640 1 -- 172.21.15.72:0/3610543043 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9520054450 con 0x7f952c06f810 2023-12-13T00:00:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.153+0000 7f9531dde640 1 -- 172.21.15.72:0/3610543043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f952c073dc0 con 0x7f952c06f810 2023-12-13T00:00:46.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.158+0000 7f9513fff640 1 -- 172.21.15.72:0/3610543043 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9520057a70 con 0x7f952c06f810 2023-12-13T00:00:46.159 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-12-13T00:00:46.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.161+0000 7f9531dde640 1 -- 172.21.15.72:0/3610543043 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f951806b1f0 msgr2=0x7f951806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:46.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.161+0000 7f9531dde640 1 --2- 172.21.15.72:0/3610543043 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f951806b1f0 0x7f951806d6b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f951c036000 tx=0x7f951c008030 comp rx=0 tx=0).stop 2023-12-13T00:00:46.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.161+0000 7f9531dde640 1 -- 172.21.15.72:0/3610543043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c06f810 msgr2=0x7f952c14bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:46.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.161+0000 7f9531dde640 1 --2- 172.21.15.72:0/3610543043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c06f810 0x7f952c14bb50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f952000c460 tx=0x7f952000c920 comp rx=0 tx=0).stop 2023-12-13T00:00:46.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.161+0000 7f9531dde640 1 -- 172.21.15.72:0/3610543043 shutdown_connections 2023-12-13T00:00:46.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.161+0000 7f9531dde640 1 --2- 172.21.15.72:0/3610543043 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f951806b1f0 0x7f951806d6b0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f951c036000 tx=0x7f951c008030 comp rx=0 tx=0).stop 2023-12-13T00:00:46.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.161+0000 7f9531dde640 1 --2- 172.21.15.72:0/3610543043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f952c151680 0x7f952c1f21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:46.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.161+0000 7f9531dde640 1 --2- 172.21.15.72:0/3610543043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c06f810 0x7f952c14bb50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:46.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.161+0000 7f9531dde640 1 --2- 172.21.15.72:0/3610543043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f952c06f3f0 0x7f952c1eec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:46.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.161+0000 7f9531dde640 1 -- 172.21.15.72:0/3610543043 >> 172.21.15.72:0/3610543043 conn(0x7f952c0707f0 msgr2=0x7f952c0afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:46.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.161+0000 7f9531dde640 1 -- 172.21.15.72:0/3610543043 shutdown_connections 2023-12-13T00:00:46.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.161+0000 7f9531dde640 1 -- 172.21.15.72:0/3610543043 wait complete. 2023-12-13T00:00:46.172 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-13T00:00:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.274+0000 7ff7a7808640 1 Processor -- start 2023-12-13T00:00:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.274+0000 7ff7a7808640 1 -- start start 2023-12-13T00:00:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.275+0000 7ff7a7808640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7a00c5080 0x7ff7a006b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.275+0000 7ff7a7808640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a006a4b0 con 0x7ff7a00c4ca0 2023-12-13T00:00:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.275+0000 7ff7a7808640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a00c8330 con 0x7ff7a015ae40 2023-12-13T00:00:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.275+0000 7ff7a7808640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a00c85d0 con 0x7ff7a00c5080 2023-12-13T00:00:46.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.275+0000 7ff7a5da5640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7ff7a015ae40 0x7ff7a0150c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:54910/0 (socket says 172.21.15.72:54910) 2023-12-13T00:00:46.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.275+0000 7ff7a5da5640 1 -- 172.21.15.72:0/3756658070 learned_addr learned my addr 172.21.15.72:0/3756658070 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:46.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.275+0000 7ff7a4da3640 1 --2- 172.21.15.72:0/3756658070 >> v2:172.21.15.72:3300/0 conn(0x7ff7a00c5080 0x7ff7a006b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:46.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.277+0000 7ff797fff640 1 -- 172.21.15.72:0/3756658070 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120253366 0 0) 0x7ff7a00c8330 con 0x7ff7a015ae40 2023-12-13T00:00:46.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.278+0000 7ff797fff640 1 -- 172.21.15.72:0/3756658070 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff78c003520 con 0x7ff7a015ae40 2023-12-13T00:00:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.279+0000 7ff7a4da3640 1 -- 172.21.15.72:0/3756658070 >> v1:172.21.15.176:6789/0 conn(0x7ff7a015ae40 legacy=0x7ff7a0150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.279+0000 7ff7a4da3640 1 -- 172.21.15.72:0/3756658070 >> v1:172.21.15.72:6789/0 conn(0x7ff7a00c4ca0 legacy=0x7ff7a0157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.279+0000 7ff7a4da3640 1 -- 172.21.15.72:0/3756658070 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a006a700 con 0x7ff7a00c5080 2023-12-13T00:00:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.283+0000 7ff7a4da3640 1 --2- 172.21.15.72:0/3756658070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a00c5080 0x7ff7a006b930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff7900097d0 tx=0x7ff79002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d09f1c65bc0857 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:46.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.285+0000 7ff797fff640 1 -- 172.21.15.72:0/3756658070 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790030610 con 0x7ff7a00c5080 2023-12-13T00:00:46.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.287+0000 7ff797fff640 1 -- 172.21.15.72:0/3756658070 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff790030770 con 0x7ff7a00c5080 2023-12-13T00:00:46.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.287+0000 7ff797fff640 1 -- 172.21.15.72:0/3756658070 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790030ae0 con 0x7ff7a00c5080 2023-12-13T00:00:46.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.287+0000 7ff7a7808640 1 -- 172.21.15.72:0/3756658070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a00c5080 msgr2=0x7ff7a006b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:46.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.287+0000 7ff7a7808640 1 --2- 172.21.15.72:0/3756658070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a00c5080 0x7ff7a006b930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff7900097d0 tx=0x7ff79002b960 comp rx=0 tx=0).stop 2023-12-13T00:00:46.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.287+0000 7ff7a7808640 1 -- 172.21.15.72:0/3756658070 shutdown_connections 2023-12-13T00:00:46.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.287+0000 7ff7a7808640 1 --2- 172.21.15.72:0/3756658070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a00c5080 0x7ff7a006b930 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:46.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.287+0000 7ff7a7808640 1 -- 172.21.15.72:0/3756658070 >> 172.21.15.72:0/3756658070 conn(0x7ff7a006d170 msgr2=0x7ff7a006d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:46.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.288+0000 7ff7a7808640 1 -- 172.21.15.72:0/3756658070 shutdown_connections 2023-12-13T00:00:46.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.288+0000 7ff7a7808640 1 -- 172.21.15.72:0/3756658070 wait complete. 2023-12-13T00:00:46.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.289+0000 7ff7a7808640 1 Processor -- start 2023-12-13T00:00:46.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.289+0000 7ff7a7808640 1 -- start start 2023-12-13T00:00:46.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.289+0000 7ff7a7808640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a00c4ca0 0x7ff7a01ed8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:46.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.289+0000 7ff7a7808640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7a00c5080 0x7ff7a01ee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:46.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.289+0000 7ff7a7808640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7a015ae40 0x7ff7a0147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:46.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.289+0000 7ff7a7808640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a014cd00 con 0x7ff7a00c4ca0 2023-12-13T00:00:46.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.289+0000 7ff7a7808640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a01ede10 con 0x7ff7a00c5080 2023-12-13T00:00:46.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.289+0000 7ff7a7808640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a01ee800 con 0x7ff7a015ae40 2023-12-13T00:00:46.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.290+0000 7ff7a55a4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a00c4ca0 0x7ff7a01ed8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:46.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.290+0000 7ff7a55a4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a00c4ca0 0x7ff7a01ed8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60020/0 (socket says 172.21.15.72:60020) 2023-12-13T00:00:46.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.290+0000 7ff7a55a4640 1 -- 172.21.15.72:0/2297129831 learned_addr learned my addr 172.21.15.72:0/2297129831 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:46.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.290+0000 7ff7a4da3640 1 --2- 172.21.15.72:0/2297129831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7a00c5080 0x7ff7a01ee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:46.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.290+0000 7ff7a5da5640 1 --2- 172.21.15.72:0/2297129831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7a015ae40 0x7ff7a0147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:46.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.293+0000 7ff7a55a4640 1 -- 172.21.15.72:0/2297129831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7a015ae40 msgr2=0x7ff7a0147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:46.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.293+0000 7ff7a55a4640 1 --2- 172.21.15.72:0/2297129831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7a015ae40 0x7ff7a0147c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:46.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.293+0000 7ff7a55a4640 1 -- 172.21.15.72:0/2297129831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7a00c5080 msgr2=0x7ff7a01ee2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:46.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.293+0000 7ff7a55a4640 1 --2- 172.21.15.72:0/2297129831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7a00c5080 0x7ff7a01ee2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:46.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.293+0000 7ff7a55a4640 1 -- 172.21.15.72:0/2297129831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff790009400 con 0x7ff7a00c4ca0 2023-12-13T00:00:46.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.296+0000 7ff7a55a4640 1 --2- 172.21.15.72:0/2297129831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a00c4ca0 0x7ff7a01ed8d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00c400 tx=0x7ff79c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:46.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.299+0000 7ff795ffb640 1 -- 172.21.15.72:0/2297129831 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c0052d0 con 0x7ff7a00c4ca0 2023-12-13T00:00:46.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.299+0000 7ff795ffb640 1 -- 172.21.15.72:0/2297129831 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79c005450 con 0x7ff7a00c4ca0 2023-12-13T00:00:46.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.299+0000 7ff795ffb640 1 -- 172.21.15.72:0/2297129831 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c007260 con 0x7ff7a00c4ca0 2023-12-13T00:00:46.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.299+0000 7ff7a7808640 1 -- 172.21.15.72:0/2297129831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a014cf10 con 0x7ff7a00c4ca0 2023-12-13T00:00:46.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.299+0000 7ff7a7808640 1 -- 172.21.15.72:0/2297129831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a014b6b0 con 0x7ff7a00c4ca0 2023-12-13T00:00:46.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.300+0000 7ff7a7808640 1 -- 172.21.15.72:0/2297129831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a00c62e0 con 0x7ff7a00c4ca0 2023-12-13T00:00:46.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.318+0000 7ff795ffb640 1 -- 172.21.15.72:0/2297129831 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff79c0073c0 con 0x7ff7a00c4ca0 2023-12-13T00:00:46.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.318+0000 7ff795ffb640 1 --2- 172.21.15.72:0/2297129831 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff78406b210 0x7ff78406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:46.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.318+0000 7ff7a4da3640 1 --2- 172.21.15.72:0/2297129831 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff78406b210 0x7ff78406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:46.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.319+0000 7ff7a4da3640 1 --2- 172.21.15.72:0/2297129831 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff78406b210 0x7ff78406d6d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff790036000 tx=0x7ff79003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.321+0000 7ff795ffb640 1 -- 172.21.15.72:0/2297129831 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff79c007670 con 0x7ff7a00c4ca0 2023-12-13T00:00:46.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.552+0000 7ff795ffb640 1 -- 172.21.15.72:0/2297129831 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff79c054400 con 0x7ff7a00c4ca0 2023-12-13T00:00:46.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.725+0000 7ff7a7808640 1 -- 172.21.15.72:0/2297129831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7a00c8bc0 con 0x7ff7a00c4ca0 2023-12-13T00:00:46.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.731+0000 7ff795ffb640 1 -- 172.21.15.72:0/2297129831 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff79c020020 con 0x7ff7a00c4ca0 2023-12-13T00:00:46.731 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-12-13T00:00:46.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.733+0000 7ff7a7808640 1 -- 172.21.15.72:0/2297129831 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff78406b210 msgr2=0x7ff78406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:46.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.733+0000 7ff7a7808640 1 --2- 172.21.15.72:0/2297129831 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff78406b210 0x7ff78406d6d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff790036000 tx=0x7ff79003d040 comp rx=0 tx=0).stop 2023-12-13T00:00:46.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.733+0000 7ff7a7808640 1 -- 172.21.15.72:0/2297129831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a00c4ca0 msgr2=0x7ff7a01ed8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:46.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.733+0000 7ff7a7808640 1 --2- 172.21.15.72:0/2297129831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a00c4ca0 0x7ff7a01ed8d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00c400 tx=0x7ff79c00c8c0 comp rx=0 tx=0).stop 2023-12-13T00:00:46.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.733+0000 7ff7a7808640 1 -- 172.21.15.72:0/2297129831 shutdown_connections 2023-12-13T00:00:46.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.733+0000 7ff7a7808640 1 --2- 172.21.15.72:0/2297129831 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff78406b210 0x7ff78406d6d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:46.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.733+0000 7ff7a7808640 1 --2- 172.21.15.72:0/2297129831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7a015ae40 0x7ff7a0147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:46.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.733+0000 7ff7a7808640 1 --2- 172.21.15.72:0/2297129831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7a00c5080 0x7ff7a01ee2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:46.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.733+0000 7ff7a7808640 1 --2- 172.21.15.72:0/2297129831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a00c4ca0 0x7ff7a01ed8d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:46.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.733+0000 7ff7a7808640 1 -- 172.21.15.72:0/2297129831 >> 172.21.15.72:0/2297129831 conn(0x7ff7a006d170 msgr2=0x7ff7a0156d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:46.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.733+0000 7ff7a7808640 1 -- 172.21.15.72:0/2297129831 shutdown_connections 2023-12-13T00:00:46.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.733+0000 7ff7a7808640 1 -- 172.21.15.72:0/2297129831 wait complete. 2023-12-13T00:00:46.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-13T00:00:46.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.846+0000 7fd02f2e7640 1 Processor -- start 2023-12-13T00:00:46.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.847+0000 7fd02f2e7640 1 -- start start 2023-12-13T00:00:46.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.847+0000 7fd02f2e7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0280cc420 0x7fd028159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:46.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.847+0000 7fd02f2e7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd028159b50 0x7fd0280c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:46.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.847+0000 7fd02f2e7640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0280cbda0 con 0x7fd0280cda70 2023-12-13T00:00:46.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.847+0000 7fd02f2e7640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0280cc230 con 0x7fd028159b50 2023-12-13T00:00:46.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.847+0000 7fd02f2e7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0280cea60 con 0x7fd0280cc420 2023-12-13T00:00:46.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.848+0000 7fd02d884640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd028159b50 0x7fd0280c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:46.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.848+0000 7fd02d884640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd028159b50 0x7fd0280c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54442/0 (socket says 172.21.15.72:54442) 2023-12-13T00:00:46.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.848+0000 7fd02d884640 1 -- 172.21.15.72:0/4117312683 learned_addr learned my addr 172.21.15.72:0/4117312683 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:46.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.848+0000 7fd02c882640 1 --2- 172.21.15.72:0/4117312683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0280cc420 0x7fd028159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:46.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.851+0000 7fd02d884640 1 -- 172.21.15.72:0/4117312683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0280cc420 msgr2=0x7fd028159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:46.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.851+0000 7fd02d884640 1 --2- 172.21.15.72:0/4117312683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0280cc420 0x7fd028159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:46.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.851+0000 7fd02d884640 1 -- 172.21.15.72:0/4117312683 >> v1:172.21.15.72:6789/0 conn(0x7fd0280cda70 legacy=0x7fd0280ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:46.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.851+0000 7fd02d884640 1 -- 172.21.15.72:0/4117312683 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0280cb4e0 con 0x7fd028159b50 2023-12-13T00:00:46.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.854+0000 7fd02d884640 1 --2- 172.21.15.72:0/4117312683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd028159b50 0x7fd0280c9620 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd020009e50 tx=0x7fd02002bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf67794fc6ffd2a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:46.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.858+0000 7fd01ffff640 1 -- 172.21.15.72:0/4117312683 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02002cb90 con 0x7fd028159b50 2023-12-13T00:00:46.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.858+0000 7fd01ffff640 1 -- 172.21.15.72:0/4117312683 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02002ccf0 con 0x7fd028159b50 2023-12-13T00:00:46.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.858+0000 7fd01ffff640 1 -- 172.21.15.72:0/4117312683 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020034610 con 0x7fd028159b50 2023-12-13T00:00:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.859+0000 7fd02f2e7640 1 -- 172.21.15.72:0/4117312683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd028159b50 msgr2=0x7fd0280c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.859+0000 7fd02f2e7640 1 --2- 172.21.15.72:0/4117312683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd028159b50 0x7fd0280c9620 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd020009e50 tx=0x7fd02002bff0 comp rx=0 tx=0).stop 2023-12-13T00:00:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.859+0000 7fd02f2e7640 1 -- 172.21.15.72:0/4117312683 shutdown_connections 2023-12-13T00:00:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.859+0000 7fd02f2e7640 1 --2- 172.21.15.72:0/4117312683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd028159b50 0x7fd0280c9620 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.859+0000 7fd02f2e7640 1 --2- 172.21.15.72:0/4117312683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0280cc420 0x7fd028159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.859+0000 7fd02f2e7640 1 -- 172.21.15.72:0/4117312683 >> 172.21.15.72:0/4117312683 conn(0x7fd0280b07b0 msgr2=0x7fd0280b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.859+0000 7fd02f2e7640 1 -- 172.21.15.72:0/4117312683 shutdown_connections 2023-12-13T00:00:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.859+0000 7fd02f2e7640 1 -- 172.21.15.72:0/4117312683 wait complete. 2023-12-13T00:00:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.860+0000 7fd02f2e7640 1 Processor -- start 2023-12-13T00:00:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.860+0000 7fd02f2e7640 1 -- start start 2023-12-13T00:00:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.861+0000 7fd02f2e7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0280cc420 0x7fd0281564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.861+0000 7fd02f2e7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0280cda70 0x7fd0281eef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:46.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.861+0000 7fd02f2e7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd028159b50 0x7fd028158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:46.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.861+0000 7fd02f2e7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0281569f0 con 0x7fd028159b50 2023-12-13T00:00:46.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.861+0000 7fd02f2e7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd028155380 con 0x7fd0280cc420 2023-12-13T00:00:46.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.861+0000 7fd02f2e7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd028155870 con 0x7fd0280cda70 2023-12-13T00:00:46.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.861+0000 7fd02d884640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd028159b50 0x7fd028158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:46.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.862+0000 7fd02d884640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd028159b50 0x7fd028158c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54452/0 (socket says 172.21.15.72:54452) 2023-12-13T00:00:46.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.862+0000 7fd02d884640 1 -- 172.21.15.72:0/2419514972 learned_addr learned my addr 172.21.15.72:0/2419514972 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:46.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.862+0000 7fd02c882640 1 --2- 172.21.15.72:0/2419514972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0280cda70 0x7fd0281eef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:46.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.862+0000 7fd02d083640 1 --2- 172.21.15.72:0/2419514972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0280cc420 0x7fd0281564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:46.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.865+0000 7fd02d884640 1 -- 172.21.15.72:0/2419514972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0280cda70 msgr2=0x7fd0281eef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:46.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.865+0000 7fd02d884640 1 --2- 172.21.15.72:0/2419514972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0280cda70 0x7fd0281eef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:46.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.865+0000 7fd02d884640 1 -- 172.21.15.72:0/2419514972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0280cc420 msgr2=0x7fd0281564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:46.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.865+0000 7fd02d884640 1 --2- 172.21.15.72:0/2419514972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0280cc420 0x7fd0281564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:46.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.865+0000 7fd02d884640 1 -- 172.21.15.72:0/2419514972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd020009b30 con 0x7fd028159b50 2023-12-13T00:00:46.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.867+0000 7fd02d884640 1 --2- 172.21.15.72:0/2419514972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd028159b50 0x7fd028158c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd020009e50 tx=0x7fd020004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:46.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.870+0000 7fd01dffb640 1 -- 172.21.15.72:0/2419514972 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020007ea0 con 0x7fd028159b50 2023-12-13T00:00:46.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.870+0000 7fd01dffb640 1 -- 172.21.15.72:0/2419514972 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02003e450 con 0x7fd028159b50 2023-12-13T00:00:46.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.870+0000 7fd01dffb640 1 -- 172.21.15.72:0/2419514972 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02003e7e0 con 0x7fd028159b50 2023-12-13T00:00:46.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.871+0000 7fd02f2e7640 1 -- 172.21.15.72:0/2419514972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd028155590 con 0x7fd028159b50 2023-12-13T00:00:46.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.871+0000 7fd02f2e7640 1 -- 172.21.15.72:0/2419514972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0281f2930 con 0x7fd028159b50 2023-12-13T00:00:46.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.872+0000 7fd02f2e7640 1 -- 172.21.15.72:0/2419514972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0281f24b0 con 0x7fd028159b50 2023-12-13T00:00:46.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.890+0000 7fd01dffb640 1 -- 172.21.15.72:0/2419514972 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd02003e940 con 0x7fd028159b50 2023-12-13T00:00:46.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.890+0000 7fd01dffb640 1 --2- 172.21.15.72:0/2419514972 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd00c06b1f0 0x7fd00c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:46.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.890+0000 7fd02d083640 1 --2- 172.21.15.72:0/2419514972 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd00c06b1f0 0x7fd00c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:46.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.890+0000 7fd02d083640 1 --2- 172.21.15.72:0/2419514972 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd00c06b1f0 0x7fd00c06d6b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd018001780 tx=0x7fd018009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:46.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:46.894+0000 7fd01dffb640 1 -- 172.21.15.72:0/2419514972 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd02007b230 con 0x7fd028159b50 2023-12-13T00:00:47.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.128+0000 7fd01dffb640 1 -- 172.21.15.72:0/2419514972 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd020077570 con 0x7fd028159b50 2023-12-13T00:00:47.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.300+0000 7fd02f2e7640 1 -- 172.21.15.72:0/2419514972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd0281f24b0 con 0x7fd028159b50 2023-12-13T00:00:47.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.307+0000 7fd01dffb640 1 -- 172.21.15.72:0/2419514972 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd0281f24b0 con 0x7fd028159b50 2023-12-13T00:00:47.307 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-12-13T00:00:47.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.309+0000 7fd02f2e7640 1 -- 172.21.15.72:0/2419514972 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd00c06b1f0 msgr2=0x7fd00c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:47.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.309+0000 7fd02f2e7640 1 --2- 172.21.15.72:0/2419514972 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd00c06b1f0 0x7fd00c06d6b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd018001780 tx=0x7fd018009040 comp rx=0 tx=0).stop 2023-12-13T00:00:47.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.309+0000 7fd02f2e7640 1 -- 172.21.15.72:0/2419514972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd028159b50 msgr2=0x7fd028158c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:47.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.309+0000 7fd02f2e7640 1 --2- 172.21.15.72:0/2419514972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd028159b50 0x7fd028158c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd020009e50 tx=0x7fd020004a40 comp rx=0 tx=0).stop 2023-12-13T00:00:47.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.309+0000 7fd02f2e7640 1 -- 172.21.15.72:0/2419514972 shutdown_connections 2023-12-13T00:00:47.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.309+0000 7fd02f2e7640 1 --2- 172.21.15.72:0/2419514972 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd00c06b1f0 0x7fd00c06d6b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:47.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.309+0000 7fd02f2e7640 1 --2- 172.21.15.72:0/2419514972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd028159b50 0x7fd028158c50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:47.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.309+0000 7fd02f2e7640 1 --2- 172.21.15.72:0/2419514972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0280cda70 0x7fd0281eef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:47.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.309+0000 7fd02f2e7640 1 --2- 172.21.15.72:0/2419514972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0280cc420 0x7fd0281564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:47.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.309+0000 7fd02f2e7640 1 -- 172.21.15.72:0/2419514972 >> 172.21.15.72:0/2419514972 conn(0x7fd0280b07b0 msgr2=0x7fd0280c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:47.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.309+0000 7fd02f2e7640 1 -- 172.21.15.72:0/2419514972 shutdown_connections 2023-12-13T00:00:47.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.309+0000 7fd02f2e7640 1 -- 172.21.15.72:0/2419514972 wait complete. 2023-12-13T00:00:47.321 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-13T00:00:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.422+0000 7f4d11c5c640 1 Processor -- start 2023-12-13T00:00:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.422+0000 7f4d11c5c640 1 -- start start 2023-12-13T00:00:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.423+0000 7f4d11c5c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4d0c1538d0 0x7f4d0c15a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.423+0000 7f4d11c5c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4d0c0c8ee0 0x7f4d0c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.423+0000 7f4d11c5c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0c0c7640 con 0x7f4d0c06ed80 2023-12-13T00:00:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.423+0000 7f4d11c5c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0c06d130 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.423+0000 7f4d11c5c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0c06b5c0 con 0x7f4d0c1538d0 2023-12-13T00:00:47.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.424+0000 7f4d0affd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4d0c0c8ee0 0x7f4d0c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:47.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.424+0000 7f4d0b7fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4d0c1538d0 0x7f4d0c15a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:47.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.424+0000 7f4d0affd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4d0c0c8ee0 0x7f4d0c06e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54468/0 (socket says 172.21.15.72:54468) 2023-12-13T00:00:47.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.424+0000 7f4d0affd640 1 -- 172.21.15.72:0/3170291030 learned_addr learned my addr 172.21.15.72:0/3170291030 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:47.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.426+0000 7f4d0affd640 1 -- 172.21.15.72:0/3170291030 >> v2:172.21.15.176:3300/0 conn(0x7f4d0c1538d0 msgr2=0x7f4d0c15a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:47.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.426+0000 7f4d0affd640 1 --2- 172.21.15.72:0/3170291030 >> v2:172.21.15.176:3300/0 conn(0x7f4d0c1538d0 0x7f4d0c15a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:47.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.426+0000 7f4d0affd640 1 -- 172.21.15.72:0/3170291030 >> v1:172.21.15.176:6789/0 conn(0x7f4d0c06ed80 legacy=0x7f4d0c06ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:47.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.426+0000 7f4d0affd640 1 -- 172.21.15.72:0/3170291030 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c15a600 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.428+0000 7f4d0affd640 1 --2- 172.21.15.72:0/3170291030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d0c0c8ee0 0x7f4d0c06e840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0cd340 tx=0x7f4d0002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1977f5ca3f7407d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:47.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.432+0000 7f4d0a7fc640 1 -- 172.21.15.72:0/3170291030 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00031870 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.432+0000 7f4d0a7fc640 1 -- 172.21.15.72:0/3170291030 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d000319d0 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.432+0000 7f4d0a7fc640 1 -- 172.21.15.72:0/3170291030 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00031d60 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.433+0000 7f4d11c5c640 1 -- 172.21.15.72:0/3170291030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d0c0c8ee0 msgr2=0x7f4d0c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:47.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.433+0000 7f4d11c5c640 1 --2- 172.21.15.72:0/3170291030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d0c0c8ee0 0x7f4d0c06e840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0cd340 tx=0x7f4d0002b910 comp rx=0 tx=0).stop 2023-12-13T00:00:47.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.433+0000 7f4d11c5c640 1 -- 172.21.15.72:0/3170291030 shutdown_connections 2023-12-13T00:00:47.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.433+0000 7f4d11c5c640 1 --2- 172.21.15.72:0/3170291030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d0c0c8ee0 0x7f4d0c06e840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:47.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.433+0000 7f4d11c5c640 1 --2- 172.21.15.72:0/3170291030 >> v2:172.21.15.176:3300/0 conn(0x7f4d0c1538d0 0x7f4d0c15a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:47.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.433+0000 7f4d11c5c640 1 -- 172.21.15.72:0/3170291030 >> 172.21.15.72:0/3170291030 conn(0x7f4d0c060f20 msgr2=0x7f4d0c061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:47.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.433+0000 7f4d11c5c640 1 -- 172.21.15.72:0/3170291030 shutdown_connections 2023-12-13T00:00:47.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.433+0000 7f4d11c5c640 1 -- 172.21.15.72:0/3170291030 wait complete. 2023-12-13T00:00:47.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.434+0000 7f4d11c5c640 1 Processor -- start 2023-12-13T00:00:47.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.434+0000 7f4d11c5c640 1 -- start start 2023-12-13T00:00:47.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.435+0000 7f4d11c5c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d0c06ed80 0x7f4d0c1ef970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:47.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.435+0000 7f4d11c5c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d0c0c8ee0 0x7f4d0c0b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:47.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.435+0000 7f4d11c5c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d0c1538d0 0x7f4d0c14a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:47.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.435+0000 7f4d11c5c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c155b70 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.435+0000 7f4d11c5c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c1efeb0 con 0x7f4d0c06ed80 2023-12-13T00:00:47.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.435+0000 7f4d11c5c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c14b770 con 0x7f4d0c1538d0 2023-12-13T00:00:47.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.435+0000 7f4d0affd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d0c0c8ee0 0x7f4d0c0b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:47.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.435+0000 7f4d0b7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d0c06ed80 0x7f4d0c1ef970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:47.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.436+0000 7f4d0bfff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d0c1538d0 0x7f4d0c14a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:47.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.436+0000 7f4d0b7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d0c06ed80 0x7f4d0c1ef970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:43210/0 (socket says 172.21.15.72:43210) 2023-12-13T00:00:47.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.436+0000 7f4d0b7fe640 1 -- 172.21.15.72:0/1377700576 learned_addr learned my addr 172.21.15.72:0/1377700576 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:47.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.439+0000 7f4d0affd640 1 -- 172.21.15.72:0/1377700576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d0c1538d0 msgr2=0x7f4d0c14a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:47.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.439+0000 7f4d0affd640 1 --2- 172.21.15.72:0/1377700576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d0c1538d0 0x7f4d0c14a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:47.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.439+0000 7f4d0affd640 1 -- 172.21.15.72:0/1377700576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d0c06ed80 msgr2=0x7f4d0c1ef970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:47.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.439+0000 7f4d0affd640 1 --2- 172.21.15.72:0/1377700576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d0c06ed80 0x7f4d0c1ef970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:47.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.439+0000 7f4d0affd640 1 -- 172.21.15.72:0/1377700576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d000094d0 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.441+0000 7f4d0affd640 1 --2- 172.21.15.72:0/1377700576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d0c0c8ee0 0x7f4d0c0b0e80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4d00033000 tx=0x7f4d000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:47.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.445+0000 7f4cf3fff640 1 -- 172.21.15.72:0/1377700576 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0003ac60 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.445+0000 7f4cf3fff640 1 -- 172.21.15.72:0/1377700576 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0003ade0 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.445+0000 7f4d11c5c640 1 -- 172.21.15.72:0/1377700576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0c156a10 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.445+0000 7f4cf3fff640 1 -- 172.21.15.72:0/1377700576 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00044630 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.445+0000 7f4d11c5c640 1 -- 172.21.15.72:0/1377700576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0c149f60 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.446+0000 7f4d11c5c640 1 -- 172.21.15.72:0/1377700576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0c067470 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.687+0000 7f4cf3fff640 1 -- 172.21.15.72:0/1377700576 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4d0004d450 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.688+0000 7f4cf3fff640 1 --2- 172.21.15.72:0/1377700576 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f4cf806b1c0 0x7f4cf806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:47.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.688+0000 7f4d0b7fe640 1 --2- 172.21.15.72:0/1377700576 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f4cf806b1c0 0x7f4cf806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:47.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.688+0000 7f4d0b7fe640 1 --2- 172.21.15.72:0/1377700576 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f4cf806b1c0 0x7f4cf806d680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009c00 tx=0x7f4cfc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:47.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.700+0000 7f4cf3fff640 1 -- 172.21.15.72:0/1377700576 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4d0002d040 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.701+0000 7f4cf3fff640 1 -- 172.21.15.72:0/1377700576 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4d00076fb0 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.868+0000 7f4d11c5c640 1 -- 172.21.15.72:0/1377700576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4d0c157060 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.873+0000 7f4cf3fff640 1 -- 172.21.15.72:0/1377700576 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4d00035020 con 0x7f4d0c0c8ee0 2023-12-13T00:00:47.873 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-12-13T00:00:47.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.874+0000 7f4d11c5c640 1 -- 172.21.15.72:0/1377700576 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f4cf806b1c0 msgr2=0x7f4cf806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.874+0000 7f4d11c5c640 1 --2- 172.21.15.72:0/1377700576 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f4cf806b1c0 0x7f4cf806d680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009c00 tx=0x7f4cfc009190 comp rx=0 tx=0).stop 2023-12-13T00:00:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.874+0000 7f4d11c5c640 1 -- 172.21.15.72:0/1377700576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d0c0c8ee0 msgr2=0x7f4d0c0b0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.874+0000 7f4d11c5c640 1 --2- 172.21.15.72:0/1377700576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d0c0c8ee0 0x7f4d0c0b0e80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4d00033000 tx=0x7f4d000046c0 comp rx=0 tx=0).stop 2023-12-13T00:00:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.874+0000 7f4d11c5c640 1 -- 172.21.15.72:0/1377700576 shutdown_connections 2023-12-13T00:00:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.874+0000 7f4d11c5c640 1 --2- 172.21.15.72:0/1377700576 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f4cf806b1c0 0x7f4cf806d680 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.874+0000 7f4d11c5c640 1 --2- 172.21.15.72:0/1377700576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d0c1538d0 0x7f4d0c14a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.874+0000 7f4d11c5c640 1 --2- 172.21.15.72:0/1377700576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d0c0c8ee0 0x7f4d0c0b0e80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.874+0000 7f4d11c5c640 1 --2- 172.21.15.72:0/1377700576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d0c06ed80 0x7f4d0c1ef970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.874+0000 7f4d11c5c640 1 -- 172.21.15.72:0/1377700576 >> 172.21.15.72:0/1377700576 conn(0x7f4d0c060f20 msgr2=0x7f4d0c0c92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.875+0000 7f4d11c5c640 1 -- 172.21.15.72:0/1377700576 shutdown_connections 2023-12-13T00:00:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.875+0000 7f4d11c5c640 1 -- 172.21.15.72:0/1377700576 wait complete. 2023-12-13T00:00:47.886 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-13T00:00:47.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.986+0000 7f4765f43640 1 Processor -- start 2023-12-13T00:00:47.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.986+0000 7f4765f43640 1 -- start start 2023-12-13T00:00:47.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.987+0000 7f4765f43640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f476006a4b0 0x7f476006a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:47.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.987+0000 7f4765f43640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f476015c9c0 0x7f476015ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:47.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.987+0000 7f4765f43640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4760159f80 con 0x7f47600c59e0 2023-12-13T00:00:47.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.987+0000 7f4765f43640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f476015d350 con 0x7f476006a4b0 2023-12-13T00:00:47.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.987+0000 7f4765f43640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47601593d0 con 0x7f476015c9c0 2023-12-13T00:00:47.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.987+0000 7f475f7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f47600c59e0 0x7f476006d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59582/0 (socket says 172.21.15.72:59582) 2023-12-13T00:00:47.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.987+0000 7f475f7fe640 1 -- 172.21.15.72:0/3473422223 learned_addr learned my addr 172.21.15.72:0/3473422223 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:47.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.987+0000 7f475effd640 1 --2- 172.21.15.72:0/3473422223 >> v2:172.21.15.176:3300/0 conn(0x7f476006a4b0 0x7f476006a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:47.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.988+0000 7f475ffff640 1 --2- 172.21.15.72:0/3473422223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f476015c9c0 0x7f476015ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:47.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.990+0000 7f475e7fc640 1 -- 172.21.15.72:0/3473422223 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100285652 0 0) 0x7f4760159f80 con 0x7f47600c59e0 2023-12-13T00:00:47.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.990+0000 7f475e7fc640 1 -- 172.21.15.72:0/3473422223 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4748003520 con 0x7f47600c59e0 2023-12-13T00:00:47.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.990+0000 7f475ffff640 1 -- 172.21.15.72:0/3473422223 >> v2:172.21.15.176:3300/0 conn(0x7f476006a4b0 msgr2=0x7f476006a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:47.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.990+0000 7f475ffff640 1 --2- 172.21.15.72:0/3473422223 >> v2:172.21.15.176:3300/0 conn(0x7f476006a4b0 0x7f476006a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:47.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.990+0000 7f475ffff640 1 -- 172.21.15.72:0/3473422223 >> v1:172.21.15.72:6789/0 conn(0x7f47600c59e0 legacy=0x7f476006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:47.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.990+0000 7f475ffff640 1 -- 172.21.15.72:0/3473422223 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4760072650 con 0x7f476015c9c0 2023-12-13T00:00:47.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.990+0000 7f475effd640 1 --2- 172.21.15.72:0/3473422223 >> v2:172.21.15.176:3300/0 conn(0x7f476006a4b0 0x7f476006a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T00:00:47.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.993+0000 7f475ffff640 1 --2- 172.21.15.72:0/3473422223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f476015c9c0 0x7f476015ce10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4758009d90 tx=0x7f475802bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a6e0459f007acc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:47.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.997+0000 7f475e7fc640 1 -- 172.21.15.72:0/3473422223 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475802cce0 con 0x7f476015c9c0 2023-12-13T00:00:47.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.997+0000 7f475e7fc640 1 -- 172.21.15.72:0/3473422223 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475802ce40 con 0x7f476015c9c0 2023-12-13T00:00:47.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.997+0000 7f475e7fc640 1 -- 172.21.15.72:0/3473422223 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4758034660 con 0x7f476015c9c0 2023-12-13T00:00:47.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.997+0000 7f4765f43640 1 -- 172.21.15.72:0/3473422223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f476015c9c0 msgr2=0x7f476015ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:47.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.997+0000 7f4765f43640 1 --2- 172.21.15.72:0/3473422223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f476015c9c0 0x7f476015ce10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4758009d90 tx=0x7f475802bf30 comp rx=0 tx=0).stop 2023-12-13T00:00:47.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.997+0000 7f4765f43640 1 -- 172.21.15.72:0/3473422223 shutdown_connections 2023-12-13T00:00:47.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.997+0000 7f4765f43640 1 --2- 172.21.15.72:0/3473422223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f476015c9c0 0x7f476015ce10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:47.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.997+0000 7f4765f43640 1 --2- 172.21.15.72:0/3473422223 >> v2:172.21.15.176:3300/0 conn(0x7f476006a4b0 0x7f476006a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:47.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.997+0000 7f4765f43640 1 -- 172.21.15.72:0/3473422223 >> 172.21.15.72:0/3473422223 conn(0x7f476006f6d0 msgr2=0x7f476006fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.997+0000 7f4765f43640 1 -- 172.21.15.72:0/3473422223 shutdown_connections 2023-12-13T00:00:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.997+0000 7f4765f43640 1 -- 172.21.15.72:0/3473422223 wait complete. 2023-12-13T00:00:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.998+0000 7f4765f43640 1 Processor -- start 2023-12-13T00:00:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.999+0000 7f4765f43640 1 -- start start 2023-12-13T00:00:48.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.999+0000 7f4765f43640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f476006a4b0 0x7f47601f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:48.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.999+0000 7f4765f43640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47600c59e0 0x7f47600cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:48.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.999+0000 7f4765f43640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f476015c9c0 0x7f47601f0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:48.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.999+0000 7f4765f43640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47601e6730 con 0x7f47600c59e0 2023-12-13T00:00:48.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.999+0000 7f4765f43640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4760153de0 con 0x7f476015c9c0 2023-12-13T00:00:48.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:47.999+0000 7f4765f43640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47601f3520 con 0x7f476006a4b0 2023-12-13T00:00:48.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.000+0000 7f475effd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47600c59e0 0x7f47600cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:48.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.000+0000 7f475effd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47600c59e0 0x7f47600cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54488/0 (socket says 172.21.15.72:54488) 2023-12-13T00:00:48.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.000+0000 7f475effd640 1 -- 172.21.15.72:0/262502012 learned_addr learned my addr 172.21.15.72:0/262502012 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:48.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.000+0000 7f475ffff640 1 --2- 172.21.15.72:0/262502012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f476015c9c0 0x7f47601f0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:48.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.000+0000 7f475f7fe640 1 --2- 172.21.15.72:0/262502012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f476006a4b0 0x7f47601f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.003+0000 7f475effd640 1 -- 172.21.15.72:0/262502012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f476006a4b0 msgr2=0x7f47601f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.003+0000 7f475effd640 1 --2- 172.21.15.72:0/262502012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f476006a4b0 0x7f47601f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.003+0000 7f475effd640 1 -- 172.21.15.72:0/262502012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f476015c9c0 msgr2=0x7f47601f0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.003+0000 7f475effd640 1 --2- 172.21.15.72:0/262502012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f476015c9c0 0x7f47601f0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.003+0000 7f475effd640 1 -- 172.21.15.72:0/262502012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4754009400 con 0x7f47600c59e0 2023-12-13T00:00:48.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.006+0000 7f475effd640 1 --2- 172.21.15.72:0/262502012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47600c59e0 0x7f47600cb220 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f475400e960 tx=0x7f475400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:48.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.009+0000 7f4747fff640 1 -- 172.21.15.72:0/262502012 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475400ca00 con 0x7f47600c59e0 2023-12-13T00:00:48.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.009+0000 7f4747fff640 1 -- 172.21.15.72:0/262502012 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475400cb60 con 0x7f47600c59e0 2023-12-13T00:00:48.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.009+0000 7f4747fff640 1 -- 172.21.15.72:0/262502012 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754013470 con 0x7f47600c59e0 2023-12-13T00:00:48.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.009+0000 7f4765f43640 1 -- 172.21.15.72:0/262502012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4758009a70 con 0x7f47600c59e0 2023-12-13T00:00:48.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.009+0000 7f4765f43640 1 -- 172.21.15.72:0/262502012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47601f09e0 con 0x7f47600c59e0 2023-12-13T00:00:48.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.010+0000 7f4765f43640 1 -- 172.21.15.72:0/262502012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47601f0b70 con 0x7f47600c59e0 2023-12-13T00:00:48.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.254+0000 7f4747fff640 1 -- 172.21.15.72:0/262502012 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f47540135d0 con 0x7f47600c59e0 2023-12-13T00:00:48.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.254+0000 7f4747fff640 1 --2- 172.21.15.72:0/262502012 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f474c06b240 0x7f474c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:48.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.255+0000 7f475f7fe640 1 --2- 172.21.15.72:0/262502012 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f474c06b240 0x7f474c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:48.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.255+0000 7f475f7fe640 1 --2- 172.21.15.72:0/262502012 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f474c06b240 0x7f474c06d700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4750005880 tx=0x7f4750009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:48.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.269+0000 7f4747fff640 1 -- 172.21.15.72:0/262502012 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4754058dc0 con 0x7f47600c59e0 2023-12-13T00:00:48.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.269+0000 7f4747fff640 1 -- 172.21.15.72:0/262502012 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4754055100 con 0x7f47600c59e0 2023-12-13T00:00:48.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.470+0000 7f4765f43640 1 -- 172.21.15.72:0/262502012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f47600c7fb0 con 0x7f47600c59e0 2023-12-13T00:00:48.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.486+0000 7f4747fff640 1 -- 172.21.15.72:0/262502012 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4754017080 con 0x7f47600c59e0 2023-12-13T00:00:48.486 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-12-13T00:00:48.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.488+0000 7f4765f43640 1 -- 172.21.15.72:0/262502012 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f474c06b240 msgr2=0x7f474c06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:48.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.488+0000 7f4765f43640 1 --2- 172.21.15.72:0/262502012 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f474c06b240 0x7f474c06d700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4750005880 tx=0x7f4750009040 comp rx=0 tx=0).stop 2023-12-13T00:00:48.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.488+0000 7f4765f43640 1 -- 172.21.15.72:0/262502012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47600c59e0 msgr2=0x7f47600cb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:48.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.488+0000 7f4765f43640 1 --2- 172.21.15.72:0/262502012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47600c59e0 0x7f47600cb220 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f475400e960 tx=0x7f475400ee20 comp rx=0 tx=0).stop 2023-12-13T00:00:48.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.488+0000 7f4765f43640 1 -- 172.21.15.72:0/262502012 shutdown_connections 2023-12-13T00:00:48.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.488+0000 7f4765f43640 1 --2- 172.21.15.72:0/262502012 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f474c06b240 0x7f474c06d700 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:48.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.488+0000 7f4765f43640 1 --2- 172.21.15.72:0/262502012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f476015c9c0 0x7f47601f0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:48.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.488+0000 7f4765f43640 1 --2- 172.21.15.72:0/262502012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47600c59e0 0x7f47600cb220 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:48.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.488+0000 7f4765f43640 1 --2- 172.21.15.72:0/262502012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f476006a4b0 0x7f47601f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:48.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.488+0000 7f4765f43640 1 -- 172.21.15.72:0/262502012 >> 172.21.15.72:0/262502012 conn(0x7f476006f6d0 msgr2=0x7f47600c83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:48.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.488+0000 7f4765f43640 1 -- 172.21.15.72:0/262502012 shutdown_connections 2023-12-13T00:00:48.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.488+0000 7f4765f43640 1 -- 172.21.15.72:0/262502012 wait complete. 2023-12-13T00:00:48.500 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-13T00:00:48.500 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-13T00:00:48.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:00:48.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.653+0000 7ff60ffdc640 1 Processor -- start 2023-12-13T00:00:48.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.653+0000 7ff60ffdc640 1 -- start start 2023-12-13T00:00:48.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.654+0000 7ff60ffdc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff608150530 0x7ff6080c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:48.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.654+0000 7ff60ffdc640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6080c7180 0x7ff6080c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:48.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.654+0000 7ff60ffdc640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff608150910 con 0x7ff6080c4a10 2023-12-13T00:00:48.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.654+0000 7ff60ffdc640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6080c1ec0 con 0x7ff6080c7180 2023-12-13T00:00:48.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.654+0000 7ff60ffdc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60815a4e0 con 0x7ff608150530 2023-12-13T00:00:48.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.655+0000 7ff60d577640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6080c7180 0x7ff6080c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:48.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.655+0000 7ff60dd78640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff608150530 0x7ff6080c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:48.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.655+0000 7ff60d577640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6080c7180 0x7ff6080c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54490/0 (socket says 172.21.15.72:54490) 2023-12-13T00:00:48.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.655+0000 7ff60d577640 1 -- 172.21.15.72:0/3013852567 learned_addr learned my addr 172.21.15.72:0/3013852567 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:48.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.658+0000 7ff60d577640 1 -- 172.21.15.72:0/3013852567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff608150530 msgr2=0x7ff6080c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:48.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.658+0000 7ff60d577640 1 --2- 172.21.15.72:0/3013852567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff608150530 0x7ff6080c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:48.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.658+0000 7ff60d577640 1 -- 172.21.15.72:0/3013852567 >> v1:172.21.15.72:6789/0 conn(0x7ff6080c4a10 legacy=0x7ff6081596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:48.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.658+0000 7ff60d577640 1 -- 172.21.15.72:0/3013852567 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6080c2110 con 0x7ff6080c7180 2023-12-13T00:00:48.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.658+0000 7ff60dd78640 1 --2- 172.21.15.72:0/3013852567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff608150530 0x7ff6080c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T00:00:48.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.663+0000 7ff60d577640 1 --2- 172.21.15.72:0/3013852567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6080c7180 0x7ff6080c44d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009870 tx=0x7ff5f802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b60ad4222b4fe8 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:48.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.666+0000 7ff60cd76640 1 -- 172.21.15.72:0/3013852567 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f802f840 con 0x7ff6080c7180 2023-12-13T00:00:48.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.667+0000 7ff60cd76640 1 -- 172.21.15.72:0/3013852567 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f802f9a0 con 0x7ff6080c7180 2023-12-13T00:00:48.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.667+0000 7ff60cd76640 1 -- 172.21.15.72:0/3013852567 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f802fd30 con 0x7ff6080c7180 2023-12-13T00:00:48.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.667+0000 7ff60ffdc640 1 -- 172.21.15.72:0/3013852567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6080c7180 msgr2=0x7ff6080c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:48.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.667+0000 7ff60ffdc640 1 --2- 172.21.15.72:0/3013852567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6080c7180 0x7ff6080c44d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009870 tx=0x7ff5f802ba20 comp rx=0 tx=0).stop 2023-12-13T00:00:48.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.667+0000 7ff60ffdc640 1 -- 172.21.15.72:0/3013852567 shutdown_connections 2023-12-13T00:00:48.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.667+0000 7ff60ffdc640 1 --2- 172.21.15.72:0/3013852567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6080c7180 0x7ff6080c44d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:48.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.667+0000 7ff60ffdc640 1 --2- 172.21.15.72:0/3013852567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff608150530 0x7ff6080c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:48.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.667+0000 7ff60ffdc640 1 -- 172.21.15.72:0/3013852567 >> 172.21.15.72:0/3013852567 conn(0x7ff60806c5f0 msgr2=0x7ff60806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:48.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.667+0000 7ff60ffdc640 1 -- 172.21.15.72:0/3013852567 shutdown_connections 2023-12-13T00:00:48.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.667+0000 7ff60ffdc640 1 -- 172.21.15.72:0/3013852567 wait complete. 2023-12-13T00:00:48.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.669+0000 7ff60ffdc640 1 Processor -- start 2023-12-13T00:00:48.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.669+0000 7ff60ffdc640 1 -- start start 2023-12-13T00:00:48.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.669+0000 7ff60ffdc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6080c4a10 0x7ff6081eceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:48.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.669+0000 7ff60ffdc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6080c7180 0x7ff608141d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:48.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.669+0000 7ff60ffdc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff608150530 0x7ff608142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:48.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.669+0000 7ff60ffdc640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6080c9f70 con 0x7ff6080c4a10 2023-12-13T00:00:48.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.669+0000 7ff60ffdc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff608149060 con 0x7ff608150530 2023-12-13T00:00:48.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.669+0000 7ff60ffdc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6081427a0 con 0x7ff6080c7180 2023-12-13T00:00:48.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.670+0000 7ff60dd78640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6080c4a10 0x7ff6081eceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:48.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.670+0000 7ff60dd78640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6080c4a10 0x7ff6081eceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54504/0 (socket says 172.21.15.72:54504) 2023-12-13T00:00:48.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.670+0000 7ff60dd78640 1 -- 172.21.15.72:0/207567356 learned_addr learned my addr 172.21.15.72:0/207567356 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:48.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.670+0000 7ff60d577640 1 --2- 172.21.15.72:0/207567356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6080c7180 0x7ff608141d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:48.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.670+0000 7ff60e579640 1 --2- 172.21.15.72:0/207567356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff608150530 0x7ff608142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:48.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.673+0000 7ff60dd78640 1 -- 172.21.15.72:0/207567356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6080c7180 msgr2=0x7ff608141d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:48.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.673+0000 7ff60dd78640 1 --2- 172.21.15.72:0/207567356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6080c7180 0x7ff608141d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:48.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.673+0000 7ff60dd78640 1 -- 172.21.15.72:0/207567356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff608150530 msgr2=0x7ff608142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:48.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.673+0000 7ff60dd78640 1 --2- 172.21.15.72:0/207567356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff608150530 0x7ff608142260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:48.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.673+0000 7ff60dd78640 1 -- 172.21.15.72:0/207567356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff604009a70 con 0x7ff6080c4a10 2023-12-13T00:00:48.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.676+0000 7ff60dd78640 1 --2- 172.21.15.72:0/207567356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6080c4a10 0x7ff6081eceb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff60400efc0 tx=0x7ff60400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:48.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.679+0000 7ff5fe7fc640 1 -- 172.21.15.72:0/207567356 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604014680 con 0x7ff6080c4a10 2023-12-13T00:00:48.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.679+0000 7ff5fe7fc640 1 -- 172.21.15.72:0/207567356 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60400f040 con 0x7ff6080c4a10 2023-12-13T00:00:48.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.679+0000 7ff60ffdc640 1 -- 172.21.15.72:0/207567356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f80094d0 con 0x7ff6080c4a10 2023-12-13T00:00:48.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.679+0000 7ff5fe7fc640 1 -- 172.21.15.72:0/207567356 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604014a00 con 0x7ff6080c4a10 2023-12-13T00:00:48.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.679+0000 7ff60ffdc640 1 -- 172.21.15.72:0/207567356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6080cb4f0 con 0x7ff6080c4a10 2023-12-13T00:00:48.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.680+0000 7ff60ffdc640 1 -- 172.21.15.72:0/207567356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6081549d0 con 0x7ff6080c4a10 2023-12-13T00:00:48.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.698+0000 7ff5fe7fc640 1 -- 172.21.15.72:0/207567356 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff604014b60 con 0x7ff6080c4a10 2023-12-13T00:00:48.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.698+0000 7ff5fe7fc640 1 --2- 172.21.15.72:0/207567356 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff5ec06b210 0x7ff5ec06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:48.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.698+0000 7ff60d577640 1 --2- 172.21.15.72:0/207567356 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff5ec06b210 0x7ff5ec06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:48.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.699+0000 7ff60d577640 1 --2- 172.21.15.72:0/207567356 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff5ec06b210 0x7ff5ec06d6d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8036000 tx=0x7ff5f8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:48.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.935+0000 7ff5fe7fc640 1 -- 172.21.15.72:0/207567356 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff60400ce70 con 0x7ff6080c4a10 2023-12-13T00:00:48.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:48.935+0000 7ff5fe7fc640 1 -- 172.21.15.72:0/207567356 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff604055c70 con 0x7ff6080c4a10 2023-12-13T00:00:49.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.103+0000 7ff60ffdc640 1 -- 172.21.15.72:0/207567356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff60806de00 con 0x7ff6080c4a10 2023-12-13T00:00:49.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.139+0000 7ff5fe7fc640 1 -- 172.21.15.72:0/207567356 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18327 (secure 0 0 0) 0x7ff604059290 con 0x7ff6080c4a10 2023-12-13T00:00:49.140 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:00:49.140 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:00:36.191864+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T00:00:27.701252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T00:00:29.324356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T00:00:33.363089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:00:49.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.141+0000 7ff60ffdc640 1 -- 172.21.15.72:0/207567356 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff5ec06b210 msgr2=0x7ff5ec06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:49.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.141+0000 7ff60ffdc640 1 --2- 172.21.15.72:0/207567356 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff5ec06b210 0x7ff5ec06d6d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8036000 tx=0x7ff5f8008030 comp rx=0 tx=0).stop 2023-12-13T00:00:49.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.141+0000 7ff60ffdc640 1 -- 172.21.15.72:0/207567356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6080c4a10 msgr2=0x7ff6081eceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:49.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.141+0000 7ff60ffdc640 1 --2- 172.21.15.72:0/207567356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6080c4a10 0x7ff6081eceb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff60400efc0 tx=0x7ff60400c490 comp rx=0 tx=0).stop 2023-12-13T00:00:49.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.141+0000 7ff60ffdc640 1 -- 172.21.15.72:0/207567356 shutdown_connections 2023-12-13T00:00:49.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.141+0000 7ff60ffdc640 1 --2- 172.21.15.72:0/207567356 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff5ec06b210 0x7ff5ec06d6d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.141+0000 7ff60ffdc640 1 --2- 172.21.15.72:0/207567356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff608150530 0x7ff608142260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.141+0000 7ff60ffdc640 1 --2- 172.21.15.72:0/207567356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6080c7180 0x7ff608141d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.141+0000 7ff60ffdc640 1 --2- 172.21.15.72:0/207567356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6080c4a10 0x7ff6081eceb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.141+0000 7ff60ffdc640 1 -- 172.21.15.72:0/207567356 >> 172.21.15.72:0/207567356 conn(0x7ff60806c5f0 msgr2=0x7ff608071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:49.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.141+0000 7ff60ffdc640 1 -- 172.21.15.72:0/207567356 shutdown_connections 2023-12-13T00:00:49.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.141+0000 7ff60ffdc640 1 -- 172.21.15.72:0/207567356 wait complete. 2023-12-13T00:00:49.153 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-13T00:00:06.839153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-13T00:00:27.701252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-13T00:00:29.324356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-13T00:00:33.363089+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-13T00:00:49.154 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-13T00:00:49.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.257+0000 7f0bf3b0f640 1 Processor -- start 2023-12-13T00:00:49.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.257+0000 7f0bf3b0f640 1 -- start start 2023-12-13T00:00:49.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.258+0000 7f0bf3b0f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0bec1538d0 0x7f0bec15a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:49.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.258+0000 7f0bf3b0f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bec0c8ee0 0x7f0bec06e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:49.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.258+0000 7f0bf3b0f640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0bec06ed80 0x7f0bec06ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:49.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.258+0000 7f0bf3b0f640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bec06d130 con 0x7f0bec1538d0 2023-12-13T00:00:49.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.258+0000 7f0bf3b0f640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bec0c7640 con 0x7f0bec06ed80 2023-12-13T00:00:49.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.258+0000 7f0bf3b0f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec06b5c0 con 0x7f0bec0c8ee0 2023-12-13T00:00:49.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.258+0000 7f0bf18ab640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0bec1538d0 0x7f0bec15a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:49.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.259+0000 7f0bf18ab640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0bec1538d0 0x7f0bec15a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54512/0 (socket says 172.21.15.72:54512) 2023-12-13T00:00:49.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.259+0000 7f0bf18ab640 1 -- 172.21.15.72:0/267551606 learned_addr learned my addr 172.21.15.72:0/267551606 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:49.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.259+0000 7f0bf10aa640 1 --2- 172.21.15.72:0/267551606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bec0c8ee0 0x7f0bec06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:49.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.259+0000 7f0bf20ac640 1 --2- 172.21.15.72:0/267551606 >> v2:172.21.15.176:3300/0 conn(0x7f0bec06ed80 0x7f0bec06ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:49.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.261+0000 7f0bf18ab640 1 -- 172.21.15.72:0/267551606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bec0c8ee0 msgr2=0x7f0bec06e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:49.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.261+0000 7f0bf18ab640 1 --2- 172.21.15.72:0/267551606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bec0c8ee0 0x7f0bec06e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.261+0000 7f0bf18ab640 1 -- 172.21.15.72:0/267551606 >> v2:172.21.15.176:3300/0 conn(0x7f0bec06ed80 msgr2=0x7f0bec06ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:49.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.261+0000 7f0bf18ab640 1 --2- 172.21.15.72:0/267551606 >> v2:172.21.15.176:3300/0 conn(0x7f0bec06ed80 0x7f0bec06ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.261+0000 7f0bf18ab640 1 -- 172.21.15.72:0/267551606 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec15a600 con 0x7f0bec1538d0 2023-12-13T00:00:49.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.263+0000 7f0bf18ab640 1 --2- 172.21.15.72:0/267551606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bec1538d0 0x7f0bec15a0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0bec072be0 tx=0x7f0be802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9b22603d7063e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:49.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.265+0000 7f0bf08a9640 1 -- 172.21.15.72:0/267551606 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be802c9e0 con 0x7f0bec1538d0 2023-12-13T00:00:49.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.266+0000 7f0bf08a9640 1 -- 172.21.15.72:0/267551606 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be802cb40 con 0x7f0bec1538d0 2023-12-13T00:00:49.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.266+0000 7f0bf08a9640 1 -- 172.21.15.72:0/267551606 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be80343f0 con 0x7f0bec1538d0 2023-12-13T00:00:49.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.267+0000 7f0bf3b0f640 1 -- 172.21.15.72:0/267551606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bec1538d0 msgr2=0x7f0bec15a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:49.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.267+0000 7f0bf3b0f640 1 --2- 172.21.15.72:0/267551606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bec1538d0 0x7f0bec15a0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0bec072be0 tx=0x7f0be802be40 comp rx=0 tx=0).stop 2023-12-13T00:00:49.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.267+0000 7f0bf3b0f640 1 -- 172.21.15.72:0/267551606 shutdown_connections 2023-12-13T00:00:49.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.267+0000 7f0bf3b0f640 1 --2- 172.21.15.72:0/267551606 >> v2:172.21.15.176:3300/0 conn(0x7f0bec06ed80 0x7f0bec06ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.267+0000 7f0bf3b0f640 1 --2- 172.21.15.72:0/267551606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bec0c8ee0 0x7f0bec06e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.267+0000 7f0bf3b0f640 1 --2- 172.21.15.72:0/267551606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bec1538d0 0x7f0bec15a0c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.267+0000 7f0bf3b0f640 1 -- 172.21.15.72:0/267551606 >> 172.21.15.72:0/267551606 conn(0x7f0bec060f20 msgr2=0x7f0bec061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:49.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.267+0000 7f0bf3b0f640 1 -- 172.21.15.72:0/267551606 shutdown_connections 2023-12-13T00:00:49.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.267+0000 7f0bf3b0f640 1 -- 172.21.15.72:0/267551606 wait complete. 2023-12-13T00:00:49.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.269+0000 7f0bf3b0f640 1 Processor -- start 2023-12-13T00:00:49.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.269+0000 7f0bf3b0f640 1 -- start start 2023-12-13T00:00:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.269+0000 7f0bf3b0f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bec06ed80 0x7f0bec14d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.269+0000 7f0bf3b0f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bec0c8ee0 0x7f0bec14e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.269+0000 7f0bf3b0f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bec1538d0 0x7f0bec1ef5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.269+0000 7f0bf3b0f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec14d090 con 0x7f0bec06ed80 2023-12-13T00:00:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.269+0000 7f0bf3b0f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec1ef120 con 0x7f0bec0c8ee0 2023-12-13T00:00:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.269+0000 7f0bf3b0f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0c40c0 con 0x7f0bec1538d0 2023-12-13T00:00:49.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.270+0000 7f0bf18ab640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bec06ed80 0x7f0bec14d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:49.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.270+0000 7f0bf18ab640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bec06ed80 0x7f0bec14d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54520/0 (socket says 172.21.15.72:54520) 2023-12-13T00:00:49.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.270+0000 7f0bf18ab640 1 -- 172.21.15.72:0/4215971635 learned_addr learned my addr 172.21.15.72:0/4215971635 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:49.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.270+0000 7f0bf10aa640 1 --2- 172.21.15.72:0/4215971635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bec0c8ee0 0x7f0bec14e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:49.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.270+0000 7f0bf20ac640 1 --2- 172.21.15.72:0/4215971635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bec1538d0 0x7f0bec1ef5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:49.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.273+0000 7f0bf18ab640 1 -- 172.21.15.72:0/4215971635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bec1538d0 msgr2=0x7f0bec1ef5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:49.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.273+0000 7f0bf18ab640 1 --2- 172.21.15.72:0/4215971635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bec1538d0 0x7f0bec1ef5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.273+0000 7f0bf18ab640 1 -- 172.21.15.72:0/4215971635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bec0c8ee0 msgr2=0x7f0bec14e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:49.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.273+0000 7f0bf18ab640 1 --2- 172.21.15.72:0/4215971635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bec0c8ee0 0x7f0bec14e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.273+0000 7f0bf18ab640 1 -- 172.21.15.72:0/4215971635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be8009b30 con 0x7f0bec06ed80 2023-12-13T00:00:49.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.275+0000 7f0bf18ab640 1 --2- 172.21.15.72:0/4215971635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bec06ed80 0x7f0bec14d8c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0be8036040 tx=0x7f0be8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:49.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.279+0000 7f0be27fc640 1 -- 172.21.15.72:0/4215971635 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8009510 con 0x7f0bec06ed80 2023-12-13T00:00:49.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.279+0000 7f0be27fc640 1 -- 172.21.15.72:0/4215971635 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be803e450 con 0x7f0bec06ed80 2023-12-13T00:00:49.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.279+0000 7f0bf3b0f640 1 -- 172.21.15.72:0/4215971635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bec14d5c0 con 0x7f0bec06ed80 2023-12-13T00:00:49.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.279+0000 7f0be27fc640 1 -- 172.21.15.72:0/4215971635 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be803e7e0 con 0x7f0bec06ed80 2023-12-13T00:00:49.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.279+0000 7f0bf3b0f640 1 -- 172.21.15.72:0/4215971635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bec14d2e0 con 0x7f0bec06ed80 2023-12-13T00:00:49.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.281+0000 7f0bf3b0f640 1 -- 172.21.15.72:0/4215971635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bec0cd100 con 0x7f0bec06ed80 2023-12-13T00:00:49.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.528+0000 7f0be27fc640 1 -- 172.21.15.72:0/4215971635 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0be803e940 con 0x7f0bec06ed80 2023-12-13T00:00:49.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.529+0000 7f0be27fc640 1 --2- 172.21.15.72:0/4215971635 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0bd006b210 0x7f0bd006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:49.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.529+0000 7f0bf10aa640 1 --2- 172.21.15.72:0/4215971635 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0bd006b210 0x7f0bd006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:49.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.529+0000 7f0bf10aa640 1 --2- 172.21.15.72:0/4215971635 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0bd006b210 0x7f0bd006d6d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0bec0c9ca0 tx=0x7f0bdc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:49.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.542+0000 7f0be27fc640 1 -- 172.21.15.72:0/4215971635 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0be807bd30 con 0x7f0bec06ed80 2023-12-13T00:00:49.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.542+0000 7f0be27fc640 1 -- 172.21.15.72:0/4215971635 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0be8078070 con 0x7f0bec06ed80 2023-12-13T00:00:49.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.747+0000 7f0bf3b0f640 1 -- 172.21.15.72:0/4215971635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0bec067470 con 0x7f0bec06ed80 2023-12-13T00:00:49.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.752+0000 7f0be27fc640 1 -- 172.21.15.72:0/4215971635 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0be807b690 con 0x7f0bec06ed80 2023-12-13T00:00:49.753 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-12-13T00:00:49.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.755+0000 7f0bf3b0f640 1 -- 172.21.15.72:0/4215971635 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0bd006b210 msgr2=0x7f0bd006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:49.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.755+0000 7f0bf3b0f640 1 --2- 172.21.15.72:0/4215971635 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0bd006b210 0x7f0bd006d6d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0bec0c9ca0 tx=0x7f0bdc009190 comp rx=0 tx=0).stop 2023-12-13T00:00:49.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.755+0000 7f0bf3b0f640 1 -- 172.21.15.72:0/4215971635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bec06ed80 msgr2=0x7f0bec14d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:49.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.755+0000 7f0bf3b0f640 1 --2- 172.21.15.72:0/4215971635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bec06ed80 0x7f0bec14d8c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0be8036040 tx=0x7f0be8004a40 comp rx=0 tx=0).stop 2023-12-13T00:00:49.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.755+0000 7f0bf3b0f640 1 -- 172.21.15.72:0/4215971635 shutdown_connections 2023-12-13T00:00:49.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.755+0000 7f0bf3b0f640 1 --2- 172.21.15.72:0/4215971635 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0bd006b210 0x7f0bd006d6d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.755+0000 7f0bf3b0f640 1 --2- 172.21.15.72:0/4215971635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bec1538d0 0x7f0bec1ef5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.755+0000 7f0bf3b0f640 1 --2- 172.21.15.72:0/4215971635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bec0c8ee0 0x7f0bec14e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.755+0000 7f0bf3b0f640 1 --2- 172.21.15.72:0/4215971635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bec06ed80 0x7f0bec14d8c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.755+0000 7f0bf3b0f640 1 -- 172.21.15.72:0/4215971635 >> 172.21.15.72:0/4215971635 conn(0x7f0bec060f20 msgr2=0x7f0bec071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:49.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.755+0000 7f0bf3b0f640 1 -- 172.21.15.72:0/4215971635 shutdown_connections 2023-12-13T00:00:49.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.755+0000 7f0bf3b0f640 1 -- 172.21.15.72:0/4215971635 wait complete. 2023-12-13T00:00:49.766 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-13T00:00:49.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.868+0000 7fec8b090640 1 Processor -- start 2023-12-13T00:00:49.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.868+0000 7fec8b090640 1 -- start start 2023-12-13T00:00:49.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.869+0000 7fec8b090640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec84151260 0x7fec8406f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:49.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.869+0000 7fec8b090640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec840c7640 0x7fec840ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:49.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.869+0000 7fec8b090640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fec840c2600 0x7fec840cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:49.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.869+0000 7fec8b090640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec841571d0 con 0x7fec840c7640 2023-12-13T00:00:49.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.869+0000 7fec8b090640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec841573c0 con 0x7fec840c2600 2023-12-13T00:00:49.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.869+0000 7fec8b090640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec841576a0 con 0x7fec84151260 2023-12-13T00:00:49.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.870+0000 7fec83fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec840c7640 0x7fec840ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:49.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.870+0000 7fec8962d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fec840c2600 0x7fec840cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:49.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.870+0000 7fec88e2c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec84151260 0x7fec8406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:49.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.870+0000 7fec83fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec840c7640 0x7fec840ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54536/0 (socket says 172.21.15.72:54536) 2023-12-13T00:00:49.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.870+0000 7fec83fff640 1 -- 172.21.15.72:0/3692416533 learned_addr learned my addr 172.21.15.72:0/3692416533 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:49.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.872+0000 7fec83fff640 1 -- 172.21.15.72:0/3692416533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec84151260 msgr2=0x7fec8406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:49.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.872+0000 7fec83fff640 1 --2- 172.21.15.72:0/3692416533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec84151260 0x7fec8406f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.872+0000 7fec83fff640 1 -- 172.21.15.72:0/3692416533 >> v2:172.21.15.176:3300/0 conn(0x7fec840c2600 msgr2=0x7fec840cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:49.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.872+0000 7fec83fff640 1 --2- 172.21.15.72:0/3692416533 >> v2:172.21.15.176:3300/0 conn(0x7fec840c2600 0x7fec840cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.872+0000 7fec83fff640 1 -- 172.21.15.72:0/3692416533 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec84157980 con 0x7fec840c7640 2023-12-13T00:00:49.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.875+0000 7fec83fff640 1 --2- 172.21.15.72:0/3692416533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec840c7640 0x7fec840ccf20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fec84070720 tx=0x7fec7802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22809eb7caa2b1a server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:49.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.878+0000 7fec837fe640 1 -- 172.21.15.72:0/3692416533 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78031870 con 0x7fec840c7640 2023-12-13T00:00:49.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.878+0000 7fec837fe640 1 -- 172.21.15.72:0/3692416533 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec780319d0 con 0x7fec840c7640 2023-12-13T00:00:49.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.878+0000 7fec837fe640 1 -- 172.21.15.72:0/3692416533 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78031d60 con 0x7fec840c7640 2023-12-13T00:00:49.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.879+0000 7fec8b090640 1 -- 172.21.15.72:0/3692416533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec840c7640 msgr2=0x7fec840ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:49.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.879+0000 7fec8b090640 1 --2- 172.21.15.72:0/3692416533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec840c7640 0x7fec840ccf20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fec84070720 tx=0x7fec7802b910 comp rx=0 tx=0).stop 2023-12-13T00:00:49.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.879+0000 7fec8b090640 1 -- 172.21.15.72:0/3692416533 shutdown_connections 2023-12-13T00:00:49.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.879+0000 7fec8b090640 1 --2- 172.21.15.72:0/3692416533 >> v2:172.21.15.176:3300/0 conn(0x7fec840c2600 0x7fec840cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.879+0000 7fec8b090640 1 --2- 172.21.15.72:0/3692416533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec840c7640 0x7fec840ccf20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.879+0000 7fec8b090640 1 --2- 172.21.15.72:0/3692416533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec84151260 0x7fec8406f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.879+0000 7fec8b090640 1 -- 172.21.15.72:0/3692416533 >> 172.21.15.72:0/3692416533 conn(0x7fec84070990 msgr2=0x7fec84070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:49.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.879+0000 7fec8b090640 1 -- 172.21.15.72:0/3692416533 shutdown_connections 2023-12-13T00:00:49.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.879+0000 7fec8b090640 1 -- 172.21.15.72:0/3692416533 wait complete. 2023-12-13T00:00:49.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.880+0000 7fec8b090640 1 Processor -- start 2023-12-13T00:00:49.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.880+0000 7fec8b090640 1 -- start start 2023-12-13T00:00:49.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.881+0000 7fec8b090640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec840c2600 0x7fec84151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:49.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.881+0000 7fec8b090640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec840c7640 0x7fec8414a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:49.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.881+0000 7fec8b090640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec84151260 0x7fec8414a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:49.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.881+0000 7fec8b090640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec841ed970 con 0x7fec84151260 2023-12-13T00:00:49.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.881+0000 7fec8b090640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec840cc2f0 con 0x7fec840c7640 2023-12-13T00:00:49.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.881+0000 7fec8b090640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec841ede30 con 0x7fec840c2600 2023-12-13T00:00:49.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.882+0000 7fec83fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec840c7640 0x7fec8414a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:49.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.882+0000 7fec88e2c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec840c2600 0x7fec84151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:49.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.882+0000 7fec83fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec840c7640 0x7fec8414a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:43272/0 (socket says 172.21.15.72:43272) 2023-12-13T00:00:49.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.882+0000 7fec83fff640 1 -- 172.21.15.72:0/2208619662 learned_addr learned my addr 172.21.15.72:0/2208619662 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:49.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.883+0000 7fec8962d640 1 --2- 172.21.15.72:0/2208619662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec84151260 0x7fec8414a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:49.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.886+0000 7fec83fff640 1 -- 172.21.15.72:0/2208619662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec840c2600 msgr2=0x7fec84151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:49.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.886+0000 7fec83fff640 1 --2- 172.21.15.72:0/2208619662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec840c2600 0x7fec84151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.886+0000 7fec83fff640 1 -- 172.21.15.72:0/2208619662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec84151260 msgr2=0x7fec8414a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:49.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.886+0000 7fec83fff640 1 --2- 172.21.15.72:0/2208619662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec84151260 0x7fec8414a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:49.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.886+0000 7fec83fff640 1 -- 172.21.15.72:0/2208619662 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec780094d0 con 0x7fec840c7640 2023-12-13T00:00:49.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.889+0000 7fec83fff640 1 --2- 172.21.15.72:0/2208619662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec840c7640 0x7fec8414a450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fec78000c00 tx=0x7fec780046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:49.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.893+0000 7fec817fa640 1 -- 172.21.15.72:0/2208619662 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7803ac60 con 0x7fec840c7640 2023-12-13T00:00:49.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.893+0000 7fec817fa640 1 -- 172.21.15.72:0/2208619662 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7803ade0 con 0x7fec840c7640 2023-12-13T00:00:49.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.893+0000 7fec8b090640 1 -- 172.21.15.72:0/2208619662 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec840cc520 con 0x7fec840c7640 2023-12-13T00:00:49.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.893+0000 7fec817fa640 1 -- 172.21.15.72:0/2208619662 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78044630 con 0x7fec840c7640 2023-12-13T00:00:49.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.893+0000 7fec8b090640 1 -- 172.21.15.72:0/2208619662 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec840c8160 con 0x7fec840c7640 2023-12-13T00:00:49.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:49.894+0000 7fec8b090640 1 -- 172.21.15.72:0/2208619662 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec840c3210 con 0x7fec840c7640 2023-12-13T00:00:50.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.140+0000 7fec817fa640 1 -- 172.21.15.72:0/2208619662 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fec7804d450 con 0x7fec840c7640 2023-12-13T00:00:50.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.140+0000 7fec817fa640 1 --2- 172.21.15.72:0/2208619662 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fec7006b210 0x7fec7006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:50.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.140+0000 7fec88e2c640 1 --2- 172.21.15.72:0/2208619662 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fec7006b210 0x7fec7006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:50.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.141+0000 7fec88e2c640 1 --2- 172.21.15.72:0/2208619662 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fec7006b210 0x7fec7006d6d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fec74009aa0 tx=0x7fec74009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:50.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.149+0000 7fec817fa640 1 -- 172.21.15.72:0/2208619662 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fec7802d040 con 0x7fec840c7640 2023-12-13T00:00:50.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.160+0000 7fec817fa640 1 -- 172.21.15.72:0/2208619662 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fec78076f70 con 0x7fec840c7640 2023-12-13T00:00:50.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.331+0000 7fec8b090640 1 -- 172.21.15.72:0/2208619662 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fec84067470 con 0x7fec840c7640 2023-12-13T00:00:50.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.337+0000 7fec817fa640 1 -- 172.21.15.72:0/2208619662 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fec7807a590 con 0x7fec840c7640 2023-12-13T00:00:50.337 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-12-13T00:00:50.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.339+0000 7fec8b090640 1 -- 172.21.15.72:0/2208619662 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fec7006b210 msgr2=0x7fec7006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:50.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.339+0000 7fec8b090640 1 --2- 172.21.15.72:0/2208619662 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fec7006b210 0x7fec7006d6d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fec74009aa0 tx=0x7fec74009190 comp rx=0 tx=0).stop 2023-12-13T00:00:50.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.339+0000 7fec8b090640 1 -- 172.21.15.72:0/2208619662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec840c7640 msgr2=0x7fec8414a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:50.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.339+0000 7fec8b090640 1 --2- 172.21.15.72:0/2208619662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec840c7640 0x7fec8414a450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fec78000c00 tx=0x7fec780046c0 comp rx=0 tx=0).stop 2023-12-13T00:00:50.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.339+0000 7fec8b090640 1 -- 172.21.15.72:0/2208619662 shutdown_connections 2023-12-13T00:00:50.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.339+0000 7fec8b090640 1 --2- 172.21.15.72:0/2208619662 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fec7006b210 0x7fec7006d6d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:50.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.339+0000 7fec8b090640 1 --2- 172.21.15.72:0/2208619662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec84151260 0x7fec8414a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:50.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.339+0000 7fec8b090640 1 --2- 172.21.15.72:0/2208619662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec840c7640 0x7fec8414a450 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:50.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.339+0000 7fec8b090640 1 --2- 172.21.15.72:0/2208619662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec840c2600 0x7fec84151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:50.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.339+0000 7fec8b090640 1 -- 172.21.15.72:0/2208619662 >> 172.21.15.72:0/2208619662 conn(0x7fec84070990 msgr2=0x7fec8414bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:50.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.339+0000 7fec8b090640 1 -- 172.21.15.72:0/2208619662 shutdown_connections 2023-12-13T00:00:50.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.339+0000 7fec8b090640 1 -- 172.21.15.72:0/2208619662 wait complete. 2023-12-13T00:00:50.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-13T00:00:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.452+0000 7fd80b8d0640 1 Processor -- start 2023-12-13T00:00:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.452+0000 7fd80b8d0640 1 -- start start 2023-12-13T00:00:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.453+0000 7fd80b8d0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8040cb520 0x7fd804159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.453+0000 7fd80b8d0640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd8040c8270 0x7fd8040c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.453+0000 7fd80b8d0640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8040c8c00 con 0x7fd8040cb900 2023-12-13T00:00:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.453+0000 7fd80b8d0640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8040c6e40 con 0x7fd8040c8270 2023-12-13T00:00:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.453+0000 7fd80b8d0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80415d430 con 0x7fd8040cb520 2023-12-13T00:00:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.453+0000 7fd809e6d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd8040c8270 0x7fd8040c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.453+0000 7fd808e6b640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd8040cb900 0x7fd80415cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59606/0 (socket says 172.21.15.72:59606) 2023-12-13T00:00:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.453+0000 7fd808e6b640 1 -- 172.21.15.72:0/2039546841 learned_addr learned my addr 172.21.15.72:0/2039546841 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.453+0000 7fd80966c640 1 --2- 172.21.15.72:0/2039546841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8040cb520 0x7fd804159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.456+0000 7fd7fbfff640 1 -- 172.21.15.72:0/2039546841 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407785543 0 0) 0x7fd8040c8c00 con 0x7fd8040cb900 2023-12-13T00:00:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.456+0000 7fd7fbfff640 1 -- 172.21.15.72:0/2039546841 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f0003520 con 0x7fd8040cb900 2023-12-13T00:00:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.456+0000 7fd809e6d640 1 -- 172.21.15.72:0/2039546841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8040cb520 msgr2=0x7fd804159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.456+0000 7fd809e6d640 1 --2- 172.21.15.72:0/2039546841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8040cb520 0x7fd804159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.456+0000 7fd809e6d640 1 -- 172.21.15.72:0/2039546841 >> v1:172.21.15.72:6789/0 conn(0x7fd8040cb900 legacy=0x7fd80415cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.456+0000 7fd809e6d640 1 -- 172.21.15.72:0/2039546841 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80415d710 con 0x7fd8040c8270 2023-12-13T00:00:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.458+0000 7fd809e6d640 1 --2- 172.21.15.72:0/2039546841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8040c8270 0x7fd8040c86c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009d90 tx=0x7fd7fc02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a82dc50a89120e3c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.461+0000 7fd7fbfff640 1 -- 172.21.15.72:0/2039546841 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc02cbc0 con 0x7fd8040c8270 2023-12-13T00:00:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.462+0000 7fd7fbfff640 1 -- 172.21.15.72:0/2039546841 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc02cd20 con 0x7fd8040c8270 2023-12-13T00:00:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.462+0000 7fd7fbfff640 1 -- 172.21.15.72:0/2039546841 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc034660 con 0x7fd8040c8270 2023-12-13T00:00:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.462+0000 7fd80b8d0640 1 -- 172.21.15.72:0/2039546841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8040c8270 msgr2=0x7fd8040c86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.462+0000 7fd80b8d0640 1 --2- 172.21.15.72:0/2039546841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8040c8270 0x7fd8040c86c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009d90 tx=0x7fd7fc02be10 comp rx=0 tx=0).stop 2023-12-13T00:00:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.462+0000 7fd80b8d0640 1 -- 172.21.15.72:0/2039546841 shutdown_connections 2023-12-13T00:00:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.462+0000 7fd80b8d0640 1 --2- 172.21.15.72:0/2039546841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8040c8270 0x7fd8040c86c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:50.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.462+0000 7fd80b8d0640 1 --2- 172.21.15.72:0/2039546841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8040cb520 0x7fd804159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:50.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.462+0000 7fd80b8d0640 1 -- 172.21.15.72:0/2039546841 >> 172.21.15.72:0/2039546841 conn(0x7fd80406d170 msgr2=0x7fd80406d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:50.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.462+0000 7fd80b8d0640 1 -- 172.21.15.72:0/2039546841 shutdown_connections 2023-12-13T00:00:50.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.462+0000 7fd80b8d0640 1 -- 172.21.15.72:0/2039546841 wait complete. 2023-12-13T00:00:50.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.463+0000 7fd80b8d0640 1 Processor -- start 2023-12-13T00:00:50.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.463+0000 7fd80b8d0640 1 -- start start 2023-12-13T00:00:50.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.464+0000 7fd80b8d0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8040c8270 0x7fd80415cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:50.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.464+0000 7fd80b8d0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8040cb520 0x7fd80406b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:50.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.464+0000 7fd80b8d0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8040cb900 0x7fd80414ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:50.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.464+0000 7fd80b8d0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8041f2200 con 0x7fd8040cb900 2023-12-13T00:00:50.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.464+0000 7fd80b8d0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8041efa90 con 0x7fd8040cb520 2023-12-13T00:00:50.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.464+0000 7fd80b8d0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8041eef10 con 0x7fd8040c8270 2023-12-13T00:00:50.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.465+0000 7fd809e6d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8040cb900 0x7fd80414ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:50.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.465+0000 7fd808e6b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8040cb520 0x7fd80406b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:50.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.465+0000 7fd808e6b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8040cb520 0x7fd80406b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:43276/0 (socket says 172.21.15.72:43276) 2023-12-13T00:00:50.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.465+0000 7fd808e6b640 1 -- 172.21.15.72:0/2989372992 learned_addr learned my addr 172.21.15.72:0/2989372992 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:50.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.468+0000 7fd809e6d640 1 -- 172.21.15.72:0/2989372992 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8040c8270 msgr2=0x7fd80415cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:50.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.468+0000 7fd809e6d640 1 --2- 172.21.15.72:0/2989372992 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8040c8270 0x7fd80415cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:50.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.468+0000 7fd809e6d640 1 -- 172.21.15.72:0/2989372992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8040cb520 msgr2=0x7fd80406b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:50.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.468+0000 7fd809e6d640 1 --2- 172.21.15.72:0/2989372992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8040cb520 0x7fd80406b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:50.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.468+0000 7fd809e6d640 1 -- 172.21.15.72:0/2989372992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc009a70 con 0x7fd8040cb900 2023-12-13T00:00:50.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.468+0000 7fd808e6b640 1 --2- 172.21.15.72:0/2989372992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8040cb520 0x7fd80406b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T00:00:50.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.470+0000 7fd809e6d640 1 --2- 172.21.15.72:0/2989372992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8040cb900 0x7fd80414ede0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc033000 tx=0x7fd7fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:50.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.474+0000 7fd7f9ffb640 1 -- 172.21.15.72:0/2989372992 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc040650 con 0x7fd8040cb900 2023-12-13T00:00:50.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.474+0000 7fd7f9ffb640 1 -- 172.21.15.72:0/2989372992 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc02ce90 con 0x7fd8040cb900 2023-12-13T00:00:50.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.474+0000 7fd7f9ffb640 1 -- 172.21.15.72:0/2989372992 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0409f0 con 0x7fd8040cb900 2023-12-13T00:00:50.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.474+0000 7fd80b8d0640 1 -- 172.21.15.72:0/2989372992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8041ef1f0 con 0x7fd8040cb900 2023-12-13T00:00:50.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.474+0000 7fd80b8d0640 1 -- 172.21.15.72:0/2989372992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8041ef7b0 con 0x7fd8040cb900 2023-12-13T00:00:50.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.475+0000 7fd80b8d0640 1 -- 172.21.15.72:0/2989372992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8040c9270 con 0x7fd8040cb900 2023-12-13T00:00:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.505+0000 7fd7f9ffb640 1 -- 172.21.15.72:0/2989372992 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd7fc040b50 con 0x7fd8040cb900 2023-12-13T00:00:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.506+0000 7fd7f9ffb640 1 --2- 172.21.15.72:0/2989372992 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd7e806b1c0 0x7fd7e806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.506+0000 7fd80966c640 1 --2- 172.21.15.72:0/2989372992 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd7e806b1c0 0x7fd7e806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:50.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.506+0000 7fd80966c640 1 --2- 172.21.15.72:0/2989372992 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd7e806b1c0 0x7fd7e806d680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd800006a90 tx=0x7fd800006a20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:50.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.741+0000 7fd7f9ffb640 1 -- 172.21.15.72:0/2989372992 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7fc07bab0 con 0x7fd8040cb900 2023-12-13T00:00:50.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.741+0000 7fd7f9ffb640 1 -- 172.21.15.72:0/2989372992 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd7fc0776f0 con 0x7fd8040cb900 2023-12-13T00:00:50.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.914+0000 7fd80b8d0640 1 -- 172.21.15.72:0/2989372992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8041f2340 con 0x7fd8040cb900 2023-12-13T00:00:50.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.919+0000 7fd7f9ffb640 1 -- 172.21.15.72:0/2989372992 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd7fc0440a0 con 0x7fd8040cb900 2023-12-13T00:00:50.919 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-12-13T00:00:50.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.920+0000 7fd80b8d0640 1 -- 172.21.15.72:0/2989372992 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd7e806b1c0 msgr2=0x7fd7e806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:50.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.920+0000 7fd80b8d0640 1 --2- 172.21.15.72:0/2989372992 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd7e806b1c0 0x7fd7e806d680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd800006a90 tx=0x7fd800006a20 comp rx=0 tx=0).stop 2023-12-13T00:00:50.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.921+0000 7fd80b8d0640 1 -- 172.21.15.72:0/2989372992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8040cb900 msgr2=0x7fd80414ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:50.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.921+0000 7fd80b8d0640 1 --2- 172.21.15.72:0/2989372992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8040cb900 0x7fd80414ede0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc033000 tx=0x7fd7fc004a40 comp rx=0 tx=0).stop 2023-12-13T00:00:50.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.921+0000 7fd80b8d0640 1 -- 172.21.15.72:0/2989372992 shutdown_connections 2023-12-13T00:00:50.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.921+0000 7fd80b8d0640 1 --2- 172.21.15.72:0/2989372992 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd7e806b1c0 0x7fd7e806d680 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:50.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.921+0000 7fd80b8d0640 1 --2- 172.21.15.72:0/2989372992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8040cb900 0x7fd80414ede0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:50.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.921+0000 7fd80b8d0640 1 --2- 172.21.15.72:0/2989372992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8040cb520 0x7fd80406b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:50.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.921+0000 7fd80b8d0640 1 --2- 172.21.15.72:0/2989372992 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8040c8270 0x7fd80415cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:50.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.921+0000 7fd80b8d0640 1 -- 172.21.15.72:0/2989372992 >> 172.21.15.72:0/2989372992 conn(0x7fd80406d170 msgr2=0x7fd80406a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:50.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.921+0000 7fd80b8d0640 1 -- 172.21.15.72:0/2989372992 shutdown_connections 2023-12-13T00:00:50.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:50.921+0000 7fd80b8d0640 1 -- 172.21.15.72:0/2989372992 wait complete. 2023-12-13T00:00:50.932 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-13T00:00:51.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.034+0000 7f10df933640 1 Processor -- start 2023-12-13T00:00:51.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.034+0000 7f10df933640 1 -- start start 2023-12-13T00:00:51.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.035+0000 7f10df933640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10d80c8ee0 0x7f10d806e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:51.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.035+0000 7f10df933640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d80c7640 con 0x7f10d806ed80 2023-12-13T00:00:51.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.035+0000 7f10df933640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d806b5c0 con 0x7f10d81538d0 2023-12-13T00:00:51.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.035+0000 7f10df933640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d806d130 con 0x7f10d80c8ee0 2023-12-13T00:00:51.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.035+0000 7f10dd6cf640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f10d81538d0 0x7f10d815a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:49132/0 (socket says 172.21.15.72:49132) 2023-12-13T00:00:51.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.035+0000 7f10dd6cf640 1 -- 172.21.15.72:0/2942659170 learned_addr learned my addr 172.21.15.72:0/2942659170 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:51.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.035+0000 7f10dcece640 1 --2- 172.21.15.72:0/2942659170 >> v2:172.21.15.72:3300/0 conn(0x7f10d80c8ee0 0x7f10d806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:51.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.038+0000 7f10cffff640 1 -- 172.21.15.72:0/2942659170 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550349360 0 0) 0x7f10d806b5c0 con 0x7f10d81538d0 2023-12-13T00:00:51.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.038+0000 7f10cffff640 1 -- 172.21.15.72:0/2942659170 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10c4003520 con 0x7f10d81538d0 2023-12-13T00:00:51.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.039+0000 7f10dcece640 1 -- 172.21.15.72:0/2942659170 >> v1:172.21.15.176:6789/0 conn(0x7f10d81538d0 legacy=0x7f10d815a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:51.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.039+0000 7f10dcece640 1 -- 172.21.15.72:0/2942659170 >> v1:172.21.15.72:6789/0 conn(0x7f10d806ed80 legacy=0x7f10d806ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:51.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.039+0000 7f10dcece640 1 -- 172.21.15.72:0/2942659170 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d80cd750 con 0x7f10d80c8ee0 2023-12-13T00:00:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.043+0000 7f10dcece640 1 --2- 172.21.15.72:0/2942659170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d80c8ee0 0x7f10d806e840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f10c80097a0 tx=0x7f10c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c1127324428e44 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.046+0000 7f10cffff640 1 -- 172.21.15.72:0/2942659170 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c8031830 con 0x7f10d80c8ee0 2023-12-13T00:00:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.046+0000 7f10cffff640 1 -- 172.21.15.72:0/2942659170 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c8031990 con 0x7f10d80c8ee0 2023-12-13T00:00:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.046+0000 7f10cffff640 1 -- 172.21.15.72:0/2942659170 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c8031d20 con 0x7f10d80c8ee0 2023-12-13T00:00:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.047+0000 7f10df933640 1 -- 172.21.15.72:0/2942659170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d80c8ee0 msgr2=0x7f10d806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.047+0000 7f10df933640 1 --2- 172.21.15.72:0/2942659170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d80c8ee0 0x7f10d806e840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f10c80097a0 tx=0x7f10c802b8d0 comp rx=0 tx=0).stop 2023-12-13T00:00:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.047+0000 7f10df933640 1 -- 172.21.15.72:0/2942659170 shutdown_connections 2023-12-13T00:00:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.047+0000 7f10df933640 1 --2- 172.21.15.72:0/2942659170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d80c8ee0 0x7f10d806e840 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.047+0000 7f10df933640 1 -- 172.21.15.72:0/2942659170 >> 172.21.15.72:0/2942659170 conn(0x7f10d8060f20 msgr2=0x7f10d8061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.047+0000 7f10df933640 1 -- 172.21.15.72:0/2942659170 shutdown_connections 2023-12-13T00:00:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.047+0000 7f10df933640 1 -- 172.21.15.72:0/2942659170 wait complete. 2023-12-13T00:00:51.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.048+0000 7f10df933640 1 Processor -- start 2023-12-13T00:00:51.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.048+0000 7f10df933640 1 -- start start 2023-12-13T00:00:51.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.049+0000 7f10df933640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10d806ed80 0x7f10d814af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:51.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.049+0000 7f10df933640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d80c8ee0 0x7f10d814b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:51.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.049+0000 7f10df933640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10d81538d0 0x7f10d80b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:51.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.049+0000 7f10df933640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d80ca590 con 0x7f10d80c8ee0 2023-12-13T00:00:51.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.049+0000 7f10df933640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d80b0800 con 0x7f10d806ed80 2023-12-13T00:00:51.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.049+0000 7f10df933640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d80b1910 con 0x7f10d81538d0 2023-12-13T00:00:51.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.049+0000 7f10dcece640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d80c8ee0 0x7f10d814b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:51.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.049+0000 7f10dded0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10d81538d0 0x7f10d80b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:51.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.050+0000 7f10dd6cf640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10d806ed80 0x7f10d814af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:51.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.050+0000 7f10dcece640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d80c8ee0 0x7f10d814b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54574/0 (socket says 172.21.15.72:54574) 2023-12-13T00:00:51.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.050+0000 7f10dcece640 1 -- 172.21.15.72:0/103476759 learned_addr learned my addr 172.21.15.72:0/103476759 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:51.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.053+0000 7f10dcece640 1 -- 172.21.15.72:0/103476759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10d81538d0 msgr2=0x7f10d80b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:51.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.053+0000 7f10dcece640 1 --2- 172.21.15.72:0/103476759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10d81538d0 0x7f10d80b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:51.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.053+0000 7f10dcece640 1 -- 172.21.15.72:0/103476759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10d806ed80 msgr2=0x7f10d814af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:51.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.053+0000 7f10dcece640 1 --2- 172.21.15.72:0/103476759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10d806ed80 0x7f10d814af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:51.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.053+0000 7f10dcece640 1 -- 172.21.15.72:0/103476759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c8009400 con 0x7f10d80c8ee0 2023-12-13T00:00:51.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.055+0000 7f10dcece640 1 --2- 172.21.15.72:0/103476759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d80c8ee0 0x7f10d814b4b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f10c80098c0 tx=0x7f10c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:51.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.058+0000 7f10cdffb640 1 -- 172.21.15.72:0/103476759 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c803a8f0 con 0x7f10d80c8ee0 2023-12-13T00:00:51.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.058+0000 7f10cdffb640 1 -- 172.21.15.72:0/103476759 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c803aa70 con 0x7f10d80c8ee0 2023-12-13T00:00:51.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.058+0000 7f10cdffb640 1 -- 172.21.15.72:0/103476759 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c803ae20 con 0x7f10d80c8ee0 2023-12-13T00:00:51.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.058+0000 7f10df933640 1 -- 172.21.15.72:0/103476759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d815a8a0 con 0x7f10d80c8ee0 2023-12-13T00:00:51.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.059+0000 7f10df933640 1 -- 172.21.15.72:0/103476759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d80b1bd0 con 0x7f10d80c8ee0 2023-12-13T00:00:51.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.060+0000 7f10df933640 1 -- 172.21.15.72:0/103476759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d80b05d0 con 0x7f10d80c8ee0 2023-12-13T00:00:51.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.078+0000 7f10cdffb640 1 -- 172.21.15.72:0/103476759 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f10c804d440 con 0x7f10d80c8ee0 2023-12-13T00:00:51.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.078+0000 7f10cdffb640 1 --2- 172.21.15.72:0/103476759 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f10bc06b210 0x7f10bc06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:51.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.079+0000 7f10dd6cf640 1 --2- 172.21.15.72:0/103476759 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f10bc06b210 0x7f10bc06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:51.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.079+0000 7f10dd6cf640 1 --2- 172.21.15.72:0/103476759 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f10bc06b210 0x7f10bc06d6d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f10d40011e0 tx=0x7f10d4007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:51.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.313+0000 7f10cdffb640 1 -- 172.21.15.72:0/103476759 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f10c807a880 con 0x7f10d80c8ee0 2023-12-13T00:00:51.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.314+0000 7f10cdffb640 1 -- 172.21.15.72:0/103476759 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f10c8076bc0 con 0x7f10d80c8ee0 2023-12-13T00:00:51.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.485+0000 7f10df933640 1 -- 172.21.15.72:0/103476759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f10d80b05d0 con 0x7f10d80c8ee0 2023-12-13T00:00:51.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.490+0000 7f10cdffb640 1 -- 172.21.15.72:0/103476759 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f10d80b05d0 con 0x7f10d80c8ee0 2023-12-13T00:00:51.491 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-12-13T00:00:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.493+0000 7f10df933640 1 -- 172.21.15.72:0/103476759 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f10bc06b210 msgr2=0x7f10bc06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.493+0000 7f10df933640 1 --2- 172.21.15.72:0/103476759 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f10bc06b210 0x7f10bc06d6d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f10d40011e0 tx=0x7f10d4007d30 comp rx=0 tx=0).stop 2023-12-13T00:00:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.493+0000 7f10df933640 1 -- 172.21.15.72:0/103476759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d80c8ee0 msgr2=0x7f10d814b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.493+0000 7f10df933640 1 --2- 172.21.15.72:0/103476759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d80c8ee0 0x7f10d814b4b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f10c80098c0 tx=0x7f10c80046c0 comp rx=0 tx=0).stop 2023-12-13T00:00:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.493+0000 7f10df933640 1 -- 172.21.15.72:0/103476759 shutdown_connections 2023-12-13T00:00:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.493+0000 7f10df933640 1 --2- 172.21.15.72:0/103476759 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f10bc06b210 0x7f10bc06d6d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.493+0000 7f10df933640 1 --2- 172.21.15.72:0/103476759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10d81538d0 0x7f10d80b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.493+0000 7f10df933640 1 --2- 172.21.15.72:0/103476759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d80c8ee0 0x7f10d814b4b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.493+0000 7f10df933640 1 --2- 172.21.15.72:0/103476759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10d806ed80 0x7f10d814af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.493+0000 7f10df933640 1 -- 172.21.15.72:0/103476759 >> 172.21.15.72:0/103476759 conn(0x7f10d8060f20 msgr2=0x7f10d80c92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.493+0000 7f10df933640 1 -- 172.21.15.72:0/103476759 shutdown_connections 2023-12-13T00:00:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.493+0000 7f10df933640 1 -- 172.21.15.72:0/103476759 wait complete. 2023-12-13T00:00:51.504 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-13T00:00:51.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.604+0000 7f883bada640 1 Processor -- start 2023-12-13T00:00:51.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.605+0000 7f883bada640 1 -- start start 2023-12-13T00:00:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.606+0000 7f883bada640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8834150530 0x7f88340c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.606+0000 7f883bada640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f88341596e0 0x7f8834159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.606+0000 7f883bada640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8834150910 con 0x7f88340c7180 2023-12-13T00:00:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.606+0000 7f883bada640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88340c1ec0 con 0x7f88341596e0 2023-12-13T00:00:51.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.606+0000 7f883bada640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883415a4e0 con 0x7f8834150530 2023-12-13T00:00:51.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.606+0000 7f8839075640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f88340c7180 0x7f88340c44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:49142/0 (socket says 172.21.15.72:49142) 2023-12-13T00:00:51.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.606+0000 7f8839075640 1 -- 172.21.15.72:0/1871843797 learned_addr learned my addr 172.21.15.72:0/1871843797 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:51.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.606+0000 7f8839876640 1 --2- 172.21.15.72:0/1871843797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8834150530 0x7f88340c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:51.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.606+0000 7f883a077640 1 --2- 172.21.15.72:0/1871843797 >> v2:172.21.15.72:3300/0 conn(0x7f88341596e0 0x7f8834159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:51.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.609+0000 7f8838874640 1 -- 172.21.15.72:0/1871843797 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275802808 0 0) 0x7f8834150910 con 0x7f88340c7180 2023-12-13T00:00:51.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.609+0000 7f8838874640 1 -- 172.21.15.72:0/1871843797 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8820005730 con 0x7f88340c7180 2023-12-13T00:00:51.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.609+0000 7f883a077640 1 -- 172.21.15.72:0/1871843797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8834150530 msgr2=0x7f88340c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:51.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.609+0000 7f883a077640 1 --2- 172.21.15.72:0/1871843797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8834150530 0x7f88340c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:51.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.609+0000 7f883a077640 1 -- 172.21.15.72:0/1871843797 >> v1:172.21.15.176:6789/0 conn(0x7f88340c7180 legacy=0x7f88340c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:51.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.609+0000 7f883a077640 1 -- 172.21.15.72:0/1871843797 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88340c2110 con 0x7f88341596e0 2023-12-13T00:00:51.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.610+0000 7f883a077640 1 --2- 172.21.15.72:0/1871843797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88341596e0 0x7f8834159b90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f88300097a0 tx=0x7f883002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6537cc284f9b2ba1 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:51.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.614+0000 7f8838874640 1 -- 172.21.15.72:0/1871843797 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830030610 con 0x7f88341596e0 2023-12-13T00:00:51.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.614+0000 7f8838874640 1 -- 172.21.15.72:0/1871843797 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8830030770 con 0x7f88341596e0 2023-12-13T00:00:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.614+0000 7f8838874640 1 -- 172.21.15.72:0/1871843797 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830030b00 con 0x7f88341596e0 2023-12-13T00:00:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.615+0000 7f883bada640 1 -- 172.21.15.72:0/1871843797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88341596e0 msgr2=0x7f8834159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.615+0000 7f883bada640 1 --2- 172.21.15.72:0/1871843797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88341596e0 0x7f8834159b90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f88300097a0 tx=0x7f883002b960 comp rx=0 tx=0).stop 2023-12-13T00:00:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.615+0000 7f883bada640 1 -- 172.21.15.72:0/1871843797 shutdown_connections 2023-12-13T00:00:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.615+0000 7f883bada640 1 --2- 172.21.15.72:0/1871843797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88341596e0 0x7f8834159b90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.615+0000 7f883bada640 1 --2- 172.21.15.72:0/1871843797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8834150530 0x7f88340c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.615+0000 7f883bada640 1 -- 172.21.15.72:0/1871843797 >> 172.21.15.72:0/1871843797 conn(0x7f883406c5f0 msgr2=0x7f883406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.615+0000 7f883bada640 1 -- 172.21.15.72:0/1871843797 shutdown_connections 2023-12-13T00:00:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.615+0000 7f883bada640 1 -- 172.21.15.72:0/1871843797 wait complete. 2023-12-13T00:00:51.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.616+0000 7f883bada640 1 Processor -- start 2023-12-13T00:00:51.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.616+0000 7f883bada640 1 -- start start 2023-12-13T00:00:51.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.617+0000 7f883bada640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88340c7180 0x7f88340cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:51.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.617+0000 7f883bada640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8834150530 0x7f8834070e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:51.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.617+0000 7f883bada640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88341596e0 0x7f88341eab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:51.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.617+0000 7f883bada640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88341eedd0 con 0x7f8834150530 2023-12-13T00:00:51.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.617+0000 7f883bada640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834148940 con 0x7f88341596e0 2023-12-13T00:00:51.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.617+0000 7f883bada640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88340cb600 con 0x7f88340c7180 2023-12-13T00:00:51.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.617+0000 7f8839075640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8834150530 0x7f8834070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:51.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.617+0000 7f8839876640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88340c7180 0x7f88340cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:51.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.617+0000 7f883a077640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88341596e0 0x7f88341eab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:51.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.617+0000 7f883a077640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88341596e0 0x7f88341eab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:43286/0 (socket says 172.21.15.72:43286) 2023-12-13T00:00:51.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.617+0000 7f8839075640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8834150530 0x7f8834070e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54596/0 (socket says 172.21.15.72:54596) 2023-12-13T00:00:51.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.617+0000 7f883a077640 1 -- 172.21.15.72:0/4287437308 learned_addr learned my addr 172.21.15.72:0/4287437308 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:51.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.620+0000 7f8839075640 1 -- 172.21.15.72:0/4287437308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88340c7180 msgr2=0x7f88340cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:51.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.621+0000 7f8839075640 1 --2- 172.21.15.72:0/4287437308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88340c7180 0x7f88340cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:51.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.621+0000 7f8839075640 1 -- 172.21.15.72:0/4287437308 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88341596e0 msgr2=0x7f88341eab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:51.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.621+0000 7f8839075640 1 --2- 172.21.15.72:0/4287437308 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88341596e0 0x7f88341eab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:51.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.621+0000 7f8839075640 1 -- 172.21.15.72:0/4287437308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830009400 con 0x7f8834150530 2023-12-13T00:00:51.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.623+0000 7f8839075640 1 --2- 172.21.15.72:0/4287437308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8834150530 0x7f8834070e90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f882400c400 tx=0x7f882400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:51.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.626+0000 7f882a7fc640 1 -- 172.21.15.72:0/4287437308 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8824005ce0 con 0x7f8834150530 2023-12-13T00:00:51.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.626+0000 7f882a7fc640 1 -- 172.21.15.72:0/4287437308 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8824005e40 con 0x7f8834150530 2023-12-13T00:00:51.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.626+0000 7f882a7fc640 1 -- 172.21.15.72:0/4287437308 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88240072f0 con 0x7f8834150530 2023-12-13T00:00:51.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.626+0000 7f883bada640 1 -- 172.21.15.72:0/4287437308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88340caa20 con 0x7f8834150530 2023-12-13T00:00:51.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.626+0000 7f883bada640 1 -- 172.21.15.72:0/4287437308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88341ee710 con 0x7f8834150530 2023-12-13T00:00:51.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.627+0000 7f883bada640 1 -- 172.21.15.72:0/4287437308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88341eef10 con 0x7f8834150530 2023-12-13T00:00:51.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.645+0000 7f882a7fc640 1 -- 172.21.15.72:0/4287437308 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8824007450 con 0x7f8834150530 2023-12-13T00:00:51.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.645+0000 7f882a7fc640 1 --2- 172.21.15.72:0/4287437308 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f881806b210 0x7f881806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:51.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.645+0000 7f8839876640 1 --2- 172.21.15.72:0/4287437308 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f881806b210 0x7f881806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:51.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.646+0000 7f8839876640 1 --2- 172.21.15.72:0/4287437308 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f881806b210 0x7f881806d6d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f882c0113e0 tx=0x7f882c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:51.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.648+0000 7f882a7fc640 1 -- 172.21.15.72:0/4287437308 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8824007e20 con 0x7f8834150530 2023-12-13T00:00:51.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:51.882+0000 7f882a7fc640 1 -- 172.21.15.72:0/4287437308 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8824053dd0 con 0x7f8834150530 2023-12-13T00:00:52.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:52.069+0000 7f883bada640 1 -- 172.21.15.72:0/4287437308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f88340caa20 con 0x7f8834150530 2023-12-13T00:00:52.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:52.073+0000 7f882a7fc640 1 -- 172.21.15.72:0/4287437308 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f88340caa20 con 0x7f8834150530 2023-12-13T00:00:52.075 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-12-13T00:00:52.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:52.075+0000 7f883bada640 1 -- 172.21.15.72:0/4287437308 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f881806b210 msgr2=0x7f881806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:52.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:52.075+0000 7f883bada640 1 --2- 172.21.15.72:0/4287437308 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f881806b210 0x7f881806d6d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f882c0113e0 tx=0x7f882c00b040 comp rx=0 tx=0).stop 2023-12-13T00:00:52.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:52.075+0000 7f883bada640 1 -- 172.21.15.72:0/4287437308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8834150530 msgr2=0x7f8834070e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:52.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:52.075+0000 7f883bada640 1 --2- 172.21.15.72:0/4287437308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8834150530 0x7f8834070e90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f882400c400 tx=0x7f882400c8c0 comp rx=0 tx=0).stop 2023-12-13T00:00:52.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:52.075+0000 7f883bada640 1 -- 172.21.15.72:0/4287437308 shutdown_connections 2023-12-13T00:00:52.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:52.075+0000 7f883bada640 1 --2- 172.21.15.72:0/4287437308 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f881806b210 0x7f881806d6d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:52.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:52.075+0000 7f883bada640 1 --2- 172.21.15.72:0/4287437308 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88341596e0 0x7f88341eab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:52.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:52.075+0000 7f883bada640 1 --2- 172.21.15.72:0/4287437308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8834150530 0x7f8834070e90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:52.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:52.075+0000 7f883bada640 1 --2- 172.21.15.72:0/4287437308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88340c7180 0x7f88340cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:52.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:52.075+0000 7f883bada640 1 -- 172.21.15.72:0/4287437308 >> 172.21.15.72:0/4287437308 conn(0x7f883406c5f0 msgr2=0x7f8834073530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:52.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:52.076+0000 7f883bada640 1 -- 172.21.15.72:0/4287437308 shutdown_connections 2023-12-13T00:00:52.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:52.076+0000 7f883bada640 1 -- 172.21.15.72:0/4287437308 wait complete. 2023-12-13T00:00:52.087 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2023-12-13T00:00:52.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:52.087 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-13T00:00:52.112 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[95791]: fuse finished with error 0 and tester_r 0 2023-12-13T00:00:52.114 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:00:58.215 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-12-13T00:00:58.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:00:58.216 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-13T00:00:58.243 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:00:58.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.385+0000 7f47daf41640 1 Processor -- start 2023-12-13T00:00:58.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.385+0000 7f47daf41640 1 -- start start 2023-12-13T00:00:58.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.386+0000 7f47daf41640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47d40c7650 0x7f47d415a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:58.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.386+0000 7f47daf41640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f47d40c7a30 0x7f47d41560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:58.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.386+0000 7f47daf41640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d4159dd0 con 0x7f47d40c6c40 2023-12-13T00:00:58.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.386+0000 7f47daf41640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d40c5ad0 con 0x7f47d40c7650 2023-12-13T00:00:58.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.386+0000 7f47daf41640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d40c5cc0 con 0x7f47d40c7a30 2023-12-13T00:00:58.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.386+0000 7f47d8cdd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47d40c7650 0x7f47d415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:58.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.387+0000 7f47d3fff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f47d40c7a30 0x7f47d41560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:58.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.387+0000 7f47d94de640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f47d40c6c40 0x7f47d40c53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52734/0 (socket says 172.21.15.72:52734) 2023-12-13T00:00:58.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.387+0000 7f47d94de640 1 -- 172.21.15.72:0/2077054460 learned_addr learned my addr 172.21.15.72:0/2077054460 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:58.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.389+0000 7f47d8cdd640 1 -- 172.21.15.72:0/2077054460 >> v2:172.21.15.176:3300/0 conn(0x7f47d40c7a30 msgr2=0x7f47d41560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:58.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.389+0000 7f47d8cdd640 1 --2- 172.21.15.72:0/2077054460 >> v2:172.21.15.176:3300/0 conn(0x7f47d40c7a30 0x7f47d41560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:58.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.389+0000 7f47d8cdd640 1 -- 172.21.15.72:0/2077054460 >> v1:172.21.15.72:6789/0 conn(0x7f47d40c6c40 legacy=0x7f47d40c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:58.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.389+0000 7f47d8cdd640 1 -- 172.21.15.72:0/2077054460 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d40c6260 con 0x7f47d40c7650 2023-12-13T00:00:58.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.393+0000 7f47d8cdd640 1 --2- 172.21.15.72:0/2077054460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d40c7650 0x7f47d415a260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f47d40c1250 tx=0x7f47c402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a4554797258e47 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.397+0000 7f47d37fe640 1 -- 172.21.15.72:0/2077054460 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c402e070 con 0x7f47d40c7650 2023-12-13T00:00:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.397+0000 7f47d37fe640 1 -- 172.21.15.72:0/2077054460 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c40315a0 con 0x7f47d40c7650 2023-12-13T00:00:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.397+0000 7f47d37fe640 1 -- 172.21.15.72:0/2077054460 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c4031930 con 0x7f47d40c7650 2023-12-13T00:00:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.398+0000 7f47daf41640 1 -- 172.21.15.72:0/2077054460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d40c7650 msgr2=0x7f47d415a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.398+0000 7f47daf41640 1 --2- 172.21.15.72:0/2077054460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d40c7650 0x7f47d415a260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f47d40c1250 tx=0x7f47c402b840 comp rx=0 tx=0).stop 2023-12-13T00:00:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.398+0000 7f47daf41640 1 -- 172.21.15.72:0/2077054460 shutdown_connections 2023-12-13T00:00:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.398+0000 7f47daf41640 1 --2- 172.21.15.72:0/2077054460 >> v2:172.21.15.176:3300/0 conn(0x7f47d40c7a30 0x7f47d41560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.398+0000 7f47daf41640 1 --2- 172.21.15.72:0/2077054460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d40c7650 0x7f47d415a260 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.398+0000 7f47daf41640 1 -- 172.21.15.72:0/2077054460 >> 172.21.15.72:0/2077054460 conn(0x7f47d406c5f0 msgr2=0x7f47d406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.398+0000 7f47daf41640 1 -- 172.21.15.72:0/2077054460 shutdown_connections 2023-12-13T00:00:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.398+0000 7f47daf41640 1 -- 172.21.15.72:0/2077054460 wait complete. 2023-12-13T00:00:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.399+0000 7f47daf41640 1 Processor -- start 2023-12-13T00:00:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.399+0000 7f47daf41640 1 -- start start 2023-12-13T00:00:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.400+0000 7f47daf41640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d40c6c40 0x7f47d4131e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.400+0000 7f47daf41640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47d40c7650 0x7f47d4140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.400+0000 7f47daf41640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47d40c7a30 0x7f47d4139360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.400+0000 7f47daf41640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d4071d40 con 0x7f47d40c6c40 2023-12-13T00:00:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.400+0000 7f47daf41640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d4072240 con 0x7f47d40c7650 2023-12-13T00:00:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.400+0000 7f47daf41640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d4072a50 con 0x7f47d40c7a30 2023-12-13T00:00:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.401+0000 7f47d8cdd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d40c6c40 0x7f47d4131e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.401+0000 7f47d3fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47d40c7650 0x7f47d4140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.401+0000 7f47d8cdd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d40c6c40 0x7f47d4131e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45514/0 (socket says 172.21.15.72:45514) 2023-12-13T00:00:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.401+0000 7f47d8cdd640 1 -- 172.21.15.72:0/4195582003 learned_addr learned my addr 172.21.15.72:0/4195582003 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.401+0000 7f47d94de640 1 --2- 172.21.15.72:0/4195582003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47d40c7a30 0x7f47d4139360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.404+0000 7f47d8cdd640 1 -- 172.21.15.72:0/4195582003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47d40c7a30 msgr2=0x7f47d4139360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.404+0000 7f47d8cdd640 1 --2- 172.21.15.72:0/4195582003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47d40c7a30 0x7f47d4139360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.404+0000 7f47d8cdd640 1 -- 172.21.15.72:0/4195582003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47d40c7650 msgr2=0x7f47d4140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.404+0000 7f47d8cdd640 1 --2- 172.21.15.72:0/4195582003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47d40c7650 0x7f47d4140250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.404+0000 7f47d8cdd640 1 -- 172.21.15.72:0/4195582003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c4009400 con 0x7f47d40c6c40 2023-12-13T00:00:58.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.406+0000 7f47d8cdd640 1 --2- 172.21.15.72:0/4195582003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d40c6c40 0x7f47d4131e30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009890 tx=0x7f47c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:58.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.408+0000 7f47d17fa640 1 -- 172.21.15.72:0/4195582003 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c4032840 con 0x7f47d40c6c40 2023-12-13T00:00:58.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.408+0000 7f47daf41640 1 -- 172.21.15.72:0/4195582003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d4072490 con 0x7f47d40c6c40 2023-12-13T00:00:58.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.408+0000 7f47daf41640 1 -- 172.21.15.72:0/4195582003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d4071540 con 0x7f47d40c6c40 2023-12-13T00:00:58.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.409+0000 7f47daf41640 1 -- 172.21.15.72:0/4195582003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d4141a50 con 0x7f47d40c6c40 2023-12-13T00:00:58.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.410+0000 7f47d17fa640 1 -- 172.21.15.72:0/4195582003 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c40329a0 con 0x7f47d40c6c40 2023-12-13T00:00:58.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.410+0000 7f47d17fa640 1 -- 172.21.15.72:0/4195582003 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c4032d10 con 0x7f47d40c6c40 2023-12-13T00:00:58.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.649+0000 7f47d17fa640 1 -- 172.21.15.72:0/4195582003 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f47c40453f0 con 0x7f47d40c6c40 2023-12-13T00:00:58.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.649+0000 7f47d17fa640 1 --2- 172.21.15.72:0/4195582003 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f47c006b1c0 0x7f47c006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:58.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.649+0000 7f47d3fff640 1 --2- 172.21.15.72:0/4195582003 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f47c006b1c0 0x7f47c006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:58.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.650+0000 7f47d3fff640 1 --2- 172.21.15.72:0/4195582003 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f47c006b1c0 0x7f47c006d680 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f47d4159540 tx=0x7f47c8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:58.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.663+0000 7f47d17fa640 1 -- 172.21.15.72:0/4195582003 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f47c407ab50 con 0x7f47d40c6c40 2023-12-13T00:00:58.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.663+0000 7f47d17fa640 1 -- 172.21.15.72:0/4195582003 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f47c4076e90 con 0x7f47d40c6c40 2023-12-13T00:00:58.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.833+0000 7f47daf41640 1 -- 172.21.15.72:0/4195582003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47d4067470 con 0x7f47d40c6c40 2023-12-13T00:00:58.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.885+0000 7f47d17fa640 1 -- 172.21.15.72:0/4195582003 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f47c407a4b0 con 0x7f47d40c6c40 2023-12-13T00:00:58.886 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:00:58.887 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:00:36.191864+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T00:00:27.701252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T00:00:29.324356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T00:00:33.363089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:00:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.887+0000 7f47daf41640 1 -- 172.21.15.72:0/4195582003 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f47c006b1c0 msgr2=0x7f47c006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.887+0000 7f47daf41640 1 --2- 172.21.15.72:0/4195582003 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f47c006b1c0 0x7f47c006d680 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f47d4159540 tx=0x7f47c8009190 comp rx=0 tx=0).stop 2023-12-13T00:00:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.887+0000 7f47daf41640 1 -- 172.21.15.72:0/4195582003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d40c6c40 msgr2=0x7f47d4131e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.887+0000 7f47daf41640 1 --2- 172.21.15.72:0/4195582003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d40c6c40 0x7f47d4131e30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009890 tx=0x7f47c40046c0 comp rx=0 tx=0).stop 2023-12-13T00:00:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.887+0000 7f47daf41640 1 -- 172.21.15.72:0/4195582003 shutdown_connections 2023-12-13T00:00:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.887+0000 7f47daf41640 1 --2- 172.21.15.72:0/4195582003 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f47c006b1c0 0x7f47c006d680 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.887+0000 7f47daf41640 1 --2- 172.21.15.72:0/4195582003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47d40c7a30 0x7f47d4139360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.887+0000 7f47daf41640 1 --2- 172.21.15.72:0/4195582003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47d40c7650 0x7f47d4140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:58.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.887+0000 7f47daf41640 1 --2- 172.21.15.72:0/4195582003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d40c6c40 0x7f47d4131e30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:58.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.887+0000 7f47daf41640 1 -- 172.21.15.72:0/4195582003 >> 172.21.15.72:0/4195582003 conn(0x7f47d406c5f0 msgr2=0x7f47d414ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:58.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.887+0000 7f47daf41640 1 -- 172.21.15.72:0/4195582003 shutdown_connections 2023-12-13T00:00:58.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.887+0000 7f47daf41640 1 -- 172.21.15.72:0/4195582003 wait complete. 2023-12-13T00:00:58.899 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:00:58.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.997+0000 7fb4c5989640 1 Processor -- start 2023-12-13T00:00:58.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.997+0000 7fb4c5989640 1 -- start start 2023-12-13T00:00:58.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.998+0000 7fb4c5989640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb4c0151680 0x7fb4c01571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:58.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.998+0000 7fb4c5989640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4c006f3f0 0x7fb4c00c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:58.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.998+0000 7fb4c5989640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c0157880 con 0x7fb4c006f810 2023-12-13T00:00:58.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.998+0000 7fb4c5989640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c0157b60 con 0x7fb4c0151680 2023-12-13T00:00:58.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.998+0000 7fb4c5989640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c0157e40 con 0x7fb4c006f3f0 2023-12-13T00:00:59.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.999+0000 7fb4beffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb4c0151680 0x7fb4c01571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:59.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.999+0000 7fb4bf7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb4c006f810 0x7fb4c00ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52738/0 (socket says 172.21.15.72:52738) 2023-12-13T00:00:59.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.999+0000 7fb4bf7fe640 1 -- 172.21.15.72:0/2851530713 learned_addr learned my addr 172.21.15.72:0/2851530713 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:59.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:58.999+0000 7fb4be7fc640 1 --2- 172.21.15.72:0/2851530713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4c006f3f0 0x7fb4c00c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:59.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.002+0000 7fb4beffd640 1 -- 172.21.15.72:0/2851530713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4c006f3f0 msgr2=0x7fb4c00c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:00:59.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.002+0000 7fb4beffd640 1 --2- 172.21.15.72:0/2851530713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4c006f3f0 0x7fb4c00c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:59.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.002+0000 7fb4beffd640 1 -- 172.21.15.72:0/2851530713 >> v1:172.21.15.72:6789/0 conn(0x7fb4c006f810 legacy=0x7fb4c00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:59.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.002+0000 7fb4beffd640 1 -- 172.21.15.72:0/2851530713 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c0158120 con 0x7fb4c0151680 2023-12-13T00:00:59.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.006+0000 7fb4beffd640 1 --2- 172.21.15.72:0/2851530713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c0151680 0x7fb4c01571d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0009d90 tx=0x7fb4b002bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6c8b772cc1fb12 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:59.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.010+0000 7fb4bdffb640 1 -- 172.21.15.72:0/2851530713 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b002cce0 con 0x7fb4c0151680 2023-12-13T00:00:59.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.010+0000 7fb4bdffb640 1 -- 172.21.15.72:0/2851530713 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b002ce40 con 0x7fb4c0151680 2023-12-13T00:00:59.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.010+0000 7fb4bdffb640 1 -- 172.21.15.72:0/2851530713 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0034660 con 0x7fb4c0151680 2023-12-13T00:00:59.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.011+0000 7fb4c5989640 1 -- 172.21.15.72:0/2851530713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c0151680 msgr2=0x7fb4c01571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:59.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.011+0000 7fb4c5989640 1 --2- 172.21.15.72:0/2851530713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c0151680 0x7fb4c01571d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0009d90 tx=0x7fb4b002bf30 comp rx=0 tx=0).stop 2023-12-13T00:00:59.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.011+0000 7fb4c5989640 1 -- 172.21.15.72:0/2851530713 shutdown_connections 2023-12-13T00:00:59.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.011+0000 7fb4c5989640 1 --2- 172.21.15.72:0/2851530713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4c006f3f0 0x7fb4c00c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:59.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.011+0000 7fb4c5989640 1 --2- 172.21.15.72:0/2851530713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c0151680 0x7fb4c01571d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:59.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.011+0000 7fb4c5989640 1 -- 172.21.15.72:0/2851530713 >> 172.21.15.72:0/2851530713 conn(0x7fb4c00707f0 msgr2=0x7fb4c0070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:59.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.011+0000 7fb4c5989640 1 -- 172.21.15.72:0/2851530713 shutdown_connections 2023-12-13T00:00:59.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.011+0000 7fb4c5989640 1 -- 172.21.15.72:0/2851530713 wait complete. 2023-12-13T00:00:59.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.012+0000 7fb4c5989640 1 Processor -- start 2023-12-13T00:00:59.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.012+0000 7fb4c5989640 1 -- start start 2023-12-13T00:00:59.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.013+0000 7fb4c5989640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4c006f3f0 0x7fb4c01590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:59.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.013+0000 7fb4c5989640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c006f810 0x7fb4c00c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:59.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.013+0000 7fb4c5989640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4c0151680 0x7fb4c015a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:59.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.013+0000 7fb4c5989640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c01480c0 con 0x7fb4c006f810 2023-12-13T00:00:59.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.013+0000 7fb4c5989640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c0159710 con 0x7fb4c0151680 2023-12-13T00:00:59.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.013+0000 7fb4c5989640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c01599f0 con 0x7fb4c006f3f0 2023-12-13T00:00:59.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.013+0000 7fb4be7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c006f810 0x7fb4c00c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:59.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.014+0000 7fb4be7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c006f810 0x7fb4c00c4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45526/0 (socket says 172.21.15.72:45526) 2023-12-13T00:00:59.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.014+0000 7fb4be7fc640 1 -- 172.21.15.72:0/3986074468 learned_addr learned my addr 172.21.15.72:0/3986074468 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:59.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.014+0000 7fb4beffd640 1 --2- 172.21.15.72:0/3986074468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4c006f3f0 0x7fb4c01590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:59.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.014+0000 7fb4bf7fe640 1 --2- 172.21.15.72:0/3986074468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4c0151680 0x7fb4c015a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:59.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.017+0000 7fb4be7fc640 1 -- 172.21.15.72:0/3986074468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4c006f3f0 msgr2=0x7fb4c01590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:59.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.017+0000 7fb4be7fc640 1 --2- 172.21.15.72:0/3986074468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4c006f3f0 0x7fb4c01590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:59.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.017+0000 7fb4be7fc640 1 -- 172.21.15.72:0/3986074468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4c0151680 msgr2=0x7fb4c015a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:59.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.017+0000 7fb4be7fc640 1 --2- 172.21.15.72:0/3986074468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4c0151680 0x7fb4c015a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:59.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.017+0000 7fb4be7fc640 1 -- 172.21.15.72:0/3986074468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b0009a70 con 0x7fb4c006f810 2023-12-13T00:00:59.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.019+0000 7fb4be7fc640 1 --2- 172.21.15.72:0/3986074468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c006f810 0x7fb4c00c4cf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400e9b0 tx=0x7fb4b400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:59.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.021+0000 7fb4a7fff640 1 -- 172.21.15.72:0/3986074468 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4009670 con 0x7fb4c006f810 2023-12-13T00:00:59.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.021+0000 7fb4c5989640 1 -- 172.21.15.72:0/3986074468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c00c3f30 con 0x7fb4c006f810 2023-12-13T00:00:59.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.021+0000 7fb4c5989640 1 -- 172.21.15.72:0/3986074468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c00c44f0 con 0x7fb4c006f810 2023-12-13T00:00:59.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.022+0000 7fb4c5989640 1 -- 172.21.15.72:0/3986074468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c0073dc0 con 0x7fb4c006f810 2023-12-13T00:00:59.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.263+0000 7fb4a7fff640 1 -- 172.21.15.72:0/3986074468 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b400c9a0 con 0x7fb4c006f810 2023-12-13T00:00:59.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.263+0000 7fb4a7fff640 1 -- 172.21.15.72:0/3986074468 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400cd10 con 0x7fb4c006f810 2023-12-13T00:00:59.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.264+0000 7fb4a7fff640 1 -- 172.21.15.72:0/3986074468 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb4b4013470 con 0x7fb4c006f810 2023-12-13T00:00:59.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.265+0000 7fb4a7fff640 1 --2- 172.21.15.72:0/3986074468 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb4ac06b1c0 0x7fb4ac06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:59.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.265+0000 7fb4beffd640 1 --2- 172.21.15.72:0/3986074468 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb4ac06b1c0 0x7fb4ac06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:59.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.265+0000 7fb4beffd640 1 --2- 172.21.15.72:0/3986074468 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb4ac06b1c0 0x7fb4ac06d680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0036000 tx=0x7fb4b0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:59.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.278+0000 7fb4a7fff640 1 -- 172.21.15.72:0/3986074468 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb4b4058e80 con 0x7fb4c006f810 2023-12-13T00:00:59.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.278+0000 7fb4a7fff640 1 -- 172.21.15.72:0/3986074468 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb4b40551c0 con 0x7fb4c006f810 2023-12-13T00:00:59.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.465+0000 7fb4c5989640 1 -- 172.21.15.72:0/3986074468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4c00c8400 con 0x7fb4c006f810 2023-12-13T00:00:59.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.577+0000 7fb4a7fff640 1 -- 172.21.15.72:0/3986074468 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18563 (secure 0 0 0) 0x7fb4b4017090 con 0x7fb4c006f810 2023-12-13T00:00:59.578 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:00:59.578 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":26,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:00:59.283151+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T00:00:27.701252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T00:00:29.324356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T00:00:33.363089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.3","mappings":[{"from":7,"to":5}]},{"pgid":"4.10","mappings":[{"from":7,"to":0}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:00:59.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.579+0000 7fb4c5989640 1 -- 172.21.15.72:0/3986074468 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb4ac06b1c0 msgr2=0x7fb4ac06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:59.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.579+0000 7fb4c5989640 1 --2- 172.21.15.72:0/3986074468 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb4ac06b1c0 0x7fb4ac06d680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0036000 tx=0x7fb4b0030000 comp rx=0 tx=0).stop 2023-12-13T00:00:59.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.579+0000 7fb4c5989640 1 -- 172.21.15.72:0/3986074468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c006f810 msgr2=0x7fb4c00c4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:59.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.579+0000 7fb4c5989640 1 --2- 172.21.15.72:0/3986074468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c006f810 0x7fb4c00c4cf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400e9b0 tx=0x7fb4b400ee70 comp rx=0 tx=0).stop 2023-12-13T00:00:59.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.579+0000 7fb4c5989640 1 -- 172.21.15.72:0/3986074468 shutdown_connections 2023-12-13T00:00:59.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.579+0000 7fb4c5989640 1 --2- 172.21.15.72:0/3986074468 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb4ac06b1c0 0x7fb4ac06d680 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:59.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.579+0000 7fb4c5989640 1 --2- 172.21.15.72:0/3986074468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4c0151680 0x7fb4c015a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:59.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.579+0000 7fb4c5989640 1 --2- 172.21.15.72:0/3986074468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c006f810 0x7fb4c00c4cf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:59.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.579+0000 7fb4c5989640 1 --2- 172.21.15.72:0/3986074468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4c006f3f0 0x7fb4c01590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:59.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.579+0000 7fb4c5989640 1 -- 172.21.15.72:0/3986074468 >> 172.21.15.72:0/3986074468 conn(0x7fb4c00707f0 msgr2=0x7fb4c0070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:59.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.579+0000 7fb4c5989640 1 -- 172.21.15.72:0/3986074468 shutdown_connections 2023-12-13T00:00:59.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.579+0000 7fb4c5989640 1 -- 172.21.15.72:0/3986074468 wait complete. 2023-12-13T00:00:59.592 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-13T00:00:59.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.696+0000 7fb57862b640 1 Processor -- start 2023-12-13T00:00:59.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.696+0000 7fb57862b640 1 -- start start 2023-12-13T00:00:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.697+0000 7fb57862b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb57006efa0 0x7fb570159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.697+0000 7fb57862b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57015a340 con 0x7fb570153330 2023-12-13T00:00:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.697+0000 7fb57862b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57006c270 con 0x7fb5700c1fb0 2023-12-13T00:00:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.697+0000 7fb57862b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57006f3c0 con 0x7fb57006efa0 2023-12-13T00:00:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.697+0000 7fb5763c7640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb570153330 0x7fb5700cce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52746/0 (socket says 172.21.15.72:52746) 2023-12-13T00:00:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.697+0000 7fb5763c7640 1 -- 172.21.15.72:0/1774320891 learned_addr learned my addr 172.21.15.72:0/1774320891 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:00:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.697+0000 7fb575bc6640 1 --2- 172.21.15.72:0/1774320891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb57006efa0 0x7fb570159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:59.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.700+0000 7fb5753c5640 1 -- 172.21.15.72:0/1774320891 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812526445 0 0) 0x7fb57015a340 con 0x7fb570153330 2023-12-13T00:00:59.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.700+0000 7fb5753c5640 1 -- 172.21.15.72:0/1774320891 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb55c003520 con 0x7fb570153330 2023-12-13T00:00:59.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.700+0000 7fb5753c5640 1 -- 172.21.15.72:0/1774320891 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345548541 0 0) 0x7fb57006c270 con 0x7fb5700c1fb0 2023-12-13T00:00:59.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.700+0000 7fb5753c5640 1 -- 172.21.15.72:0/1774320891 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb57015a340 con 0x7fb5700c1fb0 2023-12-13T00:00:59.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.700+0000 7fb575bc6640 1 -- 172.21.15.72:0/1774320891 >> v1:172.21.15.176:6789/0 conn(0x7fb5700c1fb0 legacy=0x7fb5700c23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:59.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.700+0000 7fb575bc6640 1 -- 172.21.15.72:0/1774320891 >> v1:172.21.15.72:6789/0 conn(0x7fb570153330 legacy=0x7fb5700cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:59.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.700+0000 7fb575bc6640 1 -- 172.21.15.72:0/1774320891 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57006f630 con 0x7fb57006efa0 2023-12-13T00:00:59.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.702+0000 7fb575bc6640 1 --2- 172.21.15.72:0/1774320891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb57006efa0 0x7fb570159e00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb5600097d0 tx=0x7fb56002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73e5a4f603cd503c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:59.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.705+0000 7fb5753c5640 1 -- 172.21.15.72:0/1774320891 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560031890 con 0x7fb57006efa0 2023-12-13T00:00:59.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.706+0000 7fb5753c5640 1 -- 172.21.15.72:0/1774320891 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5600319f0 con 0x7fb57006efa0 2023-12-13T00:00:59.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.706+0000 7fb5753c5640 1 -- 172.21.15.72:0/1774320891 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560031d60 con 0x7fb57006efa0 2023-12-13T00:00:59.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.707+0000 7fb57862b640 1 -- 172.21.15.72:0/1774320891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb57006efa0 msgr2=0x7fb570159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:59.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.707+0000 7fb57862b640 1 --2- 172.21.15.72:0/1774320891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb57006efa0 0x7fb570159e00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb5600097d0 tx=0x7fb56002b930 comp rx=0 tx=0).stop 2023-12-13T00:00:59.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.707+0000 7fb57862b640 1 -- 172.21.15.72:0/1774320891 shutdown_connections 2023-12-13T00:00:59.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.707+0000 7fb57862b640 1 --2- 172.21.15.72:0/1774320891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb57006efa0 0x7fb570159e00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:59.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.707+0000 7fb57862b640 1 -- 172.21.15.72:0/1774320891 >> 172.21.15.72:0/1774320891 conn(0x7fb570070990 msgr2=0x7fb570070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:00:59.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.707+0000 7fb57862b640 1 -- 172.21.15.72:0/1774320891 shutdown_connections 2023-12-13T00:00:59.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.707+0000 7fb57862b640 1 -- 172.21.15.72:0/1774320891 wait complete. 2023-12-13T00:00:59.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.708+0000 7fb57862b640 1 Processor -- start 2023-12-13T00:00:59.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.708+0000 7fb57862b640 1 -- start start 2023-12-13T00:00:59.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.709+0000 7fb57862b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb57006efa0 0x7fb5700adc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:59.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.709+0000 7fb57862b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5700c1fb0 0x7fb5700b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:59.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.709+0000 7fb57862b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb570153330 0x7fb57014bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:59.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.709+0000 7fb57862b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb570158a40 con 0x7fb57006efa0 2023-12-13T00:00:59.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.709+0000 7fb57862b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700aea00 con 0x7fb5700c1fb0 2023-12-13T00:00:59.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.709+0000 7fb57862b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700af540 con 0x7fb570153330 2023-12-13T00:00:59.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.709+0000 7fb5763c7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb57006efa0 0x7fb5700adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:59.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.709+0000 7fb575bc6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5700c1fb0 0x7fb5700b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:59.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.710+0000 7fb576bc8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb570153330 0x7fb57014bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:59.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.710+0000 7fb5763c7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb57006efa0 0x7fb5700adc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45530/0 (socket says 172.21.15.72:45530) 2023-12-13T00:00:59.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.710+0000 7fb5763c7640 1 -- 172.21.15.72:0/402338796 learned_addr learned my addr 172.21.15.72:0/402338796 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:00:59.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.713+0000 7fb5763c7640 1 -- 172.21.15.72:0/402338796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb570153330 msgr2=0x7fb57014bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:59.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.713+0000 7fb5763c7640 1 --2- 172.21.15.72:0/402338796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb570153330 0x7fb57014bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:59.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.713+0000 7fb5763c7640 1 -- 172.21.15.72:0/402338796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5700c1fb0 msgr2=0x7fb5700b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:00:59.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.713+0000 7fb5763c7640 1 --2- 172.21.15.72:0/402338796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5700c1fb0 0x7fb5700b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:00:59.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.713+0000 7fb5763c7640 1 -- 172.21.15.72:0/402338796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb560009400 con 0x7fb57006efa0 2023-12-13T00:00:59.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.715+0000 7fb5763c7640 1 --2- 172.21.15.72:0/402338796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb57006efa0 0x7fb5700adc10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00c410 tx=0x7fb56c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:59.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.719+0000 7fb566ffd640 1 -- 172.21.15.72:0/402338796 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c005ce0 con 0x7fb57006efa0 2023-12-13T00:00:59.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.719+0000 7fb566ffd640 1 -- 172.21.15.72:0/402338796 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56c005e40 con 0x7fb57006efa0 2023-12-13T00:00:59.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.719+0000 7fb57862b640 1 -- 172.21.15.72:0/402338796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5700b1b20 con 0x7fb57006efa0 2023-12-13T00:00:59.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.719+0000 7fb566ffd640 1 -- 172.21.15.72:0/402338796 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c007310 con 0x7fb57006efa0 2023-12-13T00:00:59.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.719+0000 7fb57862b640 1 -- 172.21.15.72:0/402338796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5700aec10 con 0x7fb57006efa0 2023-12-13T00:00:59.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.720+0000 7fb57862b640 1 -- 172.21.15.72:0/402338796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb570067470 con 0x7fb57006efa0 2023-12-13T00:00:59.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.739+0000 7fb566ffd640 1 -- 172.21.15.72:0/402338796 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb56c007530 con 0x7fb57006efa0 2023-12-13T00:00:59.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.739+0000 7fb566ffd640 1 --2- 172.21.15.72:0/402338796 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb55406b1c0 0x7fb55406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:00:59.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.739+0000 7fb575bc6640 1 --2- 172.21.15.72:0/402338796 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb55406b1c0 0x7fb55406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:00:59.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.740+0000 7fb575bc6640 1 --2- 172.21.15.72:0/402338796 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb55406b1c0 0x7fb55406d680 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb560036000 tx=0x7fb56003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:00:59.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:00:59.781 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:00:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.976+0000 7fb566ffd640 1 -- 172.21.15.72:0/402338796 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fb56c057f50 con 0x7fb57006efa0 2023-12-13T00:00:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:00:59.976+0000 7fb566ffd640 1 -- 172.21.15.72:0/402338796 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb56c054290 con 0x7fb57006efa0 2023-12-13T00:01:00.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:00.185+0000 7fb57862b640 1 -- 172.21.15.72:0/402338796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb5700af8f0 con 0x7fb57006efa0 2023-12-13T00:01:01.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.063+0000 7fb566ffd640 1 -- 172.21.15.72:0/402338796 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb56c0170b0 con 0x7fb57006efa0 2023-12-13T00:01:01.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.065+0000 7fb57862b640 1 -- 172.21.15.72:0/402338796 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb55406b1c0 msgr2=0x7fb55406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:01.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.065+0000 7fb57862b640 1 --2- 172.21.15.72:0/402338796 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb55406b1c0 0x7fb55406d680 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb560036000 tx=0x7fb56003d040 comp rx=0 tx=0).stop 2023-12-13T00:01:01.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.065+0000 7fb57862b640 1 -- 172.21.15.72:0/402338796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb57006efa0 msgr2=0x7fb5700adc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:01.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.065+0000 7fb57862b640 1 --2- 172.21.15.72:0/402338796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb57006efa0 0x7fb5700adc10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00c410 tx=0x7fb56c00c8d0 comp rx=0 tx=0).stop 2023-12-13T00:01:01.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.065+0000 7fb57862b640 1 -- 172.21.15.72:0/402338796 shutdown_connections 2023-12-13T00:01:01.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.065+0000 7fb57862b640 1 --2- 172.21.15.72:0/402338796 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb55406b1c0 0x7fb55406d680 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:01.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.065+0000 7fb57862b640 1 --2- 172.21.15.72:0/402338796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb570153330 0x7fb57014bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:01.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.065+0000 7fb57862b640 1 --2- 172.21.15.72:0/402338796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5700c1fb0 0x7fb5700b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:01.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.065+0000 7fb57862b640 1 --2- 172.21.15.72:0/402338796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb57006efa0 0x7fb5700adc10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:01.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.065+0000 7fb57862b640 1 -- 172.21.15.72:0/402338796 >> 172.21.15.72:0/402338796 conn(0x7fb570070990 msgr2=0x7fb570158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:01.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.065+0000 7fb57862b640 1 -- 172.21.15.72:0/402338796 shutdown_connections 2023-12-13T00:01:01.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.065+0000 7fb57862b640 1 -- 172.21.15.72:0/402338796 wait complete. 2023-12-13T00:01:01.077 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2023-12-13T00:01:01.078 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-12-13T00:01:01.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.180+0000 7f2481bc9640 1 Processor -- start 2023-12-13T00:01:01.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.180+0000 7f2481bc9640 1 -- start start 2023-12-13T00:01:01.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.181+0000 7f2481bc9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f247c0c5080 0x7f247c06b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:01.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.181+0000 7f2481bc9640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247c06a4b0 con 0x7f247c15ae40 2023-12-13T00:01:01.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.181+0000 7f2481bc9640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247c0c8330 con 0x7f247c0c4ca0 2023-12-13T00:01:01.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.181+0000 7f2481bc9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247c0c85d0 con 0x7f247c0c5080 2023-12-13T00:01:01.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.182+0000 7f247b7fe640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f247c0c4ca0 0x7f247c157f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:60374/0 (socket says 172.21.15.72:60374) 2023-12-13T00:01:01.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.182+0000 7f247b7fe640 1 -- 172.21.15.72:0/1974484987 learned_addr learned my addr 172.21.15.72:0/1974484987 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:01.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.182+0000 7f247affd640 1 --2- 172.21.15.72:0/1974484987 >> v2:172.21.15.72:3300/0 conn(0x7f247c0c5080 0x7f247c06b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:01.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.184+0000 7f247a7fc640 1 -- 172.21.15.72:0/1974484987 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3385113846 0 0) 0x7f247c0c8330 con 0x7f247c0c4ca0 2023-12-13T00:01:01.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.184+0000 7f247a7fc640 1 -- 172.21.15.72:0/1974484987 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2464003520 con 0x7f247c0c4ca0 2023-12-13T00:01:01.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.185+0000 7f247affd640 1 -- 172.21.15.72:0/1974484987 >> v1:172.21.15.176:6789/0 conn(0x7f247c0c4ca0 legacy=0x7f247c157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:01.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.185+0000 7f247affd640 1 -- 172.21.15.72:0/1974484987 >> v1:172.21.15.72:6789/0 conn(0x7f247c15ae40 legacy=0x7f247c150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:01.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.185+0000 7f247affd640 1 -- 172.21.15.72:0/1974484987 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c06a700 con 0x7f247c0c5080 2023-12-13T00:01:01.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.188+0000 7f247affd640 1 --2- 172.21.15.72:0/1974484987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f247c0c5080 0x7f247c06b930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f24700097d0 tx=0x7f247002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07cb81bd6464e51 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:01.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.193+0000 7f247a7fc640 1 -- 172.21.15.72:0/1974484987 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470030610 con 0x7f247c0c5080 2023-12-13T00:01:01.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.193+0000 7f247a7fc640 1 -- 172.21.15.72:0/1974484987 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2470030770 con 0x7f247c0c5080 2023-12-13T00:01:01.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.193+0000 7f247a7fc640 1 -- 172.21.15.72:0/1974484987 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470030b00 con 0x7f247c0c5080 2023-12-13T00:01:01.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.194+0000 7f2481bc9640 1 -- 172.21.15.72:0/1974484987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f247c0c5080 msgr2=0x7f247c06b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:01.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.194+0000 7f2481bc9640 1 --2- 172.21.15.72:0/1974484987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f247c0c5080 0x7f247c06b930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f24700097d0 tx=0x7f247002b960 comp rx=0 tx=0).stop 2023-12-13T00:01:01.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.194+0000 7f2481bc9640 1 -- 172.21.15.72:0/1974484987 shutdown_connections 2023-12-13T00:01:01.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.194+0000 7f2481bc9640 1 --2- 172.21.15.72:0/1974484987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f247c0c5080 0x7f247c06b930 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:01.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.194+0000 7f2481bc9640 1 -- 172.21.15.72:0/1974484987 >> 172.21.15.72:0/1974484987 conn(0x7f247c06d170 msgr2=0x7f247c06d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:01.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.194+0000 7f2481bc9640 1 -- 172.21.15.72:0/1974484987 shutdown_connections 2023-12-13T00:01:01.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.194+0000 7f2481bc9640 1 -- 172.21.15.72:0/1974484987 wait complete. 2023-12-13T00:01:01.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.195+0000 7f2481bc9640 1 Processor -- start 2023-12-13T00:01:01.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.195+0000 7f2481bc9640 1 -- start start 2023-12-13T00:01:01.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.196+0000 7f2481bc9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f247c0c4ca0 0x7f247c0ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:01.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.196+0000 7f2481bc9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f247c0c5080 0x7f247c156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:01.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.196+0000 7f2481bc9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f247c15ae40 0x7f247c156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:01.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.196+0000 7f2481bc9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c1f2d30 con 0x7f247c0c5080 2023-12-13T00:01:01.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.196+0000 7f2481bc9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c0c5c80 con 0x7f247c15ae40 2023-12-13T00:01:01.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.196+0000 7f2481bc9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247c14cbb0 con 0x7f247c0c4ca0 2023-12-13T00:01:01.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.196+0000 7f247affd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f247c0c5080 0x7f247c156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:01.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.197+0000 7f247affd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f247c0c5080 0x7f247c156720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45536/0 (socket says 172.21.15.72:45536) 2023-12-13T00:01:01.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.197+0000 7f247affd640 1 -- 172.21.15.72:0/1035417281 learned_addr learned my addr 172.21.15.72:0/1035417281 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:01.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.197+0000 7f247bfff640 1 --2- 172.21.15.72:0/1035417281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f247c15ae40 0x7f247c156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:01.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.197+0000 7f247b7fe640 1 --2- 172.21.15.72:0/1035417281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f247c0c4ca0 0x7f247c0ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:01.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.200+0000 7f247affd640 1 -- 172.21.15.72:0/1035417281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f247c0c4ca0 msgr2=0x7f247c0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:01.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.200+0000 7f247affd640 1 --2- 172.21.15.72:0/1035417281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f247c0c4ca0 0x7f247c0ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:01.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.200+0000 7f247affd640 1 -- 172.21.15.72:0/1035417281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f247c15ae40 msgr2=0x7f247c156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:01.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.200+0000 7f247affd640 1 --2- 172.21.15.72:0/1035417281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f247c15ae40 0x7f247c156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:01.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.200+0000 7f247affd640 1 -- 172.21.15.72:0/1035417281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2470009400 con 0x7f247c0c5080 2023-12-13T00:01:01.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.202+0000 7f247affd640 1 --2- 172.21.15.72:0/1035417281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f247c0c5080 0x7f247c156720 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f24700098f0 tx=0x7f2470004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:01.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.206+0000 7f2463fff640 1 -- 172.21.15.72:0/1035417281 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247003e040 con 0x7f247c0c5080 2023-12-13T00:01:01.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.206+0000 7f2463fff640 1 -- 172.21.15.72:0/1035417281 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2470039a20 con 0x7f247c0c5080 2023-12-13T00:01:01.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.206+0000 7f2463fff640 1 -- 172.21.15.72:0/1035417281 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470039dd0 con 0x7f247c0c5080 2023-12-13T00:01:01.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.206+0000 7f2481bc9640 1 -- 172.21.15.72:0/1035417281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247c156220 con 0x7f247c0c5080 2023-12-13T00:01:01.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.206+0000 7f2481bc9640 1 -- 172.21.15.72:0/1035417281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247c14d130 con 0x7f247c0c5080 2023-12-13T00:01:01.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.207+0000 7f2481bc9640 1 -- 172.21.15.72:0/1035417281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247c156440 con 0x7f247c0c5080 2023-12-13T00:01:01.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.225+0000 7f2463fff640 1 -- 172.21.15.72:0/1035417281 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f247004d3b0 con 0x7f247c0c5080 2023-12-13T00:01:01.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.225+0000 7f2463fff640 1 --2- 172.21.15.72:0/1035417281 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f246806b210 0x7f246806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:01.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.226+0000 7f247b7fe640 1 --2- 172.21.15.72:0/1035417281 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f246806b210 0x7f246806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:01.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.226+0000 7f247b7fe640 1 --2- 172.21.15.72:0/1035417281 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f246806b210 0x7f246806d6d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f246c0011e0 tx=0x7f246c007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:01.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.228+0000 7f2463fff640 1 -- 172.21.15.72:0/1035417281 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f2470045e20 con 0x7f247c0c5080 2023-12-13T00:01:01.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.462+0000 7f2463fff640 1 -- 172.21.15.72:0/1035417281 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2470076f10 con 0x7f247c0c5080 2023-12-13T00:01:01.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:01.682+0000 7f2481bc9640 1 -- 172.21.15.72:0/1035417281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f247c156440 con 0x7f247c0c5080 2023-12-13T00:01:02.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.786+0000 7f2463fff640 1 -- 172.21.15.72:0/1035417281 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7f247c156440 con 0x7f247c0c5080 2023-12-13T00:01:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.788+0000 7f2481bc9640 1 -- 172.21.15.72:0/1035417281 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f246806b210 msgr2=0x7f246806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.788+0000 7f2481bc9640 1 --2- 172.21.15.72:0/1035417281 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f246806b210 0x7f246806d6d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f246c0011e0 tx=0x7f246c007d30 comp rx=0 tx=0).stop 2023-12-13T00:01:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.788+0000 7f2481bc9640 1 -- 172.21.15.72:0/1035417281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f247c0c5080 msgr2=0x7f247c156720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.788+0000 7f2481bc9640 1 --2- 172.21.15.72:0/1035417281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f247c0c5080 0x7f247c156720 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f24700098f0 tx=0x7f2470004730 comp rx=0 tx=0).stop 2023-12-13T00:01:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.788+0000 7f2481bc9640 1 -- 172.21.15.72:0/1035417281 shutdown_connections 2023-12-13T00:01:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.788+0000 7f2481bc9640 1 --2- 172.21.15.72:0/1035417281 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f246806b210 0x7f246806d6d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.788+0000 7f2481bc9640 1 --2- 172.21.15.72:0/1035417281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f247c15ae40 0x7f247c156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.788+0000 7f2481bc9640 1 --2- 172.21.15.72:0/1035417281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f247c0c5080 0x7f247c156720 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.788+0000 7f2481bc9640 1 --2- 172.21.15.72:0/1035417281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f247c0c4ca0 0x7f247c0ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.788+0000 7f2481bc9640 1 -- 172.21.15.72:0/1035417281 >> 172.21.15.72:0/1035417281 conn(0x7f247c06d170 msgr2=0x7f247c0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.788+0000 7f2481bc9640 1 -- 172.21.15.72:0/1035417281 shutdown_connections 2023-12-13T00:01:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.788+0000 7f2481bc9640 1 -- 172.21.15.72:0/1035417281 wait complete. 2023-12-13T00:01:02.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-13T00:01:02.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.904+0000 7f5528c4b640 1 Processor -- start 2023-12-13T00:01:02.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.904+0000 7f5528c4b640 1 -- start start 2023-12-13T00:01:02.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.905+0000 7f5528c4b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f55240710c0 0x7f5524071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:02.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.905+0000 7f5528c4b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55241577f0 con 0x7f5524157240 2023-12-13T00:01:02.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.905+0000 7f5528c4b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5524157a90 con 0x7f5524151220 2023-12-13T00:01:02.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.905+0000 7f5528c4b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552406f470 con 0x7f55240710c0 2023-12-13T00:01:02.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.906+0000 7f5522d9d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f55240710c0 0x7f5524071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:02.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.906+0000 7f552259c640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f5524151220 0x7f552406ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:60382/0 (socket says 172.21.15.72:60382) 2023-12-13T00:01:02.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.906+0000 7f552259c640 1 -- 172.21.15.72:0/2762460826 learned_addr learned my addr 172.21.15.72:0/2762460826 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:02.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.909+0000 7f5522d9d640 1 -- 172.21.15.72:0/2762460826 >> v1:172.21.15.176:6789/0 conn(0x7f5524151220 legacy=0x7f552406ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:02.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.909+0000 7f5522d9d640 1 -- 172.21.15.72:0/2762460826 >> v1:172.21.15.72:6789/0 conn(0x7f5524157240 legacy=0x7f55240c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:02.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.909+0000 7f5522d9d640 1 -- 172.21.15.72:0/2762460826 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5524157d30 con 0x7f55240710c0 2023-12-13T00:01:02.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.913+0000 7f5522d9d640 1 --2- 172.21.15.72:0/2762460826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55240710c0 0x7f5524071530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f552406f5b0 tx=0x7f551c02bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af996815429dd807 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:02.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.918+0000 7f5521d9b640 1 -- 172.21.15.72:0/2762460826 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c02cce0 con 0x7f55240710c0 2023-12-13T00:01:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.983+0000 7f5521d9b640 1 -- 172.21.15.72:0/2762460826 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c02ce40 con 0x7f55240710c0 2023-12-13T00:01:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.983+0000 7f5521d9b640 1 -- 172.21.15.72:0/2762460826 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c034660 con 0x7f55240710c0 2023-12-13T00:01:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.983+0000 7f5528c4b640 1 -- 172.21.15.72:0/2762460826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55240710c0 msgr2=0x7f5524071530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.983+0000 7f5528c4b640 1 --2- 172.21.15.72:0/2762460826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55240710c0 0x7f5524071530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f552406f5b0 tx=0x7f551c02bf30 comp rx=0 tx=0).stop 2023-12-13T00:01:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.983+0000 7f5528c4b640 1 -- 172.21.15.72:0/2762460826 shutdown_connections 2023-12-13T00:01:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.983+0000 7f5528c4b640 1 --2- 172.21.15.72:0/2762460826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55240710c0 0x7f5524071530 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.983+0000 7f5528c4b640 1 -- 172.21.15.72:0/2762460826 >> 172.21.15.72:0/2762460826 conn(0x7f552406c5f0 msgr2=0x7f552406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.983+0000 7f5528c4b640 1 -- 172.21.15.72:0/2762460826 shutdown_connections 2023-12-13T00:01:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.983+0000 7f5528c4b640 1 -- 172.21.15.72:0/2762460826 wait complete. 2023-12-13T00:01:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.985+0000 7f5528c4b640 1 Processor -- start 2023-12-13T00:01:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.985+0000 7f5528c4b640 1 -- start start 2023-12-13T00:01:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.985+0000 7f5528c4b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55240710c0 0x7f55240c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.985+0000 7f5528c4b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5524151220 0x7f5524145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.985+0000 7f5528c4b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5524157240 0x7f55240c3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.985+0000 7f5528c4b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5524141eb0 con 0x7f5524157240 2023-12-13T00:01:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.985+0000 7f5528c4b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5524154a70 con 0x7f55240710c0 2023-12-13T00:01:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.985+0000 7f5528c4b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55241eff00 con 0x7f5524151220 2023-12-13T00:01:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.986+0000 7f5522d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5524157240 0x7f55240c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.986+0000 7f552259c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55240710c0 0x7f55240c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.986+0000 7f5522d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5524157240 0x7f55240c3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45544/0 (socket says 172.21.15.72:45544) 2023-12-13T00:01:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.986+0000 7f5522d9d640 1 -- 172.21.15.72:0/2227821074 learned_addr learned my addr 172.21.15.72:0/2227821074 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.986+0000 7f551bfff640 1 --2- 172.21.15.72:0/2227821074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5524151220 0x7f5524145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.989+0000 7f5522d9d640 1 -- 172.21.15.72:0/2227821074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5524151220 msgr2=0x7f5524145ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.989+0000 7f5522d9d640 1 --2- 172.21.15.72:0/2227821074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5524151220 0x7f5524145ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.989+0000 7f5522d9d640 1 -- 172.21.15.72:0/2227821074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55240710c0 msgr2=0x7f55240c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.989+0000 7f5522d9d640 1 --2- 172.21.15.72:0/2227821074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55240710c0 0x7f55240c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.989+0000 7f5522d9d640 1 -- 172.21.15.72:0/2227821074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c009a70 con 0x7f5524157240 2023-12-13T00:01:02.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.992+0000 7f5522d9d640 1 --2- 172.21.15.72:0/2227821074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5524157240 0x7f55240c3510 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f551c009e80 tx=0x7f551c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:02.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.995+0000 7f551affd640 1 -- 172.21.15.72:0/2227821074 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c03e670 con 0x7f5524157240 2023-12-13T00:01:02.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.995+0000 7f551affd640 1 -- 172.21.15.72:0/2227821074 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c03e7d0 con 0x7f5524157240 2023-12-13T00:01:02.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.995+0000 7f551affd640 1 -- 172.21.15.72:0/2227821074 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c03eb80 con 0x7f5524157240 2023-12-13T00:01:02.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.995+0000 7f5528c4b640 1 -- 172.21.15.72:0/2227821074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5524154800 con 0x7f5524157240 2023-12-13T00:01:02.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.995+0000 7f5528c4b640 1 -- 172.21.15.72:0/2227821074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55241ef5d0 con 0x7f5524157240 2023-12-13T00:01:02.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:02.996+0000 7f5528c4b640 1 -- 172.21.15.72:0/2227821074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5524072020 con 0x7f5524157240 2023-12-13T00:01:03.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.016+0000 7f551affd640 1 -- 172.21.15.72:0/2227821074 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f551c03b040 con 0x7f5524157240 2023-12-13T00:01:03.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.017+0000 7f551affd640 1 --2- 172.21.15.72:0/2227821074 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f550406b210 0x7f550406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:03.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.017+0000 7f552259c640 1 --2- 172.21.15.72:0/2227821074 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f550406b210 0x7f550406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:03.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.017+0000 7f552259c640 1 --2- 172.21.15.72:0/2227821074 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f550406b210 0x7f550406d6d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5514005880 tx=0x7f5514009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:03.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.019+0000 7f551affd640 1 -- 172.21.15.72:0/2227821074 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f551c07ad80 con 0x7f5524157240 2023-12-13T00:01:03.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.260+0000 7f551affd640 1 -- 172.21.15.72:0/2227821074 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f551c0770c0 con 0x7f5524157240 2023-12-13T00:01:03.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.464+0000 7f5528c4b640 1 -- 172.21.15.72:0/2227821074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5524067470 con 0x7f5524157240 2023-12-13T00:01:03.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.945+0000 7f551affd640 1 -- 172.21.15.72:0/2227821074 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f551c04e0c0 con 0x7f5524157240 2023-12-13T00:01:03.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.948+0000 7f5528c4b640 1 -- 172.21.15.72:0/2227821074 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f550406b210 msgr2=0x7f550406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:03.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.948+0000 7f5528c4b640 1 --2- 172.21.15.72:0/2227821074 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f550406b210 0x7f550406d6d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5514005880 tx=0x7f5514009040 comp rx=0 tx=0).stop 2023-12-13T00:01:03.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.948+0000 7f5528c4b640 1 -- 172.21.15.72:0/2227821074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5524157240 msgr2=0x7f55240c3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:03.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.948+0000 7f5528c4b640 1 --2- 172.21.15.72:0/2227821074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5524157240 0x7f55240c3510 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f551c009e80 tx=0x7f551c004a40 comp rx=0 tx=0).stop 2023-12-13T00:01:03.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.948+0000 7f5528c4b640 1 -- 172.21.15.72:0/2227821074 shutdown_connections 2023-12-13T00:01:03.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.948+0000 7f5528c4b640 1 --2- 172.21.15.72:0/2227821074 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f550406b210 0x7f550406d6d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:03.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.948+0000 7f5528c4b640 1 --2- 172.21.15.72:0/2227821074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5524157240 0x7f55240c3510 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:03.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.948+0000 7f5528c4b640 1 --2- 172.21.15.72:0/2227821074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5524151220 0x7f5524145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:03.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.948+0000 7f5528c4b640 1 --2- 172.21.15.72:0/2227821074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55240710c0 0x7f55240c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:03.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.948+0000 7f5528c4b640 1 -- 172.21.15.72:0/2227821074 >> 172.21.15.72:0/2227821074 conn(0x7f552406c5f0 msgr2=0x7f552414f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:03.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.948+0000 7f5528c4b640 1 -- 172.21.15.72:0/2227821074 shutdown_connections 2023-12-13T00:01:03.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:03.948+0000 7f5528c4b640 1 -- 172.21.15.72:0/2227821074 wait complete. 2023-12-13T00:01:03.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-12-13T00:01:04.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.067+0000 7ff3f537c640 1 Processor -- start 2023-12-13T00:01:04.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.067+0000 7ff3f537c640 1 -- start start 2023-12-13T00:01:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.068+0000 7ff3f537c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff3f00c9620 0x7ff3f00c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.068+0000 7ff3f537c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f00cbda0 con 0x7ff3f00cda70 2023-12-13T00:01:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.068+0000 7ff3f537c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f00cea60 con 0x7ff3f00cc420 2023-12-13T00:01:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.068+0000 7ff3f537c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f00cc230 con 0x7ff3f00c9620 2023-12-13T00:01:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.069+0000 7ff3eeffd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff3f00cda70 0x7ff3f00ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52762/0 (socket says 172.21.15.72:52762) 2023-12-13T00:01:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.069+0000 7ff3eeffd640 1 -- 172.21.15.72:0/1655062343 learned_addr learned my addr 172.21.15.72:0/1655062343 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:04.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.069+0000 7ff3ef7fe640 1 --2- 172.21.15.72:0/1655062343 >> v2:172.21.15.176:3300/0 conn(0x7ff3f00c9620 0x7ff3f00c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:04.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.071+0000 7ff3ee7fc640 1 -- 172.21.15.72:0/1655062343 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877345898 0 0) 0x7ff3f00cbda0 con 0x7ff3f00cda70 2023-12-13T00:01:04.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.071+0000 7ff3ee7fc640 1 -- 172.21.15.72:0/1655062343 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3dc003520 con 0x7ff3f00cda70 2023-12-13T00:01:04.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.072+0000 7ff3ef7fe640 1 -- 172.21.15.72:0/1655062343 >> v1:172.21.15.176:6789/0 conn(0x7ff3f00cc420 legacy=0x7ff3f0159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:04.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.072+0000 7ff3ef7fe640 1 -- 172.21.15.72:0/1655062343 >> v1:172.21.15.72:6789/0 conn(0x7ff3f00cda70 legacy=0x7ff3f00ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:04.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.072+0000 7ff3ef7fe640 1 -- 172.21.15.72:0/1655062343 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f00cb4e0 con 0x7ff3f00c9620 2023-12-13T00:01:04.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.075+0000 7ff3ef7fe640 1 --2- 172.21.15.72:0/1655062343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3f00c9620 0x7ff3f00c9a50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009d90 tx=0x7ff3e802bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e93d8367e609f572 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:04.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.079+0000 7ff3ee7fc640 1 -- 172.21.15.72:0/1655062343 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e802cd80 con 0x7ff3f00c9620 2023-12-13T00:01:04.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.079+0000 7ff3ee7fc640 1 -- 172.21.15.72:0/1655062343 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e8034440 con 0x7ff3f00c9620 2023-12-13T00:01:04.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.079+0000 7ff3ee7fc640 1 -- 172.21.15.72:0/1655062343 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80347d0 con 0x7ff3f00c9620 2023-12-13T00:01:04.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.080+0000 7ff3f537c640 1 -- 172.21.15.72:0/1655062343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3f00c9620 msgr2=0x7ff3f00c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:04.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.080+0000 7ff3f537c640 1 --2- 172.21.15.72:0/1655062343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3f00c9620 0x7ff3f00c9a50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009d90 tx=0x7ff3e802bfd0 comp rx=0 tx=0).stop 2023-12-13T00:01:04.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.080+0000 7ff3f537c640 1 -- 172.21.15.72:0/1655062343 shutdown_connections 2023-12-13T00:01:04.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.080+0000 7ff3f537c640 1 --2- 172.21.15.72:0/1655062343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3f00c9620 0x7ff3f00c9a50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:04.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.080+0000 7ff3f537c640 1 -- 172.21.15.72:0/1655062343 >> 172.21.15.72:0/1655062343 conn(0x7ff3f00b07b0 msgr2=0x7ff3f00b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:04.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.080+0000 7ff3f537c640 1 -- 172.21.15.72:0/1655062343 shutdown_connections 2023-12-13T00:01:04.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.080+0000 7ff3f537c640 1 -- 172.21.15.72:0/1655062343 wait complete. 2023-12-13T00:01:04.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.081+0000 7ff3f537c640 1 Processor -- start 2023-12-13T00:01:04.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.081+0000 7ff3f537c640 1 -- start start 2023-12-13T00:01:04.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.082+0000 7ff3f537c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f00c9620 0x7ff3f0154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:04.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.082+0000 7ff3f537c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3f00cc420 0x7ff3f00b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:04.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.082+0000 7ff3f537c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3f00cda70 0x7ff3f01f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:04.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.082+0000 7ff3f537c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f0154f80 con 0x7ff3f00c9620 2023-12-13T00:01:04.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.082+0000 7ff3f537c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f00b4180 con 0x7ff3f00cc420 2023-12-13T00:01:04.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.082+0000 7ff3f537c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f00c2f50 con 0x7ff3f00cda70 2023-12-13T00:01:04.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.082+0000 7ff3eeffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f00c9620 0x7ff3f0154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:04.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.082+0000 7ff3e7fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3f00cc420 0x7ff3f00b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:04.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.083+0000 7ff3eeffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f00c9620 0x7ff3f0154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45550/0 (socket says 172.21.15.72:45550) 2023-12-13T00:01:04.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.083+0000 7ff3eeffd640 1 -- 172.21.15.72:0/501466406 learned_addr learned my addr 172.21.15.72:0/501466406 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:04.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.083+0000 7ff3ef7fe640 1 --2- 172.21.15.72:0/501466406 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3f00cda70 0x7ff3f01f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:04.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.086+0000 7ff3eeffd640 1 -- 172.21.15.72:0/501466406 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3f00cda70 msgr2=0x7ff3f01f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:04.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.086+0000 7ff3eeffd640 1 --2- 172.21.15.72:0/501466406 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3f00cda70 0x7ff3f01f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:04.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.086+0000 7ff3eeffd640 1 -- 172.21.15.72:0/501466406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3f00cc420 msgr2=0x7ff3f00b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:04.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.086+0000 7ff3eeffd640 1 --2- 172.21.15.72:0/501466406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3f00cc420 0x7ff3f00b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:04.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.086+0000 7ff3eeffd640 1 -- 172.21.15.72:0/501466406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e8009a70 con 0x7ff3f00c9620 2023-12-13T00:01:04.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.088+0000 7ff3eeffd640 1 --2- 172.21.15.72:0/501466406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f00c9620 0x7ff3f0154a40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000c440 tx=0x7ff3e000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:04.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.091+0000 7ff3e77fe640 1 -- 172.21.15.72:0/501466406 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0005ce0 con 0x7ff3f00c9620 2023-12-13T00:01:04.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.091+0000 7ff3e77fe640 1 -- 172.21.15.72:0/501466406 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e0005e40 con 0x7ff3f00c9620 2023-12-13T00:01:04.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.091+0000 7ff3e77fe640 1 -- 172.21.15.72:0/501466406 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e00072b0 con 0x7ff3f00c9620 2023-12-13T00:01:04.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.091+0000 7ff3f537c640 1 -- 172.21.15.72:0/501466406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f01f2be0 con 0x7ff3f00c9620 2023-12-13T00:01:04.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.092+0000 7ff3f537c640 1 -- 172.21.15.72:0/501466406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f00b3720 con 0x7ff3f00c9620 2023-12-13T00:01:04.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.092+0000 7ff3f537c640 1 -- 172.21.15.72:0/501466406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f00b32a0 con 0x7ff3f00c9620 2023-12-13T00:01:04.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.111+0000 7ff3e77fe640 1 -- 172.21.15.72:0/501466406 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff3e0007410 con 0x7ff3f00c9620 2023-12-13T00:01:04.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.112+0000 7ff3e77fe640 1 --2- 172.21.15.72:0/501466406 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff3d006b210 0x7ff3d006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:04.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.112+0000 7ff3e7fff640 1 --2- 172.21.15.72:0/501466406 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff3d006b210 0x7ff3d006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:04.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.112+0000 7ff3e7fff640 1 --2- 172.21.15.72:0/501466406 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff3d006b210 0x7ff3d006d6d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8000f60 tx=0x7ff3d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:04.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.344+0000 7ff3e77fe640 1 -- 172.21.15.72:0/501466406 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7ff3e0057d00 con 0x7ff3f00c9620 2023-12-13T00:01:04.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.344+0000 7ff3e77fe640 1 -- 172.21.15.72:0/501466406 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff3e0054040 con 0x7ff3f00c9620 2023-12-13T00:01:04.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:04.563+0000 7ff3f537c640 1 -- 172.21.15.72:0/501466406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7ff3f00b32a0 con 0x7ff3f00c9620 2023-12-13T00:01:05.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.006+0000 7ff3e77fe640 1 -- 172.21.15.72:0/501466406 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) v1 ==== 115+0+0 (secure 0 0 0) 0x7ff3f00b32a0 con 0x7ff3f00c9620 2023-12-13T00:01:05.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.008+0000 7ff3f537c640 1 -- 172.21.15.72:0/501466406 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff3d006b210 msgr2=0x7ff3d006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:05.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.008+0000 7ff3f537c640 1 --2- 172.21.15.72:0/501466406 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff3d006b210 0x7ff3d006d6d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8000f60 tx=0x7ff3d8009040 comp rx=0 tx=0).stop 2023-12-13T00:01:05.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.008+0000 7ff3f537c640 1 -- 172.21.15.72:0/501466406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f00c9620 msgr2=0x7ff3f0154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:05.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.008+0000 7ff3f537c640 1 --2- 172.21.15.72:0/501466406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f00c9620 0x7ff3f0154a40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000c440 tx=0x7ff3e000c900 comp rx=0 tx=0).stop 2023-12-13T00:01:05.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.008+0000 7ff3f537c640 1 -- 172.21.15.72:0/501466406 shutdown_connections 2023-12-13T00:01:05.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.008+0000 7ff3f537c640 1 --2- 172.21.15.72:0/501466406 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff3d006b210 0x7ff3d006d6d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:05.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.008+0000 7ff3f537c640 1 --2- 172.21.15.72:0/501466406 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3f00cda70 0x7ff3f01f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:05.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.008+0000 7ff3f537c640 1 --2- 172.21.15.72:0/501466406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3f00cc420 0x7ff3f00b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:05.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.008+0000 7ff3f537c640 1 --2- 172.21.15.72:0/501466406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f00c9620 0x7ff3f0154a40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:05.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.008+0000 7ff3f537c640 1 -- 172.21.15.72:0/501466406 >> 172.21.15.72:0/501466406 conn(0x7ff3f00b07b0 msgr2=0x7ff3f00c65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:05.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.008+0000 7ff3f537c640 1 -- 172.21.15.72:0/501466406 shutdown_connections 2023-12-13T00:01:05.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.008+0000 7ff3f537c640 1 -- 172.21.15.72:0/501466406 wait complete. 2023-12-13T00:01:05.020 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-13T00:01:05.020 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T00:01:05.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.123+0000 7f32c6023640 1 Processor -- start 2023-12-13T00:01:05.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.123+0000 7f32c6023640 1 -- start start 2023-12-13T00:01:05.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.124+0000 7f32c6023640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32c0153730 0x7f32c006eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:05.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.124+0000 7f32c6023640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f32c00c91d0 0x7f32c00c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:05.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.124+0000 7f32c6023640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c006f090 con 0x7f32c015a0c0 2023-12-13T00:01:05.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.124+0000 7f32c6023640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c00c38f0 con 0x7f32c00c91d0 2023-12-13T00:01:05.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.124+0000 7f32c6023640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c01593d0 con 0x7f32c0153730 2023-12-13T00:01:05.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.125+0000 7f32bf7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32c0153730 0x7f32c006eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:05.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.125+0000 7f32beffd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f32c00c91d0 0x7f32c00c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:05.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.125+0000 7f32bffff640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f32c015a0c0 0x7f32c00ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:60394/0 (socket says 172.21.15.72:60394) 2023-12-13T00:01:05.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.125+0000 7f32bffff640 1 -- 172.21.15.72:0/2892225029 learned_addr learned my addr 172.21.15.72:0/2892225029 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:05.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.128+0000 7f32bf7fe640 1 -- 172.21.15.72:0/2892225029 >> v2:172.21.15.176:3300/0 conn(0x7f32c00c91d0 msgr2=0x7f32c00c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:05.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.128+0000 7f32bf7fe640 1 --2- 172.21.15.72:0/2892225029 >> v2:172.21.15.176:3300/0 conn(0x7f32c00c91d0 0x7f32c00c2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:05.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.128+0000 7f32bf7fe640 1 -- 172.21.15.72:0/2892225029 >> v1:172.21.15.176:6789/0 conn(0x7f32c015a0c0 legacy=0x7f32c00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:05.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.128+0000 7f32bf7fe640 1 -- 172.21.15.72:0/2892225029 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c0153b10 con 0x7f32c0153730 2023-12-13T00:01:05.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.131+0000 7f32bf7fe640 1 --2- 172.21.15.72:0/2892225029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32c0153730 0x7f32c006eb50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f32b0009d90 tx=0x7f32b002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54a3b9683f38415 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:05.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.134+0000 7f32be7fc640 1 -- 172.21.15.72:0/2892225029 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b002cce0 con 0x7f32c0153730 2023-12-13T00:01:05.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.134+0000 7f32be7fc640 1 -- 172.21.15.72:0/2892225029 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b002ce40 con 0x7f32c0153730 2023-12-13T00:01:05.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.134+0000 7f32be7fc640 1 -- 172.21.15.72:0/2892225029 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0034660 con 0x7f32c0153730 2023-12-13T00:01:05.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.135+0000 7f32c6023640 1 -- 172.21.15.72:0/2892225029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32c0153730 msgr2=0x7f32c006eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:05.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.135+0000 7f32c6023640 1 --2- 172.21.15.72:0/2892225029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32c0153730 0x7f32c006eb50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f32b0009d90 tx=0x7f32b002bf30 comp rx=0 tx=0).stop 2023-12-13T00:01:05.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.135+0000 7f32c6023640 1 -- 172.21.15.72:0/2892225029 shutdown_connections 2023-12-13T00:01:05.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.135+0000 7f32c6023640 1 --2- 172.21.15.72:0/2892225029 >> v2:172.21.15.176:3300/0 conn(0x7f32c00c91d0 0x7f32c00c2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:05.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.135+0000 7f32c6023640 1 --2- 172.21.15.72:0/2892225029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32c0153730 0x7f32c006eb50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:05.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.135+0000 7f32c6023640 1 -- 172.21.15.72:0/2892225029 >> 172.21.15.72:0/2892225029 conn(0x7f32c00707f0 msgr2=0x7f32c0070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:05.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.135+0000 7f32c6023640 1 -- 172.21.15.72:0/2892225029 shutdown_connections 2023-12-13T00:01:05.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.135+0000 7f32c6023640 1 -- 172.21.15.72:0/2892225029 wait complete. 2023-12-13T00:01:05.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.136+0000 7f32c6023640 1 Processor -- start 2023-12-13T00:01:05.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.136+0000 7f32c6023640 1 -- start start 2023-12-13T00:01:05.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.137+0000 7f32c6023640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32c00c91d0 0x7f32c014fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:05.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.137+0000 7f32c6023640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32c0153730 0x7f32c014d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:05.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.137+0000 7f32c6023640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32c015a0c0 0x7f32c01f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:05.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.137+0000 7f32c6023640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c01f34f0 con 0x7f32c00c91d0 2023-12-13T00:01:05.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.137+0000 7f32c6023640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c0146370 con 0x7f32c015a0c0 2023-12-13T00:01:05.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.137+0000 7f32c6023640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c0146650 con 0x7f32c0153730 2023-12-13T00:01:05.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.138+0000 7f32beffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32c0153730 0x7f32c014d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:05.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.138+0000 7f32beffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32c0153730 0x7f32c014d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:58942/0 (socket says 172.21.15.72:58942) 2023-12-13T00:01:05.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.138+0000 7f32beffd640 1 -- 172.21.15.72:0/734506202 learned_addr learned my addr 172.21.15.72:0/734506202 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:05.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.139+0000 7f32bffff640 1 --2- 172.21.15.72:0/734506202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32c015a0c0 0x7f32c01f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:05.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.141+0000 7f32beffd640 1 -- 172.21.15.72:0/734506202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32c015a0c0 msgr2=0x7f32c01f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:05.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.141+0000 7f32beffd640 1 --2- 172.21.15.72:0/734506202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32c015a0c0 0x7f32c01f2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:05.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.141+0000 7f32beffd640 1 -- 172.21.15.72:0/734506202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32c00c91d0 msgr2=0x7f32c014fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:05.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.141+0000 7f32beffd640 1 --2- 172.21.15.72:0/734506202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32c00c91d0 0x7f32c014fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:05.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.141+0000 7f32beffd640 1 -- 172.21.15.72:0/734506202 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b0009a70 con 0x7f32c0153730 2023-12-13T00:01:05.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.143+0000 7f32beffd640 1 --2- 172.21.15.72:0/734506202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32c0153730 0x7f32c014d160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f32a800e9b0 tx=0x7f32a800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:05.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.147+0000 7f32b7fff640 1 -- 172.21.15.72:0/734506202 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8009670 con 0x7f32c0153730 2023-12-13T00:01:05.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.147+0000 7f32b7fff640 1 -- 172.21.15.72:0/734506202 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a800c9a0 con 0x7f32c0153730 2023-12-13T00:01:05.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.147+0000 7f32c6023640 1 -- 172.21.15.72:0/734506202 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c0146930 con 0x7f32c0153730 2023-12-13T00:01:05.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.147+0000 7f32b7fff640 1 -- 172.21.15.72:0/734506202 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a800cd50 con 0x7f32c0153730 2023-12-13T00:01:05.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.147+0000 7f32c6023640 1 -- 172.21.15.72:0/734506202 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c0146ef0 con 0x7f32c0153730 2023-12-13T00:01:05.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.148+0000 7f32c6023640 1 -- 172.21.15.72:0/734506202 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c0073dc0 con 0x7f32c0153730 2023-12-13T00:01:05.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.394+0000 7f32b7fff640 1 -- 172.21.15.72:0/734506202 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f32a8013470 con 0x7f32c0153730 2023-12-13T00:01:05.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.395+0000 7f32b7fff640 1 --2- 172.21.15.72:0/734506202 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f32a006b1c0 0x7f32a006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:05.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.395+0000 7f32bf7fe640 1 --2- 172.21.15.72:0/734506202 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f32a006b1c0 0x7f32a006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:05.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.395+0000 7f32bf7fe640 1 --2- 172.21.15.72:0/734506202 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f32a006b1c0 0x7f32a006d680 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f32b0036000 tx=0x7f32b002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:05.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.398+0000 7f32b7fff640 1 -- 172.21.15.72:0/734506202 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f32a8059590 con 0x7f32c0153730 2023-12-13T00:01:05.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.413+0000 7f32b7fff640 1 -- 172.21.15.72:0/734506202 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f32a80551d0 con 0x7f32c0153730 2023-12-13T00:01:05.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.621+0000 7f32c6023640 1 -- 172.21.15.72:0/734506202 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32c0146790 con 0x7f32c0153730 2023-12-13T00:01:05.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.645+0000 7f32b7fff640 1 -- 172.21.15.72:0/734506202 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+6531 (secure 0 0 0) 0x7f32c0146790 con 0x7f32c0153730 2023-12-13T00:01:05.646 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:01:05.647 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/541435124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":541435124},{"type":"v1","addr":"172.21.15.72:6837","nonce":541435124}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4190692049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4190692049},{"type":"v1","addr":"172.21.15.176:6835","nonce":4190692049}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1780646034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1780646034},{"type":"v1","addr":"172.21.15.176:6833","nonce":1780646034}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-13T00:00:30.722325+0000","modified":"2023-12-13T00:01:05.090114+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4266,"mds_1":4264,"mds_2":4259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"c","rank":2,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.72:6839/3632161953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":3632161953},{"type":"v1","addr":"172.21.15.72:6839","nonce":3632161953}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4264":{"gid":4264,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6835/3954648997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3954648997},{"type":"v1","addr":"172.21.15.72:6835","nonce":3954648997}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4266":{"gid":4266,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6837/3968747607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":3968747607},{"type":"v1","addr":"172.21.15.176:6837","nonce":3968747607}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-13T00:01:05.647 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 13 2023-12-13T00:01:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.647+0000 7f32c6023640 1 -- 172.21.15.72:0/734506202 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f32a006b1c0 msgr2=0x7f32a006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.647+0000 7f32c6023640 1 --2- 172.21.15.72:0/734506202 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f32a006b1c0 0x7f32a006d680 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f32b0036000 tx=0x7f32b002e000 comp rx=0 tx=0).stop 2023-12-13T00:01:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.647+0000 7f32c6023640 1 -- 172.21.15.72:0/734506202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32c0153730 msgr2=0x7f32c014d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.647+0000 7f32c6023640 1 --2- 172.21.15.72:0/734506202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32c0153730 0x7f32c014d160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f32a800e9b0 tx=0x7f32a800ee70 comp rx=0 tx=0).stop 2023-12-13T00:01:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.647+0000 7f32c6023640 1 -- 172.21.15.72:0/734506202 shutdown_connections 2023-12-13T00:01:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.647+0000 7f32c6023640 1 --2- 172.21.15.72:0/734506202 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f32a006b1c0 0x7f32a006d680 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.647+0000 7f32c6023640 1 --2- 172.21.15.72:0/734506202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32c015a0c0 0x7f32c01f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.647+0000 7f32c6023640 1 --2- 172.21.15.72:0/734506202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32c0153730 0x7f32c014d160 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.647+0000 7f32c6023640 1 --2- 172.21.15.72:0/734506202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32c00c91d0 0x7f32c014fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.647+0000 7f32c6023640 1 -- 172.21.15.72:0/734506202 >> 172.21.15.72:0/734506202 conn(0x7f32c00707f0 msgr2=0x7f32c0070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.648+0000 7f32c6023640 1 -- 172.21.15.72:0/734506202 shutdown_connections 2023-12-13T00:01:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.648+0000 7f32c6023640 1 -- 172.21.15.72:0/734506202 wait complete. 2023-12-13T00:01:05.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:01:05.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.758+0000 7f83f1087640 1 Processor -- start 2023-12-13T00:01:05.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.759+0000 7f83f1087640 1 -- start start 2023-12-13T00:01:05.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.759+0000 7f83f1087640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83ec0c91d0 0x7f83ec06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:05.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.759+0000 7f83f1087640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ec06f090 con 0x7f83ec15a0c0 2023-12-13T00:01:05.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.759+0000 7f83f1087640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ec153b10 con 0x7f83ec153730 2023-12-13T00:01:05.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.759+0000 7f83f1087640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec0c38f0 con 0x7f83ec0c91d0 2023-12-13T00:01:05.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.760+0000 7f83eb59e640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f83ec15a0c0 0x7f83ec0ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52768/0 (socket says 172.21.15.72:52768) 2023-12-13T00:01:05.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.760+0000 7f83eb59e640 1 -- 172.21.15.72:0/2762196164 learned_addr learned my addr 172.21.15.72:0/2762196164 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:05.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.760+0000 7f83ea59c640 1 --2- 172.21.15.72:0/2762196164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83ec0c91d0 0x7f83ec06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:05.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.762+0000 7f83ea59c640 1 -- 172.21.15.72:0/2762196164 >> v1:172.21.15.176:6789/0 conn(0x7f83ec153730 legacy=0x7f83ec0c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:05.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.762+0000 7f83ea59c640 1 -- 172.21.15.72:0/2762196164 >> v1:172.21.15.72:6789/0 conn(0x7f83ec15a0c0 legacy=0x7f83ec0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:05.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.762+0000 7f83ea59c640 1 -- 172.21.15.72:0/2762196164 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec0c3330 con 0x7f83ec0c91d0 2023-12-13T00:01:05.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.764+0000 7f83ea59c640 1 --2- 172.21.15.72:0/2762196164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83ec0c91d0 0x7f83ec06eb50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f83dc0097d0 tx=0x7f83dc02b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b595089e408060c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:05.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.768+0000 7f83e9d9b640 1 -- 172.21.15.72:0/2762196164 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc030880 con 0x7f83ec0c91d0 2023-12-13T00:01:05.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.768+0000 7f83e9d9b640 1 -- 172.21.15.72:0/2762196164 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc0309e0 con 0x7f83ec0c91d0 2023-12-13T00:01:05.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.768+0000 7f83e9d9b640 1 -- 172.21.15.72:0/2762196164 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc030d70 con 0x7f83ec0c91d0 2023-12-13T00:01:05.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.769+0000 7f83f1087640 1 -- 172.21.15.72:0/2762196164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83ec0c91d0 msgr2=0x7f83ec06eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:05.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.769+0000 7f83f1087640 1 --2- 172.21.15.72:0/2762196164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83ec0c91d0 0x7f83ec06eb50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f83dc0097d0 tx=0x7f83dc02b9c0 comp rx=0 tx=0).stop 2023-12-13T00:01:05.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.769+0000 7f83f1087640 1 -- 172.21.15.72:0/2762196164 shutdown_connections 2023-12-13T00:01:05.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.769+0000 7f83f1087640 1 --2- 172.21.15.72:0/2762196164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83ec0c91d0 0x7f83ec06eb50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:05.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.769+0000 7f83f1087640 1 -- 172.21.15.72:0/2762196164 >> 172.21.15.72:0/2762196164 conn(0x7f83ec0707f0 msgr2=0x7f83ec070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:05.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.769+0000 7f83f1087640 1 -- 172.21.15.72:0/2762196164 shutdown_connections 2023-12-13T00:01:05.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.769+0000 7f83f1087640 1 -- 172.21.15.72:0/2762196164 wait complete. 2023-12-13T00:01:05.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.770+0000 7f83f1087640 1 Processor -- start 2023-12-13T00:01:05.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.770+0000 7f83f1087640 1 -- start start 2023-12-13T00:01:05.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.771+0000 7f83f1087640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83ec0c91d0 0x7f83ec0cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:05.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.771+0000 7f83f1087640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83ec153730 0x7f83ec1584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:05.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.771+0000 7f83f1087640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83ec15a0c0 0x7f83ec14d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:05.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.771+0000 7f83f1087640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec0cbb10 con 0x7f83ec0c91d0 2023-12-13T00:01:05.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.771+0000 7f83f1087640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec1eee20 con 0x7f83ec153730 2023-12-13T00:01:05.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.771+0000 7f83f1087640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec1ef100 con 0x7f83ec15a0c0 2023-12-13T00:01:05.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.771+0000 7f83ea59c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83ec153730 0x7f83ec1584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:05.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.771+0000 7f83eb59e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83ec15a0c0 0x7f83ec14d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:05.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.771+0000 7f83ead9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83ec0c91d0 0x7f83ec0cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:05.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.772+0000 7f83ea59c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83ec153730 0x7f83ec1584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:49782/0 (socket says 172.21.15.72:49782) 2023-12-13T00:01:05.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.772+0000 7f83ea59c640 1 -- 172.21.15.72:0/2000322849 learned_addr learned my addr 172.21.15.72:0/2000322849 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:05.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.775+0000 7f83eb59e640 1 -- 172.21.15.72:0/2000322849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83ec153730 msgr2=0x7f83ec1584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:05.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.775+0000 7f83eb59e640 1 --2- 172.21.15.72:0/2000322849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83ec153730 0x7f83ec1584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:05.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.775+0000 7f83eb59e640 1 -- 172.21.15.72:0/2000322849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83ec0c91d0 msgr2=0x7f83ec0cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:05.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.775+0000 7f83eb59e640 1 --2- 172.21.15.72:0/2000322849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83ec0c91d0 0x7f83ec0cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:05.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.775+0000 7f83eb59e640 1 -- 172.21.15.72:0/2000322849 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc009400 con 0x7f83ec15a0c0 2023-12-13T00:01:05.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.775+0000 7f83ea59c640 1 --2- 172.21.15.72:0/2000322849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83ec153730 0x7f83ec1584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T00:01:05.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.777+0000 7f83eb59e640 1 --2- 172.21.15.72:0/2000322849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83ec15a0c0 0x7f83ec14d4d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f83e400caa0 tx=0x7f83e400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:05.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.781+0000 7f83d37fe640 1 -- 172.21.15.72:0/2000322849 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e400ac00 con 0x7f83ec15a0c0 2023-12-13T00:01:05.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.781+0000 7f83d37fe640 1 -- 172.21.15.72:0/2000322849 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e400ad60 con 0x7f83ec15a0c0 2023-12-13T00:01:05.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.781+0000 7f83f1087640 1 -- 172.21.15.72:0/2000322849 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ec1ef3e0 con 0x7f83ec15a0c0 2023-12-13T00:01:05.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.781+0000 7f83d37fe640 1 -- 172.21.15.72:0/2000322849 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e4012600 con 0x7f83ec15a0c0 2023-12-13T00:01:05.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.781+0000 7f83f1087640 1 -- 172.21.15.72:0/2000322849 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83ec1ef9a0 con 0x7f83ec15a0c0 2023-12-13T00:01:05.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.782+0000 7f83f1087640 1 -- 172.21.15.72:0/2000322849 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83ec0705c0 con 0x7f83ec15a0c0 2023-12-13T00:01:05.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.800+0000 7f83d37fe640 1 -- 172.21.15.72:0/2000322849 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f83e4007070 con 0x7f83ec15a0c0 2023-12-13T00:01:05.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.800+0000 7f83d37fe640 1 --2- 172.21.15.72:0/2000322849 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f83d806b1c0 0x7f83d806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:05.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.800+0000 7f83ead9d640 1 --2- 172.21.15.72:0/2000322849 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f83d806b1c0 0x7f83d806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:05.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.801+0000 7f83ead9d640 1 --2- 172.21.15.72:0/2000322849 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f83d806b1c0 0x7f83d806d680 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f83e0001780 tx=0x7f83e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:05.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:05.802+0000 7f83d37fe640 1 -- 172.21.15.72:0/2000322849 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f83e4058780 con 0x7f83ec15a0c0 2023-12-13T00:01:06.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.037+0000 7f83d37fe640 1 -- 172.21.15.72:0/2000322849 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f83e4054ac0 con 0x7f83ec15a0c0 2023-12-13T00:01:06.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.230+0000 7f83f1087640 1 -- 172.21.15.72:0/2000322849 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83ec1efb90 con 0x7f83ec15a0c0 2023-12-13T00:01:06.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.282+0000 7f83d37fe640 1 -- 172.21.15.72:0/2000322849 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18563 (secure 0 0 0) 0x7f83e4021090 con 0x7f83ec15a0c0 2023-12-13T00:01:06.283 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:01:06.283 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:01:00.435991+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T00:00:27.701252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T00:00:29.324356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T00:00:33.363089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.3","mappings":[{"from":7,"to":5}]},{"pgid":"4.10","mappings":[{"from":7,"to":0}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:01:06.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.284+0000 7f83f1087640 1 -- 172.21.15.72:0/2000322849 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f83d806b1c0 msgr2=0x7f83d806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:06.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.284+0000 7f83f1087640 1 --2- 172.21.15.72:0/2000322849 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f83d806b1c0 0x7f83d806d680 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f83e0001780 tx=0x7f83e0009040 comp rx=0 tx=0).stop 2023-12-13T00:01:06.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.284+0000 7f83f1087640 1 -- 172.21.15.72:0/2000322849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83ec15a0c0 msgr2=0x7f83ec14d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:06.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.284+0000 7f83f1087640 1 --2- 172.21.15.72:0/2000322849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83ec15a0c0 0x7f83ec14d4d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f83e400caa0 tx=0x7f83e400cf60 comp rx=0 tx=0).stop 2023-12-13T00:01:06.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.284+0000 7f83f1087640 1 -- 172.21.15.72:0/2000322849 shutdown_connections 2023-12-13T00:01:06.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.284+0000 7f83f1087640 1 --2- 172.21.15.72:0/2000322849 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f83d806b1c0 0x7f83d806d680 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:06.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.284+0000 7f83f1087640 1 --2- 172.21.15.72:0/2000322849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83ec15a0c0 0x7f83ec14d4d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:06.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.284+0000 7f83f1087640 1 --2- 172.21.15.72:0/2000322849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83ec153730 0x7f83ec1584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:06.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.284+0000 7f83f1087640 1 --2- 172.21.15.72:0/2000322849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83ec0c91d0 0x7f83ec0cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:06.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.284+0000 7f83f1087640 1 -- 172.21.15.72:0/2000322849 >> 172.21.15.72:0/2000322849 conn(0x7f83ec0707f0 msgr2=0x7f83ec150ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:06.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.284+0000 7f83f1087640 1 -- 172.21.15.72:0/2000322849 shutdown_connections 2023-12-13T00:01:06.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.284+0000 7f83f1087640 1 -- 172.21.15.72:0/2000322849 wait complete. 2023-12-13T00:01:06.296 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-13T00:01:06.296 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T00:01:06.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.395+0000 7fedd8e56640 1 Processor -- start 2023-12-13T00:01:06.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.395+0000 7fedd8e56640 1 -- start start 2023-12-13T00:01:06.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.396+0000 7fedd8e56640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fedd414ffa0 0x7fedd40c1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:06.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.396+0000 7fedd8e56640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd41570d0 con 0x7fedd40c6570 2023-12-13T00:01:06.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.396+0000 7fedd8e56640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd4156270 con 0x7fedd4150380 2023-12-13T00:01:06.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.396+0000 7fedd8e56640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd4156550 con 0x7fedd414ffa0 2023-12-13T00:01:06.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.397+0000 7fedd1d9b640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fedd4150380 0x7fedd406fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:60414/0 (socket says 172.21.15.72:60414) 2023-12-13T00:01:06.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.397+0000 7fedd1d9b640 1 -- 172.21.15.72:0/728286923 learned_addr learned my addr 172.21.15.72:0/728286923 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:06.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.397+0000 7fedd259c640 1 --2- 172.21.15.72:0/728286923 >> v2:172.21.15.72:3300/0 conn(0x7fedd414ffa0 0x7fedd40c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:06.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.399+0000 7fedd159a640 1 -- 172.21.15.72:0/728286923 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043578456 0 0) 0x7fedd4156270 con 0x7fedd4150380 2023-12-13T00:01:06.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.399+0000 7fedd159a640 1 -- 172.21.15.72:0/728286923 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedbc003520 con 0x7fedd4150380 2023-12-13T00:01:06.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.401+0000 7fedd259c640 1 -- 172.21.15.72:0/728286923 >> v1:172.21.15.176:6789/0 conn(0x7fedd4150380 legacy=0x7fedd406fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:06.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.401+0000 7fedd259c640 1 -- 172.21.15.72:0/728286923 >> v1:172.21.15.72:6789/0 conn(0x7fedd40c6570 legacy=0x7fedd40c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:06.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.401+0000 7fedd259c640 1 -- 172.21.15.72:0/728286923 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd4156830 con 0x7fedd414ffa0 2023-12-13T00:01:06.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.405+0000 7fedd259c640 1 --2- 172.21.15.72:0/728286923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedd414ffa0 0x7fedd40c1900 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fedc80097a0 tx=0x7fedc802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be30f51a07a767f server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:06.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.409+0000 7fedd159a640 1 -- 172.21.15.72:0/728286923 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc802f810 con 0x7fedd414ffa0 2023-12-13T00:01:06.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.409+0000 7fedd159a640 1 -- 172.21.15.72:0/728286923 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc802f970 con 0x7fedd414ffa0 2023-12-13T00:01:06.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.409+0000 7fedd159a640 1 -- 172.21.15.72:0/728286923 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc802fd00 con 0x7fedd414ffa0 2023-12-13T00:01:06.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.410+0000 7fedd8e56640 1 -- 172.21.15.72:0/728286923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedd414ffa0 msgr2=0x7fedd40c1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:06.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.410+0000 7fedd8e56640 1 --2- 172.21.15.72:0/728286923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedd414ffa0 0x7fedd40c1900 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fedc80097a0 tx=0x7fedc802b9f0 comp rx=0 tx=0).stop 2023-12-13T00:01:06.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.410+0000 7fedd8e56640 1 -- 172.21.15.72:0/728286923 shutdown_connections 2023-12-13T00:01:06.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.410+0000 7fedd8e56640 1 --2- 172.21.15.72:0/728286923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedd414ffa0 0x7fedd40c1900 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:06.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.410+0000 7fedd8e56640 1 -- 172.21.15.72:0/728286923 >> 172.21.15.72:0/728286923 conn(0x7fedd406b5c0 msgr2=0x7fedd406b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:06.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.410+0000 7fedd8e56640 1 -- 172.21.15.72:0/728286923 shutdown_connections 2023-12-13T00:01:06.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.410+0000 7fedd8e56640 1 -- 172.21.15.72:0/728286923 wait complete. 2023-12-13T00:01:06.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.412+0000 7fedd8e56640 1 Processor -- start 2023-12-13T00:01:06.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.412+0000 7fedd8e56640 1 -- start start 2023-12-13T00:01:06.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.412+0000 7fedd8e56640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd40c6570 0x7fedd4158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:06.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.412+0000 7fedd8e56640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedd414ffa0 0x7fedd4159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:06.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.412+0000 7fedd8e56640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedd4150380 0x7fedd40c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:06.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.412+0000 7fedd8e56640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd41ef530 con 0x7fedd414ffa0 2023-12-13T00:01:06.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.412+0000 7fedd8e56640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd41576d0 con 0x7fedd40c6570 2023-12-13T00:01:06.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.412+0000 7fedd8e56640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd41ef710 con 0x7fedd4150380 2023-12-13T00:01:06.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.413+0000 7fedd1d9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedd414ffa0 0x7fedd4159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:06.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.413+0000 7fedd1d9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedd414ffa0 0x7fedd4159110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45592/0 (socket says 172.21.15.72:45592) 2023-12-13T00:01:06.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.413+0000 7fedd1d9b640 1 -- 172.21.15.72:0/1128223158 learned_addr learned my addr 172.21.15.72:0/1128223158 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:06.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.413+0000 7fedd259c640 1 --2- 172.21.15.72:0/1128223158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd40c6570 0x7fedd4158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:06.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.413+0000 7fedd2d9d640 1 --2- 172.21.15.72:0/1128223158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedd4150380 0x7fedd40c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:06.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.417+0000 7fedd259c640 1 -- 172.21.15.72:0/1128223158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedd4150380 msgr2=0x7fedd40c35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:06.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.417+0000 7fedd259c640 1 --2- 172.21.15.72:0/1128223158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedd4150380 0x7fedd40c35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:06.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.417+0000 7fedd259c640 1 -- 172.21.15.72:0/1128223158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedd414ffa0 msgr2=0x7fedd4159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:06.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.417+0000 7fedd259c640 1 --2- 172.21.15.72:0/1128223158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedd414ffa0 0x7fedd4159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:06.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.417+0000 7fedd259c640 1 -- 172.21.15.72:0/1128223158 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc8009400 con 0x7fedd40c6570 2023-12-13T00:01:06.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.419+0000 7fedd259c640 1 --2- 172.21.15.72:0/1128223158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd40c6570 0x7fedd4158bd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fedd40c91f0 tx=0x7fedc80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:06.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.423+0000 7fedc2ffd640 1 -- 172.21.15.72:0/1128223158 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc803b040 con 0x7fedd40c6570 2023-12-13T00:01:06.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.423+0000 7fedc2ffd640 1 -- 172.21.15.72:0/1128223158 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc8037910 con 0x7fedd40c6570 2023-12-13T00:01:06.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.423+0000 7fedd8e56640 1 -- 172.21.15.72:0/1128223158 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd4158110 con 0x7fedd40c6570 2023-12-13T00:01:06.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.423+0000 7fedc2ffd640 1 -- 172.21.15.72:0/1128223158 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc8037cc0 con 0x7fedd40c6570 2023-12-13T00:01:06.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.423+0000 7fedd8e56640 1 -- 172.21.15.72:0/1128223158 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd41583d0 con 0x7fedd40c6570 2023-12-13T00:01:06.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.424+0000 7fedd8e56640 1 -- 172.21.15.72:0/1128223158 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd414cd50 con 0x7fedd40c6570 2023-12-13T00:01:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.673+0000 7fedc2ffd640 1 -- 172.21.15.72:0/1128223158 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fedc8042460 con 0x7fedd40c6570 2023-12-13T00:01:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.673+0000 7fedc2ffd640 1 --2- 172.21.15.72:0/1128223158 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fedb406b1c0 0x7fedb406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.673+0000 7fedd1d9b640 1 --2- 172.21.15.72:0/1128223158 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fedb406b1c0 0x7fedb406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.674+0000 7fedd1d9b640 1 --2- 172.21.15.72:0/1128223158 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fedb406b1c0 0x7fedb406d680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fedd40c7210 tx=0x7fedc4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:06.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.675+0000 7fedc2ffd640 1 -- 172.21.15.72:0/1128223158 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fedc8037e20 con 0x7fedd40c6570 2023-12-13T00:01:06.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.686+0000 7fedc2ffd640 1 -- 172.21.15.72:0/1128223158 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fedc80773a0 con 0x7fedd40c6570 2023-12-13T00:01:06.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.850+0000 7fedd8e56640 1 -- 172.21.15.72:0/1128223158 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fedd4156df0 con 0x7fedb406b1c0 2023-12-13T00:01:06.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.860+0000 7fedc2ffd640 1 -- 172.21.15.72:0/1128223158 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345332 (secure 0 0 0) 0x7fedc400f820 con 0x7fedb406b1c0 2023-12-13T00:01:06.864 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:01:06.867 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-12-13T00:01:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.863+0000 7fedd8e56640 1 -- 172.21.15.72:0/1128223158 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fedb406b1c0 msgr2=0x7fedb406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.863+0000 7fedd8e56640 1 --2- 172.21.15.72:0/1128223158 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fedb406b1c0 0x7fedb406d680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fedd40c7210 tx=0x7fedc4009040 comp rx=0 tx=0).stop 2023-12-13T00:01:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.863+0000 7fedd8e56640 1 -- 172.21.15.72:0/1128223158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd40c6570 msgr2=0x7fedd4158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.863+0000 7fedd8e56640 1 --2- 172.21.15.72:0/1128223158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd40c6570 0x7fedd4158bd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fedd40c91f0 tx=0x7fedc80046c0 comp rx=0 tx=0).stop 2023-12-13T00:01:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.863+0000 7fedd8e56640 1 -- 172.21.15.72:0/1128223158 shutdown_connections 2023-12-13T00:01:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.863+0000 7fedd8e56640 1 --2- 172.21.15.72:0/1128223158 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fedb406b1c0 0x7fedb406d680 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.863+0000 7fedd8e56640 1 --2- 172.21.15.72:0/1128223158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedd4150380 0x7fedd40c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.863+0000 7fedd8e56640 1 --2- 172.21.15.72:0/1128223158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedd414ffa0 0x7fedd4159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.863+0000 7fedd8e56640 1 --2- 172.21.15.72:0/1128223158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd40c6570 0x7fedd4158bd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.863+0000 7fedd8e56640 1 -- 172.21.15.72:0/1128223158 >> 172.21.15.72:0/1128223158 conn(0x7fedd406b5c0 msgr2=0x7fedd4071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.863+0000 7fedd8e56640 1 -- 172.21.15.72:0/1128223158 shutdown_connections 2023-12-13T00:01:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:06.863+0000 7fedd8e56640 1 -- 172.21.15.72:0/1128223158 wait complete. 2023-12-13T00:01:06.874 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2023-12-13T00:01:06.533672+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595629,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":210,"num_write_kb":2437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219620,"kb_used_data":3440,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755100,"statfs":{"total":773094113280,"available":772869222400,"internally_reserved":0,"allocated":3522560,"data_stored":2114428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001811"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462633+0000","last_change":"2023-12-13T00:00:29.997631+0000","last_active":"2023-12-13T00:00:59.462633+0000","last_peered":"2023-12-13T00:00:59.462633+0000","last_clean":"2023-12-13T00:00:59.462633+0000","last_became_active":"2023-12-13T00:00:29.997381+0000","last_became_peered":"2023-12-13T00:00:29.997381+0000","last_unstale":"2023-12-13T00:00:59.462633+0000","last_undegraded":"2023-12-13T00:00:59.462633+0000","last_fullsized":"2023-12-13T00:00:59.462633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:33:37.976462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465727+0000","last_change":"2023-12-13T00:00:31.138533+0000","last_active":"2023-12-13T00:00:59.465727+0000","last_peered":"2023-12-13T00:00:59.465727+0000","last_clean":"2023-12-13T00:00:59.465727+0000","last_became_active":"2023-12-13T00:00:31.138242+0000","last_became_peered":"2023-12-13T00:00:31.138242+0000","last_unstale":"2023-12-13T00:00:59.465727+0000","last_undegraded":"2023-12-13T00:00:59.465727+0000","last_fullsized":"2023-12-13T00:00:59.465727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:39:59.955103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461340+0000","last_change":"2023-12-13T00:00:35.667840+0000","last_active":"2023-12-13T00:00:59.461340+0000","last_peered":"2023-12-13T00:00:59.461340+0000","last_clean":"2023-12-13T00:00:59.461340+0000","last_became_active":"2023-12-13T00:00:35.667498+0000","last_became_peered":"2023-12-13T00:00:35.667498+0000","last_unstale":"2023-12-13T00:00:59.461340+0000","last_undegraded":"2023-12-13T00:00:59.461340+0000","last_fullsized":"2023-12-13T00:00:59.461340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:17.304722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465816+0000","last_change":"2023-12-13T00:00:30.001888+0000","last_active":"2023-12-13T00:00:59.465816+0000","last_peered":"2023-12-13T00:00:59.465816+0000","last_clean":"2023-12-13T00:00:59.465816+0000","last_became_active":"2023-12-13T00:00:30.001628+0000","last_became_peered":"2023-12-13T00:00:30.001628+0000","last_unstale":"2023-12-13T00:00:59.465816+0000","last_undegraded":"2023-12-13T00:00:59.465816+0000","last_fullsized":"2023-12-13T00:00:59.465816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:48:30.422214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465657+0000","last_change":"2023-12-13T00:00:31.036420+0000","last_active":"2023-12-13T00:00:59.465657+0000","last_peered":"2023-12-13T00:00:59.465657+0000","last_clean":"2023-12-13T00:00:59.465657+0000","last_became_active":"2023-12-13T00:00:31.036197+0000","last_became_peered":"2023-12-13T00:00:31.036197+0000","last_unstale":"2023-12-13T00:00:59.465657+0000","last_undegraded":"2023-12-13T00:00:59.465657+0000","last_fullsized":"2023-12-13T00:00:59.465657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:05:56.876593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461830+0000","last_change":"2023-12-13T00:00:35.665348+0000","last_active":"2023-12-13T00:00:59.461830+0000","last_peered":"2023-12-13T00:00:59.461830+0000","last_clean":"2023-12-13T00:00:59.461830+0000","last_became_active":"2023-12-13T00:00:35.664981+0000","last_became_peered":"2023-12-13T00:00:35.664981+0000","last_unstale":"2023-12-13T00:00:59.461830+0000","last_undegraded":"2023-12-13T00:00:59.461830+0000","last_fullsized":"2023-12-13T00:00:59.461830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:55.759392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461293+0000","last_change":"2023-12-13T00:00:30.009983+0000","last_active":"2023-12-13T00:00:59.461293+0000","last_peered":"2023-12-13T00:00:59.461293+0000","last_clean":"2023-12-13T00:00:59.461293+0000","last_became_active":"2023-12-13T00:00:30.009724+0000","last_became_peered":"2023-12-13T00:00:30.009724+0000","last_unstale":"2023-12-13T00:00:59.461293+0000","last_undegraded":"2023-12-13T00:00:59.461293+0000","last_fullsized":"2023-12-13T00:00:59.461293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:20:28.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456667+0000","last_change":"2023-12-13T00:00:31.151042+0000","last_active":"2023-12-13T00:00:59.456667+0000","last_peered":"2023-12-13T00:00:59.456667+0000","last_clean":"2023-12-13T00:00:59.456667+0000","last_became_active":"2023-12-13T00:00:31.150735+0000","last_became_peered":"2023-12-13T00:00:31.150735+0000","last_unstale":"2023-12-13T00:00:59.456667+0000","last_undegraded":"2023-12-13T00:00:59.456667+0000","last_fullsized":"2023-12-13T00:00:59.456667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:36.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462064+0000","last_change":"2023-12-13T00:00:35.668759+0000","last_active":"2023-12-13T00:00:59.462064+0000","last_peered":"2023-12-13T00:00:59.462064+0000","last_clean":"2023-12-13T00:00:59.462064+0000","last_became_active":"2023-12-13T00:00:35.668361+0000","last_became_peered":"2023-12-13T00:00:35.668361+0000","last_unstale":"2023-12-13T00:00:59.462064+0000","last_undegraded":"2023-12-13T00:00:59.462064+0000","last_fullsized":"2023-12-13T00:00:59.462064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:05.770014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461073+0000","last_change":"2023-12-13T00:00:30.009921+0000","last_active":"2023-12-13T00:00:59.461073+0000","last_peered":"2023-12-13T00:00:59.461073+0000","last_clean":"2023-12-13T00:00:59.461073+0000","last_became_active":"2023-12-13T00:00:30.009644+0000","last_became_peered":"2023-12-13T00:00:30.009644+0000","last_unstale":"2023-12-13T00:00:59.461073+0000","last_undegraded":"2023-12-13T00:00:59.461073+0000","last_fullsized":"2023-12-13T00:00:59.461073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:48:30.422214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457963+0000","last_change":"2023-12-13T00:00:31.146801+0000","last_active":"2023-12-13T00:00:59.457963+0000","last_peered":"2023-12-13T00:00:59.457963+0000","last_clean":"2023-12-13T00:00:59.457963+0000","last_became_active":"2023-12-13T00:00:31.146516+0000","last_became_peered":"2023-12-13T00:00:31.146516+0000","last_unstale":"2023-12-13T00:00:59.457963+0000","last_undegraded":"2023-12-13T00:00:59.457963+0000","last_fullsized":"2023-12-13T00:00:59.457963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:44:23.442162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461875+0000","last_change":"2023-12-13T00:00:35.668621+0000","last_active":"2023-12-13T00:00:59.461875+0000","last_peered":"2023-12-13T00:00:59.461875+0000","last_clean":"2023-12-13T00:00:59.461875+0000","last_became_active":"2023-12-13T00:00:35.668298+0000","last_became_peered":"2023-12-13T00:00:35.668298+0000","last_unstale":"2023-12-13T00:00:59.461875+0000","last_undegraded":"2023-12-13T00:00:59.461875+0000","last_fullsized":"2023-12-13T00:00:59.461875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:40:04.506084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457767+0000","last_change":"2023-12-13T00:00:31.036347+0000","last_active":"2023-12-13T00:00:59.457767+0000","last_peered":"2023-12-13T00:00:59.457767+0000","last_clean":"2023-12-13T00:00:59.457767+0000","last_became_active":"2023-12-13T00:00:31.036062+0000","last_became_peered":"2023-12-13T00:00:31.036062+0000","last_unstale":"2023-12-13T00:00:59.457767+0000","last_undegraded":"2023-12-13T00:00:59.457767+0000","last_fullsized":"2023-12-13T00:00:59.457767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:15:29.783257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459059+0000","last_change":"2023-12-13T00:00:30.001066+0000","last_active":"2023-12-13T00:00:59.459059+0000","last_peered":"2023-12-13T00:00:59.459059+0000","last_clean":"2023-12-13T00:00:59.459059+0000","last_became_active":"2023-12-13T00:00:30.000782+0000","last_became_peered":"2023-12-13T00:00:30.000782+0000","last_unstale":"2023-12-13T00:00:59.459059+0000","last_undegraded":"2023-12-13T00:00:59.459059+0000","last_fullsized":"2023-12-13T00:00:59.459059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:53.977921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457740+0000","last_change":"2023-12-13T00:00:35.662038+0000","last_active":"2023-12-13T00:00:59.457740+0000","last_peered":"2023-12-13T00:00:59.457740+0000","last_clean":"2023-12-13T00:00:59.457740+0000","last_became_active":"2023-12-13T00:00:35.661458+0000","last_became_peered":"2023-12-13T00:00:35.661458+0000","last_unstale":"2023-12-13T00:00:59.457740+0000","last_undegraded":"2023-12-13T00:00:59.457740+0000","last_fullsized":"2023-12-13T00:00:59.457740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:12:27.307277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462675+0000","last_change":"2023-12-13T00:00:31.119718+0000","last_active":"2023-12-13T00:00:59.462675+0000","last_peered":"2023-12-13T00:00:59.462675+0000","last_clean":"2023-12-13T00:00:59.462675+0000","last_became_active":"2023-12-13T00:00:31.119447+0000","last_became_peered":"2023-12-13T00:00:31.119447+0000","last_unstale":"2023-12-13T00:00:59.462675+0000","last_undegraded":"2023-12-13T00:00:59.462675+0000","last_fullsized":"2023-12-13T00:00:59.462675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:08.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463791+0000","last_change":"2023-12-13T00:00:29.968425+0000","last_active":"2023-12-13T00:00:59.463791+0000","last_peered":"2023-12-13T00:00:59.463791+0000","last_clean":"2023-12-13T00:00:59.463791+0000","last_became_active":"2023-12-13T00:00:29.967929+0000","last_became_peered":"2023-12-13T00:00:29.967929+0000","last_unstale":"2023-12-13T00:00:59.463791+0000","last_undegraded":"2023-12-13T00:00:59.463791+0000","last_fullsized":"2023-12-13T00:00:59.463791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:53.977921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460657+0000","last_change":"2023-12-13T00:00:35.662848+0000","last_active":"2023-12-13T00:00:59.460657+0000","last_peered":"2023-12-13T00:00:59.460657+0000","last_clean":"2023-12-13T00:00:59.460657+0000","last_became_active":"2023-12-13T00:00:35.662469+0000","last_became_peered":"2023-12-13T00:00:35.662469+0000","last_unstale":"2023-12-13T00:00:59.460657+0000","last_undegraded":"2023-12-13T00:00:59.460657+0000","last_fullsized":"2023-12-13T00:00:59.460657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:17:20.456996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461523+0000","last_change":"2023-12-13T00:00:31.143108+0000","last_active":"2023-12-13T00:00:59.461523+0000","last_peered":"2023-12-13T00:00:59.461523+0000","last_clean":"2023-12-13T00:00:59.461523+0000","last_became_active":"2023-12-13T00:00:31.142847+0000","last_became_peered":"2023-12-13T00:00:31.142847+0000","last_unstale":"2023-12-13T00:00:59.461523+0000","last_undegraded":"2023-12-13T00:00:59.461523+0000","last_fullsized":"2023-12-13T00:00:59.461523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:20.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462594+0000","last_change":"2023-12-13T00:00:30.004483+0000","last_active":"2023-12-13T00:00:59.462594+0000","last_peered":"2023-12-13T00:00:59.462594+0000","last_clean":"2023-12-13T00:00:59.462594+0000","last_became_active":"2023-12-13T00:00:30.004195+0000","last_became_peered":"2023-12-13T00:00:30.004195+0000","last_unstale":"2023-12-13T00:00:59.462594+0000","last_undegraded":"2023-12-13T00:00:59.462594+0000","last_fullsized":"2023-12-13T00:00:59.462594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:35.192132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462443+0000","last_change":"2023-12-13T00:00:35.660024+0000","last_active":"2023-12-13T00:00:59.462443+0000","last_peered":"2023-12-13T00:00:59.462443+0000","last_clean":"2023-12-13T00:00:59.462443+0000","last_became_active":"2023-12-13T00:00:35.659637+0000","last_became_peered":"2023-12-13T00:00:35.659637+0000","last_unstale":"2023-12-13T00:00:59.462443+0000","last_undegraded":"2023-12-13T00:00:59.462443+0000","last_fullsized":"2023-12-13T00:00:59.462443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:19.752973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457668+0000","last_change":"2023-12-13T00:00:31.143938+0000","last_active":"2023-12-13T00:00:59.457668+0000","last_peered":"2023-12-13T00:00:59.457668+0000","last_clean":"2023-12-13T00:00:59.457668+0000","last_became_active":"2023-12-13T00:00:31.143673+0000","last_became_peered":"2023-12-13T00:00:31.143673+0000","last_unstale":"2023-12-13T00:00:59.457668+0000","last_undegraded":"2023-12-13T00:00:59.457668+0000","last_fullsized":"2023-12-13T00:00:59.457668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:56:04.585998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460369+0000","last_change":"2023-12-13T00:00:30.005987+0000","last_active":"2023-12-13T00:00:59.460369+0000","last_peered":"2023-12-13T00:00:59.460369+0000","last_clean":"2023-12-13T00:00:59.460369+0000","last_became_active":"2023-12-13T00:00:30.005740+0000","last_became_peered":"2023-12-13T00:00:30.005740+0000","last_unstale":"2023-12-13T00:00:59.460369+0000","last_undegraded":"2023-12-13T00:00:59.460369+0000","last_fullsized":"2023-12-13T00:00:59.460369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:03:55.109283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462647+0000","last_change":"2023-12-13T00:00:35.666041+0000","last_active":"2023-12-13T00:00:59.462647+0000","last_peered":"2023-12-13T00:00:59.462647+0000","last_clean":"2023-12-13T00:00:59.462647+0000","last_became_active":"2023-12-13T00:00:35.665670+0000","last_became_peered":"2023-12-13T00:00:35.665670+0000","last_unstale":"2023-12-13T00:00:59.462647+0000","last_undegraded":"2023-12-13T00:00:59.462647+0000","last_fullsized":"2023-12-13T00:00:59.462647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:10.984025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462081+0000","last_change":"2023-12-13T00:00:31.146677+0000","last_active":"2023-12-13T00:00:59.462081+0000","last_peered":"2023-12-13T00:00:59.462081+0000","last_clean":"2023-12-13T00:00:59.462081+0000","last_became_active":"2023-12-13T00:00:31.146435+0000","last_became_peered":"2023-12-13T00:00:31.146435+0000","last_unstale":"2023-12-13T00:00:59.462081+0000","last_undegraded":"2023-12-13T00:00:59.462081+0000","last_fullsized":"2023-12-13T00:00:59.462081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:32:52.059012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458705+0000","last_change":"2023-12-13T00:00:30.006240+0000","last_active":"2023-12-13T00:00:59.458705+0000","last_peered":"2023-12-13T00:00:59.458705+0000","last_clean":"2023-12-13T00:00:59.458705+0000","last_became_active":"2023-12-13T00:00:30.005909+0000","last_became_peered":"2023-12-13T00:00:30.005909+0000","last_unstale":"2023-12-13T00:00:59.458705+0000","last_undegraded":"2023-12-13T00:00:59.458705+0000","last_fullsized":"2023-12-13T00:00:59.458705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:59:20.687032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462982+0000","last_change":"2023-12-13T00:00:35.665918+0000","last_active":"2023-12-13T00:00:59.462982+0000","last_peered":"2023-12-13T00:00:59.462982+0000","last_clean":"2023-12-13T00:00:59.462982+0000","last_became_active":"2023-12-13T00:00:35.665521+0000","last_became_peered":"2023-12-13T00:00:35.665521+0000","last_unstale":"2023-12-13T00:00:59.462982+0000","last_undegraded":"2023-12-13T00:00:59.462982+0000","last_fullsized":"2023-12-13T00:00:59.462982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:05.461575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462472+0000","last_change":"2023-12-13T00:00:31.145392+0000","last_active":"2023-12-13T00:00:59.462472+0000","last_peered":"2023-12-13T00:00:59.462472+0000","last_clean":"2023-12-13T00:00:59.462472+0000","last_became_active":"2023-12-13T00:00:31.145115+0000","last_became_peered":"2023-12-13T00:00:31.145115+0000","last_unstale":"2023-12-13T00:00:59.462472+0000","last_undegraded":"2023-12-13T00:00:59.462472+0000","last_fullsized":"2023-12-13T00:00:59.462472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:15.201991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462257+0000","last_change":"2023-12-13T00:00:30.006295+0000","last_active":"2023-12-13T00:00:59.462257+0000","last_peered":"2023-12-13T00:00:59.462257+0000","last_clean":"2023-12-13T00:00:59.462257+0000","last_became_active":"2023-12-13T00:00:30.005988+0000","last_became_peered":"2023-12-13T00:00:30.005988+0000","last_unstale":"2023-12-13T00:00:59.462257+0000","last_undegraded":"2023-12-13T00:00:59.462257+0000","last_fullsized":"2023-12-13T00:00:59.462257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:15:15.243155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461393+0000","last_change":"2023-12-13T00:00:35.662996+0000","last_active":"2023-12-13T00:00:59.461393+0000","last_peered":"2023-12-13T00:00:59.461393+0000","last_clean":"2023-12-13T00:00:59.461393+0000","last_became_active":"2023-12-13T00:00:35.662612+0000","last_became_peered":"2023-12-13T00:00:35.662612+0000","last_unstale":"2023-12-13T00:00:59.461393+0000","last_undegraded":"2023-12-13T00:00:59.461393+0000","last_fullsized":"2023-12-13T00:00:59.461393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:58.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463941+0000","last_change":"2023-12-13T00:00:31.118054+0000","last_active":"2023-12-13T00:00:59.463941+0000","last_peered":"2023-12-13T00:00:59.463941+0000","last_clean":"2023-12-13T00:00:59.463941+0000","last_became_active":"2023-12-13T00:00:31.117814+0000","last_became_peered":"2023-12-13T00:00:31.117814+0000","last_unstale":"2023-12-13T00:00:59.463941+0000","last_undegraded":"2023-12-13T00:00:59.463941+0000","last_fullsized":"2023-12-13T00:00:59.463941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:15.201991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458862+0000","last_change":"2023-12-13T00:00:30.001001+0000","last_active":"2023-12-13T00:00:59.458862+0000","last_peered":"2023-12-13T00:00:59.458862+0000","last_clean":"2023-12-13T00:00:59.458862+0000","last_became_active":"2023-12-13T00:00:30.000755+0000","last_became_peered":"2023-12-13T00:00:30.000755+0000","last_unstale":"2023-12-13T00:00:59.458862+0000","last_undegraded":"2023-12-13T00:00:59.458862+0000","last_fullsized":"2023-12-13T00:00:59.458862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:02:11.314721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.545340+0000","last_change":"2023-12-13T00:01:00.545340+0000","last_active":"2023-12-13T00:01:00.545340+0000","last_peered":"2023-12-13T00:01:00.545340+0000","last_clean":"2023-12-13T00:01:00.545340+0000","last_became_active":"2023-12-13T00:01:00.544906+0000","last_became_peered":"2023-12-13T00:01:00.544906+0000","last_unstale":"2023-12-13T00:01:00.545340+0000","last_undegraded":"2023-12-13T00:01:00.545340+0000","last_fullsized":"2023-12-13T00:01:00.545340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:44:27.993144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,5],"acting":[6,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462448+0000","last_change":"2023-12-13T00:00:31.143429+0000","last_active":"2023-12-13T00:00:59.462448+0000","last_peered":"2023-12-13T00:00:59.462448+0000","last_clean":"2023-12-13T00:00:59.462448+0000","last_became_active":"2023-12-13T00:00:31.143182+0000","last_became_peered":"2023-12-13T00:00:31.143182+0000","last_unstale":"2023-12-13T00:00:59.462448+0000","last_undegraded":"2023-12-13T00:00:59.462448+0000","last_fullsized":"2023-12-13T00:00:59.462448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:09:34.339195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465302+0000","last_change":"2023-12-13T00:00:29.969160+0000","last_active":"2023-12-13T00:00:59.465302+0000","last_peered":"2023-12-13T00:00:59.465302+0000","last_clean":"2023-12-13T00:00:59.465302+0000","last_became_active":"2023-12-13T00:00:29.968860+0000","last_became_peered":"2023-12-13T00:00:29.968860+0000","last_unstale":"2023-12-13T00:00:59.465302+0000","last_undegraded":"2023-12-13T00:00:59.465302+0000","last_fullsized":"2023-12-13T00:00:59.465302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:42:13.602889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463519+0000","last_change":"2023-12-13T00:00:35.642597+0000","last_active":"2023-12-13T00:00:59.463519+0000","last_peered":"2023-12-13T00:00:59.463519+0000","last_clean":"2023-12-13T00:00:59.463519+0000","last_became_active":"2023-12-13T00:00:35.642215+0000","last_became_peered":"2023-12-13T00:00:35.642215+0000","last_unstale":"2023-12-13T00:00:59.463519+0000","last_undegraded":"2023-12-13T00:00:59.463519+0000","last_fullsized":"2023-12-13T00:00:59.463519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:54:48.007993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460583+0000","last_change":"2023-12-13T00:00:31.149832+0000","last_active":"2023-12-13T00:00:59.460583+0000","last_peered":"2023-12-13T00:00:59.460583+0000","last_clean":"2023-12-13T00:00:59.460583+0000","last_became_active":"2023-12-13T00:00:31.149587+0000","last_became_peered":"2023-12-13T00:00:31.149587+0000","last_unstale":"2023-12-13T00:00:59.460583+0000","last_undegraded":"2023-12-13T00:00:59.460583+0000","last_fullsized":"2023-12-13T00:00:59.460583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:00.910594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459235+0000","last_change":"2023-12-13T00:00:29.998103+0000","last_active":"2023-12-13T00:00:59.459235+0000","last_peered":"2023-12-13T00:00:59.459235+0000","last_clean":"2023-12-13T00:00:59.459235+0000","last_became_active":"2023-12-13T00:00:29.997848+0000","last_became_peered":"2023-12-13T00:00:29.997848+0000","last_unstale":"2023-12-13T00:00:59.459235+0000","last_undegraded":"2023-12-13T00:00:59.459235+0000","last_fullsized":"2023-12-13T00:00:59.459235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:52:58.951228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463768+0000","last_change":"2023-12-13T00:00:35.652104+0000","last_active":"2023-12-13T00:00:59.463768+0000","last_peered":"2023-12-13T00:00:59.463768+0000","last_clean":"2023-12-13T00:00:59.463768+0000","last_became_active":"2023-12-13T00:00:35.651766+0000","last_became_peered":"2023-12-13T00:00:35.651766+0000","last_unstale":"2023-12-13T00:00:59.463768+0000","last_undegraded":"2023-12-13T00:00:59.463768+0000","last_fullsized":"2023-12-13T00:00:59.463768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:08:10.211533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465392+0000","last_change":"2023-12-13T00:00:31.120580+0000","last_active":"2023-12-13T00:00:59.465392+0000","last_peered":"2023-12-13T00:00:59.465392+0000","last_clean":"2023-12-13T00:00:59.465392+0000","last_became_active":"2023-12-13T00:00:31.120330+0000","last_became_peered":"2023-12-13T00:00:31.120330+0000","last_unstale":"2023-12-13T00:00:59.465392+0000","last_undegraded":"2023-12-13T00:00:59.465392+0000","last_fullsized":"2023-12-13T00:00:59.465392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:04:30.356287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461518+0000","last_change":"2023-12-13T00:00:30.000752+0000","last_active":"2023-12-13T00:00:59.461518+0000","last_peered":"2023-12-13T00:00:59.461518+0000","last_clean":"2023-12-13T00:00:59.461518+0000","last_became_active":"2023-12-13T00:00:30.000015+0000","last_became_peered":"2023-12-13T00:00:30.000015+0000","last_unstale":"2023-12-13T00:00:59.461518+0000","last_undegraded":"2023-12-13T00:00:59.461518+0000","last_fullsized":"2023-12-13T00:00:59.461518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:20:46.566684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463425+0000","last_change":"2023-12-13T00:00:35.667415+0000","last_active":"2023-12-13T00:00:59.463425+0000","last_peered":"2023-12-13T00:00:59.463425+0000","last_clean":"2023-12-13T00:00:59.463425+0000","last_became_active":"2023-12-13T00:00:35.667028+0000","last_became_peered":"2023-12-13T00:00:35.667028+0000","last_unstale":"2023-12-13T00:00:59.463425+0000","last_undegraded":"2023-12-13T00:00:59.463425+0000","last_fullsized":"2023-12-13T00:00:59.463425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:58.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.464043+0000","last_change":"2023-12-13T00:00:31.140853+0000","last_active":"2023-12-13T00:00:59.464043+0000","last_peered":"2023-12-13T00:00:59.464043+0000","last_clean":"2023-12-13T00:00:59.464043+0000","last_became_active":"2023-12-13T00:00:31.140597+0000","last_became_peered":"2023-12-13T00:00:31.140597+0000","last_unstale":"2023-12-13T00:00:59.464043+0000","last_undegraded":"2023-12-13T00:00:59.464043+0000","last_fullsized":"2023-12-13T00:00:59.464043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:13.923453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457435+0000","last_change":"2023-12-13T00:00:29.998765+0000","last_active":"2023-12-13T00:00:59.457435+0000","last_peered":"2023-12-13T00:00:59.457435+0000","last_clean":"2023-12-13T00:00:59.457435+0000","last_became_active":"2023-12-13T00:00:29.998552+0000","last_became_peered":"2023-12-13T00:00:29.998552+0000","last_unstale":"2023-12-13T00:00:59.457435+0000","last_undegraded":"2023-12-13T00:00:59.457435+0000","last_fullsized":"2023-12-13T00:00:59.457435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:54:42.351946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465621+0000","last_change":"2023-12-13T00:00:35.666575+0000","last_active":"2023-12-13T00:00:59.465621+0000","last_peered":"2023-12-13T00:00:59.465621+0000","last_clean":"2023-12-13T00:00:59.465621+0000","last_became_active":"2023-12-13T00:00:35.666135+0000","last_became_peered":"2023-12-13T00:00:35.666135+0000","last_unstale":"2023-12-13T00:00:59.465621+0000","last_undegraded":"2023-12-13T00:00:59.465621+0000","last_fullsized":"2023-12-13T00:00:59.465621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:02:03.031651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462174+0000","last_change":"2023-12-13T00:00:31.148698+0000","last_active":"2023-12-13T00:00:59.462174+0000","last_peered":"2023-12-13T00:00:59.462174+0000","last_clean":"2023-12-13T00:00:59.462174+0000","last_became_active":"2023-12-13T00:00:31.148421+0000","last_became_peered":"2023-12-13T00:00:31.148421+0000","last_unstale":"2023-12-13T00:00:59.462174+0000","last_undegraded":"2023-12-13T00:00:59.462174+0000","last_fullsized":"2023-12-13T00:00:59.462174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:53:00.056294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459132+0000","last_change":"2023-12-13T00:00:30.001220+0000","last_active":"2023-12-13T00:00:59.459132+0000","last_peered":"2023-12-13T00:00:59.459132+0000","last_clean":"2023-12-13T00:00:59.459132+0000","last_became_active":"2023-12-13T00:00:30.000854+0000","last_became_peered":"2023-12-13T00:00:30.000854+0000","last_unstale":"2023-12-13T00:00:59.459132+0000","last_undegraded":"2023-12-13T00:00:59.459132+0000","last_fullsized":"2023-12-13T00:00:59.459132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:50:11.243011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456321+0000","last_change":"2023-12-13T00:00:08.575071+0000","last_active":"2023-12-13T00:00:59.456321+0000","last_peered":"2023-12-13T00:00:59.456321+0000","last_clean":"2023-12-13T00:00:59.456321+0000","last_became_active":"2023-12-13T00:00:08.574464+0000","last_became_peered":"2023-12-13T00:00:08.574464+0000","last_unstale":"2023-12-13T00:00:59.456321+0000","last_undegraded":"2023-12-13T00:00:59.456321+0000","last_fullsized":"2023-12-13T00:00:59.456321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:07.226606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:07.226606+0000","last_clean_scrub_stamp":"2023-12-13T00:00:07.226606+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:51:39.168480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458245+0000","last_change":"2023-12-13T00:00:35.661806+0000","last_active":"2023-12-13T00:00:59.458245+0000","last_peered":"2023-12-13T00:00:59.458245+0000","last_clean":"2023-12-13T00:00:59.458245+0000","last_became_active":"2023-12-13T00:00:35.660976+0000","last_became_peered":"2023-12-13T00:00:35.660976+0000","last_unstale":"2023-12-13T00:00:59.458245+0000","last_undegraded":"2023-12-13T00:00:59.458245+0000","last_fullsized":"2023-12-13T00:00:59.458245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:04:57.617925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458767+0000","last_change":"2023-12-13T00:00:31.036383+0000","last_active":"2023-12-13T00:00:59.458767+0000","last_peered":"2023-12-13T00:00:59.458767+0000","last_clean":"2023-12-13T00:00:59.458767+0000","last_became_active":"2023-12-13T00:00:31.036127+0000","last_became_peered":"2023-12-13T00:00:31.036127+0000","last_unstale":"2023-12-13T00:00:59.458767+0000","last_undegraded":"2023-12-13T00:00:59.458767+0000","last_fullsized":"2023-12-13T00:00:59.458767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:12:16.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.464525+0000","last_change":"2023-12-13T00:00:30.006258+0000","last_active":"2023-12-13T00:00:59.464525+0000","last_peered":"2023-12-13T00:00:59.464525+0000","last_clean":"2023-12-13T00:00:59.464525+0000","last_became_active":"2023-12-13T00:00:30.005943+0000","last_became_peered":"2023-12-13T00:00:30.005943+0000","last_unstale":"2023-12-13T00:00:59.464525+0000","last_undegraded":"2023-12-13T00:00:59.464525+0000","last_fullsized":"2023-12-13T00:00:59.464525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:52:45.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461955+0000","last_change":"2023-12-13T00:00:35.665140+0000","last_active":"2023-12-13T00:00:59.461955+0000","last_peered":"2023-12-13T00:00:59.461955+0000","last_clean":"2023-12-13T00:00:59.461955+0000","last_became_active":"2023-12-13T00:00:35.664071+0000","last_became_peered":"2023-12-13T00:00:35.664071+0000","last_unstale":"2023-12-13T00:00:59.461955+0000","last_undegraded":"2023-12-13T00:00:59.461955+0000","last_fullsized":"2023-12-13T00:00:59.461955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:06:01.427574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460927+0000","last_change":"2023-12-13T00:00:31.147760+0000","last_active":"2023-12-13T00:00:59.460927+0000","last_peered":"2023-12-13T00:00:59.460927+0000","last_clean":"2023-12-13T00:00:59.460927+0000","last_became_active":"2023-12-13T00:00:31.147523+0000","last_became_peered":"2023-12-13T00:00:31.147523+0000","last_unstale":"2023-12-13T00:00:59.460927+0000","last_undegraded":"2023-12-13T00:00:59.460927+0000","last_fullsized":"2023-12-13T00:00:59.460927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:56:28.188041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465526+0000","last_change":"2023-12-13T00:00:30.002705+0000","last_active":"2023-12-13T00:00:59.465526+0000","last_peered":"2023-12-13T00:00:59.465526+0000","last_clean":"2023-12-13T00:00:59.465526+0000","last_became_active":"2023-12-13T00:00:30.002427+0000","last_became_peered":"2023-12-13T00:00:30.002427+0000","last_unstale":"2023-12-13T00:00:59.465526+0000","last_undegraded":"2023-12-13T00:00:59.465526+0000","last_fullsized":"2023-12-13T00:00:59.465526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:06:37.325239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465997+0000","last_change":"2023-12-13T00:00:35.661309+0000","last_active":"2023-12-13T00:00:59.465997+0000","last_peered":"2023-12-13T00:00:59.465997+0000","last_clean":"2023-12-13T00:00:59.465997+0000","last_became_active":"2023-12-13T00:00:35.660939+0000","last_became_peered":"2023-12-13T00:00:35.660939+0000","last_unstale":"2023-12-13T00:00:59.465997+0000","last_undegraded":"2023-12-13T00:00:59.465997+0000","last_fullsized":"2023-12-13T00:00:59.465997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:49:19.372464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459530+0000","last_change":"2023-12-13T00:00:31.146265+0000","last_active":"2023-12-13T00:00:59.459530+0000","last_peered":"2023-12-13T00:00:59.459530+0000","last_clean":"2023-12-13T00:00:59.459530+0000","last_became_active":"2023-12-13T00:00:31.145997+0000","last_became_peered":"2023-12-13T00:00:31.145997+0000","last_unstale":"2023-12-13T00:00:59.459530+0000","last_undegraded":"2023-12-13T00:00:59.459530+0000","last_fullsized":"2023-12-13T00:00:59.459530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:53:32.846210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462169+0000","last_change":"2023-12-13T00:00:29.968222+0000","last_active":"2023-12-13T00:00:59.462169+0000","last_peered":"2023-12-13T00:00:59.462169+0000","last_clean":"2023-12-13T00:00:59.462169+0000","last_became_active":"2023-12-13T00:00:29.967916+0000","last_became_peered":"2023-12-13T00:00:29.967916+0000","last_unstale":"2023-12-13T00:00:59.462169+0000","last_undegraded":"2023-12-13T00:00:59.462169+0000","last_fullsized":"2023-12-13T00:00:59.462169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:12.818387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457105+0000","last_change":"2023-12-13T00:00:35.667745+0000","last_active":"2023-12-13T00:00:59.457105+0000","last_peered":"2023-12-13T00:00:59.457105+0000","last_clean":"2023-12-13T00:00:59.457105+0000","last_became_active":"2023-12-13T00:00:35.666891+0000","last_became_peered":"2023-12-13T00:00:35.666891+0000","last_unstale":"2023-12-13T00:00:59.457105+0000","last_undegraded":"2023-12-13T00:00:59.457105+0000","last_fullsized":"2023-12-13T00:00:59.457105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:30:53.285154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462868+0000","last_change":"2023-12-13T00:00:31.148279+0000","last_active":"2023-12-13T00:00:59.462868+0000","last_peered":"2023-12-13T00:00:59.462868+0000","last_clean":"2023-12-13T00:00:59.462868+0000","last_became_active":"2023-12-13T00:00:31.148016+0000","last_became_peered":"2023-12-13T00:00:31.148016+0000","last_unstale":"2023-12-13T00:00:59.462868+0000","last_undegraded":"2023-12-13T00:00:59.462868+0000","last_fullsized":"2023-12-13T00:00:59.462868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:37:40.762676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459753+0000","last_change":"2023-12-13T00:00:30.008152+0000","last_active":"2023-12-13T00:00:59.459753+0000","last_peered":"2023-12-13T00:00:59.459753+0000","last_clean":"2023-12-13T00:00:59.459753+0000","last_became_active":"2023-12-13T00:00:30.007907+0000","last_became_peered":"2023-12-13T00:00:30.007907+0000","last_unstale":"2023-12-13T00:00:59.459753+0000","last_undegraded":"2023-12-13T00:00:59.459753+0000","last_fullsized":"2023-12-13T00:00:59.459753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:46:40.001298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456332+0000","last_change":"2023-12-13T00:00:35.660971+0000","last_active":"2023-12-13T00:00:59.456332+0000","last_peered":"2023-12-13T00:00:59.456332+0000","last_clean":"2023-12-13T00:00:59.456332+0000","last_became_active":"2023-12-13T00:00:35.660627+0000","last_became_peered":"2023-12-13T00:00:35.660627+0000","last_unstale":"2023-12-13T00:00:59.456332+0000","last_undegraded":"2023-12-13T00:00:59.456332+0000","last_fullsized":"2023-12-13T00:00:59.456332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:18.474434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457469+0000","last_change":"2023-12-13T00:00:31.142437+0000","last_active":"2023-12-13T00:00:59.457469+0000","last_peered":"2023-12-13T00:00:59.457469+0000","last_clean":"2023-12-13T00:00:59.457469+0000","last_became_active":"2023-12-13T00:00:31.142150+0000","last_became_peered":"2023-12-13T00:00:31.142150+0000","last_unstale":"2023-12-13T00:00:59.457469+0000","last_undegraded":"2023-12-13T00:00:59.457469+0000","last_fullsized":"2023-12-13T00:00:59.457469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:10:54.020587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461595+0000","last_change":"2023-12-13T00:00:30.000646+0000","last_active":"2023-12-13T00:00:59.461595+0000","last_peered":"2023-12-13T00:00:59.461595+0000","last_clean":"2023-12-13T00:00:59.461595+0000","last_became_active":"2023-12-13T00:00:30.000388+0000","last_became_peered":"2023-12-13T00:00:30.000388+0000","last_unstale":"2023-12-13T00:00:59.461595+0000","last_undegraded":"2023-12-13T00:00:59.461595+0000","last_fullsized":"2023-12-13T00:00:59.461595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:07.704455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465717+0000","last_change":"2023-12-13T00:00:35.666659+0000","last_active":"2023-12-13T00:00:59.465717+0000","last_peered":"2023-12-13T00:00:59.465717+0000","last_clean":"2023-12-13T00:00:59.465717+0000","last_became_active":"2023-12-13T00:00:35.666304+0000","last_became_peered":"2023-12-13T00:00:35.666304+0000","last_unstale":"2023-12-13T00:00:59.465717+0000","last_undegraded":"2023-12-13T00:00:59.465717+0000","last_fullsized":"2023-12-13T00:00:59.465717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:35:49.956369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456174+0000","last_change":"2023-12-13T00:00:31.037568+0000","last_active":"2023-12-13T00:00:59.456174+0000","last_peered":"2023-12-13T00:00:59.456174+0000","last_clean":"2023-12-13T00:00:59.456174+0000","last_became_active":"2023-12-13T00:00:31.037398+0000","last_became_peered":"2023-12-13T00:00:31.037398+0000","last_unstale":"2023-12-13T00:00:59.456174+0000","last_undegraded":"2023-12-13T00:00:59.456174+0000","last_fullsized":"2023-12-13T00:00:59.456174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:08.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459763+0000","last_change":"2023-12-13T00:00:30.006086+0000","last_active":"2023-12-13T00:00:59.459763+0000","last_peered":"2023-12-13T00:00:59.459763+0000","last_clean":"2023-12-13T00:00:59.459763+0000","last_became_active":"2023-12-13T00:00:30.005752+0000","last_became_peered":"2023-12-13T00:00:30.005752+0000","last_unstale":"2023-12-13T00:00:59.459763+0000","last_undegraded":"2023-12-13T00:00:59.459763+0000","last_fullsized":"2023-12-13T00:00:59.459763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:06:37.325239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465548+0000","last_change":"2023-12-13T00:00:35.666467+0000","last_active":"2023-12-13T00:00:59.465548+0000","last_peered":"2023-12-13T00:00:59.465548+0000","last_clean":"2023-12-13T00:00:59.465548+0000","last_became_active":"2023-12-13T00:00:35.666061+0000","last_became_peered":"2023-12-13T00:00:35.666061+0000","last_unstale":"2023-12-13T00:00:59.465548+0000","last_undegraded":"2023-12-13T00:00:59.465548+0000","last_fullsized":"2023-12-13T00:00:59.465548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:19:16.858246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.702387+0000","last_change":"2023-12-13T00:01:00.702387+0000","last_active":"2023-12-13T00:01:00.702387+0000","last_peered":"2023-12-13T00:01:00.702387+0000","last_clean":"2023-12-13T00:01:00.702387+0000","last_became_active":"2023-12-13T00:01:00.702089+0000","last_became_peered":"2023-12-13T00:01:00.702089+0000","last_unstale":"2023-12-13T00:01:00.702387+0000","last_undegraded":"2023-12-13T00:01:00.702387+0000","last_fullsized":"2023-12-13T00:01:00.702387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:48:49.380742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459150+0000","last_change":"2023-12-13T00:00:30.001171+0000","last_active":"2023-12-13T00:00:59.459150+0000","last_peered":"2023-12-13T00:00:59.459150+0000","last_clean":"2023-12-13T00:00:59.459150+0000","last_became_active":"2023-12-13T00:00:30.000803+0000","last_became_peered":"2023-12-13T00:00:30.000803+0000","last_unstale":"2023-12-13T00:00:59.459150+0000","last_undegraded":"2023-12-13T00:00:59.459150+0000","last_fullsized":"2023-12-13T00:00:59.459150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:19.012092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463671+0000","last_change":"2023-12-13T00:00:35.649561+0000","last_active":"2023-12-13T00:00:59.463671+0000","last_peered":"2023-12-13T00:00:59.463671+0000","last_clean":"2023-12-13T00:00:59.463671+0000","last_became_active":"2023-12-13T00:00:35.649151+0000","last_became_peered":"2023-12-13T00:00:35.649151+0000","last_unstale":"2023-12-13T00:00:59.463671+0000","last_undegraded":"2023-12-13T00:00:59.463671+0000","last_fullsized":"2023-12-13T00:00:59.463671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:06:34.023899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463669+0000","last_change":"2023-12-13T00:00:31.116002+0000","last_active":"2023-12-13T00:00:59.463669+0000","last_peered":"2023-12-13T00:00:59.463669+0000","last_clean":"2023-12-13T00:00:59.463669+0000","last_became_active":"2023-12-13T00:00:31.115678+0000","last_became_peered":"2023-12-13T00:00:31.115678+0000","last_unstale":"2023-12-13T00:00:59.463669+0000","last_undegraded":"2023-12-13T00:00:59.463669+0000","last_fullsized":"2023-12-13T00:00:59.463669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:21:51.967408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463370+0000","last_change":"2023-12-13T00:00:30.004329+0000","last_active":"2023-12-13T00:00:59.463370+0000","last_peered":"2023-12-13T00:00:59.463370+0000","last_clean":"2023-12-13T00:00:59.463370+0000","last_became_active":"2023-12-13T00:00:30.004089+0000","last_became_peered":"2023-12-13T00:00:30.004089+0000","last_unstale":"2023-12-13T00:00:59.463370+0000","last_undegraded":"2023-12-13T00:00:59.463370+0000","last_fullsized":"2023-12-13T00:00:59.463370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:05:04.403249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457886+0000","last_change":"2023-12-13T00:00:35.652272+0000","last_active":"2023-12-13T00:00:59.457886+0000","last_peered":"2023-12-13T00:00:59.457886+0000","last_clean":"2023-12-13T00:00:59.457886+0000","last_became_active":"2023-12-13T00:00:35.651907+0000","last_became_peered":"2023-12-13T00:00:35.651907+0000","last_unstale":"2023-12-13T00:00:59.457886+0000","last_undegraded":"2023-12-13T00:00:59.457886+0000","last_fullsized":"2023-12-13T00:00:59.457886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:15:01.873129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461182+0000","last_change":"2023-12-13T00:00:31.148754+0000","last_active":"2023-12-13T00:00:59.461182+0000","last_peered":"2023-12-13T00:00:59.461182+0000","last_clean":"2023-12-13T00:00:59.461182+0000","last_became_active":"2023-12-13T00:00:31.147846+0000","last_became_peered":"2023-12-13T00:00:31.147846+0000","last_unstale":"2023-12-13T00:00:59.461182+0000","last_undegraded":"2023-12-13T00:00:59.461182+0000","last_fullsized":"2023-12-13T00:00:59.461182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:39:59.955103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462295+0000","last_change":"2023-12-13T00:00:30.001703+0000","last_active":"2023-12-13T00:00:59.462295+0000","last_peered":"2023-12-13T00:00:59.462295+0000","last_clean":"2023-12-13T00:00:59.462295+0000","last_became_active":"2023-12-13T00:00:30.001420+0000","last_became_peered":"2023-12-13T00:00:30.001420+0000","last_unstale":"2023-12-13T00:00:59.462295+0000","last_undegraded":"2023-12-13T00:00:59.462295+0000","last_fullsized":"2023-12-13T00:00:59.462295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:02:06.211723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.546607+0000","last_change":"2023-12-13T00:01:00.546607+0000","last_active":"2023-12-13T00:01:00.546607+0000","last_peered":"2023-12-13T00:01:00.546607+0000","last_clean":"2023-12-13T00:01:00.546607+0000","last_became_active":"2023-12-13T00:01:00.546264+0000","last_became_peered":"2023-12-13T00:01:00.546264+0000","last_unstale":"2023-12-13T00:01:00.546607+0000","last_undegraded":"2023-12-13T00:01:00.546607+0000","last_fullsized":"2023-12-13T00:01:00.546607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:12:57.696627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457889+0000","last_change":"2023-12-13T00:00:31.138998+0000","last_active":"2023-12-13T00:00:59.457889+0000","last_peered":"2023-12-13T00:00:59.457889+0000","last_clean":"2023-12-13T00:00:59.457889+0000","last_became_active":"2023-12-13T00:00:31.138723+0000","last_became_peered":"2023-12-13T00:00:31.138723+0000","last_unstale":"2023-12-13T00:00:59.457889+0000","last_undegraded":"2023-12-13T00:00:59.457889+0000","last_fullsized":"2023-12-13T00:00:59.457889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:24:05.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461871+0000","last_change":"2023-12-13T00:00:30.003079+0000","last_active":"2023-12-13T00:00:59.461871+0000","last_peered":"2023-12-13T00:00:59.461871+0000","last_clean":"2023-12-13T00:00:59.461871+0000","last_became_active":"2023-12-13T00:00:30.002823+0000","last_became_peered":"2023-12-13T00:00:30.002823+0000","last_unstale":"2023-12-13T00:00:59.461871+0000","last_undegraded":"2023-12-13T00:00:59.461871+0000","last_fullsized":"2023-12-13T00:00:59.461871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:07.829448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.697705+0000","last_change":"2023-12-13T00:01:00.697705+0000","last_active":"2023-12-13T00:01:00.697705+0000","last_peered":"2023-12-13T00:01:00.697705+0000","last_clean":"2023-12-13T00:01:00.697705+0000","last_became_active":"2023-12-13T00:01:00.697231+0000","last_became_peered":"2023-12-13T00:01:00.697231+0000","last_unstale":"2023-12-13T00:01:00.697705+0000","last_undegraded":"2023-12-13T00:01:00.697705+0000","last_fullsized":"2023-12-13T00:01:00.697705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:54:04.994059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465742+0000","last_change":"2023-12-13T00:00:31.027503+0000","last_active":"2023-12-13T00:00:59.465742+0000","last_peered":"2023-12-13T00:00:59.465742+0000","last_clean":"2023-12-13T00:00:59.465742+0000","last_became_active":"2023-12-13T00:00:31.027239+0000","last_became_peered":"2023-12-13T00:00:31.027239+0000","last_unstale":"2023-12-13T00:00:59.465742+0000","last_undegraded":"2023-12-13T00:00:59.465742+0000","last_fullsized":"2023-12-13T00:00:59.465742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:50:58.339436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461192+0000","last_change":"2023-12-13T00:00:30.009592+0000","last_active":"2023-12-13T00:00:59.461192+0000","last_peered":"2023-12-13T00:00:59.461192+0000","last_clean":"2023-12-13T00:00:59.461192+0000","last_became_active":"2023-12-13T00:00:30.009351+0000","last_became_peered":"2023-12-13T00:00:30.009351+0000","last_unstale":"2023-12-13T00:00:59.461192+0000","last_undegraded":"2023-12-13T00:00:59.461192+0000","last_fullsized":"2023-12-13T00:00:59.461192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:46:22.716022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.720435+0000","last_change":"2023-12-13T00:01:00.717446+0000","last_active":"2023-12-13T00:01:00.720435+0000","last_peered":"2023-12-13T00:01:00.720435+0000","last_clean":"2023-12-13T00:01:00.720435+0000","last_became_active":"2023-12-13T00:01:00.717019+0000","last_became_peered":"2023-12-13T00:01:00.717019+0000","last_unstale":"2023-12-13T00:01:00.720435+0000","last_undegraded":"2023-12-13T00:01:00.720435+0000","last_fullsized":"2023-12-13T00:01:00.720435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:22:05.566928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462796+0000","last_change":"2023-12-13T00:00:31.139946+0000","last_active":"2023-12-13T00:00:59.462796+0000","last_peered":"2023-12-13T00:00:59.462796+0000","last_clean":"2023-12-13T00:00:59.462796+0000","last_became_active":"2023-12-13T00:00:31.139656+0000","last_became_peered":"2023-12-13T00:00:31.139656+0000","last_unstale":"2023-12-13T00:00:59.462796+0000","last_undegraded":"2023-12-13T00:00:59.462796+0000","last_fullsized":"2023-12-13T00:00:59.462796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:13:39.042325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458675+0000","last_change":"2023-12-13T00:00:30.003511+0000","last_active":"2023-12-13T00:00:59.458675+0000","last_peered":"2023-12-13T00:00:59.458675+0000","last_clean":"2023-12-13T00:00:59.458675+0000","last_became_active":"2023-12-13T00:00:30.002630+0000","last_became_peered":"2023-12-13T00:00:30.002630+0000","last_unstale":"2023-12-13T00:00:59.458675+0000","last_undegraded":"2023-12-13T00:00:59.458675+0000","last_fullsized":"2023-12-13T00:00:59.458675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:58:21.724544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462429+0000","last_change":"2023-12-13T00:00:35.649725+0000","last_active":"2023-12-13T00:00:59.462429+0000","last_peered":"2023-12-13T00:00:59.462429+0000","last_clean":"2023-12-13T00:00:59.462429+0000","last_became_active":"2023-12-13T00:00:35.649401+0000","last_became_peered":"2023-12-13T00:00:35.649401+0000","last_unstale":"2023-12-13T00:00:59.462429+0000","last_undegraded":"2023-12-13T00:00:59.462429+0000","last_fullsized":"2023-12-13T00:00:59.462429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:56:09.136979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462981+0000","last_change":"2023-12-13T00:00:35.662790+0000","last_active":"2023-12-13T00:00:59.462981+0000","last_peered":"2023-12-13T00:00:59.462981+0000","last_clean":"2023-12-13T00:00:59.462981+0000","last_became_active":"2023-12-13T00:00:35.662406+0000","last_became_peered":"2023-12-13T00:00:35.662406+0000","last_unstale":"2023-12-13T00:00:59.462981+0000","last_undegraded":"2023-12-13T00:00:59.462981+0000","last_fullsized":"2023-12-13T00:00:59.462981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:10:58.571569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462513+0000","last_change":"2023-12-13T00:00:31.143141+0000","last_active":"2023-12-13T00:00:59.462513+0000","last_peered":"2023-12-13T00:00:59.462513+0000","last_clean":"2023-12-13T00:00:59.462513+0000","last_became_active":"2023-12-13T00:00:31.142823+0000","last_became_peered":"2023-12-13T00:00:31.142823+0000","last_unstale":"2023-12-13T00:00:59.462513+0000","last_undegraded":"2023-12-13T00:00:59.462513+0000","last_fullsized":"2023-12-13T00:00:59.462513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:22:51.335464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457357+0000","last_change":"2023-12-13T00:00:30.004773+0000","last_active":"2023-12-13T00:00:59.457357+0000","last_peered":"2023-12-13T00:00:59.457357+0000","last_clean":"2023-12-13T00:00:59.457357+0000","last_became_active":"2023-12-13T00:00:30.004496+0000","last_became_peered":"2023-12-13T00:00:30.004496+0000","last_unstale":"2023-12-13T00:00:59.457357+0000","last_undegraded":"2023-12-13T00:00:59.457357+0000","last_fullsized":"2023-12-13T00:00:59.457357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:51:20.708568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457933+0000","last_change":"2023-12-13T00:00:35.666457+0000","last_active":"2023-12-13T00:00:59.457933+0000","last_peered":"2023-12-13T00:00:59.457933+0000","last_clean":"2023-12-13T00:00:59.457933+0000","last_became_active":"2023-12-13T00:00:35.666075+0000","last_became_peered":"2023-12-13T00:00:35.666075+0000","last_unstale":"2023-12-13T00:00:59.457933+0000","last_undegraded":"2023-12-13T00:00:59.457933+0000","last_fullsized":"2023-12-13T00:00:59.457933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:18:38.741479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465799+0000","last_change":"2023-12-13T00:00:31.116511+0000","last_active":"2023-12-13T00:00:59.465799+0000","last_peered":"2023-12-13T00:00:59.465799+0000","last_clean":"2023-12-13T00:00:59.465799+0000","last_became_active":"2023-12-13T00:00:31.116209+0000","last_became_peered":"2023-12-13T00:00:31.116209+0000","last_unstale":"2023-12-13T00:00:59.465799+0000","last_undegraded":"2023-12-13T00:00:59.465799+0000","last_fullsized":"2023-12-13T00:00:59.465799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:06.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.464752+0000","last_change":"2023-12-13T00:00:30.006475+0000","last_active":"2023-12-13T00:00:59.464752+0000","last_peered":"2023-12-13T00:00:59.464752+0000","last_clean":"2023-12-13T00:00:59.464752+0000","last_became_active":"2023-12-13T00:00:30.006026+0000","last_became_peered":"2023-12-13T00:00:30.006026+0000","last_unstale":"2023-12-13T00:00:59.464752+0000","last_undegraded":"2023-12-13T00:00:59.464752+0000","last_fullsized":"2023-12-13T00:00:59.464752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:29.225167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458114+0000","last_change":"2023-12-13T00:00:30.004483+0000","last_active":"2023-12-13T00:00:59.458114+0000","last_peered":"2023-12-13T00:00:59.458114+0000","last_clean":"2023-12-13T00:00:59.458114+0000","last_became_active":"2023-12-13T00:00:30.004214+0000","last_became_peered":"2023-12-13T00:00:30.004214+0000","last_unstale":"2023-12-13T00:00:59.458114+0000","last_undegraded":"2023-12-13T00:00:59.458114+0000","last_fullsized":"2023-12-13T00:00:59.458114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:14.096925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461971+0000","last_change":"2023-12-13T00:00:31.147121+0000","last_active":"2023-12-13T00:00:59.461971+0000","last_peered":"2023-12-13T00:00:59.461971+0000","last_clean":"2023-12-13T00:00:59.461971+0000","last_became_active":"2023-12-13T00:00:31.146818+0000","last_became_peered":"2023-12-13T00:00:31.146818+0000","last_unstale":"2023-12-13T00:00:59.461971+0000","last_undegraded":"2023-12-13T00:00:59.461971+0000","last_fullsized":"2023-12-13T00:00:59.461971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:12.753740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461393+0000","last_change":"2023-12-13T00:00:35.642485+0000","last_active":"2023-12-13T00:00:59.461393+0000","last_peered":"2023-12-13T00:00:59.461393+0000","last_clean":"2023-12-13T00:00:59.461393+0000","last_became_active":"2023-12-13T00:00:35.642114+0000","last_became_peered":"2023-12-13T00:00:35.642114+0000","last_unstale":"2023-12-13T00:00:59.461393+0000","last_undegraded":"2023-12-13T00:00:59.461393+0000","last_fullsized":"2023-12-13T00:00:59.461393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:24:10.067039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:04.029541+0000","last_change":"2023-12-13T00:00:29.972296+0000","last_active":"2023-12-13T00:01:04.029541+0000","last_peered":"2023-12-13T00:01:04.029541+0000","last_clean":"2023-12-13T00:01:04.029541+0000","last_became_active":"2023-12-13T00:00:29.972018+0000","last_became_peered":"2023-12-13T00:00:29.972018+0000","last_unstale":"2023-12-13T00:01:04.029541+0000","last_undegraded":"2023-12-13T00:01:04.029541+0000","last_fullsized":"2023-12-13T00:01:04.029541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:30:26.126361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456414+0000","last_change":"2023-12-13T00:00:31.037679+0000","last_active":"2023-12-13T00:00:59.456414+0000","last_peered":"2023-12-13T00:00:59.456414+0000","last_clean":"2023-12-13T00:00:59.456414+0000","last_became_active":"2023-12-13T00:00:31.037445+0000","last_became_peered":"2023-12-13T00:00:31.037445+0000","last_unstale":"2023-12-13T00:00:59.456414+0000","last_undegraded":"2023-12-13T00:00:59.456414+0000","last_fullsized":"2023-12-13T00:00:59.456414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:55.082987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461668+0000","last_change":"2023-12-13T00:00:35.661405+0000","last_active":"2023-12-13T00:00:59.461668+0000","last_peered":"2023-12-13T00:00:59.461668+0000","last_clean":"2023-12-13T00:00:59.461668+0000","last_became_active":"2023-12-13T00:00:35.660984+0000","last_became_peered":"2023-12-13T00:00:35.660984+0000","last_unstale":"2023-12-13T00:00:59.461668+0000","last_undegraded":"2023-12-13T00:00:59.461668+0000","last_fullsized":"2023-12-13T00:00:59.461668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:24.668139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462010+0000","last_change":"2023-12-13T00:00:31.147104+0000","last_active":"2023-12-13T00:00:59.462010+0000","last_peered":"2023-12-13T00:00:59.462010+0000","last_clean":"2023-12-13T00:00:59.462010+0000","last_became_active":"2023-12-13T00:00:31.145225+0000","last_became_peered":"2023-12-13T00:00:31.145225+0000","last_unstale":"2023-12-13T00:00:59.462010+0000","last_undegraded":"2023-12-13T00:00:59.462010+0000","last_fullsized":"2023-12-13T00:00:59.462010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:42:14.707955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461433+0000","last_change":"2023-12-13T00:00:31.119735+0000","last_active":"2023-12-13T00:00:59.461433+0000","last_peered":"2023-12-13T00:00:59.461433+0000","last_clean":"2023-12-13T00:00:59.461433+0000","last_became_active":"2023-12-13T00:00:31.119474+0000","last_became_peered":"2023-12-13T00:00:31.119474+0000","last_unstale":"2023-12-13T00:00:59.461433+0000","last_undegraded":"2023-12-13T00:00:59.461433+0000","last_fullsized":"2023-12-13T00:00:59.461433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:30.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457690+0000","last_change":"2023-12-13T00:00:31.027180+0000","last_active":"2023-12-13T00:00:59.457690+0000","last_peered":"2023-12-13T00:00:59.457690+0000","last_clean":"2023-12-13T00:00:59.457690+0000","last_became_active":"2023-12-13T00:00:31.026922+0000","last_became_peered":"2023-12-13T00:00:31.026922+0000","last_unstale":"2023-12-13T00:00:59.457690+0000","last_undegraded":"2023-12-13T00:00:59.457690+0000","last_fullsized":"2023-12-13T00:00:59.457690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:58:37.933386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.466020+0000","last_change":"2023-12-13T00:00:31.119937+0000","last_active":"2023-12-13T00:00:59.466020+0000","last_peered":"2023-12-13T00:00:59.466020+0000","last_clean":"2023-12-13T00:00:59.466020+0000","last_became_active":"2023-12-13T00:00:31.119685+0000","last_became_peered":"2023-12-13T00:00:31.119685+0000","last_unstale":"2023-12-13T00:00:59.466020+0000","last_undegraded":"2023-12-13T00:00:59.466020+0000","last_fullsized":"2023-12-13T00:00:59.466020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:00.910594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463856+0000","last_change":"2023-12-13T00:00:31.150597+0000","last_active":"2023-12-13T00:00:59.463856+0000","last_peered":"2023-12-13T00:00:59.463856+0000","last_clean":"2023-12-13T00:00:59.463856+0000","last_became_active":"2023-12-13T00:00:31.150275+0000","last_became_peered":"2023-12-13T00:00:31.150275+0000","last_unstale":"2023-12-13T00:00:59.463856+0000","last_undegraded":"2023-12-13T00:00:59.463856+0000","last_fullsized":"2023-12-13T00:00:59.463856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:20.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463111+0000","last_change":"2023-12-13T00:00:31.117688+0000","last_active":"2023-12-13T00:00:59.463111+0000","last_peered":"2023-12-13T00:00:59.463111+0000","last_clean":"2023-12-13T00:00:59.463111+0000","last_became_active":"2023-12-13T00:00:31.117409+0000","last_became_peered":"2023-12-13T00:00:31.117409+0000","last_unstale":"2023-12-13T00:00:59.463111+0000","last_undegraded":"2023-12-13T00:00:59.463111+0000","last_fullsized":"2023-12-13T00:00:59.463111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:12.753740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462722+0000","last_change":"2023-12-13T00:00:31.142584+0000","last_active":"2023-12-13T00:00:59.462722+0000","last_peered":"2023-12-13T00:00:59.462722+0000","last_clean":"2023-12-13T00:00:59.462722+0000","last_became_active":"2023-12-13T00:00:31.141656+0000","last_became_peered":"2023-12-13T00:00:31.141656+0000","last_unstale":"2023-12-13T00:00:59.462722+0000","last_undegraded":"2023-12-13T00:00:59.462722+0000","last_fullsized":"2023-12-13T00:00:59.462722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:49:22.676243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465450+0000","last_change":"2023-12-13T00:00:31.036263+0000","last_active":"2023-12-13T00:00:59.465450+0000","last_peered":"2023-12-13T00:00:59.465450+0000","last_clean":"2023-12-13T00:00:59.465450+0000","last_became_active":"2023-12-13T00:00:31.036113+0000","last_became_peered":"2023-12-13T00:00:31.036113+0000","last_unstale":"2023-12-13T00:00:59.465450+0000","last_undegraded":"2023-12-13T00:00:59.465450+0000","last_fullsized":"2023-12-13T00:00:59.465450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:01.219033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457279+0000","last_change":"2023-12-13T00:00:31.027230+0000","last_active":"2023-12-13T00:00:59.457279+0000","last_peered":"2023-12-13T00:00:59.457279+0000","last_clean":"2023-12-13T00:00:59.457279+0000","last_became_active":"2023-12-13T00:00:31.026968+0000","last_became_peered":"2023-12-13T00:00:31.026968+0000","last_unstale":"2023-12-13T00:00:59.457279+0000","last_undegraded":"2023-12-13T00:00:59.457279+0000","last_fullsized":"2023-12-13T00:00:59.457279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:53.920022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465839+0000","last_change":"2023-12-13T00:00:31.139140+0000","last_active":"2023-12-13T00:00:59.465839+0000","last_peered":"2023-12-13T00:00:59.465839+0000","last_clean":"2023-12-13T00:00:59.465839+0000","last_became_active":"2023-12-13T00:00:31.138869+0000","last_became_peered":"2023-12-13T00:00:31.138869+0000","last_unstale":"2023-12-13T00:00:59.465839+0000","last_undegraded":"2023-12-13T00:00:59.465839+0000","last_fullsized":"2023-12-13T00:00:59.465839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:03:13.913502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456333+0000","last_change":"2023-12-13T00:00:31.146522+0000","last_active":"2023-12-13T00:00:59.456333+0000","last_peered":"2023-12-13T00:00:59.456333+0000","last_clean":"2023-12-13T00:00:59.456333+0000","last_became_active":"2023-12-13T00:00:31.146264+0000","last_became_peered":"2023-12-13T00:00:31.146264+0000","last_unstale":"2023-12-13T00:00:59.456333+0000","last_undegraded":"2023-12-13T00:00:59.456333+0000","last_fullsized":"2023-12-13T00:00:59.456333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:20:47.671750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461891+0000","last_change":"2023-12-13T00:00:31.143709+0000","last_active":"2023-12-13T00:00:59.461891+0000","last_peered":"2023-12-13T00:00:59.461891+0000","last_clean":"2023-12-13T00:00:59.461891+0000","last_became_active":"2023-12-13T00:00:31.143472+0000","last_became_peered":"2023-12-13T00:00:31.143472+0000","last_unstale":"2023-12-13T00:00:59.461891+0000","last_undegraded":"2023-12-13T00:00:59.461891+0000","last_fullsized":"2023-12-13T00:00:59.461891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:21:51.967408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460848+0000","last_change":"2023-12-13T00:00:31.146698+0000","last_active":"2023-12-13T00:00:59.460848+0000","last_peered":"2023-12-13T00:00:59.460848+0000","last_clean":"2023-12-13T00:00:59.460848+0000","last_became_active":"2023-12-13T00:00:31.146159+0000","last_became_peered":"2023-12-13T00:00:31.146159+0000","last_unstale":"2023-12-13T00:00:59.460848+0000","last_undegraded":"2023-12-13T00:00:59.460848+0000","last_fullsized":"2023-12-13T00:00:59.460848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:05:56.876593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458930+0000","last_change":"2023-12-13T00:00:31.143946+0000","last_active":"2023-12-13T00:00:59.458930+0000","last_peered":"2023-12-13T00:00:59.458930+0000","last_clean":"2023-12-13T00:00:59.458930+0000","last_became_active":"2023-12-13T00:00:31.143663+0000","last_became_peered":"2023-12-13T00:00:31.143663+0000","last_unstale":"2023-12-13T00:00:59.458930+0000","last_undegraded":"2023-12-13T00:00:59.458930+0000","last_fullsized":"2023-12-13T00:00:59.458930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:27:24.026750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462145+0000","last_change":"2023-12-13T00:00:31.142314+0000","last_active":"2023-12-13T00:00:59.462145+0000","last_peered":"2023-12-13T00:00:59.462145+0000","last_clean":"2023-12-13T00:00:59.462145+0000","last_became_active":"2023-12-13T00:00:31.142067+0000","last_became_peered":"2023-12-13T00:00:31.142067+0000","last_unstale":"2023-12-13T00:00:59.462145+0000","last_undegraded":"2023-12-13T00:00:59.462145+0000","last_fullsized":"2023-12-13T00:00:59.462145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:36.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458609+0000","last_change":"2023-12-13T00:00:31.146764+0000","last_active":"2023-12-13T00:00:59.458609+0000","last_peered":"2023-12-13T00:00:59.458609+0000","last_clean":"2023-12-13T00:00:59.458609+0000","last_became_active":"2023-12-13T00:00:31.146501+0000","last_became_peered":"2023-12-13T00:00:31.146501+0000","last_unstale":"2023-12-13T00:00:59.458609+0000","last_undegraded":"2023-12-13T00:00:59.458609+0000","last_fullsized":"2023-12-13T00:00:59.458609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:20:36.334790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457190+0000","last_change":"2023-12-13T00:00:31.138982+0000","last_active":"2023-12-13T00:00:59.457190+0000","last_peered":"2023-12-13T00:00:59.457190+0000","last_clean":"2023-12-13T00:00:59.457190+0000","last_became_active":"2023-12-13T00:00:31.138738+0000","last_became_peered":"2023-12-13T00:00:31.138738+0000","last_unstale":"2023-12-13T00:00:59.457190+0000","last_undegraded":"2023-12-13T00:00:59.457190+0000","last_fullsized":"2023-12-13T00:00:59.457190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:08:05.660552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465686+0000","last_change":"2023-12-13T00:00:31.148499+0000","last_active":"2023-12-13T00:00:59.465686+0000","last_peered":"2023-12-13T00:00:59.465686+0000","last_clean":"2023-12-13T00:00:59.465686+0000","last_became_active":"2023-12-13T00:00:31.148251+0000","last_became_peered":"2023-12-13T00:00:31.148251+0000","last_unstale":"2023-12-13T00:00:59.465686+0000","last_undegraded":"2023-12-13T00:00:59.465686+0000","last_fullsized":"2023-12-13T00:00:59.465686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:46:41.106364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463595+0000","last_change":"2023-12-13T00:00:31.117684+0000","last_active":"2023-12-13T00:00:59.463595+0000","last_peered":"2023-12-13T00:00:59.463595+0000","last_clean":"2023-12-13T00:00:59.463595+0000","last_became_active":"2023-12-13T00:00:31.117423+0000","last_became_peered":"2023-12-13T00:00:31.117423+0000","last_unstale":"2023-12-13T00:00:59.463595+0000","last_undegraded":"2023-12-13T00:00:59.463595+0000","last_fullsized":"2023-12-13T00:00:59.463595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:33:39.081529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.464860+0000","last_change":"2023-12-13T00:00:31.150615+0000","last_active":"2023-12-13T00:00:59.464860+0000","last_peered":"2023-12-13T00:00:59.464860+0000","last_clean":"2023-12-13T00:00:59.464860+0000","last_became_active":"2023-12-13T00:00:31.150324+0000","last_became_peered":"2023-12-13T00:00:31.150324+0000","last_unstale":"2023-12-13T00:00:59.464860+0000","last_undegraded":"2023-12-13T00:00:59.464860+0000","last_fullsized":"2023-12-13T00:00:59.464860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:15:16.348222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461196+0000","last_change":"2023-12-13T00:00:31.147145+0000","last_active":"2023-12-13T00:00:59.461196+0000","last_peered":"2023-12-13T00:00:59.461196+0000","last_clean":"2023-12-13T00:00:59.461196+0000","last_became_active":"2023-12-13T00:00:31.146444+0000","last_became_peered":"2023-12-13T00:00:31.146444+0000","last_unstale":"2023-12-13T00:00:59.461196+0000","last_undegraded":"2023-12-13T00:00:59.461196+0000","last_fullsized":"2023-12-13T00:00:59.461196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:52:46.548248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461101+0000","last_change":"2023-12-13T00:00:31.148920+0000","last_active":"2023-12-13T00:00:59.461101+0000","last_peered":"2023-12-13T00:00:59.461101+0000","last_clean":"2023-12-13T00:00:59.461101+0000","last_became_active":"2023-12-13T00:00:31.148529+0000","last_became_peered":"2023-12-13T00:00:31.148529+0000","last_unstale":"2023-12-13T00:00:59.461101+0000","last_undegraded":"2023-12-13T00:00:59.461101+0000","last_fullsized":"2023-12-13T00:00:59.461101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:51.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461057+0000","last_change":"2023-12-13T00:00:31.149934+0000","last_active":"2023-12-13T00:00:59.461057+0000","last_peered":"2023-12-13T00:00:59.461057+0000","last_clean":"2023-12-13T00:00:59.461057+0000","last_became_active":"2023-12-13T00:00:31.149685+0000","last_became_peered":"2023-12-13T00:00:31.149685+0000","last_unstale":"2023-12-13T00:00:59.461057+0000","last_undegraded":"2023-12-13T00:00:59.461057+0000","last_fullsized":"2023-12-13T00:00:59.461057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:06.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458537+0000","last_change":"2023-12-13T00:00:31.035879+0000","last_active":"2023-12-13T00:00:59.458537+0000","last_peered":"2023-12-13T00:00:59.458537+0000","last_clean":"2023-12-13T00:00:59.458537+0000","last_became_active":"2023-12-13T00:00:31.035672+0000","last_became_peered":"2023-12-13T00:00:31.035672+0000","last_unstale":"2023-12-13T00:00:59.458537+0000","last_undegraded":"2023-12-13T00:00:59.458537+0000","last_fullsized":"2023-12-13T00:00:59.458537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:30.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465289+0000","last_change":"2023-12-13T00:00:31.146556+0000","last_active":"2023-12-13T00:00:59.465289+0000","last_peered":"2023-12-13T00:00:59.465289+0000","last_clean":"2023-12-13T00:00:59.465289+0000","last_became_active":"2023-12-13T00:00:31.146186+0000","last_became_peered":"2023-12-13T00:00:31.146186+0000","last_unstale":"2023-12-13T00:00:59.465289+0000","last_undegraded":"2023-12-13T00:00:59.465289+0000","last_fullsized":"2023-12-13T00:00:59.465289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:20:30.098687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459678+0000","last_change":"2023-12-13T00:00:31.145365+0000","last_active":"2023-12-13T00:00:59.459678+0000","last_peered":"2023-12-13T00:00:59.459678+0000","last_clean":"2023-12-13T00:00:59.459678+0000","last_became_active":"2023-12-13T00:00:31.144458+0000","last_became_peered":"2023-12-13T00:00:31.144458+0000","last_unstale":"2023-12-13T00:00:59.459678+0000","last_undegraded":"2023-12-13T00:00:59.459678+0000","last_fullsized":"2023-12-13T00:00:59.459678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:03:13.913502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462069+0000","last_change":"2023-12-13T00:00:31.145052+0000","last_active":"2023-12-13T00:00:59.462069+0000","last_peered":"2023-12-13T00:00:59.462069+0000","last_clean":"2023-12-13T00:00:59.462069+0000","last_became_active":"2023-12-13T00:00:31.144792+0000","last_became_peered":"2023-12-13T00:00:31.144792+0000","last_unstale":"2023-12-13T00:00:59.462069+0000","last_undegraded":"2023-12-13T00:00:59.462069+0000","last_fullsized":"2023-12-13T00:00:59.462069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:30:27.231427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460654+0000","last_change":"2023-12-13T00:00:31.149527+0000","last_active":"2023-12-13T00:00:59.460654+0000","last_peered":"2023-12-13T00:00:59.460654+0000","last_clean":"2023-12-13T00:00:59.460654+0000","last_became_active":"2023-12-13T00:00:31.148875+0000","last_became_peered":"2023-12-13T00:00:31.148875+0000","last_unstale":"2023-12-13T00:00:59.460654+0000","last_undegraded":"2023-12-13T00:00:59.460654+0000","last_fullsized":"2023-12-13T00:00:59.460654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:01.219033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462203+0000","last_change":"2023-12-13T00:00:31.144423+0000","last_active":"2023-12-13T00:00:59.462203+0000","last_peered":"2023-12-13T00:00:59.462203+0000","last_clean":"2023-12-13T00:00:59.462203+0000","last_became_active":"2023-12-13T00:00:31.144174+0000","last_became_peered":"2023-12-13T00:00:31.144174+0000","last_unstale":"2023-12-13T00:00:59.462203+0000","last_undegraded":"2023-12-13T00:00:59.462203+0000","last_fullsized":"2023-12-13T00:00:59.462203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:10:31.724460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465379+0000","last_change":"2023-12-13T00:00:31.144074+0000","last_active":"2023-12-13T00:00:59.465379+0000","last_peered":"2023-12-13T00:00:59.465379+0000","last_clean":"2023-12-13T00:00:59.465379+0000","last_became_active":"2023-12-13T00:00:31.143809+0000","last_became_peered":"2023-12-13T00:00:31.143809+0000","last_unstale":"2023-12-13T00:00:59.465379+0000","last_undegraded":"2023-12-13T00:00:59.465379+0000","last_fullsized":"2023-12-13T00:00:59.465379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:51.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465650+0000","last_change":"2023-12-13T00:00:31.116522+0000","last_active":"2023-12-13T00:00:59.465650+0000","last_peered":"2023-12-13T00:00:59.465650+0000","last_clean":"2023-12-13T00:00:59.465650+0000","last_became_active":"2023-12-13T00:00:31.116230+0000","last_became_peered":"2023-12-13T00:00:31.116230+0000","last_unstale":"2023-12-13T00:00:59.465650+0000","last_undegraded":"2023-12-13T00:00:59.465650+0000","last_fullsized":"2023-12-13T00:00:59.465650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:52:46.548248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459456+0000","last_change":"2023-12-13T00:00:31.149691+0000","last_active":"2023-12-13T00:00:59.459456+0000","last_peered":"2023-12-13T00:00:59.459456+0000","last_clean":"2023-12-13T00:00:59.459456+0000","last_became_active":"2023-12-13T00:00:31.149410+0000","last_became_peered":"2023-12-13T00:00:31.149410+0000","last_unstale":"2023-12-13T00:00:59.459456+0000","last_undegraded":"2023-12-13T00:00:59.459456+0000","last_fullsized":"2023-12-13T00:00:59.459456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:50:58.339436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5261,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":9900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47,"ondisk_log_size":47,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":115598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":115474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":119987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":116056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":705912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.187}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":119315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":115530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":892928,"data_stored":706556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T00:01:06.880 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T00:01:07.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.019+0000 7ff251831640 1 Processor -- start 2023-12-13T00:01:07.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.019+0000 7ff251831640 1 -- start start 2023-12-13T00:01:07.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.020+0000 7ff251831640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff24c153730 0x7ff24c06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:07.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.020+0000 7ff251831640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff24c0c91d0 0x7ff24c0c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:07.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.020+0000 7ff251831640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff24c15a0c0 0x7ff24c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:07.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.020+0000 7ff251831640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff24c0c38f0 con 0x7ff24c153730 2023-12-13T00:01:07.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.020+0000 7ff251831640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff24c1593d0 con 0x7ff24c0c91d0 2023-12-13T00:01:07.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.020+0000 7ff251831640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c06f090 con 0x7ff24c15a0c0 2023-12-13T00:01:07.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.021+0000 7ff24affd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff24c153730 0x7ff24c06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:07.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.021+0000 7ff24a7fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff24c0c91d0 0x7ff24c0c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:07.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.021+0000 7ff24b7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff24c15a0c0 0x7ff24c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:07.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.021+0000 7ff24affd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff24c153730 0x7ff24c06eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35418/0 (socket says 172.21.15.72:35418) 2023-12-13T00:01:07.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.021+0000 7ff24affd640 1 -- 172.21.15.72:0/2712723521 learned_addr learned my addr 172.21.15.72:0/2712723521 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:07.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.023+0000 7ff24affd640 1 -- 172.21.15.72:0/2712723521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff24c15a0c0 msgr2=0x7ff24c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:07.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.023+0000 7ff24affd640 1 --2- 172.21.15.72:0/2712723521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff24c15a0c0 0x7ff24c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:07.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.023+0000 7ff24affd640 1 -- 172.21.15.72:0/2712723521 >> v2:172.21.15.176:3300/0 conn(0x7ff24c0c91d0 msgr2=0x7ff24c0c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:07.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.023+0000 7ff24affd640 1 --2- 172.21.15.72:0/2712723521 >> v2:172.21.15.176:3300/0 conn(0x7ff24c0c91d0 0x7ff24c0c2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:07.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.023+0000 7ff24affd640 1 -- 172.21.15.72:0/2712723521 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c153b10 con 0x7ff24c153730 2023-12-13T00:01:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.025+0000 7ff24affd640 1 --2- 172.21.15.72:0/2712723521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24c153730 0x7ff24c06eb50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff24c06fef0 tx=0x7ff23c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00b1497eec02ba5 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.029+0000 7ff249ffb640 1 -- 172.21.15.72:0/2712723521 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c02cb00 con 0x7ff24c153730 2023-12-13T00:01:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.029+0000 7ff249ffb640 1 -- 172.21.15.72:0/2712723521 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23c02cc60 con 0x7ff24c153730 2023-12-13T00:01:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.029+0000 7ff249ffb640 1 -- 172.21.15.72:0/2712723521 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c0343f0 con 0x7ff24c153730 2023-12-13T00:01:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.029+0000 7ff251831640 1 -- 172.21.15.72:0/2712723521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24c153730 msgr2=0x7ff24c06eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.029+0000 7ff251831640 1 --2- 172.21.15.72:0/2712723521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24c153730 0x7ff24c06eb50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff24c06fef0 tx=0x7ff23c02bf60 comp rx=0 tx=0).stop 2023-12-13T00:01:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.029+0000 7ff251831640 1 -- 172.21.15.72:0/2712723521 shutdown_connections 2023-12-13T00:01:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.029+0000 7ff251831640 1 --2- 172.21.15.72:0/2712723521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff24c15a0c0 0x7ff24c0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.029+0000 7ff251831640 1 --2- 172.21.15.72:0/2712723521 >> v2:172.21.15.176:3300/0 conn(0x7ff24c0c91d0 0x7ff24c0c2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.029+0000 7ff251831640 1 --2- 172.21.15.72:0/2712723521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24c153730 0x7ff24c06eb50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.029+0000 7ff251831640 1 -- 172.21.15.72:0/2712723521 >> 172.21.15.72:0/2712723521 conn(0x7ff24c0707f0 msgr2=0x7ff24c070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.029+0000 7ff251831640 1 -- 172.21.15.72:0/2712723521 shutdown_connections 2023-12-13T00:01:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.029+0000 7ff251831640 1 -- 172.21.15.72:0/2712723521 wait complete. 2023-12-13T00:01:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.031+0000 7ff251831640 1 Processor -- start 2023-12-13T00:01:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.031+0000 7ff251831640 1 -- start start 2023-12-13T00:01:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.032+0000 7ff251831640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24c0c91d0 0x7ff24c0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:07.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.032+0000 7ff251831640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff24c153730 0x7ff24c0caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:07.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.032+0000 7ff251831640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff24c15a0c0 0x7ff24c151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:07.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.032+0000 7ff251831640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c147da0 con 0x7ff24c0c91d0 2023-12-13T00:01:07.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.032+0000 7ff251831640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c1ef4b0 con 0x7ff24c15a0c0 2023-12-13T00:01:07.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.032+0000 7ff251831640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c0cc8a0 con 0x7ff24c153730 2023-12-13T00:01:07.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.032+0000 7ff24affd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24c0c91d0 0x7ff24c0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:07.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.032+0000 7ff24a7fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff24c153730 0x7ff24c0caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:07.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.032+0000 7ff24affd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24c0c91d0 0x7ff24c0cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35424/0 (socket says 172.21.15.72:35424) 2023-12-13T00:01:07.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.032+0000 7ff24affd640 1 -- 172.21.15.72:0/3816443854 learned_addr learned my addr 172.21.15.72:0/3816443854 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:07.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.033+0000 7ff24b7fe640 1 --2- 172.21.15.72:0/3816443854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff24c15a0c0 0x7ff24c151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:07.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.036+0000 7ff24affd640 1 -- 172.21.15.72:0/3816443854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff24c153730 msgr2=0x7ff24c0caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:07.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.036+0000 7ff24affd640 1 --2- 172.21.15.72:0/3816443854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff24c153730 0x7ff24c0caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:07.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.036+0000 7ff24affd640 1 -- 172.21.15.72:0/3816443854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff24c15a0c0 msgr2=0x7ff24c151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:07.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.036+0000 7ff24affd640 1 --2- 172.21.15.72:0/3816443854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff24c15a0c0 0x7ff24c151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:07.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.036+0000 7ff24affd640 1 -- 172.21.15.72:0/3816443854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c009b30 con 0x7ff24c0c91d0 2023-12-13T00:01:07.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.038+0000 7ff24affd640 1 --2- 172.21.15.72:0/3816443854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24c0c91d0 0x7ff24c0cc360 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff23c000f80 tx=0x7ff23c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:07.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.041+0000 7ff233fff640 1 -- 172.21.15.72:0/3816443854 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c03e450 con 0x7ff24c0c91d0 2023-12-13T00:01:07.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.041+0000 7ff233fff640 1 -- 172.21.15.72:0/3816443854 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23c03e5b0 con 0x7ff24c0c91d0 2023-12-13T00:01:07.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.041+0000 7ff233fff640 1 -- 172.21.15.72:0/3816443854 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c03e960 con 0x7ff24c0c91d0 2023-12-13T00:01:07.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.041+0000 7ff251831640 1 -- 172.21.15.72:0/3816443854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff24c14a430 con 0x7ff24c0c91d0 2023-12-13T00:01:07.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.041+0000 7ff251831640 1 -- 172.21.15.72:0/3816443854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff24c1eee60 con 0x7ff24c0c91d0 2023-12-13T00:01:07.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.042+0000 7ff251831640 1 -- 172.21.15.72:0/3816443854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff24c073dc0 con 0x7ff24c0c91d0 2023-12-13T00:01:07.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.289+0000 7ff233fff640 1 -- 172.21.15.72:0/3816443854 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff23c03eac0 con 0x7ff24c0c91d0 2023-12-13T00:01:07.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.289+0000 7ff233fff640 1 --2- 172.21.15.72:0/3816443854 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff23806b240 0x7ff23806d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:07.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.289+0000 7ff24a7fc640 1 --2- 172.21.15.72:0/3816443854 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff23806b240 0x7ff23806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:07.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.290+0000 7ff24a7fc640 1 --2- 172.21.15.72:0/3816443854 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff23806b240 0x7ff23806d700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0cbb70 tx=0x7ff240009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:07.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.303+0000 7ff233fff640 1 -- 172.21.15.72:0/3816443854 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7ff23c07b670 con 0x7ff24c0c91d0 2023-12-13T00:01:07.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.303+0000 7ff233fff640 1 -- 172.21.15.72:0/3816443854 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff23c0779b0 con 0x7ff24c0c91d0 2023-12-13T00:01:07.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.475+0000 7ff251831640 1 -- 172.21.15.72:0/3816443854 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff24c159c10 con 0x7ff23806b240 2023-12-13T00:01:07.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.484+0000 7ff233fff640 1 -- 172.21.15.72:0/3816443854 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345332 (secure 0 0 0) 0x7ff24c159c10 con 0x7ff23806b240 2023-12-13T00:01:07.488 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:01:07.490 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-12-13T00:01:07.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.487+0000 7ff251831640 1 -- 172.21.15.72:0/3816443854 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff23806b240 msgr2=0x7ff23806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:07.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.487+0000 7ff251831640 1 --2- 172.21.15.72:0/3816443854 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff23806b240 0x7ff23806d700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0cbb70 tx=0x7ff240009190 comp rx=0 tx=0).stop 2023-12-13T00:01:07.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.487+0000 7ff251831640 1 -- 172.21.15.72:0/3816443854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24c0c91d0 msgr2=0x7ff24c0cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:07.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.487+0000 7ff251831640 1 --2- 172.21.15.72:0/3816443854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24c0c91d0 0x7ff24c0cc360 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff23c000f80 tx=0x7ff23c004a40 comp rx=0 tx=0).stop 2023-12-13T00:01:07.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.487+0000 7ff251831640 1 -- 172.21.15.72:0/3816443854 shutdown_connections 2023-12-13T00:01:07.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.487+0000 7ff251831640 1 --2- 172.21.15.72:0/3816443854 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff23806b240 0x7ff23806d700 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:07.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.487+0000 7ff251831640 1 --2- 172.21.15.72:0/3816443854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff24c15a0c0 0x7ff24c151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:07.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.487+0000 7ff251831640 1 --2- 172.21.15.72:0/3816443854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff24c153730 0x7ff24c0caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:07.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.487+0000 7ff251831640 1 --2- 172.21.15.72:0/3816443854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24c0c91d0 0x7ff24c0cc360 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:07.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.487+0000 7ff251831640 1 -- 172.21.15.72:0/3816443854 >> 172.21.15.72:0/3816443854 conn(0x7ff24c0707f0 msgr2=0x7ff24c0c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:07.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.487+0000 7ff251831640 1 -- 172.21.15.72:0/3816443854 shutdown_connections 2023-12-13T00:01:07.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.487+0000 7ff251831640 1 -- 172.21.15.72:0/3816443854 wait complete. 2023-12-13T00:01:07.499 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2023-12-13T00:01:06.533672+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595629,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":210,"num_write_kb":2437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219620,"kb_used_data":3440,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755100,"statfs":{"total":773094113280,"available":772869222400,"internally_reserved":0,"allocated":3522560,"data_stored":2114428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001811"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462633+0000","last_change":"2023-12-13T00:00:29.997631+0000","last_active":"2023-12-13T00:00:59.462633+0000","last_peered":"2023-12-13T00:00:59.462633+0000","last_clean":"2023-12-13T00:00:59.462633+0000","last_became_active":"2023-12-13T00:00:29.997381+0000","last_became_peered":"2023-12-13T00:00:29.997381+0000","last_unstale":"2023-12-13T00:00:59.462633+0000","last_undegraded":"2023-12-13T00:00:59.462633+0000","last_fullsized":"2023-12-13T00:00:59.462633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:33:37.976462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465727+0000","last_change":"2023-12-13T00:00:31.138533+0000","last_active":"2023-12-13T00:00:59.465727+0000","last_peered":"2023-12-13T00:00:59.465727+0000","last_clean":"2023-12-13T00:00:59.465727+0000","last_became_active":"2023-12-13T00:00:31.138242+0000","last_became_peered":"2023-12-13T00:00:31.138242+0000","last_unstale":"2023-12-13T00:00:59.465727+0000","last_undegraded":"2023-12-13T00:00:59.465727+0000","last_fullsized":"2023-12-13T00:00:59.465727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:39:59.955103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461340+0000","last_change":"2023-12-13T00:00:35.667840+0000","last_active":"2023-12-13T00:00:59.461340+0000","last_peered":"2023-12-13T00:00:59.461340+0000","last_clean":"2023-12-13T00:00:59.461340+0000","last_became_active":"2023-12-13T00:00:35.667498+0000","last_became_peered":"2023-12-13T00:00:35.667498+0000","last_unstale":"2023-12-13T00:00:59.461340+0000","last_undegraded":"2023-12-13T00:00:59.461340+0000","last_fullsized":"2023-12-13T00:00:59.461340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:17.304722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465816+0000","last_change":"2023-12-13T00:00:30.001888+0000","last_active":"2023-12-13T00:00:59.465816+0000","last_peered":"2023-12-13T00:00:59.465816+0000","last_clean":"2023-12-13T00:00:59.465816+0000","last_became_active":"2023-12-13T00:00:30.001628+0000","last_became_peered":"2023-12-13T00:00:30.001628+0000","last_unstale":"2023-12-13T00:00:59.465816+0000","last_undegraded":"2023-12-13T00:00:59.465816+0000","last_fullsized":"2023-12-13T00:00:59.465816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:48:30.422214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465657+0000","last_change":"2023-12-13T00:00:31.036420+0000","last_active":"2023-12-13T00:00:59.465657+0000","last_peered":"2023-12-13T00:00:59.465657+0000","last_clean":"2023-12-13T00:00:59.465657+0000","last_became_active":"2023-12-13T00:00:31.036197+0000","last_became_peered":"2023-12-13T00:00:31.036197+0000","last_unstale":"2023-12-13T00:00:59.465657+0000","last_undegraded":"2023-12-13T00:00:59.465657+0000","last_fullsized":"2023-12-13T00:00:59.465657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:05:56.876593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461830+0000","last_change":"2023-12-13T00:00:35.665348+0000","last_active":"2023-12-13T00:00:59.461830+0000","last_peered":"2023-12-13T00:00:59.461830+0000","last_clean":"2023-12-13T00:00:59.461830+0000","last_became_active":"2023-12-13T00:00:35.664981+0000","last_became_peered":"2023-12-13T00:00:35.664981+0000","last_unstale":"2023-12-13T00:00:59.461830+0000","last_undegraded":"2023-12-13T00:00:59.461830+0000","last_fullsized":"2023-12-13T00:00:59.461830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:55.759392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461293+0000","last_change":"2023-12-13T00:00:30.009983+0000","last_active":"2023-12-13T00:00:59.461293+0000","last_peered":"2023-12-13T00:00:59.461293+0000","last_clean":"2023-12-13T00:00:59.461293+0000","last_became_active":"2023-12-13T00:00:30.009724+0000","last_became_peered":"2023-12-13T00:00:30.009724+0000","last_unstale":"2023-12-13T00:00:59.461293+0000","last_undegraded":"2023-12-13T00:00:59.461293+0000","last_fullsized":"2023-12-13T00:00:59.461293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:20:28.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456667+0000","last_change":"2023-12-13T00:00:31.151042+0000","last_active":"2023-12-13T00:00:59.456667+0000","last_peered":"2023-12-13T00:00:59.456667+0000","last_clean":"2023-12-13T00:00:59.456667+0000","last_became_active":"2023-12-13T00:00:31.150735+0000","last_became_peered":"2023-12-13T00:00:31.150735+0000","last_unstale":"2023-12-13T00:00:59.456667+0000","last_undegraded":"2023-12-13T00:00:59.456667+0000","last_fullsized":"2023-12-13T00:00:59.456667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:36.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462064+0000","last_change":"2023-12-13T00:00:35.668759+0000","last_active":"2023-12-13T00:00:59.462064+0000","last_peered":"2023-12-13T00:00:59.462064+0000","last_clean":"2023-12-13T00:00:59.462064+0000","last_became_active":"2023-12-13T00:00:35.668361+0000","last_became_peered":"2023-12-13T00:00:35.668361+0000","last_unstale":"2023-12-13T00:00:59.462064+0000","last_undegraded":"2023-12-13T00:00:59.462064+0000","last_fullsized":"2023-12-13T00:00:59.462064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:05.770014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461073+0000","last_change":"2023-12-13T00:00:30.009921+0000","last_active":"2023-12-13T00:00:59.461073+0000","last_peered":"2023-12-13T00:00:59.461073+0000","last_clean":"2023-12-13T00:00:59.461073+0000","last_became_active":"2023-12-13T00:00:30.009644+0000","last_became_peered":"2023-12-13T00:00:30.009644+0000","last_unstale":"2023-12-13T00:00:59.461073+0000","last_undegraded":"2023-12-13T00:00:59.461073+0000","last_fullsized":"2023-12-13T00:00:59.461073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:48:30.422214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457963+0000","last_change":"2023-12-13T00:00:31.146801+0000","last_active":"2023-12-13T00:00:59.457963+0000","last_peered":"2023-12-13T00:00:59.457963+0000","last_clean":"2023-12-13T00:00:59.457963+0000","last_became_active":"2023-12-13T00:00:31.146516+0000","last_became_peered":"2023-12-13T00:00:31.146516+0000","last_unstale":"2023-12-13T00:00:59.457963+0000","last_undegraded":"2023-12-13T00:00:59.457963+0000","last_fullsized":"2023-12-13T00:00:59.457963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:44:23.442162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461875+0000","last_change":"2023-12-13T00:00:35.668621+0000","last_active":"2023-12-13T00:00:59.461875+0000","last_peered":"2023-12-13T00:00:59.461875+0000","last_clean":"2023-12-13T00:00:59.461875+0000","last_became_active":"2023-12-13T00:00:35.668298+0000","last_became_peered":"2023-12-13T00:00:35.668298+0000","last_unstale":"2023-12-13T00:00:59.461875+0000","last_undegraded":"2023-12-13T00:00:59.461875+0000","last_fullsized":"2023-12-13T00:00:59.461875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:40:04.506084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457767+0000","last_change":"2023-12-13T00:00:31.036347+0000","last_active":"2023-12-13T00:00:59.457767+0000","last_peered":"2023-12-13T00:00:59.457767+0000","last_clean":"2023-12-13T00:00:59.457767+0000","last_became_active":"2023-12-13T00:00:31.036062+0000","last_became_peered":"2023-12-13T00:00:31.036062+0000","last_unstale":"2023-12-13T00:00:59.457767+0000","last_undegraded":"2023-12-13T00:00:59.457767+0000","last_fullsized":"2023-12-13T00:00:59.457767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:15:29.783257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459059+0000","last_change":"2023-12-13T00:00:30.001066+0000","last_active":"2023-12-13T00:00:59.459059+0000","last_peered":"2023-12-13T00:00:59.459059+0000","last_clean":"2023-12-13T00:00:59.459059+0000","last_became_active":"2023-12-13T00:00:30.000782+0000","last_became_peered":"2023-12-13T00:00:30.000782+0000","last_unstale":"2023-12-13T00:00:59.459059+0000","last_undegraded":"2023-12-13T00:00:59.459059+0000","last_fullsized":"2023-12-13T00:00:59.459059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:53.977921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457740+0000","last_change":"2023-12-13T00:00:35.662038+0000","last_active":"2023-12-13T00:00:59.457740+0000","last_peered":"2023-12-13T00:00:59.457740+0000","last_clean":"2023-12-13T00:00:59.457740+0000","last_became_active":"2023-12-13T00:00:35.661458+0000","last_became_peered":"2023-12-13T00:00:35.661458+0000","last_unstale":"2023-12-13T00:00:59.457740+0000","last_undegraded":"2023-12-13T00:00:59.457740+0000","last_fullsized":"2023-12-13T00:00:59.457740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:12:27.307277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462675+0000","last_change":"2023-12-13T00:00:31.119718+0000","last_active":"2023-12-13T00:00:59.462675+0000","last_peered":"2023-12-13T00:00:59.462675+0000","last_clean":"2023-12-13T00:00:59.462675+0000","last_became_active":"2023-12-13T00:00:31.119447+0000","last_became_peered":"2023-12-13T00:00:31.119447+0000","last_unstale":"2023-12-13T00:00:59.462675+0000","last_undegraded":"2023-12-13T00:00:59.462675+0000","last_fullsized":"2023-12-13T00:00:59.462675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:08.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463791+0000","last_change":"2023-12-13T00:00:29.968425+0000","last_active":"2023-12-13T00:00:59.463791+0000","last_peered":"2023-12-13T00:00:59.463791+0000","last_clean":"2023-12-13T00:00:59.463791+0000","last_became_active":"2023-12-13T00:00:29.967929+0000","last_became_peered":"2023-12-13T00:00:29.967929+0000","last_unstale":"2023-12-13T00:00:59.463791+0000","last_undegraded":"2023-12-13T00:00:59.463791+0000","last_fullsized":"2023-12-13T00:00:59.463791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:53.977921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460657+0000","last_change":"2023-12-13T00:00:35.662848+0000","last_active":"2023-12-13T00:00:59.460657+0000","last_peered":"2023-12-13T00:00:59.460657+0000","last_clean":"2023-12-13T00:00:59.460657+0000","last_became_active":"2023-12-13T00:00:35.662469+0000","last_became_peered":"2023-12-13T00:00:35.662469+0000","last_unstale":"2023-12-13T00:00:59.460657+0000","last_undegraded":"2023-12-13T00:00:59.460657+0000","last_fullsized":"2023-12-13T00:00:59.460657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:17:20.456996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461523+0000","last_change":"2023-12-13T00:00:31.143108+0000","last_active":"2023-12-13T00:00:59.461523+0000","last_peered":"2023-12-13T00:00:59.461523+0000","last_clean":"2023-12-13T00:00:59.461523+0000","last_became_active":"2023-12-13T00:00:31.142847+0000","last_became_peered":"2023-12-13T00:00:31.142847+0000","last_unstale":"2023-12-13T00:00:59.461523+0000","last_undegraded":"2023-12-13T00:00:59.461523+0000","last_fullsized":"2023-12-13T00:00:59.461523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:20.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462594+0000","last_change":"2023-12-13T00:00:30.004483+0000","last_active":"2023-12-13T00:00:59.462594+0000","last_peered":"2023-12-13T00:00:59.462594+0000","last_clean":"2023-12-13T00:00:59.462594+0000","last_became_active":"2023-12-13T00:00:30.004195+0000","last_became_peered":"2023-12-13T00:00:30.004195+0000","last_unstale":"2023-12-13T00:00:59.462594+0000","last_undegraded":"2023-12-13T00:00:59.462594+0000","last_fullsized":"2023-12-13T00:00:59.462594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:35.192132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462443+0000","last_change":"2023-12-13T00:00:35.660024+0000","last_active":"2023-12-13T00:00:59.462443+0000","last_peered":"2023-12-13T00:00:59.462443+0000","last_clean":"2023-12-13T00:00:59.462443+0000","last_became_active":"2023-12-13T00:00:35.659637+0000","last_became_peered":"2023-12-13T00:00:35.659637+0000","last_unstale":"2023-12-13T00:00:59.462443+0000","last_undegraded":"2023-12-13T00:00:59.462443+0000","last_fullsized":"2023-12-13T00:00:59.462443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:19.752973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457668+0000","last_change":"2023-12-13T00:00:31.143938+0000","last_active":"2023-12-13T00:00:59.457668+0000","last_peered":"2023-12-13T00:00:59.457668+0000","last_clean":"2023-12-13T00:00:59.457668+0000","last_became_active":"2023-12-13T00:00:31.143673+0000","last_became_peered":"2023-12-13T00:00:31.143673+0000","last_unstale":"2023-12-13T00:00:59.457668+0000","last_undegraded":"2023-12-13T00:00:59.457668+0000","last_fullsized":"2023-12-13T00:00:59.457668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:56:04.585998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460369+0000","last_change":"2023-12-13T00:00:30.005987+0000","last_active":"2023-12-13T00:00:59.460369+0000","last_peered":"2023-12-13T00:00:59.460369+0000","last_clean":"2023-12-13T00:00:59.460369+0000","last_became_active":"2023-12-13T00:00:30.005740+0000","last_became_peered":"2023-12-13T00:00:30.005740+0000","last_unstale":"2023-12-13T00:00:59.460369+0000","last_undegraded":"2023-12-13T00:00:59.460369+0000","last_fullsized":"2023-12-13T00:00:59.460369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:03:55.109283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462647+0000","last_change":"2023-12-13T00:00:35.666041+0000","last_active":"2023-12-13T00:00:59.462647+0000","last_peered":"2023-12-13T00:00:59.462647+0000","last_clean":"2023-12-13T00:00:59.462647+0000","last_became_active":"2023-12-13T00:00:35.665670+0000","last_became_peered":"2023-12-13T00:00:35.665670+0000","last_unstale":"2023-12-13T00:00:59.462647+0000","last_undegraded":"2023-12-13T00:00:59.462647+0000","last_fullsized":"2023-12-13T00:00:59.462647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:10.984025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462081+0000","last_change":"2023-12-13T00:00:31.146677+0000","last_active":"2023-12-13T00:00:59.462081+0000","last_peered":"2023-12-13T00:00:59.462081+0000","last_clean":"2023-12-13T00:00:59.462081+0000","last_became_active":"2023-12-13T00:00:31.146435+0000","last_became_peered":"2023-12-13T00:00:31.146435+0000","last_unstale":"2023-12-13T00:00:59.462081+0000","last_undegraded":"2023-12-13T00:00:59.462081+0000","last_fullsized":"2023-12-13T00:00:59.462081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:32:52.059012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458705+0000","last_change":"2023-12-13T00:00:30.006240+0000","last_active":"2023-12-13T00:00:59.458705+0000","last_peered":"2023-12-13T00:00:59.458705+0000","last_clean":"2023-12-13T00:00:59.458705+0000","last_became_active":"2023-12-13T00:00:30.005909+0000","last_became_peered":"2023-12-13T00:00:30.005909+0000","last_unstale":"2023-12-13T00:00:59.458705+0000","last_undegraded":"2023-12-13T00:00:59.458705+0000","last_fullsized":"2023-12-13T00:00:59.458705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:59:20.687032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462982+0000","last_change":"2023-12-13T00:00:35.665918+0000","last_active":"2023-12-13T00:00:59.462982+0000","last_peered":"2023-12-13T00:00:59.462982+0000","last_clean":"2023-12-13T00:00:59.462982+0000","last_became_active":"2023-12-13T00:00:35.665521+0000","last_became_peered":"2023-12-13T00:00:35.665521+0000","last_unstale":"2023-12-13T00:00:59.462982+0000","last_undegraded":"2023-12-13T00:00:59.462982+0000","last_fullsized":"2023-12-13T00:00:59.462982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:05.461575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462472+0000","last_change":"2023-12-13T00:00:31.145392+0000","last_active":"2023-12-13T00:00:59.462472+0000","last_peered":"2023-12-13T00:00:59.462472+0000","last_clean":"2023-12-13T00:00:59.462472+0000","last_became_active":"2023-12-13T00:00:31.145115+0000","last_became_peered":"2023-12-13T00:00:31.145115+0000","last_unstale":"2023-12-13T00:00:59.462472+0000","last_undegraded":"2023-12-13T00:00:59.462472+0000","last_fullsized":"2023-12-13T00:00:59.462472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:15.201991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462257+0000","last_change":"2023-12-13T00:00:30.006295+0000","last_active":"2023-12-13T00:00:59.462257+0000","last_peered":"2023-12-13T00:00:59.462257+0000","last_clean":"2023-12-13T00:00:59.462257+0000","last_became_active":"2023-12-13T00:00:30.005988+0000","last_became_peered":"2023-12-13T00:00:30.005988+0000","last_unstale":"2023-12-13T00:00:59.462257+0000","last_undegraded":"2023-12-13T00:00:59.462257+0000","last_fullsized":"2023-12-13T00:00:59.462257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:15:15.243155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461393+0000","last_change":"2023-12-13T00:00:35.662996+0000","last_active":"2023-12-13T00:00:59.461393+0000","last_peered":"2023-12-13T00:00:59.461393+0000","last_clean":"2023-12-13T00:00:59.461393+0000","last_became_active":"2023-12-13T00:00:35.662612+0000","last_became_peered":"2023-12-13T00:00:35.662612+0000","last_unstale":"2023-12-13T00:00:59.461393+0000","last_undegraded":"2023-12-13T00:00:59.461393+0000","last_fullsized":"2023-12-13T00:00:59.461393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:58.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463941+0000","last_change":"2023-12-13T00:00:31.118054+0000","last_active":"2023-12-13T00:00:59.463941+0000","last_peered":"2023-12-13T00:00:59.463941+0000","last_clean":"2023-12-13T00:00:59.463941+0000","last_became_active":"2023-12-13T00:00:31.117814+0000","last_became_peered":"2023-12-13T00:00:31.117814+0000","last_unstale":"2023-12-13T00:00:59.463941+0000","last_undegraded":"2023-12-13T00:00:59.463941+0000","last_fullsized":"2023-12-13T00:00:59.463941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:15.201991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458862+0000","last_change":"2023-12-13T00:00:30.001001+0000","last_active":"2023-12-13T00:00:59.458862+0000","last_peered":"2023-12-13T00:00:59.458862+0000","last_clean":"2023-12-13T00:00:59.458862+0000","last_became_active":"2023-12-13T00:00:30.000755+0000","last_became_peered":"2023-12-13T00:00:30.000755+0000","last_unstale":"2023-12-13T00:00:59.458862+0000","last_undegraded":"2023-12-13T00:00:59.458862+0000","last_fullsized":"2023-12-13T00:00:59.458862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:02:11.314721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.545340+0000","last_change":"2023-12-13T00:01:00.545340+0000","last_active":"2023-12-13T00:01:00.545340+0000","last_peered":"2023-12-13T00:01:00.545340+0000","last_clean":"2023-12-13T00:01:00.545340+0000","last_became_active":"2023-12-13T00:01:00.544906+0000","last_became_peered":"2023-12-13T00:01:00.544906+0000","last_unstale":"2023-12-13T00:01:00.545340+0000","last_undegraded":"2023-12-13T00:01:00.545340+0000","last_fullsized":"2023-12-13T00:01:00.545340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:44:27.993144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,5],"acting":[6,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462448+0000","last_change":"2023-12-13T00:00:31.143429+0000","last_active":"2023-12-13T00:00:59.462448+0000","last_peered":"2023-12-13T00:00:59.462448+0000","last_clean":"2023-12-13T00:00:59.462448+0000","last_became_active":"2023-12-13T00:00:31.143182+0000","last_became_peered":"2023-12-13T00:00:31.143182+0000","last_unstale":"2023-12-13T00:00:59.462448+0000","last_undegraded":"2023-12-13T00:00:59.462448+0000","last_fullsized":"2023-12-13T00:00:59.462448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:09:34.339195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465302+0000","last_change":"2023-12-13T00:00:29.969160+0000","last_active":"2023-12-13T00:00:59.465302+0000","last_peered":"2023-12-13T00:00:59.465302+0000","last_clean":"2023-12-13T00:00:59.465302+0000","last_became_active":"2023-12-13T00:00:29.968860+0000","last_became_peered":"2023-12-13T00:00:29.968860+0000","last_unstale":"2023-12-13T00:00:59.465302+0000","last_undegraded":"2023-12-13T00:00:59.465302+0000","last_fullsized":"2023-12-13T00:00:59.465302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:42:13.602889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463519+0000","last_change":"2023-12-13T00:00:35.642597+0000","last_active":"2023-12-13T00:00:59.463519+0000","last_peered":"2023-12-13T00:00:59.463519+0000","last_clean":"2023-12-13T00:00:59.463519+0000","last_became_active":"2023-12-13T00:00:35.642215+0000","last_became_peered":"2023-12-13T00:00:35.642215+0000","last_unstale":"2023-12-13T00:00:59.463519+0000","last_undegraded":"2023-12-13T00:00:59.463519+0000","last_fullsized":"2023-12-13T00:00:59.463519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:54:48.007993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460583+0000","last_change":"2023-12-13T00:00:31.149832+0000","last_active":"2023-12-13T00:00:59.460583+0000","last_peered":"2023-12-13T00:00:59.460583+0000","last_clean":"2023-12-13T00:00:59.460583+0000","last_became_active":"2023-12-13T00:00:31.149587+0000","last_became_peered":"2023-12-13T00:00:31.149587+0000","last_unstale":"2023-12-13T00:00:59.460583+0000","last_undegraded":"2023-12-13T00:00:59.460583+0000","last_fullsized":"2023-12-13T00:00:59.460583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:00.910594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459235+0000","last_change":"2023-12-13T00:00:29.998103+0000","last_active":"2023-12-13T00:00:59.459235+0000","last_peered":"2023-12-13T00:00:59.459235+0000","last_clean":"2023-12-13T00:00:59.459235+0000","last_became_active":"2023-12-13T00:00:29.997848+0000","last_became_peered":"2023-12-13T00:00:29.997848+0000","last_unstale":"2023-12-13T00:00:59.459235+0000","last_undegraded":"2023-12-13T00:00:59.459235+0000","last_fullsized":"2023-12-13T00:00:59.459235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:52:58.951228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463768+0000","last_change":"2023-12-13T00:00:35.652104+0000","last_active":"2023-12-13T00:00:59.463768+0000","last_peered":"2023-12-13T00:00:59.463768+0000","last_clean":"2023-12-13T00:00:59.463768+0000","last_became_active":"2023-12-13T00:00:35.651766+0000","last_became_peered":"2023-12-13T00:00:35.651766+0000","last_unstale":"2023-12-13T00:00:59.463768+0000","last_undegraded":"2023-12-13T00:00:59.463768+0000","last_fullsized":"2023-12-13T00:00:59.463768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:08:10.211533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465392+0000","last_change":"2023-12-13T00:00:31.120580+0000","last_active":"2023-12-13T00:00:59.465392+0000","last_peered":"2023-12-13T00:00:59.465392+0000","last_clean":"2023-12-13T00:00:59.465392+0000","last_became_active":"2023-12-13T00:00:31.120330+0000","last_became_peered":"2023-12-13T00:00:31.120330+0000","last_unstale":"2023-12-13T00:00:59.465392+0000","last_undegraded":"2023-12-13T00:00:59.465392+0000","last_fullsized":"2023-12-13T00:00:59.465392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:04:30.356287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461518+0000","last_change":"2023-12-13T00:00:30.000752+0000","last_active":"2023-12-13T00:00:59.461518+0000","last_peered":"2023-12-13T00:00:59.461518+0000","last_clean":"2023-12-13T00:00:59.461518+0000","last_became_active":"2023-12-13T00:00:30.000015+0000","last_became_peered":"2023-12-13T00:00:30.000015+0000","last_unstale":"2023-12-13T00:00:59.461518+0000","last_undegraded":"2023-12-13T00:00:59.461518+0000","last_fullsized":"2023-12-13T00:00:59.461518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:20:46.566684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463425+0000","last_change":"2023-12-13T00:00:35.667415+0000","last_active":"2023-12-13T00:00:59.463425+0000","last_peered":"2023-12-13T00:00:59.463425+0000","last_clean":"2023-12-13T00:00:59.463425+0000","last_became_active":"2023-12-13T00:00:35.667028+0000","last_became_peered":"2023-12-13T00:00:35.667028+0000","last_unstale":"2023-12-13T00:00:59.463425+0000","last_undegraded":"2023-12-13T00:00:59.463425+0000","last_fullsized":"2023-12-13T00:00:59.463425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:58.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.464043+0000","last_change":"2023-12-13T00:00:31.140853+0000","last_active":"2023-12-13T00:00:59.464043+0000","last_peered":"2023-12-13T00:00:59.464043+0000","last_clean":"2023-12-13T00:00:59.464043+0000","last_became_active":"2023-12-13T00:00:31.140597+0000","last_became_peered":"2023-12-13T00:00:31.140597+0000","last_unstale":"2023-12-13T00:00:59.464043+0000","last_undegraded":"2023-12-13T00:00:59.464043+0000","last_fullsized":"2023-12-13T00:00:59.464043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:13.923453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457435+0000","last_change":"2023-12-13T00:00:29.998765+0000","last_active":"2023-12-13T00:00:59.457435+0000","last_peered":"2023-12-13T00:00:59.457435+0000","last_clean":"2023-12-13T00:00:59.457435+0000","last_became_active":"2023-12-13T00:00:29.998552+0000","last_became_peered":"2023-12-13T00:00:29.998552+0000","last_unstale":"2023-12-13T00:00:59.457435+0000","last_undegraded":"2023-12-13T00:00:59.457435+0000","last_fullsized":"2023-12-13T00:00:59.457435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:54:42.351946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465621+0000","last_change":"2023-12-13T00:00:35.666575+0000","last_active":"2023-12-13T00:00:59.465621+0000","last_peered":"2023-12-13T00:00:59.465621+0000","last_clean":"2023-12-13T00:00:59.465621+0000","last_became_active":"2023-12-13T00:00:35.666135+0000","last_became_peered":"2023-12-13T00:00:35.666135+0000","last_unstale":"2023-12-13T00:00:59.465621+0000","last_undegraded":"2023-12-13T00:00:59.465621+0000","last_fullsized":"2023-12-13T00:00:59.465621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:02:03.031651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462174+0000","last_change":"2023-12-13T00:00:31.148698+0000","last_active":"2023-12-13T00:00:59.462174+0000","last_peered":"2023-12-13T00:00:59.462174+0000","last_clean":"2023-12-13T00:00:59.462174+0000","last_became_active":"2023-12-13T00:00:31.148421+0000","last_became_peered":"2023-12-13T00:00:31.148421+0000","last_unstale":"2023-12-13T00:00:59.462174+0000","last_undegraded":"2023-12-13T00:00:59.462174+0000","last_fullsized":"2023-12-13T00:00:59.462174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:53:00.056294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459132+0000","last_change":"2023-12-13T00:00:30.001220+0000","last_active":"2023-12-13T00:00:59.459132+0000","last_peered":"2023-12-13T00:00:59.459132+0000","last_clean":"2023-12-13T00:00:59.459132+0000","last_became_active":"2023-12-13T00:00:30.000854+0000","last_became_peered":"2023-12-13T00:00:30.000854+0000","last_unstale":"2023-12-13T00:00:59.459132+0000","last_undegraded":"2023-12-13T00:00:59.459132+0000","last_fullsized":"2023-12-13T00:00:59.459132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:50:11.243011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456321+0000","last_change":"2023-12-13T00:00:08.575071+0000","last_active":"2023-12-13T00:00:59.456321+0000","last_peered":"2023-12-13T00:00:59.456321+0000","last_clean":"2023-12-13T00:00:59.456321+0000","last_became_active":"2023-12-13T00:00:08.574464+0000","last_became_peered":"2023-12-13T00:00:08.574464+0000","last_unstale":"2023-12-13T00:00:59.456321+0000","last_undegraded":"2023-12-13T00:00:59.456321+0000","last_fullsized":"2023-12-13T00:00:59.456321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:07.226606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:07.226606+0000","last_clean_scrub_stamp":"2023-12-13T00:00:07.226606+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:51:39.168480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458245+0000","last_change":"2023-12-13T00:00:35.661806+0000","last_active":"2023-12-13T00:00:59.458245+0000","last_peered":"2023-12-13T00:00:59.458245+0000","last_clean":"2023-12-13T00:00:59.458245+0000","last_became_active":"2023-12-13T00:00:35.660976+0000","last_became_peered":"2023-12-13T00:00:35.660976+0000","last_unstale":"2023-12-13T00:00:59.458245+0000","last_undegraded":"2023-12-13T00:00:59.458245+0000","last_fullsized":"2023-12-13T00:00:59.458245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:04:57.617925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458767+0000","last_change":"2023-12-13T00:00:31.036383+0000","last_active":"2023-12-13T00:00:59.458767+0000","last_peered":"2023-12-13T00:00:59.458767+0000","last_clean":"2023-12-13T00:00:59.458767+0000","last_became_active":"2023-12-13T00:00:31.036127+0000","last_became_peered":"2023-12-13T00:00:31.036127+0000","last_unstale":"2023-12-13T00:00:59.458767+0000","last_undegraded":"2023-12-13T00:00:59.458767+0000","last_fullsized":"2023-12-13T00:00:59.458767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:12:16.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.464525+0000","last_change":"2023-12-13T00:00:30.006258+0000","last_active":"2023-12-13T00:00:59.464525+0000","last_peered":"2023-12-13T00:00:59.464525+0000","last_clean":"2023-12-13T00:00:59.464525+0000","last_became_active":"2023-12-13T00:00:30.005943+0000","last_became_peered":"2023-12-13T00:00:30.005943+0000","last_unstale":"2023-12-13T00:00:59.464525+0000","last_undegraded":"2023-12-13T00:00:59.464525+0000","last_fullsized":"2023-12-13T00:00:59.464525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:52:45.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461955+0000","last_change":"2023-12-13T00:00:35.665140+0000","last_active":"2023-12-13T00:00:59.461955+0000","last_peered":"2023-12-13T00:00:59.461955+0000","last_clean":"2023-12-13T00:00:59.461955+0000","last_became_active":"2023-12-13T00:00:35.664071+0000","last_became_peered":"2023-12-13T00:00:35.664071+0000","last_unstale":"2023-12-13T00:00:59.461955+0000","last_undegraded":"2023-12-13T00:00:59.461955+0000","last_fullsized":"2023-12-13T00:00:59.461955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:06:01.427574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460927+0000","last_change":"2023-12-13T00:00:31.147760+0000","last_active":"2023-12-13T00:00:59.460927+0000","last_peered":"2023-12-13T00:00:59.460927+0000","last_clean":"2023-12-13T00:00:59.460927+0000","last_became_active":"2023-12-13T00:00:31.147523+0000","last_became_peered":"2023-12-13T00:00:31.147523+0000","last_unstale":"2023-12-13T00:00:59.460927+0000","last_undegraded":"2023-12-13T00:00:59.460927+0000","last_fullsized":"2023-12-13T00:00:59.460927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:56:28.188041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465526+0000","last_change":"2023-12-13T00:00:30.002705+0000","last_active":"2023-12-13T00:00:59.465526+0000","last_peered":"2023-12-13T00:00:59.465526+0000","last_clean":"2023-12-13T00:00:59.465526+0000","last_became_active":"2023-12-13T00:00:30.002427+0000","last_became_peered":"2023-12-13T00:00:30.002427+0000","last_unstale":"2023-12-13T00:00:59.465526+0000","last_undegraded":"2023-12-13T00:00:59.465526+0000","last_fullsized":"2023-12-13T00:00:59.465526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:06:37.325239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465997+0000","last_change":"2023-12-13T00:00:35.661309+0000","last_active":"2023-12-13T00:00:59.465997+0000","last_peered":"2023-12-13T00:00:59.465997+0000","last_clean":"2023-12-13T00:00:59.465997+0000","last_became_active":"2023-12-13T00:00:35.660939+0000","last_became_peered":"2023-12-13T00:00:35.660939+0000","last_unstale":"2023-12-13T00:00:59.465997+0000","last_undegraded":"2023-12-13T00:00:59.465997+0000","last_fullsized":"2023-12-13T00:00:59.465997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:49:19.372464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459530+0000","last_change":"2023-12-13T00:00:31.146265+0000","last_active":"2023-12-13T00:00:59.459530+0000","last_peered":"2023-12-13T00:00:59.459530+0000","last_clean":"2023-12-13T00:00:59.459530+0000","last_became_active":"2023-12-13T00:00:31.145997+0000","last_became_peered":"2023-12-13T00:00:31.145997+0000","last_unstale":"2023-12-13T00:00:59.459530+0000","last_undegraded":"2023-12-13T00:00:59.459530+0000","last_fullsized":"2023-12-13T00:00:59.459530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:53:32.846210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462169+0000","last_change":"2023-12-13T00:00:29.968222+0000","last_active":"2023-12-13T00:00:59.462169+0000","last_peered":"2023-12-13T00:00:59.462169+0000","last_clean":"2023-12-13T00:00:59.462169+0000","last_became_active":"2023-12-13T00:00:29.967916+0000","last_became_peered":"2023-12-13T00:00:29.967916+0000","last_unstale":"2023-12-13T00:00:59.462169+0000","last_undegraded":"2023-12-13T00:00:59.462169+0000","last_fullsized":"2023-12-13T00:00:59.462169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:12.818387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457105+0000","last_change":"2023-12-13T00:00:35.667745+0000","last_active":"2023-12-13T00:00:59.457105+0000","last_peered":"2023-12-13T00:00:59.457105+0000","last_clean":"2023-12-13T00:00:59.457105+0000","last_became_active":"2023-12-13T00:00:35.666891+0000","last_became_peered":"2023-12-13T00:00:35.666891+0000","last_unstale":"2023-12-13T00:00:59.457105+0000","last_undegraded":"2023-12-13T00:00:59.457105+0000","last_fullsized":"2023-12-13T00:00:59.457105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:30:53.285154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462868+0000","last_change":"2023-12-13T00:00:31.148279+0000","last_active":"2023-12-13T00:00:59.462868+0000","last_peered":"2023-12-13T00:00:59.462868+0000","last_clean":"2023-12-13T00:00:59.462868+0000","last_became_active":"2023-12-13T00:00:31.148016+0000","last_became_peered":"2023-12-13T00:00:31.148016+0000","last_unstale":"2023-12-13T00:00:59.462868+0000","last_undegraded":"2023-12-13T00:00:59.462868+0000","last_fullsized":"2023-12-13T00:00:59.462868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:37:40.762676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459753+0000","last_change":"2023-12-13T00:00:30.008152+0000","last_active":"2023-12-13T00:00:59.459753+0000","last_peered":"2023-12-13T00:00:59.459753+0000","last_clean":"2023-12-13T00:00:59.459753+0000","last_became_active":"2023-12-13T00:00:30.007907+0000","last_became_peered":"2023-12-13T00:00:30.007907+0000","last_unstale":"2023-12-13T00:00:59.459753+0000","last_undegraded":"2023-12-13T00:00:59.459753+0000","last_fullsized":"2023-12-13T00:00:59.459753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:46:40.001298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456332+0000","last_change":"2023-12-13T00:00:35.660971+0000","last_active":"2023-12-13T00:00:59.456332+0000","last_peered":"2023-12-13T00:00:59.456332+0000","last_clean":"2023-12-13T00:00:59.456332+0000","last_became_active":"2023-12-13T00:00:35.660627+0000","last_became_peered":"2023-12-13T00:00:35.660627+0000","last_unstale":"2023-12-13T00:00:59.456332+0000","last_undegraded":"2023-12-13T00:00:59.456332+0000","last_fullsized":"2023-12-13T00:00:59.456332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:18.474434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457469+0000","last_change":"2023-12-13T00:00:31.142437+0000","last_active":"2023-12-13T00:00:59.457469+0000","last_peered":"2023-12-13T00:00:59.457469+0000","last_clean":"2023-12-13T00:00:59.457469+0000","last_became_active":"2023-12-13T00:00:31.142150+0000","last_became_peered":"2023-12-13T00:00:31.142150+0000","last_unstale":"2023-12-13T00:00:59.457469+0000","last_undegraded":"2023-12-13T00:00:59.457469+0000","last_fullsized":"2023-12-13T00:00:59.457469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:10:54.020587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461595+0000","last_change":"2023-12-13T00:00:30.000646+0000","last_active":"2023-12-13T00:00:59.461595+0000","last_peered":"2023-12-13T00:00:59.461595+0000","last_clean":"2023-12-13T00:00:59.461595+0000","last_became_active":"2023-12-13T00:00:30.000388+0000","last_became_peered":"2023-12-13T00:00:30.000388+0000","last_unstale":"2023-12-13T00:00:59.461595+0000","last_undegraded":"2023-12-13T00:00:59.461595+0000","last_fullsized":"2023-12-13T00:00:59.461595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:07.704455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465717+0000","last_change":"2023-12-13T00:00:35.666659+0000","last_active":"2023-12-13T00:00:59.465717+0000","last_peered":"2023-12-13T00:00:59.465717+0000","last_clean":"2023-12-13T00:00:59.465717+0000","last_became_active":"2023-12-13T00:00:35.666304+0000","last_became_peered":"2023-12-13T00:00:35.666304+0000","last_unstale":"2023-12-13T00:00:59.465717+0000","last_undegraded":"2023-12-13T00:00:59.465717+0000","last_fullsized":"2023-12-13T00:00:59.465717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:35:49.956369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456174+0000","last_change":"2023-12-13T00:00:31.037568+0000","last_active":"2023-12-13T00:00:59.456174+0000","last_peered":"2023-12-13T00:00:59.456174+0000","last_clean":"2023-12-13T00:00:59.456174+0000","last_became_active":"2023-12-13T00:00:31.037398+0000","last_became_peered":"2023-12-13T00:00:31.037398+0000","last_unstale":"2023-12-13T00:00:59.456174+0000","last_undegraded":"2023-12-13T00:00:59.456174+0000","last_fullsized":"2023-12-13T00:00:59.456174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:08.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459763+0000","last_change":"2023-12-13T00:00:30.006086+0000","last_active":"2023-12-13T00:00:59.459763+0000","last_peered":"2023-12-13T00:00:59.459763+0000","last_clean":"2023-12-13T00:00:59.459763+0000","last_became_active":"2023-12-13T00:00:30.005752+0000","last_became_peered":"2023-12-13T00:00:30.005752+0000","last_unstale":"2023-12-13T00:00:59.459763+0000","last_undegraded":"2023-12-13T00:00:59.459763+0000","last_fullsized":"2023-12-13T00:00:59.459763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:06:37.325239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465548+0000","last_change":"2023-12-13T00:00:35.666467+0000","last_active":"2023-12-13T00:00:59.465548+0000","last_peered":"2023-12-13T00:00:59.465548+0000","last_clean":"2023-12-13T00:00:59.465548+0000","last_became_active":"2023-12-13T00:00:35.666061+0000","last_became_peered":"2023-12-13T00:00:35.666061+0000","last_unstale":"2023-12-13T00:00:59.465548+0000","last_undegraded":"2023-12-13T00:00:59.465548+0000","last_fullsized":"2023-12-13T00:00:59.465548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:19:16.858246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.702387+0000","last_change":"2023-12-13T00:01:00.702387+0000","last_active":"2023-12-13T00:01:00.702387+0000","last_peered":"2023-12-13T00:01:00.702387+0000","last_clean":"2023-12-13T00:01:00.702387+0000","last_became_active":"2023-12-13T00:01:00.702089+0000","last_became_peered":"2023-12-13T00:01:00.702089+0000","last_unstale":"2023-12-13T00:01:00.702387+0000","last_undegraded":"2023-12-13T00:01:00.702387+0000","last_fullsized":"2023-12-13T00:01:00.702387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:48:49.380742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459150+0000","last_change":"2023-12-13T00:00:30.001171+0000","last_active":"2023-12-13T00:00:59.459150+0000","last_peered":"2023-12-13T00:00:59.459150+0000","last_clean":"2023-12-13T00:00:59.459150+0000","last_became_active":"2023-12-13T00:00:30.000803+0000","last_became_peered":"2023-12-13T00:00:30.000803+0000","last_unstale":"2023-12-13T00:00:59.459150+0000","last_undegraded":"2023-12-13T00:00:59.459150+0000","last_fullsized":"2023-12-13T00:00:59.459150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:19.012092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463671+0000","last_change":"2023-12-13T00:00:35.649561+0000","last_active":"2023-12-13T00:00:59.463671+0000","last_peered":"2023-12-13T00:00:59.463671+0000","last_clean":"2023-12-13T00:00:59.463671+0000","last_became_active":"2023-12-13T00:00:35.649151+0000","last_became_peered":"2023-12-13T00:00:35.649151+0000","last_unstale":"2023-12-13T00:00:59.463671+0000","last_undegraded":"2023-12-13T00:00:59.463671+0000","last_fullsized":"2023-12-13T00:00:59.463671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:06:34.023899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463669+0000","last_change":"2023-12-13T00:00:31.116002+0000","last_active":"2023-12-13T00:00:59.463669+0000","last_peered":"2023-12-13T00:00:59.463669+0000","last_clean":"2023-12-13T00:00:59.463669+0000","last_became_active":"2023-12-13T00:00:31.115678+0000","last_became_peered":"2023-12-13T00:00:31.115678+0000","last_unstale":"2023-12-13T00:00:59.463669+0000","last_undegraded":"2023-12-13T00:00:59.463669+0000","last_fullsized":"2023-12-13T00:00:59.463669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:21:51.967408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463370+0000","last_change":"2023-12-13T00:00:30.004329+0000","last_active":"2023-12-13T00:00:59.463370+0000","last_peered":"2023-12-13T00:00:59.463370+0000","last_clean":"2023-12-13T00:00:59.463370+0000","last_became_active":"2023-12-13T00:00:30.004089+0000","last_became_peered":"2023-12-13T00:00:30.004089+0000","last_unstale":"2023-12-13T00:00:59.463370+0000","last_undegraded":"2023-12-13T00:00:59.463370+0000","last_fullsized":"2023-12-13T00:00:59.463370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:05:04.403249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457886+0000","last_change":"2023-12-13T00:00:35.652272+0000","last_active":"2023-12-13T00:00:59.457886+0000","last_peered":"2023-12-13T00:00:59.457886+0000","last_clean":"2023-12-13T00:00:59.457886+0000","last_became_active":"2023-12-13T00:00:35.651907+0000","last_became_peered":"2023-12-13T00:00:35.651907+0000","last_unstale":"2023-12-13T00:00:59.457886+0000","last_undegraded":"2023-12-13T00:00:59.457886+0000","last_fullsized":"2023-12-13T00:00:59.457886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:15:01.873129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461182+0000","last_change":"2023-12-13T00:00:31.148754+0000","last_active":"2023-12-13T00:00:59.461182+0000","last_peered":"2023-12-13T00:00:59.461182+0000","last_clean":"2023-12-13T00:00:59.461182+0000","last_became_active":"2023-12-13T00:00:31.147846+0000","last_became_peered":"2023-12-13T00:00:31.147846+0000","last_unstale":"2023-12-13T00:00:59.461182+0000","last_undegraded":"2023-12-13T00:00:59.461182+0000","last_fullsized":"2023-12-13T00:00:59.461182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:39:59.955103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462295+0000","last_change":"2023-12-13T00:00:30.001703+0000","last_active":"2023-12-13T00:00:59.462295+0000","last_peered":"2023-12-13T00:00:59.462295+0000","last_clean":"2023-12-13T00:00:59.462295+0000","last_became_active":"2023-12-13T00:00:30.001420+0000","last_became_peered":"2023-12-13T00:00:30.001420+0000","last_unstale":"2023-12-13T00:00:59.462295+0000","last_undegraded":"2023-12-13T00:00:59.462295+0000","last_fullsized":"2023-12-13T00:00:59.462295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:02:06.211723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.546607+0000","last_change":"2023-12-13T00:01:00.546607+0000","last_active":"2023-12-13T00:01:00.546607+0000","last_peered":"2023-12-13T00:01:00.546607+0000","last_clean":"2023-12-13T00:01:00.546607+0000","last_became_active":"2023-12-13T00:01:00.546264+0000","last_became_peered":"2023-12-13T00:01:00.546264+0000","last_unstale":"2023-12-13T00:01:00.546607+0000","last_undegraded":"2023-12-13T00:01:00.546607+0000","last_fullsized":"2023-12-13T00:01:00.546607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:12:57.696627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457889+0000","last_change":"2023-12-13T00:00:31.138998+0000","last_active":"2023-12-13T00:00:59.457889+0000","last_peered":"2023-12-13T00:00:59.457889+0000","last_clean":"2023-12-13T00:00:59.457889+0000","last_became_active":"2023-12-13T00:00:31.138723+0000","last_became_peered":"2023-12-13T00:00:31.138723+0000","last_unstale":"2023-12-13T00:00:59.457889+0000","last_undegraded":"2023-12-13T00:00:59.457889+0000","last_fullsized":"2023-12-13T00:00:59.457889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:24:05.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461871+0000","last_change":"2023-12-13T00:00:30.003079+0000","last_active":"2023-12-13T00:00:59.461871+0000","last_peered":"2023-12-13T00:00:59.461871+0000","last_clean":"2023-12-13T00:00:59.461871+0000","last_became_active":"2023-12-13T00:00:30.002823+0000","last_became_peered":"2023-12-13T00:00:30.002823+0000","last_unstale":"2023-12-13T00:00:59.461871+0000","last_undegraded":"2023-12-13T00:00:59.461871+0000","last_fullsized":"2023-12-13T00:00:59.461871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:07.829448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.697705+0000","last_change":"2023-12-13T00:01:00.697705+0000","last_active":"2023-12-13T00:01:00.697705+0000","last_peered":"2023-12-13T00:01:00.697705+0000","last_clean":"2023-12-13T00:01:00.697705+0000","last_became_active":"2023-12-13T00:01:00.697231+0000","last_became_peered":"2023-12-13T00:01:00.697231+0000","last_unstale":"2023-12-13T00:01:00.697705+0000","last_undegraded":"2023-12-13T00:01:00.697705+0000","last_fullsized":"2023-12-13T00:01:00.697705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:54:04.994059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465742+0000","last_change":"2023-12-13T00:00:31.027503+0000","last_active":"2023-12-13T00:00:59.465742+0000","last_peered":"2023-12-13T00:00:59.465742+0000","last_clean":"2023-12-13T00:00:59.465742+0000","last_became_active":"2023-12-13T00:00:31.027239+0000","last_became_peered":"2023-12-13T00:00:31.027239+0000","last_unstale":"2023-12-13T00:00:59.465742+0000","last_undegraded":"2023-12-13T00:00:59.465742+0000","last_fullsized":"2023-12-13T00:00:59.465742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:50:58.339436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461192+0000","last_change":"2023-12-13T00:00:30.009592+0000","last_active":"2023-12-13T00:00:59.461192+0000","last_peered":"2023-12-13T00:00:59.461192+0000","last_clean":"2023-12-13T00:00:59.461192+0000","last_became_active":"2023-12-13T00:00:30.009351+0000","last_became_peered":"2023-12-13T00:00:30.009351+0000","last_unstale":"2023-12-13T00:00:59.461192+0000","last_undegraded":"2023-12-13T00:00:59.461192+0000","last_fullsized":"2023-12-13T00:00:59.461192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:46:22.716022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.720435+0000","last_change":"2023-12-13T00:01:00.717446+0000","last_active":"2023-12-13T00:01:00.720435+0000","last_peered":"2023-12-13T00:01:00.720435+0000","last_clean":"2023-12-13T00:01:00.720435+0000","last_became_active":"2023-12-13T00:01:00.717019+0000","last_became_peered":"2023-12-13T00:01:00.717019+0000","last_unstale":"2023-12-13T00:01:00.720435+0000","last_undegraded":"2023-12-13T00:01:00.720435+0000","last_fullsized":"2023-12-13T00:01:00.720435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:22:05.566928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462796+0000","last_change":"2023-12-13T00:00:31.139946+0000","last_active":"2023-12-13T00:00:59.462796+0000","last_peered":"2023-12-13T00:00:59.462796+0000","last_clean":"2023-12-13T00:00:59.462796+0000","last_became_active":"2023-12-13T00:00:31.139656+0000","last_became_peered":"2023-12-13T00:00:31.139656+0000","last_unstale":"2023-12-13T00:00:59.462796+0000","last_undegraded":"2023-12-13T00:00:59.462796+0000","last_fullsized":"2023-12-13T00:00:59.462796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:13:39.042325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458675+0000","last_change":"2023-12-13T00:00:30.003511+0000","last_active":"2023-12-13T00:00:59.458675+0000","last_peered":"2023-12-13T00:00:59.458675+0000","last_clean":"2023-12-13T00:00:59.458675+0000","last_became_active":"2023-12-13T00:00:30.002630+0000","last_became_peered":"2023-12-13T00:00:30.002630+0000","last_unstale":"2023-12-13T00:00:59.458675+0000","last_undegraded":"2023-12-13T00:00:59.458675+0000","last_fullsized":"2023-12-13T00:00:59.458675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:58:21.724544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462429+0000","last_change":"2023-12-13T00:00:35.649725+0000","last_active":"2023-12-13T00:00:59.462429+0000","last_peered":"2023-12-13T00:00:59.462429+0000","last_clean":"2023-12-13T00:00:59.462429+0000","last_became_active":"2023-12-13T00:00:35.649401+0000","last_became_peered":"2023-12-13T00:00:35.649401+0000","last_unstale":"2023-12-13T00:00:59.462429+0000","last_undegraded":"2023-12-13T00:00:59.462429+0000","last_fullsized":"2023-12-13T00:00:59.462429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:56:09.136979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462981+0000","last_change":"2023-12-13T00:00:35.662790+0000","last_active":"2023-12-13T00:00:59.462981+0000","last_peered":"2023-12-13T00:00:59.462981+0000","last_clean":"2023-12-13T00:00:59.462981+0000","last_became_active":"2023-12-13T00:00:35.662406+0000","last_became_peered":"2023-12-13T00:00:35.662406+0000","last_unstale":"2023-12-13T00:00:59.462981+0000","last_undegraded":"2023-12-13T00:00:59.462981+0000","last_fullsized":"2023-12-13T00:00:59.462981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:10:58.571569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462513+0000","last_change":"2023-12-13T00:00:31.143141+0000","last_active":"2023-12-13T00:00:59.462513+0000","last_peered":"2023-12-13T00:00:59.462513+0000","last_clean":"2023-12-13T00:00:59.462513+0000","last_became_active":"2023-12-13T00:00:31.142823+0000","last_became_peered":"2023-12-13T00:00:31.142823+0000","last_unstale":"2023-12-13T00:00:59.462513+0000","last_undegraded":"2023-12-13T00:00:59.462513+0000","last_fullsized":"2023-12-13T00:00:59.462513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:22:51.335464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457357+0000","last_change":"2023-12-13T00:00:30.004773+0000","last_active":"2023-12-13T00:00:59.457357+0000","last_peered":"2023-12-13T00:00:59.457357+0000","last_clean":"2023-12-13T00:00:59.457357+0000","last_became_active":"2023-12-13T00:00:30.004496+0000","last_became_peered":"2023-12-13T00:00:30.004496+0000","last_unstale":"2023-12-13T00:00:59.457357+0000","last_undegraded":"2023-12-13T00:00:59.457357+0000","last_fullsized":"2023-12-13T00:00:59.457357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:51:20.708568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457933+0000","last_change":"2023-12-13T00:00:35.666457+0000","last_active":"2023-12-13T00:00:59.457933+0000","last_peered":"2023-12-13T00:00:59.457933+0000","last_clean":"2023-12-13T00:00:59.457933+0000","last_became_active":"2023-12-13T00:00:35.666075+0000","last_became_peered":"2023-12-13T00:00:35.666075+0000","last_unstale":"2023-12-13T00:00:59.457933+0000","last_undegraded":"2023-12-13T00:00:59.457933+0000","last_fullsized":"2023-12-13T00:00:59.457933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:18:38.741479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465799+0000","last_change":"2023-12-13T00:00:31.116511+0000","last_active":"2023-12-13T00:00:59.465799+0000","last_peered":"2023-12-13T00:00:59.465799+0000","last_clean":"2023-12-13T00:00:59.465799+0000","last_became_active":"2023-12-13T00:00:31.116209+0000","last_became_peered":"2023-12-13T00:00:31.116209+0000","last_unstale":"2023-12-13T00:00:59.465799+0000","last_undegraded":"2023-12-13T00:00:59.465799+0000","last_fullsized":"2023-12-13T00:00:59.465799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:06.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.464752+0000","last_change":"2023-12-13T00:00:30.006475+0000","last_active":"2023-12-13T00:00:59.464752+0000","last_peered":"2023-12-13T00:00:59.464752+0000","last_clean":"2023-12-13T00:00:59.464752+0000","last_became_active":"2023-12-13T00:00:30.006026+0000","last_became_peered":"2023-12-13T00:00:30.006026+0000","last_unstale":"2023-12-13T00:00:59.464752+0000","last_undegraded":"2023-12-13T00:00:59.464752+0000","last_fullsized":"2023-12-13T00:00:59.464752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:29.225167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458114+0000","last_change":"2023-12-13T00:00:30.004483+0000","last_active":"2023-12-13T00:00:59.458114+0000","last_peered":"2023-12-13T00:00:59.458114+0000","last_clean":"2023-12-13T00:00:59.458114+0000","last_became_active":"2023-12-13T00:00:30.004214+0000","last_became_peered":"2023-12-13T00:00:30.004214+0000","last_unstale":"2023-12-13T00:00:59.458114+0000","last_undegraded":"2023-12-13T00:00:59.458114+0000","last_fullsized":"2023-12-13T00:00:59.458114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:14.096925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461971+0000","last_change":"2023-12-13T00:00:31.147121+0000","last_active":"2023-12-13T00:00:59.461971+0000","last_peered":"2023-12-13T00:00:59.461971+0000","last_clean":"2023-12-13T00:00:59.461971+0000","last_became_active":"2023-12-13T00:00:31.146818+0000","last_became_peered":"2023-12-13T00:00:31.146818+0000","last_unstale":"2023-12-13T00:00:59.461971+0000","last_undegraded":"2023-12-13T00:00:59.461971+0000","last_fullsized":"2023-12-13T00:00:59.461971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:12.753740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461393+0000","last_change":"2023-12-13T00:00:35.642485+0000","last_active":"2023-12-13T00:00:59.461393+0000","last_peered":"2023-12-13T00:00:59.461393+0000","last_clean":"2023-12-13T00:00:59.461393+0000","last_became_active":"2023-12-13T00:00:35.642114+0000","last_became_peered":"2023-12-13T00:00:35.642114+0000","last_unstale":"2023-12-13T00:00:59.461393+0000","last_undegraded":"2023-12-13T00:00:59.461393+0000","last_fullsized":"2023-12-13T00:00:59.461393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:24:10.067039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:04.029541+0000","last_change":"2023-12-13T00:00:29.972296+0000","last_active":"2023-12-13T00:01:04.029541+0000","last_peered":"2023-12-13T00:01:04.029541+0000","last_clean":"2023-12-13T00:01:04.029541+0000","last_became_active":"2023-12-13T00:00:29.972018+0000","last_became_peered":"2023-12-13T00:00:29.972018+0000","last_unstale":"2023-12-13T00:01:04.029541+0000","last_undegraded":"2023-12-13T00:01:04.029541+0000","last_fullsized":"2023-12-13T00:01:04.029541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:30:26.126361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456414+0000","last_change":"2023-12-13T00:00:31.037679+0000","last_active":"2023-12-13T00:00:59.456414+0000","last_peered":"2023-12-13T00:00:59.456414+0000","last_clean":"2023-12-13T00:00:59.456414+0000","last_became_active":"2023-12-13T00:00:31.037445+0000","last_became_peered":"2023-12-13T00:00:31.037445+0000","last_unstale":"2023-12-13T00:00:59.456414+0000","last_undegraded":"2023-12-13T00:00:59.456414+0000","last_fullsized":"2023-12-13T00:00:59.456414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:55.082987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461668+0000","last_change":"2023-12-13T00:00:35.661405+0000","last_active":"2023-12-13T00:00:59.461668+0000","last_peered":"2023-12-13T00:00:59.461668+0000","last_clean":"2023-12-13T00:00:59.461668+0000","last_became_active":"2023-12-13T00:00:35.660984+0000","last_became_peered":"2023-12-13T00:00:35.660984+0000","last_unstale":"2023-12-13T00:00:59.461668+0000","last_undegraded":"2023-12-13T00:00:59.461668+0000","last_fullsized":"2023-12-13T00:00:59.461668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:24.668139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462010+0000","last_change":"2023-12-13T00:00:31.147104+0000","last_active":"2023-12-13T00:00:59.462010+0000","last_peered":"2023-12-13T00:00:59.462010+0000","last_clean":"2023-12-13T00:00:59.462010+0000","last_became_active":"2023-12-13T00:00:31.145225+0000","last_became_peered":"2023-12-13T00:00:31.145225+0000","last_unstale":"2023-12-13T00:00:59.462010+0000","last_undegraded":"2023-12-13T00:00:59.462010+0000","last_fullsized":"2023-12-13T00:00:59.462010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:42:14.707955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461433+0000","last_change":"2023-12-13T00:00:31.119735+0000","last_active":"2023-12-13T00:00:59.461433+0000","last_peered":"2023-12-13T00:00:59.461433+0000","last_clean":"2023-12-13T00:00:59.461433+0000","last_became_active":"2023-12-13T00:00:31.119474+0000","last_became_peered":"2023-12-13T00:00:31.119474+0000","last_unstale":"2023-12-13T00:00:59.461433+0000","last_undegraded":"2023-12-13T00:00:59.461433+0000","last_fullsized":"2023-12-13T00:00:59.461433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:30.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457690+0000","last_change":"2023-12-13T00:00:31.027180+0000","last_active":"2023-12-13T00:00:59.457690+0000","last_peered":"2023-12-13T00:00:59.457690+0000","last_clean":"2023-12-13T00:00:59.457690+0000","last_became_active":"2023-12-13T00:00:31.026922+0000","last_became_peered":"2023-12-13T00:00:31.026922+0000","last_unstale":"2023-12-13T00:00:59.457690+0000","last_undegraded":"2023-12-13T00:00:59.457690+0000","last_fullsized":"2023-12-13T00:00:59.457690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:58:37.933386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.466020+0000","last_change":"2023-12-13T00:00:31.119937+0000","last_active":"2023-12-13T00:00:59.466020+0000","last_peered":"2023-12-13T00:00:59.466020+0000","last_clean":"2023-12-13T00:00:59.466020+0000","last_became_active":"2023-12-13T00:00:31.119685+0000","last_became_peered":"2023-12-13T00:00:31.119685+0000","last_unstale":"2023-12-13T00:00:59.466020+0000","last_undegraded":"2023-12-13T00:00:59.466020+0000","last_fullsized":"2023-12-13T00:00:59.466020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:00.910594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463856+0000","last_change":"2023-12-13T00:00:31.150597+0000","last_active":"2023-12-13T00:00:59.463856+0000","last_peered":"2023-12-13T00:00:59.463856+0000","last_clean":"2023-12-13T00:00:59.463856+0000","last_became_active":"2023-12-13T00:00:31.150275+0000","last_became_peered":"2023-12-13T00:00:31.150275+0000","last_unstale":"2023-12-13T00:00:59.463856+0000","last_undegraded":"2023-12-13T00:00:59.463856+0000","last_fullsized":"2023-12-13T00:00:59.463856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:20.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463111+0000","last_change":"2023-12-13T00:00:31.117688+0000","last_active":"2023-12-13T00:00:59.463111+0000","last_peered":"2023-12-13T00:00:59.463111+0000","last_clean":"2023-12-13T00:00:59.463111+0000","last_became_active":"2023-12-13T00:00:31.117409+0000","last_became_peered":"2023-12-13T00:00:31.117409+0000","last_unstale":"2023-12-13T00:00:59.463111+0000","last_undegraded":"2023-12-13T00:00:59.463111+0000","last_fullsized":"2023-12-13T00:00:59.463111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:12.753740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462722+0000","last_change":"2023-12-13T00:00:31.142584+0000","last_active":"2023-12-13T00:00:59.462722+0000","last_peered":"2023-12-13T00:00:59.462722+0000","last_clean":"2023-12-13T00:00:59.462722+0000","last_became_active":"2023-12-13T00:00:31.141656+0000","last_became_peered":"2023-12-13T00:00:31.141656+0000","last_unstale":"2023-12-13T00:00:59.462722+0000","last_undegraded":"2023-12-13T00:00:59.462722+0000","last_fullsized":"2023-12-13T00:00:59.462722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:49:22.676243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465450+0000","last_change":"2023-12-13T00:00:31.036263+0000","last_active":"2023-12-13T00:00:59.465450+0000","last_peered":"2023-12-13T00:00:59.465450+0000","last_clean":"2023-12-13T00:00:59.465450+0000","last_became_active":"2023-12-13T00:00:31.036113+0000","last_became_peered":"2023-12-13T00:00:31.036113+0000","last_unstale":"2023-12-13T00:00:59.465450+0000","last_undegraded":"2023-12-13T00:00:59.465450+0000","last_fullsized":"2023-12-13T00:00:59.465450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:01.219033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457279+0000","last_change":"2023-12-13T00:00:31.027230+0000","last_active":"2023-12-13T00:00:59.457279+0000","last_peered":"2023-12-13T00:00:59.457279+0000","last_clean":"2023-12-13T00:00:59.457279+0000","last_became_active":"2023-12-13T00:00:31.026968+0000","last_became_peered":"2023-12-13T00:00:31.026968+0000","last_unstale":"2023-12-13T00:00:59.457279+0000","last_undegraded":"2023-12-13T00:00:59.457279+0000","last_fullsized":"2023-12-13T00:00:59.457279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:53.920022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465839+0000","last_change":"2023-12-13T00:00:31.139140+0000","last_active":"2023-12-13T00:00:59.465839+0000","last_peered":"2023-12-13T00:00:59.465839+0000","last_clean":"2023-12-13T00:00:59.465839+0000","last_became_active":"2023-12-13T00:00:31.138869+0000","last_became_peered":"2023-12-13T00:00:31.138869+0000","last_unstale":"2023-12-13T00:00:59.465839+0000","last_undegraded":"2023-12-13T00:00:59.465839+0000","last_fullsized":"2023-12-13T00:00:59.465839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:03:13.913502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456333+0000","last_change":"2023-12-13T00:00:31.146522+0000","last_active":"2023-12-13T00:00:59.456333+0000","last_peered":"2023-12-13T00:00:59.456333+0000","last_clean":"2023-12-13T00:00:59.456333+0000","last_became_active":"2023-12-13T00:00:31.146264+0000","last_became_peered":"2023-12-13T00:00:31.146264+0000","last_unstale":"2023-12-13T00:00:59.456333+0000","last_undegraded":"2023-12-13T00:00:59.456333+0000","last_fullsized":"2023-12-13T00:00:59.456333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:20:47.671750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461891+0000","last_change":"2023-12-13T00:00:31.143709+0000","last_active":"2023-12-13T00:00:59.461891+0000","last_peered":"2023-12-13T00:00:59.461891+0000","last_clean":"2023-12-13T00:00:59.461891+0000","last_became_active":"2023-12-13T00:00:31.143472+0000","last_became_peered":"2023-12-13T00:00:31.143472+0000","last_unstale":"2023-12-13T00:00:59.461891+0000","last_undegraded":"2023-12-13T00:00:59.461891+0000","last_fullsized":"2023-12-13T00:00:59.461891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:21:51.967408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460848+0000","last_change":"2023-12-13T00:00:31.146698+0000","last_active":"2023-12-13T00:00:59.460848+0000","last_peered":"2023-12-13T00:00:59.460848+0000","last_clean":"2023-12-13T00:00:59.460848+0000","last_became_active":"2023-12-13T00:00:31.146159+0000","last_became_peered":"2023-12-13T00:00:31.146159+0000","last_unstale":"2023-12-13T00:00:59.460848+0000","last_undegraded":"2023-12-13T00:00:59.460848+0000","last_fullsized":"2023-12-13T00:00:59.460848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:05:56.876593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458930+0000","last_change":"2023-12-13T00:00:31.143946+0000","last_active":"2023-12-13T00:00:59.458930+0000","last_peered":"2023-12-13T00:00:59.458930+0000","last_clean":"2023-12-13T00:00:59.458930+0000","last_became_active":"2023-12-13T00:00:31.143663+0000","last_became_peered":"2023-12-13T00:00:31.143663+0000","last_unstale":"2023-12-13T00:00:59.458930+0000","last_undegraded":"2023-12-13T00:00:59.458930+0000","last_fullsized":"2023-12-13T00:00:59.458930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:27:24.026750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462145+0000","last_change":"2023-12-13T00:00:31.142314+0000","last_active":"2023-12-13T00:00:59.462145+0000","last_peered":"2023-12-13T00:00:59.462145+0000","last_clean":"2023-12-13T00:00:59.462145+0000","last_became_active":"2023-12-13T00:00:31.142067+0000","last_became_peered":"2023-12-13T00:00:31.142067+0000","last_unstale":"2023-12-13T00:00:59.462145+0000","last_undegraded":"2023-12-13T00:00:59.462145+0000","last_fullsized":"2023-12-13T00:00:59.462145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:36.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458609+0000","last_change":"2023-12-13T00:00:31.146764+0000","last_active":"2023-12-13T00:00:59.458609+0000","last_peered":"2023-12-13T00:00:59.458609+0000","last_clean":"2023-12-13T00:00:59.458609+0000","last_became_active":"2023-12-13T00:00:31.146501+0000","last_became_peered":"2023-12-13T00:00:31.146501+0000","last_unstale":"2023-12-13T00:00:59.458609+0000","last_undegraded":"2023-12-13T00:00:59.458609+0000","last_fullsized":"2023-12-13T00:00:59.458609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:20:36.334790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457190+0000","last_change":"2023-12-13T00:00:31.138982+0000","last_active":"2023-12-13T00:00:59.457190+0000","last_peered":"2023-12-13T00:00:59.457190+0000","last_clean":"2023-12-13T00:00:59.457190+0000","last_became_active":"2023-12-13T00:00:31.138738+0000","last_became_peered":"2023-12-13T00:00:31.138738+0000","last_unstale":"2023-12-13T00:00:59.457190+0000","last_undegraded":"2023-12-13T00:00:59.457190+0000","last_fullsized":"2023-12-13T00:00:59.457190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:08:05.660552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465686+0000","last_change":"2023-12-13T00:00:31.148499+0000","last_active":"2023-12-13T00:00:59.465686+0000","last_peered":"2023-12-13T00:00:59.465686+0000","last_clean":"2023-12-13T00:00:59.465686+0000","last_became_active":"2023-12-13T00:00:31.148251+0000","last_became_peered":"2023-12-13T00:00:31.148251+0000","last_unstale":"2023-12-13T00:00:59.465686+0000","last_undegraded":"2023-12-13T00:00:59.465686+0000","last_fullsized":"2023-12-13T00:00:59.465686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:46:41.106364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463595+0000","last_change":"2023-12-13T00:00:31.117684+0000","last_active":"2023-12-13T00:00:59.463595+0000","last_peered":"2023-12-13T00:00:59.463595+0000","last_clean":"2023-12-13T00:00:59.463595+0000","last_became_active":"2023-12-13T00:00:31.117423+0000","last_became_peered":"2023-12-13T00:00:31.117423+0000","last_unstale":"2023-12-13T00:00:59.463595+0000","last_undegraded":"2023-12-13T00:00:59.463595+0000","last_fullsized":"2023-12-13T00:00:59.463595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:33:39.081529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.464860+0000","last_change":"2023-12-13T00:00:31.150615+0000","last_active":"2023-12-13T00:00:59.464860+0000","last_peered":"2023-12-13T00:00:59.464860+0000","last_clean":"2023-12-13T00:00:59.464860+0000","last_became_active":"2023-12-13T00:00:31.150324+0000","last_became_peered":"2023-12-13T00:00:31.150324+0000","last_unstale":"2023-12-13T00:00:59.464860+0000","last_undegraded":"2023-12-13T00:00:59.464860+0000","last_fullsized":"2023-12-13T00:00:59.464860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:15:16.348222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461196+0000","last_change":"2023-12-13T00:00:31.147145+0000","last_active":"2023-12-13T00:00:59.461196+0000","last_peered":"2023-12-13T00:00:59.461196+0000","last_clean":"2023-12-13T00:00:59.461196+0000","last_became_active":"2023-12-13T00:00:31.146444+0000","last_became_peered":"2023-12-13T00:00:31.146444+0000","last_unstale":"2023-12-13T00:00:59.461196+0000","last_undegraded":"2023-12-13T00:00:59.461196+0000","last_fullsized":"2023-12-13T00:00:59.461196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:52:46.548248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461101+0000","last_change":"2023-12-13T00:00:31.148920+0000","last_active":"2023-12-13T00:00:59.461101+0000","last_peered":"2023-12-13T00:00:59.461101+0000","last_clean":"2023-12-13T00:00:59.461101+0000","last_became_active":"2023-12-13T00:00:31.148529+0000","last_became_peered":"2023-12-13T00:00:31.148529+0000","last_unstale":"2023-12-13T00:00:59.461101+0000","last_undegraded":"2023-12-13T00:00:59.461101+0000","last_fullsized":"2023-12-13T00:00:59.461101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:51.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461057+0000","last_change":"2023-12-13T00:00:31.149934+0000","last_active":"2023-12-13T00:00:59.461057+0000","last_peered":"2023-12-13T00:00:59.461057+0000","last_clean":"2023-12-13T00:00:59.461057+0000","last_became_active":"2023-12-13T00:00:31.149685+0000","last_became_peered":"2023-12-13T00:00:31.149685+0000","last_unstale":"2023-12-13T00:00:59.461057+0000","last_undegraded":"2023-12-13T00:00:59.461057+0000","last_fullsized":"2023-12-13T00:00:59.461057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:06.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458537+0000","last_change":"2023-12-13T00:00:31.035879+0000","last_active":"2023-12-13T00:00:59.458537+0000","last_peered":"2023-12-13T00:00:59.458537+0000","last_clean":"2023-12-13T00:00:59.458537+0000","last_became_active":"2023-12-13T00:00:31.035672+0000","last_became_peered":"2023-12-13T00:00:31.035672+0000","last_unstale":"2023-12-13T00:00:59.458537+0000","last_undegraded":"2023-12-13T00:00:59.458537+0000","last_fullsized":"2023-12-13T00:00:59.458537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:30.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465289+0000","last_change":"2023-12-13T00:00:31.146556+0000","last_active":"2023-12-13T00:00:59.465289+0000","last_peered":"2023-12-13T00:00:59.465289+0000","last_clean":"2023-12-13T00:00:59.465289+0000","last_became_active":"2023-12-13T00:00:31.146186+0000","last_became_peered":"2023-12-13T00:00:31.146186+0000","last_unstale":"2023-12-13T00:00:59.465289+0000","last_undegraded":"2023-12-13T00:00:59.465289+0000","last_fullsized":"2023-12-13T00:00:59.465289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:20:30.098687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459678+0000","last_change":"2023-12-13T00:00:31.145365+0000","last_active":"2023-12-13T00:00:59.459678+0000","last_peered":"2023-12-13T00:00:59.459678+0000","last_clean":"2023-12-13T00:00:59.459678+0000","last_became_active":"2023-12-13T00:00:31.144458+0000","last_became_peered":"2023-12-13T00:00:31.144458+0000","last_unstale":"2023-12-13T00:00:59.459678+0000","last_undegraded":"2023-12-13T00:00:59.459678+0000","last_fullsized":"2023-12-13T00:00:59.459678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:03:13.913502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462069+0000","last_change":"2023-12-13T00:00:31.145052+0000","last_active":"2023-12-13T00:00:59.462069+0000","last_peered":"2023-12-13T00:00:59.462069+0000","last_clean":"2023-12-13T00:00:59.462069+0000","last_became_active":"2023-12-13T00:00:31.144792+0000","last_became_peered":"2023-12-13T00:00:31.144792+0000","last_unstale":"2023-12-13T00:00:59.462069+0000","last_undegraded":"2023-12-13T00:00:59.462069+0000","last_fullsized":"2023-12-13T00:00:59.462069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:30:27.231427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460654+0000","last_change":"2023-12-13T00:00:31.149527+0000","last_active":"2023-12-13T00:00:59.460654+0000","last_peered":"2023-12-13T00:00:59.460654+0000","last_clean":"2023-12-13T00:00:59.460654+0000","last_became_active":"2023-12-13T00:00:31.148875+0000","last_became_peered":"2023-12-13T00:00:31.148875+0000","last_unstale":"2023-12-13T00:00:59.460654+0000","last_undegraded":"2023-12-13T00:00:59.460654+0000","last_fullsized":"2023-12-13T00:00:59.460654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:01.219033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462203+0000","last_change":"2023-12-13T00:00:31.144423+0000","last_active":"2023-12-13T00:00:59.462203+0000","last_peered":"2023-12-13T00:00:59.462203+0000","last_clean":"2023-12-13T00:00:59.462203+0000","last_became_active":"2023-12-13T00:00:31.144174+0000","last_became_peered":"2023-12-13T00:00:31.144174+0000","last_unstale":"2023-12-13T00:00:59.462203+0000","last_undegraded":"2023-12-13T00:00:59.462203+0000","last_fullsized":"2023-12-13T00:00:59.462203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:10:31.724460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465379+0000","last_change":"2023-12-13T00:00:31.144074+0000","last_active":"2023-12-13T00:00:59.465379+0000","last_peered":"2023-12-13T00:00:59.465379+0000","last_clean":"2023-12-13T00:00:59.465379+0000","last_became_active":"2023-12-13T00:00:31.143809+0000","last_became_peered":"2023-12-13T00:00:31.143809+0000","last_unstale":"2023-12-13T00:00:59.465379+0000","last_undegraded":"2023-12-13T00:00:59.465379+0000","last_fullsized":"2023-12-13T00:00:59.465379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:51.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465650+0000","last_change":"2023-12-13T00:00:31.116522+0000","last_active":"2023-12-13T00:00:59.465650+0000","last_peered":"2023-12-13T00:00:59.465650+0000","last_clean":"2023-12-13T00:00:59.465650+0000","last_became_active":"2023-12-13T00:00:31.116230+0000","last_became_peered":"2023-12-13T00:00:31.116230+0000","last_unstale":"2023-12-13T00:00:59.465650+0000","last_undegraded":"2023-12-13T00:00:59.465650+0000","last_fullsized":"2023-12-13T00:00:59.465650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:52:46.548248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459456+0000","last_change":"2023-12-13T00:00:31.149691+0000","last_active":"2023-12-13T00:00:59.459456+0000","last_peered":"2023-12-13T00:00:59.459456+0000","last_clean":"2023-12-13T00:00:59.459456+0000","last_became_active":"2023-12-13T00:00:31.149410+0000","last_became_peered":"2023-12-13T00:00:31.149410+0000","last_unstale":"2023-12-13T00:00:59.459456+0000","last_undegraded":"2023-12-13T00:00:59.459456+0000","last_fullsized":"2023-12-13T00:00:59.459456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:50:58.339436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5261,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":9900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47,"ondisk_log_size":47,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":115598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":115474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":119987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":116056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":705912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.187}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":119315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":115530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":892928,"data_stored":706556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T00:01:07.505 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-13T00:01:07.505 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-13T00:01:07.505 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-13T00:01:07.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-13T00:01:07.506 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-13T00:01:07.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.641+0000 7f35b23c9640 1 Processor -- start 2023-12-13T00:01:07.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.641+0000 7f35b23c9640 1 -- start start 2023-12-13T00:01:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.642+0000 7f35b23c9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f35ac1571d0 0x7f35ac0c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.642+0000 7f35b23c9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ac0ccac0 0x7f35ac0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.642+0000 7f35b23c9640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ac1575f0 con 0x7f35ac151680 2023-12-13T00:01:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.642+0000 7f35b23c9640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ac06fb00 con 0x7f35ac1571d0 2023-12-13T00:01:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.642+0000 7f35b23c9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac157880 con 0x7f35ac0ccac0 2023-12-13T00:01:07.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.642+0000 7f35abfff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f35ac151680 0x7f35ac06f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47934/0 (socket says 172.21.15.72:47934) 2023-12-13T00:01:07.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.642+0000 7f35abfff640 1 -- 172.21.15.72:0/2039417685 learned_addr learned my addr 172.21.15.72:0/2039417685 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:07.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.642+0000 7f35ab7fe640 1 --2- 172.21.15.72:0/2039417685 >> v2:172.21.15.176:3300/0 conn(0x7f35ac1571d0 0x7f35ac0c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:07.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.642+0000 7f35b0966640 1 --2- 172.21.15.72:0/2039417685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ac0ccac0 0x7f35ac0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:07.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.645+0000 7f35aaffd640 1 -- 172.21.15.72:0/2039417685 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237373918 0 0) 0x7f35ac1575f0 con 0x7f35ac151680 2023-12-13T00:01:07.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.645+0000 7f35aaffd640 1 -- 172.21.15.72:0/2039417685 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3594003520 con 0x7f35ac151680 2023-12-13T00:01:07.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.645+0000 7f35b0966640 1 -- 172.21.15.72:0/2039417685 >> v2:172.21.15.176:3300/0 conn(0x7f35ac1571d0 msgr2=0x7f35ac0c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:07.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.645+0000 7f35b0966640 1 --2- 172.21.15.72:0/2039417685 >> v2:172.21.15.176:3300/0 conn(0x7f35ac1571d0 0x7f35ac0c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:07.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.645+0000 7f35b0966640 1 -- 172.21.15.72:0/2039417685 >> v1:172.21.15.72:6789/0 conn(0x7f35ac151680 legacy=0x7f35ac06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:07.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.645+0000 7f35b0966640 1 -- 172.21.15.72:0/2039417685 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac157b60 con 0x7f35ac0ccac0 2023-12-13T00:01:07.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.647+0000 7f35b0966640 1 --2- 172.21.15.72:0/2039417685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ac0ccac0 0x7f35ac0ccf10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009d90 tx=0x7f35a402bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9a8260696141330 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:07.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.650+0000 7f35aaffd640 1 -- 172.21.15.72:0/2039417685 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a402cce0 con 0x7f35ac0ccac0 2023-12-13T00:01:07.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.651+0000 7f35aaffd640 1 -- 172.21.15.72:0/2039417685 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a402ce40 con 0x7f35ac0ccac0 2023-12-13T00:01:07.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.651+0000 7f35aaffd640 1 -- 172.21.15.72:0/2039417685 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4034660 con 0x7f35ac0ccac0 2023-12-13T00:01:07.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.651+0000 7f35b23c9640 1 -- 172.21.15.72:0/2039417685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ac0ccac0 msgr2=0x7f35ac0ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:07.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.651+0000 7f35b23c9640 1 --2- 172.21.15.72:0/2039417685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ac0ccac0 0x7f35ac0ccf10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009d90 tx=0x7f35a402bf30 comp rx=0 tx=0).stop 2023-12-13T00:01:07.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.651+0000 7f35b23c9640 1 -- 172.21.15.72:0/2039417685 shutdown_connections 2023-12-13T00:01:07.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.651+0000 7f35b23c9640 1 --2- 172.21.15.72:0/2039417685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ac0ccac0 0x7f35ac0ccf10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:07.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.651+0000 7f35b23c9640 1 --2- 172.21.15.72:0/2039417685 >> v2:172.21.15.176:3300/0 conn(0x7f35ac1571d0 0x7f35ac0c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:07.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.651+0000 7f35b23c9640 1 -- 172.21.15.72:0/2039417685 >> 172.21.15.72:0/2039417685 conn(0x7f35ac0707f0 msgr2=0x7f35ac070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:07.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.651+0000 7f35b23c9640 1 -- 172.21.15.72:0/2039417685 shutdown_connections 2023-12-13T00:01:07.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.651+0000 7f35b23c9640 1 -- 172.21.15.72:0/2039417685 wait complete. 2023-12-13T00:01:07.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.652+0000 7f35b23c9640 1 Processor -- start 2023-12-13T00:01:07.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.653+0000 7f35b23c9640 1 -- start start 2023-12-13T00:01:07.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.653+0000 7f35b23c9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ac0ccac0 0x7f35ac1ee9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:07.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.653+0000 7f35b23c9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35ac151680 0x7f35ac0c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:07.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.653+0000 7f35b23c9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35ac1571d0 0x7f35ac06c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:07.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.653+0000 7f35b23c9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0cbbf0 con 0x7f35ac1571d0 2023-12-13T00:01:07.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.653+0000 7f35b23c9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0cad00 con 0x7f35ac151680 2023-12-13T00:01:07.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.653+0000 7f35b23c9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0cafe0 con 0x7f35ac0ccac0 2023-12-13T00:01:07.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.654+0000 7f35b0966640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35ac1571d0 0x7f35ac06c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:07.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.654+0000 7f35ab7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35ac151680 0x7f35ac0c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:07.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.654+0000 7f35abfff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ac0ccac0 0x7f35ac1ee9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:07.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.654+0000 7f35ab7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35ac151680 0x7f35ac0c51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:59908/0 (socket says 172.21.15.72:59908) 2023-12-13T00:01:07.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.654+0000 7f35ab7fe640 1 -- 172.21.15.72:0/1654352946 learned_addr learned my addr 172.21.15.72:0/1654352946 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:07.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.658+0000 7f35b0966640 1 -- 172.21.15.72:0/1654352946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ac0ccac0 msgr2=0x7f35ac1ee9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:07.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.658+0000 7f35b0966640 1 --2- 172.21.15.72:0/1654352946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ac0ccac0 0x7f35ac1ee9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:07.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.658+0000 7f35b0966640 1 -- 172.21.15.72:0/1654352946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35ac151680 msgr2=0x7f35ac0c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:07.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.658+0000 7f35b0966640 1 --2- 172.21.15.72:0/1654352946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35ac151680 0x7f35ac0c51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:07.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.658+0000 7f35b0966640 1 -- 172.21.15.72:0/1654352946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a4009a70 con 0x7f35ac1571d0 2023-12-13T00:01:07.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.660+0000 7f35b0966640 1 --2- 172.21.15.72:0/1654352946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35ac1571d0 0x7f35ac06c110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f35a4033000 tx=0x7f35a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:07.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.663+0000 7f35a8ff9640 1 -- 172.21.15.72:0/1654352946 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a403d600 con 0x7f35ac1571d0 2023-12-13T00:01:07.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.663+0000 7f35a8ff9640 1 -- 172.21.15.72:0/1654352946 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a403d780 con 0x7f35ac1571d0 2023-12-13T00:01:07.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.663+0000 7f35a8ff9640 1 -- 172.21.15.72:0/1654352946 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a403db30 con 0x7f35ac1571d0 2023-12-13T00:01:07.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.663+0000 7f35b23c9640 1 -- 172.21.15.72:0/1654352946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ac0cb2c0 con 0x7f35ac1571d0 2023-12-13T00:01:07.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.664+0000 7f35b23c9640 1 -- 172.21.15.72:0/1654352946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ac0cb880 con 0x7f35ac1571d0 2023-12-13T00:01:07.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.664+0000 7f35b23c9640 1 -- 172.21.15.72:0/1654352946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ac156ff0 con 0x7f35ac1571d0 2023-12-13T00:01:07.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.684+0000 7f35a8ff9640 1 -- 172.21.15.72:0/1654352946 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f35a403b040 con 0x7f35ac1571d0 2023-12-13T00:01:07.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.685+0000 7f35a8ff9640 1 --2- 172.21.15.72:0/1654352946 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f359806b240 0x7f359806d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:07.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.685+0000 7f35abfff640 1 --2- 172.21.15.72:0/1654352946 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f359806b240 0x7f359806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.685+0000 7f35abfff640 1 --2- 172.21.15.72:0/1654352946 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f359806b240 0x7f359806d700 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f35a00011e0 tx=0x7f35a0007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:07.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.928+0000 7f35a8ff9640 1 -- 172.21.15.72:0/1654352946 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f35a407a6c0 con 0x7f35ac1571d0 2023-12-13T00:01:07.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:07.928+0000 7f35a8ff9640 1 -- 172.21.15.72:0/1654352946 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f35a4076a00 con 0x7f35ac1571d0 2023-12-13T00:01:08.085 INFO:tasks.ceph.mds.f.smithi176.stderr:2023-12-13T00:01:08.084+0000 f5b6640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-12-13T00:01:08.085 INFO:tasks.ceph.mds.f.smithi176.stderr:2023-12-13T00:01:08.084+0000 f5b6640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2023-12-13T00:01:08.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.139+0000 7f35b23c9640 1 -- 172.21.15.72:0/1654352946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f35ac073dc0 con 0x7f35ac1571d0 2023-12-13T00:01:08.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.278+0000 7f35a8ff9640 1 -- 172.21.15.72:0/1654352946 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171162 (secure 0 0 0) 0x7f35a4039090 con 0x7f35ac1571d0 2023-12-13T00:01:08.281 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:01:08.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.280+0000 7f35b23c9640 1 -- 172.21.15.72:0/1654352946 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f359806b240 msgr2=0x7f359806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:08.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.281+0000 7f35b23c9640 1 --2- 172.21.15.72:0/1654352946 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f359806b240 0x7f359806d700 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f35a00011e0 tx=0x7f35a0007d30 comp rx=0 tx=0).stop 2023-12-13T00:01:08.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.281+0000 7f35b23c9640 1 -- 172.21.15.72:0/1654352946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35ac1571d0 msgr2=0x7f35ac06c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:08.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.281+0000 7f35b23c9640 1 --2- 172.21.15.72:0/1654352946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35ac1571d0 0x7f35ac06c110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f35a4033000 tx=0x7f35a4004a40 comp rx=0 tx=0).stop 2023-12-13T00:01:08.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.281+0000 7f35b23c9640 1 -- 172.21.15.72:0/1654352946 shutdown_connections 2023-12-13T00:01:08.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.281+0000 7f35b23c9640 1 --2- 172.21.15.72:0/1654352946 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f359806b240 0x7f359806d700 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:08.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.281+0000 7f35b23c9640 1 --2- 172.21.15.72:0/1654352946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35ac1571d0 0x7f35ac06c110 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:08.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.281+0000 7f35b23c9640 1 --2- 172.21.15.72:0/1654352946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35ac151680 0x7f35ac0c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:08.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.281+0000 7f35b23c9640 1 --2- 172.21.15.72:0/1654352946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ac0ccac0 0x7f35ac1ee9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:08.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.281+0000 7f35b23c9640 1 -- 172.21.15.72:0/1654352946 >> 172.21.15.72:0/1654352946 conn(0x7f35ac0707f0 msgr2=0x7f35ac1552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:08.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.281+0000 7f35b23c9640 1 -- 172.21.15.72:0/1654352946 shutdown_connections 2023-12-13T00:01:08.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.281+0000 7f35b23c9640 1 -- 172.21.15.72:0/1654352946 wait complete. 2023-12-13T00:01:08.292 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":5,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3427715460},{"type":"v1","addr":"172.21.15.72:6801","nonce":3427715460}]},"active_addr":"172.21.15.72:6801/3427715460","active_change":"2023-12-12T23:59:58.063135+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4112,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":3103761897}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":450926852}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":3514946569}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1844937857}]}]} 2023-12-13T00:01:08.296 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-13T00:01:08.296 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-13T00:01:08.297 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:01:08.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.395+0000 7f5d4214c640 1 Processor -- start 2023-12-13T00:01:08.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.395+0000 7f5d4214c640 1 -- start start 2023-12-13T00:01:08.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.395+0000 7f5d4214c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5d3c1591b0 0x7f5d3c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:08.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.395+0000 7f5d4214c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d3c1573c0 con 0x7f5d3c0c7640 2023-12-13T00:01:08.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.395+0000 7f5d4214c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d3c1576a0 con 0x7f5d3c151260 2023-12-13T00:01:08.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.395+0000 7f5d4214c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3c1571d0 con 0x7f5d3c1591b0 2023-12-13T00:01:08.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.396+0000 7f5d3b7fe640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f5d3c151260 0x7f5d3c0ccf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:43726/0 (socket says 172.21.15.72:43726) 2023-12-13T00:01:08.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.396+0000 7f5d3b7fe640 1 -- 172.21.15.72:0/469110015 learned_addr learned my addr 172.21.15.72:0/469110015 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:08.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.396+0000 7f5d3bfff640 1 --2- 172.21.15.72:0/469110015 >> v2:172.21.15.176:3300/0 conn(0x7f5d3c1591b0 0x7f5d3c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:08.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.399+0000 7f5d3a7fc640 1 -- 172.21.15.72:0/469110015 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481236935 0 0) 0x7f5d3c1573c0 con 0x7f5d3c0c7640 2023-12-13T00:01:08.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.399+0000 7f5d3a7fc640 1 -- 172.21.15.72:0/469110015 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d24003520 con 0x7f5d3c0c7640 2023-12-13T00:01:08.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.400+0000 7f5d3bfff640 1 -- 172.21.15.72:0/469110015 >> v1:172.21.15.176:6789/0 conn(0x7f5d3c151260 legacy=0x7f5d3c0ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:08.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.400+0000 7f5d3bfff640 1 -- 172.21.15.72:0/469110015 >> v1:172.21.15.72:6789/0 conn(0x7f5d3c0c7640 legacy=0x7f5d3c158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:08.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.400+0000 7f5d3bfff640 1 -- 172.21.15.72:0/469110015 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c157980 con 0x7f5d3c1591b0 2023-12-13T00:01:08.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.405+0000 7f5d3bfff640 1 --2- 172.21.15.72:0/469110015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d3c1591b0 0x7f5d3c06f040 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009d90 tx=0x7f5d3402bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a317562a15d91a9f server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:08.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.407+0000 7f5d3a7fc640 1 -- 172.21.15.72:0/469110015 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3402cd80 con 0x7f5d3c1591b0 2023-12-13T00:01:08.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.408+0000 7f5d3a7fc640 1 -- 172.21.15.72:0/469110015 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d34034440 con 0x7f5d3c1591b0 2023-12-13T00:01:08.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.408+0000 7f5d3a7fc640 1 -- 172.21.15.72:0/469110015 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d340347b0 con 0x7f5d3c1591b0 2023-12-13T00:01:08.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.409+0000 7f5d4214c640 1 -- 172.21.15.72:0/469110015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d3c1591b0 msgr2=0x7f5d3c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:08.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.409+0000 7f5d4214c640 1 --2- 172.21.15.72:0/469110015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d3c1591b0 0x7f5d3c06f040 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009d90 tx=0x7f5d3402bfd0 comp rx=0 tx=0).stop 2023-12-13T00:01:08.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.409+0000 7f5d4214c640 1 -- 172.21.15.72:0/469110015 shutdown_connections 2023-12-13T00:01:08.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.409+0000 7f5d4214c640 1 --2- 172.21.15.72:0/469110015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d3c1591b0 0x7f5d3c06f040 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:08.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.409+0000 7f5d4214c640 1 -- 172.21.15.72:0/469110015 >> 172.21.15.72:0/469110015 conn(0x7f5d3c070990 msgr2=0x7f5d3c070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:08.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.409+0000 7f5d4214c640 1 -- 172.21.15.72:0/469110015 shutdown_connections 2023-12-13T00:01:08.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.409+0000 7f5d4214c640 1 -- 172.21.15.72:0/469110015 wait complete. 2023-12-13T00:01:08.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.410+0000 7f5d4214c640 1 Processor -- start 2023-12-13T00:01:08.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.410+0000 7f5d4214c640 1 -- start start 2023-12-13T00:01:08.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.411+0000 7f5d4214c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d3c0c7640 0x7f5d3c152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:08.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.411+0000 7f5d4214c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d3c151260 0x7f5d3c1526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:08.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.411+0000 7f5d4214c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d3c1591b0 0x7f5d3c1f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:08.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.411+0000 7f5d4214c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c153d00 con 0x7f5d3c0c7640 2023-12-13T00:01:08.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.411+0000 7f5d4214c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c14f8b0 con 0x7f5d3c1591b0 2023-12-13T00:01:08.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.411+0000 7f5d4214c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c151cf0 con 0x7f5d3c151260 2023-12-13T00:01:08.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.411+0000 7f5d3b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d3c0c7640 0x7f5d3c152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:08.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.412+0000 7f5d3b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d3c0c7640 0x7f5d3c152180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35450/0 (socket says 172.21.15.72:35450) 2023-12-13T00:01:08.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.412+0000 7f5d3b7fe640 1 -- 172.21.15.72:0/2686427444 learned_addr learned my addr 172.21.15.72:0/2686427444 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:08.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.412+0000 7f5d3bfff640 1 --2- 172.21.15.72:0/2686427444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d3c1591b0 0x7f5d3c1f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:08.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.412+0000 7f5d3affd640 1 --2- 172.21.15.72:0/2686427444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d3c151260 0x7f5d3c1526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:08.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.415+0000 7f5d3b7fe640 1 -- 172.21.15.72:0/2686427444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d3c151260 msgr2=0x7f5d3c1526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:08.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.415+0000 7f5d3b7fe640 1 --2- 172.21.15.72:0/2686427444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d3c151260 0x7f5d3c1526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:08.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.415+0000 7f5d3b7fe640 1 -- 172.21.15.72:0/2686427444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d3c1591b0 msgr2=0x7f5d3c1f2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:08.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.415+0000 7f5d3b7fe640 1 --2- 172.21.15.72:0/2686427444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d3c1591b0 0x7f5d3c1f2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:08.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.415+0000 7f5d3b7fe640 1 -- 172.21.15.72:0/2686427444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d34009a70 con 0x7f5d3c0c7640 2023-12-13T00:01:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.417+0000 7f5d3b7fe640 1 --2- 172.21.15.72:0/2686427444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d3c0c7640 0x7f5d3c152180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00c4d0 tx=0x7f5d2c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:08.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.423+0000 7f5d23fff640 1 -- 172.21.15.72:0/2686427444 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c005ce0 con 0x7f5d3c0c7640 2023-12-13T00:01:08.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.423+0000 7f5d23fff640 1 -- 172.21.15.72:0/2686427444 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2c005e40 con 0x7f5d3c0c7640 2023-12-13T00:01:08.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.423+0000 7f5d4214c640 1 -- 172.21.15.72:0/2686427444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3c14fac0 con 0x7f5d3c0c7640 2023-12-13T00:01:08.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.423+0000 7f5d23fff640 1 -- 172.21.15.72:0/2686427444 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c007270 con 0x7f5d3c0c7640 2023-12-13T00:01:08.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.423+0000 7f5d4214c640 1 -- 172.21.15.72:0/2686427444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3c150080 con 0x7f5d3c0c7640 2023-12-13T00:01:08.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.424+0000 7f5d4214c640 1 -- 172.21.15.72:0/2686427444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d3c06ed70 con 0x7f5d3c0c7640 2023-12-13T00:01:08.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.668+0000 7f5d23fff640 1 -- 172.21.15.72:0/2686427444 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5d2c0073d0 con 0x7f5d3c0c7640 2023-12-13T00:01:08.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.668+0000 7f5d23fff640 1 --2- 172.21.15.72:0/2686427444 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5d2806b240 0x7f5d2806d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:08.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.668+0000 7f5d3affd640 1 --2- 172.21.15.72:0/2686427444 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5d2806b240 0x7f5d2806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:08.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.669+0000 7f5d3affd640 1 --2- 172.21.15.72:0/2686427444 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5d2806b240 0x7f5d2806d700 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c071680 tx=0x7f5d30009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:08.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.682+0000 7f5d23fff640 1 -- 172.21.15.72:0/2686427444 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f5d2c01de70 con 0x7f5d3c0c7640 2023-12-13T00:01:08.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.682+0000 7f5d23fff640 1 -- 172.21.15.72:0/2686427444 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5d2c0541e0 con 0x7f5d3c0c7640 2023-12-13T00:01:08.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.860+0000 7f5d4214c640 1 -- 172.21.15.72:0/2686427444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d3c067470 con 0x7f5d3c0c7640 2023-12-13T00:01:08.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.897+0000 7f5d23fff640 1 -- 172.21.15.72:0/2686427444 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18563 (secure 0 0 0) 0x7f5d2c057800 con 0x7f5d3c0c7640 2023-12-13T00:01:08.899 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:01:08.899 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:01:00.435991+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T00:00:27.701252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T00:00:29.324356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T00:00:33.363089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.3","mappings":[{"from":7,"to":5}]},{"pgid":"4.10","mappings":[{"from":7,"to":0}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:01:08.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.899+0000 7f5d4214c640 1 -- 172.21.15.72:0/2686427444 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5d2806b240 msgr2=0x7f5d2806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:08.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.899+0000 7f5d4214c640 1 --2- 172.21.15.72:0/2686427444 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5d2806b240 0x7f5d2806d700 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c071680 tx=0x7f5d30009040 comp rx=0 tx=0).stop 2023-12-13T00:01:08.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.899+0000 7f5d4214c640 1 -- 172.21.15.72:0/2686427444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d3c0c7640 msgr2=0x7f5d3c152180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:08.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.899+0000 7f5d4214c640 1 --2- 172.21.15.72:0/2686427444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d3c0c7640 0x7f5d3c152180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00c4d0 tx=0x7f5d2c00c990 comp rx=0 tx=0).stop 2023-12-13T00:01:08.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.900+0000 7f5d4214c640 1 -- 172.21.15.72:0/2686427444 shutdown_connections 2023-12-13T00:01:08.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.900+0000 7f5d4214c640 1 --2- 172.21.15.72:0/2686427444 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5d2806b240 0x7f5d2806d700 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:08.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.900+0000 7f5d4214c640 1 --2- 172.21.15.72:0/2686427444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d3c1591b0 0x7f5d3c1f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:08.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.900+0000 7f5d4214c640 1 --2- 172.21.15.72:0/2686427444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d3c151260 0x7f5d3c1526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:08.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.900+0000 7f5d4214c640 1 --2- 172.21.15.72:0/2686427444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d3c0c7640 0x7f5d3c152180 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:08.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.900+0000 7f5d4214c640 1 -- 172.21.15.72:0/2686427444 >> 172.21.15.72:0/2686427444 conn(0x7f5d3c070990 msgr2=0x7f5d3c0cb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:08.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.900+0000 7f5d4214c640 1 -- 172.21.15.72:0/2686427444 shutdown_connections 2023-12-13T00:01:08.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:08.900+0000 7f5d4214c640 1 -- 172.21.15.72:0/2686427444 wait complete. 2023-12-13T00:01:08.911 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-13T00:01:08.911 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:01:09.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.009+0000 7fbf4894c640 1 Processor -- start 2023-12-13T00:01:09.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.009+0000 7fbf4894c640 1 -- start start 2023-12-13T00:01:09.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.010+0000 7fbf4894c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf44153b50 0x7fbf440cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.010+0000 7fbf4894c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf4415a2a0 0x7fbf440cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.010+0000 7fbf4894c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4415d550 con 0x7fbf44153770 2023-12-13T00:01:09.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.010+0000 7fbf4894c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4415da80 con 0x7fbf4415a2a0 2023-12-13T00:01:09.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.010+0000 7fbf4894c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf441596e0 con 0x7fbf44153b50 2023-12-13T00:01:09.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.011+0000 7fbf42d9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf4415a2a0 0x7fbf440cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.011+0000 7fbf41d9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf44153b50 0x7fbf440cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.011+0000 7fbf4259c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbf44153770 0x7fbf44159b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47960/0 (socket says 172.21.15.72:47960) 2023-12-13T00:01:09.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.011+0000 7fbf4259c640 1 -- 172.21.15.72:0/2283622119 learned_addr learned my addr 172.21.15.72:0/2283622119 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:09.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.013+0000 7fbf41d9b640 1 -- 172.21.15.72:0/2283622119 >> v2:172.21.15.72:3300/0 conn(0x7fbf4415a2a0 msgr2=0x7fbf440cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:09.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.013+0000 7fbf41d9b640 1 --2- 172.21.15.72:0/2283622119 >> v2:172.21.15.72:3300/0 conn(0x7fbf4415a2a0 0x7fbf440cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.014+0000 7fbf41d9b640 1 -- 172.21.15.72:0/2283622119 >> v1:172.21.15.72:6789/0 conn(0x7fbf44153770 legacy=0x7fbf44159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.014+0000 7fbf41d9b640 1 -- 172.21.15.72:0/2283622119 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4415d7a0 con 0x7fbf44153b50 2023-12-13T00:01:09.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.016+0000 7fbf41d9b640 1 --2- 172.21.15.72:0/2283622119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf44153b50 0x7fbf440cb6b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbf380097a0 tx=0x7fbf3802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc0a1f8da915e92f server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.019+0000 7fbf4159a640 1 -- 172.21.15.72:0/2283622119 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38031830 con 0x7fbf44153b50 2023-12-13T00:01:09.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.019+0000 7fbf4159a640 1 -- 172.21.15.72:0/2283622119 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf38031990 con 0x7fbf44153b50 2023-12-13T00:01:09.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.019+0000 7fbf4159a640 1 -- 172.21.15.72:0/2283622119 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38031d20 con 0x7fbf44153b50 2023-12-13T00:01:09.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.020+0000 7fbf4894c640 1 -- 172.21.15.72:0/2283622119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf44153b50 msgr2=0x7fbf440cb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.020+0000 7fbf4894c640 1 --2- 172.21.15.72:0/2283622119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf44153b50 0x7fbf440cb6b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbf380097a0 tx=0x7fbf3802b8d0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.020+0000 7fbf4894c640 1 -- 172.21.15.72:0/2283622119 shutdown_connections 2023-12-13T00:01:09.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.020+0000 7fbf4894c640 1 --2- 172.21.15.72:0/2283622119 >> v2:172.21.15.72:3300/0 conn(0x7fbf4415a2a0 0x7fbf440cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.020+0000 7fbf4894c640 1 --2- 172.21.15.72:0/2283622119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf44153b50 0x7fbf440cb6b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.020+0000 7fbf4894c640 1 -- 172.21.15.72:0/2283622119 >> 172.21.15.72:0/2283622119 conn(0x7fbf44060f20 msgr2=0x7fbf44061330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.020+0000 7fbf4894c640 1 -- 172.21.15.72:0/2283622119 shutdown_connections 2023-12-13T00:01:09.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.020+0000 7fbf4894c640 1 -- 172.21.15.72:0/2283622119 wait complete. 2023-12-13T00:01:09.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.022+0000 7fbf4894c640 1 Processor -- start 2023-12-13T00:01:09.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.022+0000 7fbf4894c640 1 -- start start 2023-12-13T00:01:09.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.022+0000 7fbf4894c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf44153770 0x7fbf4414d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.022+0000 7fbf4894c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf4415a2a0 0x7fbf4415b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.022+0000 7fbf4894c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf4415c740 0x7fbf441e5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.022+0000 7fbf4894c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf441f3590 con 0x7fbf4415c740 2023-12-13T00:01:09.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.022+0000 7fbf4894c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4415a810 con 0x7fbf4415a2a0 2023-12-13T00:01:09.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.022+0000 7fbf4894c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf441f2ff0 con 0x7fbf44153770 2023-12-13T00:01:09.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.023+0000 7fbf4259c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf44153770 0x7fbf4414d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.023+0000 7fbf42d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf4415c740 0x7fbf441e5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.023+0000 7fbf41d9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf4415a2a0 0x7fbf4415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.023+0000 7fbf42d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf4415c740 0x7fbf441e5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35472/0 (socket says 172.21.15.72:35472) 2023-12-13T00:01:09.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.023+0000 7fbf42d9d640 1 -- 172.21.15.72:0/3146208676 learned_addr learned my addr 172.21.15.72:0/3146208676 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:09.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.027+0000 7fbf4259c640 1 -- 172.21.15.72:0/3146208676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf4415a2a0 msgr2=0x7fbf4415b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.027+0000 7fbf4259c640 1 --2- 172.21.15.72:0/3146208676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf4415a2a0 0x7fbf4415b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.027+0000 7fbf4259c640 1 -- 172.21.15.72:0/3146208676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf4415c740 msgr2=0x7fbf441e5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.027+0000 7fbf4259c640 1 --2- 172.21.15.72:0/3146208676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf4415c740 0x7fbf441e5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.027+0000 7fbf4259c640 1 -- 172.21.15.72:0/3146208676 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf38009400 con 0x7fbf44153770 2023-12-13T00:01:09.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.029+0000 7fbf4259c640 1 --2- 172.21.15.72:0/3146208676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf44153770 0x7fbf4414d160 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400ca50 tx=0x7fbf3400cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.033+0000 7fbf32ffd640 1 -- 172.21.15.72:0/3146208676 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3400abb0 con 0x7fbf44153770 2023-12-13T00:01:09.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.033+0000 7fbf32ffd640 1 -- 172.21.15.72:0/3146208676 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3400ad10 con 0x7fbf44153770 2023-12-13T00:01:09.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.033+0000 7fbf4894c640 1 -- 172.21.15.72:0/3146208676 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf441f32b0 con 0x7fbf44153770 2023-12-13T00:01:09.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.033+0000 7fbf32ffd640 1 -- 172.21.15.72:0/3146208676 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34012620 con 0x7fbf44153770 2023-12-13T00:01:09.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.033+0000 7fbf4894c640 1 -- 172.21.15.72:0/3146208676 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4415ab00 con 0x7fbf44153770 2023-12-13T00:01:09.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.034+0000 7fbf4894c640 1 -- 172.21.15.72:0/3146208676 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf440ae570 con 0x7fbf44153770 2023-12-13T00:01:09.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.278+0000 7fbf32ffd640 1 -- 172.21.15.72:0/3146208676 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbf34007070 con 0x7fbf44153770 2023-12-13T00:01:09.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.278+0000 7fbf32ffd640 1 --2- 172.21.15.72:0/3146208676 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbf2406b210 0x7fbf2406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.279+0000 7fbf41d9b640 1 --2- 172.21.15.72:0/3146208676 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbf2406b210 0x7fbf2406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.279+0000 7fbf41d9b640 1 --2- 172.21.15.72:0/3146208676 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbf2406b210 0x7fbf2406d6d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbf38036000 tx=0x7fbf3803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.281+0000 7fbf32ffd640 1 -- 172.21.15.72:0/3146208676 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fbf340587d0 con 0x7fbf44153770 2023-12-13T00:01:09.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.293+0000 7fbf32ffd640 1 -- 172.21.15.72:0/3146208676 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbf34054b10 con 0x7fbf44153770 2023-12-13T00:01:09.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.461+0000 7fbf4894c640 1 -- 172.21.15.72:0/3146208676 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf44067ca0 con 0x7fbf44153770 2023-12-13T00:01:09.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.499+0000 7fbf32ffd640 1 -- 172.21.15.72:0/3146208676 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18563 (secure 0 0 0) 0x7fbf34017070 con 0x7fbf44153770 2023-12-13T00:01:09.500 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:01:09.500 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:01:00.435991+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T00:00:27.701252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T00:00:29.324356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T00:00:33.363089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.3","mappings":[{"from":7,"to":5}]},{"pgid":"4.10","mappings":[{"from":7,"to":0}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:01:09.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.500+0000 7fbf4894c640 1 -- 172.21.15.72:0/3146208676 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbf2406b210 msgr2=0x7fbf2406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.500+0000 7fbf4894c640 1 --2- 172.21.15.72:0/3146208676 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbf2406b210 0x7fbf2406d6d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbf38036000 tx=0x7fbf3803c040 comp rx=0 tx=0).stop 2023-12-13T00:01:09.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.501+0000 7fbf4894c640 1 -- 172.21.15.72:0/3146208676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf44153770 msgr2=0x7fbf4414d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.501+0000 7fbf4894c640 1 --2- 172.21.15.72:0/3146208676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf44153770 0x7fbf4414d160 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400ca50 tx=0x7fbf3400cf10 comp rx=0 tx=0).stop 2023-12-13T00:01:09.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.501+0000 7fbf4894c640 1 -- 172.21.15.72:0/3146208676 shutdown_connections 2023-12-13T00:01:09.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.501+0000 7fbf4894c640 1 --2- 172.21.15.72:0/3146208676 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbf2406b210 0x7fbf2406d6d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.501+0000 7fbf4894c640 1 --2- 172.21.15.72:0/3146208676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf4415c740 0x7fbf441e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.501+0000 7fbf4894c640 1 --2- 172.21.15.72:0/3146208676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf4415a2a0 0x7fbf4415b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.501+0000 7fbf4894c640 1 --2- 172.21.15.72:0/3146208676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf44153770 0x7fbf4414d160 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.501+0000 7fbf4894c640 1 -- 172.21.15.72:0/3146208676 >> 172.21.15.72:0/3146208676 conn(0x7fbf44060f20 msgr2=0x7fbf44150d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.501+0000 7fbf4894c640 1 -- 172.21.15.72:0/3146208676 shutdown_connections 2023-12-13T00:01:09.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.501+0000 7fbf4894c640 1 -- 172.21.15.72:0/3146208676 wait complete. 2023-12-13T00:01:09.513 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-13T00:01:09.513 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-13T00:01:09.514 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-13T00:01:09.514 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-13T00:01:09.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-13T00:01:09.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-13T00:01:09.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-13T00:01:09.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-13T00:01:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.685+0000 7f100a62b640 1 Processor -- start 2023-12-13T00:01:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.686+0000 7fa7c93c5640 1 Processor -- start 2023-12-13T00:01:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.685+0000 7f100a62b640 1 -- start start 2023-12-13T00:01:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.686+0000 7f100a62b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10040c9c70 0x7f10041594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.687+0000 7f100a62b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10040cd430 0x7f10040cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.687+0000 7f100a62b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10040cba70 con 0x7f10040cbf00 2023-12-13T00:01:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.687+0000 7f100a62b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1004153c60 con 0x7f10040cd430 2023-12-13T00:01:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.687+0000 7f100a62b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10040cb490 con 0x7f10040c9c70 2023-12-13T00:01:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.687+0000 7f25d6f75640 1 Processor -- start 2023-12-13T00:01:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.686+0000 7fa7c93c5640 1 -- start start 2023-12-13T00:01:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.687+0000 7f972d4ad640 1 Processor -- start 2023-12-13T00:01:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.687+0000 7f972d4ad640 1 -- start start 2023-12-13T00:01:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f972d4ad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9728152b30 0x7f9728156120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f972d4ad640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9728158aa0 0x7f9728071c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.687+0000 7f4f430d3640 1 Processor -- start 2023-12-13T00:01:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.687+0000 7f4f430d3640 1 -- start start 2023-12-13T00:01:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f4f430d3640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4f3c152b30 0x7f4f3c156120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.688+0000 7f1003fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10040c9c70 0x7f10041594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.688+0000 7f1003fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10040c9c70 0x7f10041594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:48218/0 (socket says 172.21.15.72:48218) 2023-12-13T00:01:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.688+0000 7f1003fff640 1 -- 172.21.15.72:0/429148746 learned_addr learned my addr 172.21.15.72:0/429148746 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.688+0000 7f1008bc8640 1 --2- 172.21.15.72:0/429148746 >> v2:172.21.15.72:3300/0 conn(0x7f10040cd430 0x7f10040cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.687+0000 7f25d6f75640 1 -- start start 2023-12-13T00:01:09.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f25d6f75640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25c80d6da0 0x7f25c8033280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f4f430d3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f3c158aa0 0x7f4f3c071c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f49e359e640 1 Processor -- start 2023-12-13T00:01:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f25d6f75640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f25c804c440 0x7f25c80dd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7fa7c93c5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa7bc0dcd80 0x7fa7bc006210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7fa7c93c5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7bc006750 0x7fa7bc006b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7fa7c93c5640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc0070b0 con 0x7fa7bc0d5380 2023-12-13T00:01:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7fa7c93c5640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7bc0072e0 con 0x7fa7bc0dcd80 2023-12-13T00:01:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7fa7c93c5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0075c0 con 0x7fa7bc006750 2023-12-13T00:01:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f972d4ad640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97280723b0 con 0x7f97280c6d50 2023-12-13T00:01:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f972d4ad640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97280721b0 con 0x7f9728158aa0 2023-12-13T00:01:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f972d4ad640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9728072690 con 0x7f9728152b30 2023-12-13T00:01:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f4f430d3640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f3c0c6d50 0x7f4f3c0c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f038b59e640 1 Processor -- start 2023-12-13T00:01:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f25d6f75640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c80d7180 con 0x7f25c80337c0 2023-12-13T00:01:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f25d6f75640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c8050f80 con 0x7f25c80d6da0 2023-12-13T00:01:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f25d6f75640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c80076d0 con 0x7f25c804c440 2023-12-13T00:01:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f4f430d3640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c0721b0 con 0x7f4f3c0c6d50 2023-12-13T00:01:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f4f430d3640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c158ef0 con 0x7f4f3c152b30 2023-12-13T00:01:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f4f430d3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c0723b0 con 0x7f4f3c158aa0 2023-12-13T00:01:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f038b59e640 1 -- start start 2023-12-13T00:01:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.689+0000 7f49e359e640 1 -- start start 2023-12-13T00:01:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.690+0000 7f4f40e6f640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4f3c152b30 0x7f4f3c156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.690+0000 7f25d6774640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f25c804c440 0x7f25c80dd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.690+0000 7f4f40e6f640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4f3c152b30 0x7f4f3c156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:59942/0 (socket says 172.21.15.72:59942) 2023-12-13T00:01:09.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.690+0000 7f4f40e6f640 1 -- 172.21.15.72:0/1854320182 learned_addr learned my addr 172.21.15.72:0/1854320182 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:09.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.690+0000 7f97267fc640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9728158aa0 0x7f9728071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.690+0000 7f038b59e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038c157820 0x7f038c161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.690+0000 7f038b59e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f038c0c5080 0x7f038c15d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.690+0000 7f25d6774640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f25c804c440 0x7f25c80dd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:59956/0 (socket says 172.21.15.72:59956) 2023-12-13T00:01:09.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.690+0000 7f25d6774640 1 -- 172.21.15.72:0/2521509791 learned_addr learned my addr 172.21.15.72:0/2521509791 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:09.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.690+0000 7f49e359e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f49e40cc050 0x7f49e415a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.691+0000 7f49e359e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e4153ab0 con 0x7f49e40c8bc0 2023-12-13T00:01:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.691+0000 7f49e359e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e40cbbc0 con 0x7f49e40c86e0 2023-12-13T00:01:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.691+0000 7f49e359e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e40c9890 con 0x7f49e40cc050 2023-12-13T00:01:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.690+0000 7f038b59e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f038c0c1460 0x7f038c0c6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.690+0000 7f038b59e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038c161270 con 0x7f038c0c5080 2023-12-13T00:01:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.691+0000 7f1003fff640 1 -- 172.21.15.72:0/429148746 >> v2:172.21.15.72:3300/0 conn(0x7f10040cd430 msgr2=0x7f10040cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.691+0000 7f1003fff640 1 --2- 172.21.15.72:0/429148746 >> v2:172.21.15.72:3300/0 conn(0x7f10040cd430 0x7f10040cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.691+0000 7f1003fff640 1 -- 172.21.15.72:0/429148746 >> v1:172.21.15.72:6789/0 conn(0x7f10040cbf00 legacy=0x7f10040ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.691+0000 7f1003fff640 1 -- 172.21.15.72:0/429148746 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10040ce2f0 con 0x7f10040c9c70 2023-12-13T00:01:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.690+0000 7f038b59e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038c0c69b0 con 0x7f038c0c1460 2023-12-13T00:01:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.690+0000 7f038b59e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0c8b50 con 0x7f038c157820 2023-12-13T00:01:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.691+0000 7f97267fc640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9728158aa0 0x7f9728071c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35502/0 (socket says 172.21.15.72:35502) 2023-12-13T00:01:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.691+0000 7f97267fc640 1 -- 172.21.15.72:0/1078072510 learned_addr learned my addr 172.21.15.72:0/1078072510 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:09.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.691+0000 7fa7c27fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa7bc0dcd80 0x7fa7bc006210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.691+0000 7fa7c37fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7bc006750 0x7fa7bc006b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.692+0000 7fa7c37fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7bc006750 0x7fa7bc006b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:48226/0 (socket says 172.21.15.72:48226) 2023-12-13T00:01:09.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.692+0000 7fa7c37fe640 1 -- 172.21.15.72:0/3889755945 learned_addr learned my addr 172.21.15.72:0/3889755945 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.693+0000 7f25d5f73640 1 --2- 172.21.15.72:0/2521509791 >> v2:172.21.15.72:3300/0 conn(0x7f25c80d6da0 0x7f25c8033280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.694+0000 7f25d6774640 1 -- 172.21.15.72:0/2521509791 >> v2:172.21.15.72:3300/0 conn(0x7f25c80d6da0 msgr2=0x7f25c8033280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.694+0000 7f25d6774640 1 --2- 172.21.15.72:0/2521509791 >> v2:172.21.15.72:3300/0 conn(0x7f25c80d6da0 0x7f25c8033280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.694+0000 7f25d6774640 1 -- 172.21.15.72:0/2521509791 >> v1:172.21.15.176:6789/0 conn(0x7f25c80337c0 legacy=0x7f25c80dcaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.694+0000 7f25d6774640 1 -- 172.21.15.72:0/2521509791 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c804b550 con 0x7f25c804c440 2023-12-13T00:01:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.694+0000 7f4f3bfff640 1 --2- 172.21.15.72:0/1854320182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f3c158aa0 0x7f4f3c071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.694+0000 7f97267fc640 1 -- 172.21.15.72:0/1078072510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9728152b30 msgr2=0x7f9728156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:09.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.694+0000 7f97267fc640 1 --2- 172.21.15.72:0/1078072510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9728152b30 0x7f9728156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.694+0000 7f97267fc640 1 -- 172.21.15.72:0/1078072510 >> v1:172.21.15.176:6789/0 conn(0x7f97280c6d50 legacy=0x7f97280c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:09.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.694+0000 7f97267fc640 1 -- 172.21.15.72:0/1078072510 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9728072970 con 0x7f9728158aa0 2023-12-13T00:01:09.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.695+0000 7fa7c37fe640 1 -- 172.21.15.72:0/3889755945 >> v2:172.21.15.176:3300/0 conn(0x7fa7bc0dcd80 msgr2=0x7fa7bc006210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:09.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.695+0000 7fa7c37fe640 1 --2- 172.21.15.72:0/3889755945 >> v2:172.21.15.176:3300/0 conn(0x7fa7bc0dcd80 0x7fa7bc006210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.695+0000 7f4f40e6f640 1 -- 172.21.15.72:0/1854320182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f3c158aa0 msgr2=0x7f4f3c071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:09.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.695+0000 7fa7c37fe640 1 -- 172.21.15.72:0/3889755945 >> v1:172.21.15.72:6789/0 conn(0x7fa7bc0d5380 legacy=0x7fa7bc0dc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:09.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.695+0000 7f4f41670640 1 --2- 172.21.15.72:0/1854320182 >> v2:172.21.15.72:3300/0 conn(0x7f4f3c0c6d50 0x7f4f3c0c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.695+0000 7f4f40e6f640 1 --2- 172.21.15.72:0/1854320182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f3c158aa0 0x7f4f3c071c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.695+0000 7f4f40e6f640 1 -- 172.21.15.72:0/1854320182 >> v2:172.21.15.72:3300/0 conn(0x7f4f3c0c6d50 msgr2=0x7f4f3c0c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.695+0000 7fa7c37fe640 1 -- 172.21.15.72:0/3889755945 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc0078a0 con 0x7fa7bc006750 2023-12-13T00:01:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.696+0000 7f4f40e6f640 1 --2- 172.21.15.72:0/1854320182 >> v2:172.21.15.72:3300/0 conn(0x7f4f3c0c6d50 0x7f4f3c0c79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.696+0000 7f4f40e6f640 1 -- 172.21.15.72:0/1854320182 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c072690 con 0x7f4f3c152b30 2023-12-13T00:01:09.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.699+0000 7f97267fc640 1 --2- 172.21.15.72:0/1078072510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9728158aa0 0x7f9728071c70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f971c008870 tx=0x7f971c02df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42689894b88ead2 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.700+0000 7fa7c37fe640 1 --2- 172.21.15.72:0/3889755945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7bc006750 0x7fa7bc006b70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009870 tx=0x7fa7b402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61aaee0eb33f7f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.701+0000 7f1003fff640 1 --2- 172.21.15.72:0/429148746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10040c9c70 0x7f10041594c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009e50 tx=0x7f0ffc02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4698a8980667d2f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.701+0000 7f49e1d9b640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f49e40c8bc0 0x7f49e4161b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47986/0 (socket says 172.21.15.72:47986) 2023-12-13T00:01:09.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.701+0000 7f49e1d9b640 1 -- 172.21.15.72:0/3749495048 learned_addr learned my addr 172.21.15.72:0/3749495048 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:09.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.701+0000 7f25d6774640 1 --2- 172.21.15.72:0/2521509791 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25c804c440 0x7f25c80dd1b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f25d00694c0 tx=0x7f25d00a62e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c57d91d2d7ee3969 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.702+0000 7f038a59c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038c157820 0x7f038c161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.703+0000 7f038a59c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038c157820 0x7f038c161700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:48256/0 (socket says 172.21.15.72:48256) 2023-12-13T00:01:09.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.703+0000 7f038a59c640 1 -- 172.21.15.72:0/2508797371 learned_addr learned my addr 172.21.15.72:0/2508797371 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:09.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.703+0000 7f4f40e6f640 1 --2- 172.21.15.72:0/1854320182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f3c152b30 0x7f4f3c156120 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c06f730 tx=0x7f4f3002cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94157a5f4bd6a18c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.703+0000 7f0389d9b640 1 --2- 172.21.15.72:0/2508797371 >> v2:172.21.15.72:3300/0 conn(0x7f038c0c5080 0x7f038c15d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.704+0000 7fd7d1690640 1 Processor -- start 2023-12-13T00:01:09.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.704+0000 7fd7d1690640 1 -- start start 2023-12-13T00:01:09.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.705+0000 7fd7d1690640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd7cc0cda70 0x7fd7cc0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.705+0000 7fd7d1690640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd7cc0cc420 0x7fd7cc159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.705+0000 7fd7d1690640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7cc0cbda0 con 0x7fd7cc159b50 2023-12-13T00:01:09.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.705+0000 7fd7d1690640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7cc0cc230 con 0x7fd7cc0cda70 2023-12-13T00:01:09.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.705+0000 7fd7d1690640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7cc0cb4e0 con 0x7fd7cc0cc420 2023-12-13T00:01:09.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.705+0000 7f25d4f71640 1 -- 172.21.15.72:0/2521509791 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d00ae640 con 0x7f25c804c440 2023-12-13T00:01:09.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.709+0000 7f038a59c640 1 -- 172.21.15.72:0/2508797371 >> v2:172.21.15.176:3300/0 conn(0x7f038c0c1460 msgr2=0x7f038c0c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:09.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.709+0000 7f038a59c640 1 --2- 172.21.15.72:0/2508797371 >> v2:172.21.15.176:3300/0 conn(0x7f038c0c1460 0x7f038c0c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.709+0000 7f038a59c640 1 -- 172.21.15.72:0/2508797371 >> v2:172.21.15.72:3300/0 conn(0x7f038c0c5080 msgr2=0x7f038c15d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:09.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.709+0000 7f038a59c640 1 --2- 172.21.15.72:0/2508797371 >> v2:172.21.15.72:3300/0 conn(0x7f038c0c5080 0x7f038c15d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.709+0000 7f038a59c640 1 -- 172.21.15.72:0/2508797371 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c160c60 con 0x7f038c157820 2023-12-13T00:01:09.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.711+0000 7f1002ffd640 1 -- 172.21.15.72:0/429148746 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc02cb00 con 0x7f10040c9c70 2023-12-13T00:01:09.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.711+0000 7f1002ffd640 1 -- 172.21.15.72:0/429148746 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc02cc60 con 0x7f10040c9c70 2023-12-13T00:01:09.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.711+0000 7f1002ffd640 1 -- 172.21.15.72:0/429148746 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc0343f0 con 0x7f10040c9c70 2023-12-13T00:01:09.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.711+0000 7f49e159a640 1 -- 172.21.15.72:0/3749495048 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977924496 0 0) 0x7f49e4153ab0 con 0x7f49e40c8bc0 2023-12-13T00:01:09.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.712+0000 7f49e159a640 1 -- 172.21.15.72:0/3749495048 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49cc003520 con 0x7f49e40c8bc0 2023-12-13T00:01:09.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.712+0000 7f100a62b640 1 -- 172.21.15.72:0/429148746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10040c9c70 msgr2=0x7f10041594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.712+0000 7f100a62b640 1 --2- 172.21.15.72:0/429148746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10040c9c70 0x7f10041594c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009e50 tx=0x7f0ffc02bf60 comp rx=0 tx=0).stop 2023-12-13T00:01:09.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.712+0000 7fa7c1ffb640 1 -- 172.21.15.72:0/3889755945 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4030840 con 0x7fa7bc006750 2023-12-13T00:01:09.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.712+0000 7fa7c1ffb640 1 -- 172.21.15.72:0/3889755945 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b40309a0 con 0x7fa7bc006750 2023-12-13T00:01:09.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.712+0000 7fa7c1ffb640 1 -- 172.21.15.72:0/3889755945 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4030d30 con 0x7fa7bc006750 2023-12-13T00:01:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.712+0000 7f100a62b640 1 -- 172.21.15.72:0/429148746 shutdown_connections 2023-12-13T00:01:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.712+0000 7f100a62b640 1 --2- 172.21.15.72:0/429148746 >> v2:172.21.15.72:3300/0 conn(0x7f10040cd430 0x7f10040cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.712+0000 7f100a62b640 1 --2- 172.21.15.72:0/429148746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10040c9c70 0x7f10041594c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.712+0000 7f100a62b640 1 -- 172.21.15.72:0/429148746 >> 172.21.15.72:0/429148746 conn(0x7f10040b07d0 msgr2=0x7f10040b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.712+0000 7f100a62b640 1 -- 172.21.15.72:0/429148746 shutdown_connections 2023-12-13T00:01:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.712+0000 7f100a62b640 1 -- 172.21.15.72:0/429148746 wait complete. 2023-12-13T00:01:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.713+0000 7fd7caffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd7cc0cda70 0x7fd7cc0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.713+0000 7fa7c93c5640 1 -- 172.21.15.72:0/3889755945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7bc006750 msgr2=0x7fa7bc006b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.713+0000 7fa7c93c5640 1 --2- 172.21.15.72:0/3889755945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7bc006750 0x7fa7bc006b70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009870 tx=0x7fa7b402b980 comp rx=0 tx=0).stop 2023-12-13T00:01:09.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.713+0000 7fa7c93c5640 1 -- 172.21.15.72:0/3889755945 shutdown_connections 2023-12-13T00:01:09.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.713+0000 7fa7c93c5640 1 --2- 172.21.15.72:0/3889755945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7bc006750 0x7fa7bc006b70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.713+0000 7fa7c93c5640 1 --2- 172.21.15.72:0/3889755945 >> v2:172.21.15.176:3300/0 conn(0x7fa7bc0dcd80 0x7fa7bc006210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.713+0000 7fa7c93c5640 1 -- 172.21.15.72:0/3889755945 >> 172.21.15.72:0/3889755945 conn(0x7fa7bc0509e0 msgr2=0x7fa7bc050df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.713+0000 7fa7c93c5640 1 -- 172.21.15.72:0/3889755945 shutdown_connections 2023-12-13T00:01:09.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.713+0000 7fa7c93c5640 1 -- 172.21.15.72:0/3889755945 wait complete. 2023-12-13T00:01:09.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.713+0000 7f100a62b640 1 Processor -- start 2023-12-13T00:01:09.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.714+0000 7f100a62b640 1 -- start start 2023-12-13T00:01:09.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.714+0000 7f4f3b7fe640 1 -- 172.21.15.72:0/1854320182 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3002d9e0 con 0x7f4f3c152b30 2023-12-13T00:01:09.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.714+0000 7f4f3b7fe640 1 -- 172.21.15.72:0/1854320182 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3002db40 con 0x7f4f3c152b30 2023-12-13T00:01:09.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.714+0000 7f4f3b7fe640 1 -- 172.21.15.72:0/1854320182 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30035440 con 0x7f4f3c152b30 2023-12-13T00:01:09.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.714+0000 7fd7caffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd7cc0cda70 0x7fd7cc0ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35526/0 (socket says 172.21.15.72:35526) 2023-12-13T00:01:09.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.714+0000 7fd7caffd640 1 -- 172.21.15.72:0/3736095595 learned_addr learned my addr 172.21.15.72:0/3736095595 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:09.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.714+0000 7f49e2d9d640 1 --2- 172.21.15.72:0/3749495048 >> v2:172.21.15.176:3300/0 conn(0x7f49e40cc050 0x7f49e415a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.714+0000 7f100a62b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10040c9c70 0x7f1004156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.714+0000 7f100a62b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10040cbf00 0x7f10040c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.714+0000 7f100a62b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10040cd430 0x7f100406bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.714+0000 7f100a62b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10040c4710 con 0x7f10040cbf00 2023-12-13T00:01:09.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.714+0000 7f100a62b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10040c52a0 con 0x7f10040cd430 2023-12-13T00:01:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.714+0000 7f100a62b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10040c54f0 con 0x7f10040c9c70 2023-12-13T00:01:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.715+0000 7fa7c93c5640 1 Processor -- start 2023-12-13T00:01:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.715+0000 7f25d4f71640 1 -- 172.21.15.72:0/2521509791 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d00ae7a0 con 0x7f25c804c440 2023-12-13T00:01:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.715+0000 7f25d4f71640 1 -- 172.21.15.72:0/2521509791 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d00aebd0 con 0x7f25c804c440 2023-12-13T00:01:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.715+0000 7f4f430d3640 1 -- 172.21.15.72:0/1854320182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f3c152b30 msgr2=0x7f4f3c156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.715+0000 7f4f430d3640 1 --2- 172.21.15.72:0/1854320182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f3c152b30 0x7f4f3c156120 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c06f730 tx=0x7f4f3002cc30 comp rx=0 tx=0).stop 2023-12-13T00:01:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.715+0000 7fa7c93c5640 1 -- start start 2023-12-13T00:01:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.715+0000 7f038a59c640 1 --2- 172.21.15.72:0/2508797371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038c157820 0x7f038c161700 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f038c06db00 tx=0x7f037c02b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf0cb125b8547825 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.715+0000 7f49e159a640 1 -- 172.21.15.72:0/3749495048 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515384070 0 0) 0x7f49e40cbbc0 con 0x7f49e40c86e0 2023-12-13T00:01:09.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.715+0000 7f49e159a640 1 -- 172.21.15.72:0/3749495048 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49e4153ab0 con 0x7f49e40c86e0 2023-12-13T00:01:09.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.715+0000 7f4f430d3640 1 -- 172.21.15.72:0/1854320182 shutdown_connections 2023-12-13T00:01:09.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.715+0000 7f4f430d3640 1 --2- 172.21.15.72:0/1854320182 >> v2:172.21.15.72:3300/0 conn(0x7f4f3c0c6d50 0x7f4f3c0c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.715+0000 7f4f430d3640 1 --2- 172.21.15.72:0/1854320182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f3c158aa0 0x7f4f3c071c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.715+0000 7f4f430d3640 1 --2- 172.21.15.72:0/1854320182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f3c152b30 0x7f4f3c156120 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.715+0000 7f4f430d3640 1 -- 172.21.15.72:0/1854320182 >> 172.21.15.72:0/1854320182 conn(0x7f4f3c06c5f0 msgr2=0x7f4f3c06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.715+0000 7f4f430d3640 1 -- 172.21.15.72:0/1854320182 shutdown_connections 2023-12-13T00:01:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.716+0000 7f4f430d3640 1 -- 172.21.15.72:0/1854320182 wait complete. 2023-12-13T00:01:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.716+0000 7f25d6f75640 1 -- 172.21.15.72:0/2521509791 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25c804c440 msgr2=0x7f25c80dd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.716+0000 7f25d6f75640 1 --2- 172.21.15.72:0/2521509791 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25c804c440 0x7f25c80dd1b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f25d00694c0 tx=0x7f25d00a62e0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.716+0000 7f25d6f75640 1 -- 172.21.15.72:0/2521509791 shutdown_connections 2023-12-13T00:01:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.716+0000 7f25d6f75640 1 --2- 172.21.15.72:0/2521509791 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25c804c440 0x7f25c80dd1b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.716+0000 7f25d6f75640 1 --2- 172.21.15.72:0/2521509791 >> v2:172.21.15.72:3300/0 conn(0x7f25c80d6da0 0x7f25c8033280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.716+0000 7f25d6f75640 1 -- 172.21.15.72:0/2521509791 >> 172.21.15.72:0/2521509791 conn(0x7f25c8050150 msgr2=0x7f25c8050560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.716+0000 7fa7c93c5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7bc006750 0x7fa7bc0cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.716+0000 7fa7c93c5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7bc0d5380 0x7fa7bc17a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.716+0000 7f25d6f75640 1 -- 172.21.15.72:0/2521509791 shutdown_connections 2023-12-13T00:01:09.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.716+0000 7fa7c93c5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7bc0dcd80 0x7fa7bc0db9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.716+0000 7f25d6f75640 1 -- 172.21.15.72:0/2521509791 wait complete. 2023-12-13T00:01:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.716+0000 7fa7c93c5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0cc140 con 0x7fa7bc0dcd80 2023-12-13T00:01:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.716+0000 7fa7c93c5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0cc420 con 0x7fa7bc0d5380 2023-12-13T00:01:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.716+0000 7fa7c93c5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0cc700 con 0x7fa7bc006750 2023-12-13T00:01:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.717+0000 7f4f430d3640 1 Processor -- start 2023-12-13T00:01:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.717+0000 7f4f430d3640 1 -- start start 2023-12-13T00:01:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.717+0000 7f1003fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10040c9c70 0x7f1004156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.718+0000 7f4f430d3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f3c0c6d50 0x7f4f3c151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.718+0000 7f4f430d3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f3c152b30 0x7f4f3c1eb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.718+0000 7f4f430d3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f3c158aa0 0x7f4f3c1581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.718+0000 7f4f430d3640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c14e070 con 0x7f4f3c152b30 2023-12-13T00:01:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.718+0000 7f4f430d3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c1500d0 con 0x7f4f3c158aa0 2023-12-13T00:01:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.718+0000 7f4f430d3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c1503b0 con 0x7f4f3c0c6d50 2023-12-13T00:01:09.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.718+0000 7f25d6f75640 1 Processor -- start 2023-12-13T00:01:09.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.718+0000 7f25d6f75640 1 -- start start 2023-12-13T00:01:09.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.719+0000 7fd7caffd640 1 -- 172.21.15.72:0/3736095595 >> v2:172.21.15.176:3300/0 conn(0x7fd7cc0cc420 msgr2=0x7fd7cc159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:09.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.719+0000 7fd7caffd640 1 --2- 172.21.15.72:0/3736095595 >> v2:172.21.15.176:3300/0 conn(0x7fd7cc0cc420 0x7fd7cc159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.719+0000 7fd7caffd640 1 -- 172.21.15.72:0/3736095595 >> v1:172.21.15.72:6789/0 conn(0x7fd7cc159b50 legacy=0x7fd7cc0c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:09.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.719+0000 7fd7caffd640 1 -- 172.21.15.72:0/3736095595 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc0cce00 con 0x7fd7cc0cda70 2023-12-13T00:01:09.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.719+0000 7f25d6f75640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25c80337c0 0x7f25c804a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.719+0000 7f25d6f75640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25c804c440 0x7f25c81766c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.719+0000 7f25d6f75640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25c80d6da0 0x7f25c804eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.719+0000 7f25d6f75640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80d81b0 con 0x7f25c80d6da0 2023-12-13T00:01:09.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.719+0000 7f25d6f75640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c8176c00 con 0x7f25c80337c0 2023-12-13T00:01:09.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.719+0000 7f25d6f75640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80d8c10 con 0x7f25c804c440 2023-12-13T00:01:09.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.720+0000 7f49e159a640 1 -- 172.21.15.72:0/3749495048 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1807471584 0 0) 0x7f49e4153ab0 con 0x7f49e40c86e0 2023-12-13T00:01:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.720+0000 7f49e159a640 1 -- 172.21.15.72:0/3749495048 >> v2:172.21.15.176:3300/0 conn(0x7f49e40cc050 msgr2=0x7f49e415a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.720+0000 7f49e159a640 1 --2- 172.21.15.72:0/3749495048 >> v2:172.21.15.176:3300/0 conn(0x7f49e40cc050 0x7f49e415a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.720+0000 7f49e159a640 1 -- 172.21.15.72:0/3749495048 >> v1:172.21.15.72:6789/0 conn(0x7f49e40c8bc0 legacy=0x7f49e4161b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.720+0000 7f49e159a640 1 -- 172.21.15.72:0/3749495048 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e40c9b30 con 0x7f49e40c86e0 2023-12-13T00:01:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.720+0000 7f49e159a640 1 -- 172.21.15.72:0/3749495048 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1233568696 0 0) 0x7f49d4001670 con 0x7f49e40c86e0 2023-12-13T00:01:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.720+0000 7f49e159a640 1 -- 172.21.15.72:0/3749495048 >> v1:172.21.15.176:6789/0 conn(0x7f49e40c86e0 legacy=0x7f49e406c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.720+0000 7f49e159a640 1 --2- 172.21.15.72:0/3749495048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49cc003b50 0x7f49cc003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.720+0000 7f49e159a640 1 --2- 172.21.15.72:0/3749495048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49cc0047c0 0x7f49cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.720+0000 7f49e159a640 1 --2- 172.21.15.72:0/3749495048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49cc0051d0 0x7f49cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.721+0000 7f49e159a640 1 -- 172.21.15.72:0/3749495048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40c9890 con 0x7f49cc0051d0 2023-12-13T00:01:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.721+0000 7f49e159a640 1 -- 172.21.15.72:0/3749495048 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc00c050 con 0x7f49cc003b50 2023-12-13T00:01:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.721+0000 7f49e159a640 1 -- 172.21.15.72:0/3749495048 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc00c210 con 0x7f49cc0047c0 2023-12-13T00:01:09.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.722+0000 7f1003fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10040c9c70 0x7f1004156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:48268/0 (socket says 172.21.15.72:48268) 2023-12-13T00:01:09.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.722+0000 7f1003fff640 1 -- 172.21.15.72:0/4106955035 learned_addr learned my addr 172.21.15.72:0/4106955035 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:09.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.722+0000 7f038959a640 1 -- 172.21.15.72:0/2508797371 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c031870 con 0x7f038c157820 2023-12-13T00:01:09.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.722+0000 7f038959a640 1 -- 172.21.15.72:0/2508797371 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c0319d0 con 0x7f038c157820 2023-12-13T00:01:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.723+0000 7fa7c2ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7bc006750 0x7fa7bc0cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.723+0000 7f038959a640 1 -- 172.21.15.72:0/2508797371 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c031d60 con 0x7f038c157820 2023-12-13T00:01:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.723+0000 7fa7c2ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7bc006750 0x7fa7bc0cd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:48282/0 (socket says 172.21.15.72:48282) 2023-12-13T00:01:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.723+0000 7fa7c2ffd640 1 -- 172.21.15.72:0/2325832233 learned_addr learned my addr 172.21.15.72:0/2325832233 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:09.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.723+0000 7f038b59e640 1 -- 172.21.15.72:0/2508797371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038c157820 msgr2=0x7f038c161700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.723+0000 7f038b59e640 1 --2- 172.21.15.72:0/2508797371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038c157820 0x7f038c161700 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f038c06db00 tx=0x7f037c02b910 comp rx=0 tx=0).stop 2023-12-13T00:01:09.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.723+0000 7f25d5772640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25c804c440 0x7f25c81766c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.723+0000 7f038b59e640 1 -- 172.21.15.72:0/2508797371 shutdown_connections 2023-12-13T00:01:09.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.723+0000 7f038b59e640 1 --2- 172.21.15.72:0/2508797371 >> v2:172.21.15.176:3300/0 conn(0x7f038c0c1460 0x7f038c0c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.723+0000 7f038b59e640 1 --2- 172.21.15.72:0/2508797371 >> v2:172.21.15.72:3300/0 conn(0x7f038c0c5080 0x7f038c15d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.724+0000 7f038b59e640 1 --2- 172.21.15.72:0/2508797371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038c157820 0x7f038c161700 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.724+0000 7f038b59e640 1 -- 172.21.15.72:0/2508797371 >> 172.21.15.72:0/2508797371 conn(0x7f038c06a4b0 msgr2=0x7f038c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.724+0000 7f038b59e640 1 -- 172.21.15.72:0/2508797371 shutdown_connections 2023-12-13T00:01:09.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.724+0000 7f038b59e640 1 -- 172.21.15.72:0/2508797371 wait complete. 2023-12-13T00:01:09.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.724+0000 7f49e1d9b640 1 --2- 172.21.15.72:0/3749495048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49cc0047c0 0x7f49cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.724+0000 7f25d5772640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25c804c440 0x7f25c81766c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:48302/0 (socket says 172.21.15.72:48302) 2023-12-13T00:01:09.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.724+0000 7f25d5772640 1 -- 172.21.15.72:0/3773662727 learned_addr learned my addr 172.21.15.72:0/3773662727 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.725+0000 7f038b59e640 1 Processor -- start 2023-12-13T00:01:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.725+0000 7f038b59e640 1 -- start start 2023-12-13T00:01:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.726+0000 7f038b59e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f038c0c1460 0x7f038c1f7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.726+0000 7f038b59e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038c0c5080 0x7f038c15fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.726+0000 7f038b59e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f038c157820 0x7f038c14d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.726+0000 7f038b59e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c1f7790 con 0x7f038c157820 2023-12-13T00:01:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.726+0000 7f038b59e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c14aaf0 con 0x7f038c0c1460 2023-12-13T00:01:09.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.726+0000 7f038b59e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c14add0 con 0x7f038c0c5080 2023-12-13T00:01:09.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.727+0000 7f9725ffb640 1 -- 172.21.15.72:0/1078072510 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c02ecb0 con 0x7f9728158aa0 2023-12-13T00:01:09.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.727+0000 7f9725ffb640 1 -- 172.21.15.72:0/1078072510 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971c032070 con 0x7f9728158aa0 2023-12-13T00:01:09.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.727+0000 7f9725ffb640 1 -- 172.21.15.72:0/1078072510 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c038620 con 0x7f9728158aa0 2023-12-13T00:01:09.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.728+0000 7f972d4ad640 1 -- 172.21.15.72:0/1078072510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9728158aa0 msgr2=0x7f9728071c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.728+0000 7f972d4ad640 1 --2- 172.21.15.72:0/1078072510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9728158aa0 0x7f9728071c70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f971c008870 tx=0x7f971c02df00 comp rx=0 tx=0).stop 2023-12-13T00:01:09.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.728+0000 7fa7c27fc640 1 --2- 172.21.15.72:0/2325832233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7bc0d5380 0x7fa7bc17a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.728+0000 7f972d4ad640 1 -- 172.21.15.72:0/1078072510 shutdown_connections 2023-12-13T00:01:09.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.728+0000 7f972d4ad640 1 --2- 172.21.15.72:0/1078072510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9728158aa0 0x7f9728071c70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.728+0000 7f972d4ad640 1 --2- 172.21.15.72:0/1078072510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9728152b30 0x7f9728156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.728+0000 7f972d4ad640 1 -- 172.21.15.72:0/1078072510 >> 172.21.15.72:0/1078072510 conn(0x7f972806c5f0 msgr2=0x7f972806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.728+0000 7fa7c2ffd640 1 -- 172.21.15.72:0/2325832233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7bc0d5380 msgr2=0x7fa7bc17a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.728+0000 7fa7c2ffd640 1 --2- 172.21.15.72:0/2325832233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7bc0d5380 0x7fa7bc17a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.728+0000 7fa7c2ffd640 1 -- 172.21.15.72:0/2325832233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7bc0dcd80 msgr2=0x7fa7bc0db9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.728+0000 7fa7c2ffd640 1 --2- 172.21.15.72:0/2325832233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7bc0dcd80 0x7fa7bc0db9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.728+0000 7fa7c2ffd640 1 -- 172.21.15.72:0/2325832233 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b40094d0 con 0x7fa7bc006750 2023-12-13T00:01:09.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.728+0000 7fd7caffd640 1 --2- 172.21.15.72:0/3736095595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7cc0cda70 0x7fd7cc0ce350 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0cfda0 tx=0x7fd7bc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f5be5e0f75e7fb server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.728+0000 7f972d4ad640 1 -- 172.21.15.72:0/1078072510 shutdown_connections 2023-12-13T00:01:09.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.728+0000 7f972d4ad640 1 -- 172.21.15.72:0/1078072510 wait complete. 2023-12-13T00:01:09.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.728+0000 7f4f41670640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f3c158aa0 0x7f4f3c1581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.729+0000 7f972d4ad640 1 Processor -- start 2023-12-13T00:01:09.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.729+0000 7f972d4ad640 1 -- start start 2023-12-13T00:01:09.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.730+0000 7f4f41670640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f3c158aa0 0x7f4f3c1581a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:60018/0 (socket says 172.21.15.72:60018) 2023-12-13T00:01:09.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.730+0000 7f4f41670640 1 -- 172.21.15.72:0/2135432281 learned_addr learned my addr 172.21.15.72:0/2135432281 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:09.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.730+0000 7f972d4ad640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97280c6d50 0x7f9728154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.730+0000 7f972d4ad640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9728152b30 0x7f97281515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.730+0000 7f972d4ad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9728158aa0 0x7f972814cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.730+0000 7f972d4ad640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97280c8cc0 con 0x7f9728152b30 2023-12-13T00:01:09.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.730+0000 7f972d4ad640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9728154050 con 0x7f97280c6d50 2023-12-13T00:01:09.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.730+0000 7f972d4ad640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9728155350 con 0x7f9728158aa0 2023-12-13T00:01:09.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.731+0000 7f49e259c640 1 --2- 172.21.15.72:0/3749495048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49cc003b50 0x7f49cc003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.733+0000 7f25d5772640 1 -- 172.21.15.72:0/3773662727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25c80337c0 msgr2=0x7f25c804a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.733+0000 7f25d5772640 1 --2- 172.21.15.72:0/3773662727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25c80337c0 0x7f25c804a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.733+0000 7f25d5772640 1 -- 172.21.15.72:0/3773662727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25c80d6da0 msgr2=0x7f25c804eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.733+0000 7f25d5772640 1 --2- 172.21.15.72:0/3773662727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25c80d6da0 0x7f25c804eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.734+0000 7f25d5772640 1 -- 172.21.15.72:0/3773662727 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d0069d80 con 0x7f25c804c440 2023-12-13T00:01:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.734+0000 7f10037fe640 1 --2- 172.21.15.72:0/4106955035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10040cbf00 0x7f10040c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.735+0000 7f4f3bfff640 1 --2- 172.21.15.72:0/2135432281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f3c152b30 0x7f4f3c1eb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.736+0000 7f4f41670640 1 -- 172.21.15.72:0/2135432281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f3c0c6d50 msgr2=0x7f4f3c151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.736+0000 7f4f41670640 1 --2- 172.21.15.72:0/2135432281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f3c0c6d50 0x7f4f3c151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.736+0000 7f4f41670640 1 -- 172.21.15.72:0/2135432281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f3c152b30 msgr2=0x7f4f3c1eb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.736+0000 7f4f41670640 1 --2- 172.21.15.72:0/2135432281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f3c152b30 0x7f4f3c1eb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.736+0000 7f4f41670640 1 -- 172.21.15.72:0/2135432281 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f300094d0 con 0x7f4f3c158aa0 2023-12-13T00:01:09.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.736+0000 7fa7c2ffd640 1 --2- 172.21.15.72:0/2325832233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7bc006750 0x7fa7bc0cd1e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800c410 tx=0x7fa7b800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.739+0000 7f10037fe640 1 -- 172.21.15.72:0/4106955035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10040c9c70 msgr2=0x7f1004156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.739+0000 7f10037fe640 1 --2- 172.21.15.72:0/4106955035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10040c9c70 0x7f1004156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.739+0000 7f10037fe640 1 -- 172.21.15.72:0/4106955035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10040cd430 msgr2=0x7f100406bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.739+0000 7f10037fe640 1 --2- 172.21.15.72:0/4106955035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10040cd430 0x7f100406bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.739+0000 7f10037fe640 1 -- 172.21.15.72:0/4106955035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc009b30 con 0x7f10040cbf00 2023-12-13T00:01:09.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.742+0000 7f49e259c640 1 -- 172.21.15.72:0/3749495048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49cc0047c0 msgr2=0x7f49cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:09.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.742+0000 7f49e259c640 1 --2- 172.21.15.72:0/3749495048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49cc0047c0 0x7f49cc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.742+0000 7f49e259c640 1 -- 172.21.15.72:0/3749495048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49cc0051d0 msgr2=0x7f49cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:09.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.742+0000 7f49e259c640 1 --2- 172.21.15.72:0/3749495048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49cc0051d0 0x7f49cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.742+0000 7f49e2d9d640 1 -- 172.21.15.72:0/3749495048 reap_dead start 2023-12-13T00:01:09.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.742+0000 7f49e259c640 1 -- 172.21.15.72:0/3749495048 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4153ab0 con 0x7f49cc003b50 2023-12-13T00:01:09.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.742+0000 7f4f41670640 1 --2- 172.21.15.72:0/2135432281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f3c158aa0 0x7f4f3c1581a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400cd70 tx=0x7f4f3400a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.744+0000 7f038ad9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f038c157820 0x7f038c14d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.744+0000 7fd7c9ffb640 1 -- 172.21.15.72:0/3736095595 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc030860 con 0x7fd7cc0cda70 2023-12-13T00:01:09.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.744+0000 7fd7c9ffb640 1 -- 172.21.15.72:0/3736095595 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc0309c0 con 0x7fd7cc0cda70 2023-12-13T00:01:09.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.744+0000 7fd7c9ffb640 1 -- 172.21.15.72:0/3736095595 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc030d50 con 0x7fd7cc0cda70 2023-12-13T00:01:09.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.745+0000 7f038ad9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f038c157820 0x7f038c14d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35584/0 (socket says 172.21.15.72:35584) 2023-12-13T00:01:09.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.745+0000 7f038ad9d640 1 -- 172.21.15.72:0/1175253494 learned_addr learned my addr 172.21.15.72:0/1175253494 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:09.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.745+0000 7fd7d1690640 1 -- 172.21.15.72:0/3736095595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7cc0cda70 msgr2=0x7fd7cc0ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.745+0000 7fd7d1690640 1 --2- 172.21.15.72:0/3736095595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7cc0cda70 0x7fd7cc0ce350 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0cfda0 tx=0x7fd7bc02b9a0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.745+0000 7fd7d1690640 1 -- 172.21.15.72:0/3736095595 shutdown_connections 2023-12-13T00:01:09.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.745+0000 7fd7d1690640 1 --2- 172.21.15.72:0/3736095595 >> v2:172.21.15.176:3300/0 conn(0x7fd7cc0cc420 0x7fd7cc159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.745+0000 7fd7d1690640 1 --2- 172.21.15.72:0/3736095595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7cc0cda70 0x7fd7cc0ce350 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.745+0000 7fd7d1690640 1 -- 172.21.15.72:0/3736095595 >> 172.21.15.72:0/3736095595 conn(0x7fd7cc0b07b0 msgr2=0x7fd7cc0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.745+0000 7fd7d1690640 1 -- 172.21.15.72:0/3736095595 shutdown_connections 2023-12-13T00:01:09.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.745+0000 7fd7d1690640 1 -- 172.21.15.72:0/3736095595 wait complete. 2023-12-13T00:01:09.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.746+0000 7f10037fe640 1 --2- 172.21.15.72:0/4106955035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10040cbf00 0x7f10040c4d60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f10040cc360 tx=0x7f0ff800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.747+0000 7fd7d1690640 1 Processor -- start 2023-12-13T00:01:09.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.747+0000 7fd7d1690640 1 -- start start 2023-12-13T00:01:09.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.748+0000 7fd7d1690640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7cc0cc420 0x7fd7cc1eeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.748+0000 7fd7d1690640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7cc0cda70 0x7fd7cc1507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.748+0000 7fd7d1690640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7cc159b50 0x7fd7cc149760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.748+0000 7fd7d1690640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc0b2af0 con 0x7fd7cc0cda70 2023-12-13T00:01:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.748+0000 7fd7d1690640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc0b1f50 con 0x7fd7cc0cc420 2023-12-13T00:01:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.748+0000 7fd7d1690640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc1e6110 con 0x7fd7cc159b50 2023-12-13T00:01:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.750+0000 7f038ad9d640 1 -- 172.21.15.72:0/1175253494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038c0c5080 msgr2=0x7f038c15fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.750+0000 7f038ad9d640 1 --2- 172.21.15.72:0/1175253494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038c0c5080 0x7f038c15fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.750+0000 7f038ad9d640 1 -- 172.21.15.72:0/1175253494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f038c0c1460 msgr2=0x7f038c1f7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.750+0000 7f038ad9d640 1 --2- 172.21.15.72:0/1175253494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f038c0c1460 0x7f038c1f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.750+0000 7f038ad9d640 1 -- 172.21.15.72:0/1175253494 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c0094d0 con 0x7f038c157820 2023-12-13T00:01:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.750+0000 7f49e259c640 1 --2- 172.21.15.72:0/3749495048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49cc003b50 0x7f49cc003f50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f49d4007e90 tx=0x7f49cc0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10263bc2bba21ff0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.751+0000 7f97277fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9728158aa0 0x7f972814cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.753+0000 7fd7caffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7cc0cc420 0x7fd7cc1eeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.753+0000 7f9726ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97280c6d50 0x7f9728154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.753+0000 7f97277fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9728158aa0 0x7f972814cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:48318/0 (socket says 172.21.15.72:48318) 2023-12-13T00:01:09.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.753+0000 7f97277fe640 1 -- 172.21.15.72:0/3339403226 learned_addr learned my addr 172.21.15.72:0/3339403226 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:09.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.754+0000 7fd7caffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7cc0cc420 0x7fd7cc1eeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:60060/0 (socket says 172.21.15.72:60060) 2023-12-13T00:01:09.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.754+0000 7fd7caffd640 1 -- 172.21.15.72:0/1694360482 learned_addr learned my addr 172.21.15.72:0/1694360482 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:09.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.754+0000 7fa7ab7fe640 1 -- 172.21.15.72:0/2325832233 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b80035f0 con 0x7fa7bc006750 2023-12-13T00:01:09.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.754+0000 7fa7ab7fe640 1 -- 172.21.15.72:0/2325832233 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b8003750 con 0x7fa7bc006750 2023-12-13T00:01:09.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.754+0000 7fa7c93c5640 1 -- 172.21.15.72:0/2325832233 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7bc0cc9e0 con 0x7fa7bc006750 2023-12-13T00:01:09.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.754+0000 7fa7ab7fe640 1 -- 172.21.15.72:0/2325832233 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8003b40 con 0x7fa7bc006750 2023-12-13T00:01:09.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.754+0000 7fd7cb7fe640 1 --2- 172.21.15.72:0/1694360482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7cc159b50 0x7fd7cc149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.754+0000 7fa7c93c5640 1 -- 172.21.15.72:0/2325832233 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7bc0ce430 con 0x7fa7bc006750 2023-12-13T00:01:09.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.755+0000 7fa7c93c5640 1 -- 172.21.15.72:0/2325832233 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa7bc0cc590 con 0x7fa7bc006750 2023-12-13T00:01:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.757+0000 7f4f397fa640 1 -- 172.21.15.72:0/2135432281 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34003b90 con 0x7f4f3c158aa0 2023-12-13T00:01:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.757+0000 7f4f397fa640 1 -- 172.21.15.72:0/2135432281 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f34003cf0 con 0x7f4f3c158aa0 2023-12-13T00:01:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.757+0000 7f4f430d3640 1 -- 172.21.15.72:0/2135432281 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3c150690 con 0x7f4f3c158aa0 2023-12-13T00:01:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.757+0000 7f4f397fa640 1 -- 172.21.15.72:0/2135432281 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34004240 con 0x7f4f3c158aa0 2023-12-13T00:01:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.757+0000 7f4f430d3640 1 -- 172.21.15.72:0/2135432281 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c1ead40 con 0x7f4f3c158aa0 2023-12-13T00:01:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.757+0000 7f49e159a640 1 -- 172.21.15.72:0/3749495048 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d402c890 con 0x7f49cc003b50 2023-12-13T00:01:09.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.757+0000 7f49e159a640 1 -- 172.21.15.72:0/3749495048 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d402ca10 con 0x7f49cc003b50 2023-12-13T00:01:09.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.757+0000 7f038ad9d640 1 --2- 172.21.15.72:0/1175253494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f038c157820 0x7f038c14d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0380009fd0 tx=0x7f038000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.758+0000 7f4f430d3640 1 -- 172.21.15.72:0/2135432281 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f3c152f10 con 0x7f4f3c158aa0 2023-12-13T00:01:09.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.758+0000 7f49e359e640 1 -- 172.21.15.72:0/3749495048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49cc003b50 msgr2=0x7f49cc003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.758+0000 7f49e359e640 1 --2- 172.21.15.72:0/3749495048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49cc003b50 0x7f49cc003f50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f49d4007e90 tx=0x7f49cc0057f0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.758+0000 7f49e359e640 1 -- 172.21.15.72:0/3749495048 shutdown_connections 2023-12-13T00:01:09.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.758+0000 7f49e359e640 1 --2- 172.21.15.72:0/3749495048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49cc003b50 0x7f49cc003f50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.758+0000 7f49e359e640 1 -- 172.21.15.72:0/3749495048 >> 172.21.15.72:0/3749495048 conn(0x7f49e406bb20 msgr2=0x7f49e4060f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.758+0000 7f49e359e640 1 -- 172.21.15.72:0/3749495048 shutdown_connections 2023-12-13T00:01:09.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.758+0000 7f49e359e640 1 -- 172.21.15.72:0/3749495048 wait complete. 2023-12-13T00:01:09.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.758+0000 7f97277fe640 1 -- 172.21.15.72:0/3339403226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97280c6d50 msgr2=0x7f9728154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.758+0000 7f97277fe640 1 --2- 172.21.15.72:0/3339403226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97280c6d50 0x7f9728154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.758+0000 7f97277fe640 1 -- 172.21.15.72:0/3339403226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9728152b30 msgr2=0x7f97281515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.758+0000 7f97277fe640 1 --2- 172.21.15.72:0/3339403226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9728152b30 0x7f97281515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.758+0000 7f97277fe640 1 -- 172.21.15.72:0/3339403226 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c008550 con 0x7f9728158aa0 2023-12-13T00:01:09.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.760+0000 7f49e359e640 1 Processor -- start 2023-12-13T00:01:09.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.760+0000 7f49e359e640 1 -- start start 2023-12-13T00:01:09.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.760+0000 7fd7caffd640 1 -- 172.21.15.72:0/1694360482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7cc159b50 msgr2=0x7fd7cc149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.760+0000 7fd7caffd640 1 --2- 172.21.15.72:0/1694360482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7cc159b50 0x7fd7cc149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.760+0000 7fd7caffd640 1 -- 172.21.15.72:0/1694360482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7cc0cda70 msgr2=0x7fd7cc1507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.760+0000 7fd7caffd640 1 --2- 172.21.15.72:0/1694360482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7cc0cda70 0x7fd7cc1507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.760+0000 7fd7caffd640 1 -- 172.21.15.72:0/1694360482 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc0094d0 con 0x7fd7cc0cc420 2023-12-13T00:01:09.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.761+0000 7f49e359e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49cc003b50 0x7f49e4147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.761+0000 7f49e359e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49e4157320 0x7f49e415b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.761+0000 7f49e359e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49e415be20 0x7f49e41f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.761+0000 7f49e359e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40b2bf0 con 0x7f49cc003b50 2023-12-13T00:01:09.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.761+0000 7f49e359e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e4147ff0 con 0x7f49e415be20 2023-12-13T00:01:09.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.761+0000 7f49e359e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40b23e0 con 0x7f49e4157320 2023-12-13T00:01:09.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.763+0000 7f037affd640 1 -- 172.21.15.72:0/1175253494 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380011830 con 0x7f038c157820 2023-12-13T00:01:09.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.764+0000 7f038b59e640 1 -- 172.21.15.72:0/1175253494 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038c14b0b0 con 0x7f038c157820 2023-12-13T00:01:09.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.764+0000 7f038b59e640 1 -- 172.21.15.72:0/1175253494 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038c14b670 con 0x7f038c157820 2023-12-13T00:01:09.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.764+0000 7fd7caffd640 1 --2- 172.21.15.72:0/1694360482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7cc0cc420 0x7fd7cc1eeeb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc000c00 tx=0x7fd7bc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.764+0000 7f038b59e640 1 -- 172.21.15.72:0/1175253494 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f038c067bf0 con 0x7f038c157820 2023-12-13T00:01:09.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.766+0000 7f037affd640 1 -- 172.21.15.72:0/1175253494 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c067bf0 con 0x7f038c157820 2023-12-13T00:01:09.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.766+0000 7f037affd640 1 -- 172.21.15.72:0/1175253494 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380011b90 con 0x7f038c157820 2023-12-13T00:01:09.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.768+0000 7f1000ff9640 1 -- 172.21.15.72:0/4106955035 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff80052d0 con 0x7f10040cbf00 2023-12-13T00:01:09.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.768+0000 7f1000ff9640 1 -- 172.21.15.72:0/4106955035 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff8005430 con 0x7f10040cbf00 2023-12-13T00:01:09.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.768+0000 7f1000ff9640 1 -- 172.21.15.72:0/4106955035 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8003830 con 0x7f10040cbf00 2023-12-13T00:01:09.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.768+0000 7f100a62b640 1 -- 172.21.15.72:0/4106955035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10040c57d0 con 0x7f10040cbf00 2023-12-13T00:01:09.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.768+0000 7f100a62b640 1 -- 172.21.15.72:0/4106955035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1004158800 con 0x7f10040cbf00 2023-12-13T00:01:09.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.769+0000 7f100a62b640 1 -- 172.21.15.72:0/4106955035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f10040cb700 con 0x7f10040cbf00 2023-12-13T00:01:09.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.770+0000 7f49e259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49cc003b50 0x7f49e4147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.774+0000 7f49e2d9d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49e415be20 0x7f49e41f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.776+0000 7fd7b37fe640 1 -- 172.21.15.72:0/1694360482 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc039e20 con 0x7fd7cc0cc420 2023-12-13T00:01:09.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.776+0000 7fd7b37fe640 1 -- 172.21.15.72:0/1694360482 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc043400 con 0x7fd7cc0cc420 2023-12-13T00:01:09.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.776+0000 7fd7d1690640 1 -- 172.21.15.72:0/1694360482 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7cc1e6370 con 0x7fd7cc0cc420 2023-12-13T00:01:09.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.777+0000 7fd7b37fe640 1 -- 172.21.15.72:0/1694360482 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc0437b0 con 0x7fd7cc0cc420 2023-12-13T00:01:09.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.777+0000 7fd7d1690640 1 -- 172.21.15.72:0/1694360482 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7cc0b1900 con 0x7fd7cc0cc420 2023-12-13T00:01:09.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.777+0000 7fd7d1690640 1 -- 172.21.15.72:0/1694360482 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7cc0cba30 con 0x7fd7cc0cc420 2023-12-13T00:01:09.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.784+0000 7fa7ab7fe640 1 -- 172.21.15.72:0/2325832233 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa7b8003ca0 con 0x7fa7bc006750 2023-12-13T00:01:09.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.784+0000 7fa7ab7fe640 1 --2- 172.21.15.72:0/2325832233 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa7b006b240 0x7fa7b006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.785+0000 7fa7c27fc640 1 --2- 172.21.15.72:0/2325832233 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa7b006b240 0x7fa7b006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.785+0000 7fa7c27fc640 1 --2- 172.21.15.72:0/2325832233 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa7b006b240 0x7fa7b006d700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa7c402cee0 tx=0x7fa7c4074890 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.792+0000 7fa7ab7fe640 1 -- 172.21.15.72:0/2325832233 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fa7b80588a0 con 0x7fa7bc006750 2023-12-13T00:01:09.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.793+0000 7fa7ab7fe640 1 --2- 172.21.15.72:0/2325832233 >> [v2:172.21.15.72:6802/1644978744,v1:172.21.15.72:6803/1644978744] conn(0x7fa7b00749a0 0x7fa7b0076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.793+0000 7fa7ab7fe640 1 -- 172.21.15.72:0/2325832233 --> [v2:172.21.15.72:6802/1644978744,v1:172.21.15.72:6803/1644978744] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7b0077510 con 0x7fa7b00749a0 2023-12-13T00:01:09.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.793+0000 7fa7ab7fe640 1 -- 172.21.15.72:0/2325832233 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7b80544e0 con 0x7fa7bc006750 2023-12-13T00:01:09.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.793+0000 7fa7c37fe640 1 --2- 172.21.15.72:0/2325832233 >> [v2:172.21.15.72:6802/1644978744,v1:172.21.15.72:6803/1644978744] conn(0x7fa7b00749a0 0x7fa7b0076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.793+0000 7fa7c37fe640 1 --2- 172.21.15.72:0/2325832233 >> [v2:172.21.15.72:6802/1644978744,v1:172.21.15.72:6803/1644978744] conn(0x7fa7b00749a0 0x7fa7b0076e40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.794+0000 7f4f397fa640 1 -- 172.21.15.72:0/2135432281 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4f340043a0 con 0x7f4f3c158aa0 2023-12-13T00:01:09.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.794+0000 7f4f397fa640 1 --2- 172.21.15.72:0/2135432281 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f4f2806b210 0x7f4f2806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.794+0000 7fa7ab7fe640 1 -- 172.21.15.72:0/2325832233 <== osd.2 v2:172.21.15.72:6802/1644978744 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa7b0077510 con 0x7fa7b00749a0 2023-12-13T00:01:09.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.794+0000 7f4f40e6f640 1 --2- 172.21.15.72:0/2135432281 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f4f2806b210 0x7f4f2806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.795+0000 7f4f40e6f640 1 --2- 172.21.15.72:0/2135432281 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f4f2806b210 0x7f4f2806d6d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4f30037000 tx=0x7f4f3002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.795+0000 7f49e2d9d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49e415be20 0x7f49e41f2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:60062/0 (socket says 172.21.15.72:60062) 2023-12-13T00:01:09.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.795+0000 7f49e2d9d640 1 -- 172.21.15.72:0/551191101 learned_addr learned my addr 172.21.15.72:0/551191101 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:09.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.796+0000 7f25d5772640 1 --2- 172.21.15.72:0/3773662727 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25c804c440 0x7f25c81766c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f25c000c410 tx=0x7f25c000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.799+0000 7f037affd640 1 -- 172.21.15.72:0/1175253494 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0380011cf0 con 0x7f038c157820 2023-12-13T00:01:09.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.799+0000 7f4f397fa640 1 -- 172.21.15.72:0/2135432281 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f4f34012070 con 0x7f4f3c158aa0 2023-12-13T00:01:09.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.799+0000 7f4f397fa640 1 --2- 172.21.15.72:0/2135432281 >> [v2:172.21.15.72:6826/602713131,v1:172.21.15.72:6827/602713131] conn(0x7f4f28074970 0x7f4f28076e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.800+0000 7f4f397fa640 1 -- 172.21.15.72:0/2135432281 --> [v2:172.21.15.72:6826/602713131,v1:172.21.15.72:6827/602713131] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f280774e0 con 0x7f4f28074970 2023-12-13T00:01:09.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.800+0000 7f037affd640 1 --2- 172.21.15.72:0/1175253494 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f036c06b1c0 0x7f036c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.800+0000 7f4f3bfff640 1 --2- 172.21.15.72:0/2135432281 >> [v2:172.21.15.72:6826/602713131,v1:172.21.15.72:6827/602713131] conn(0x7f4f28074970 0x7f4f28076e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.800+0000 7f038a59c640 1 --2- 172.21.15.72:0/1175253494 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f036c06b1c0 0x7f036c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.800+0000 7f4f3bfff640 1 --2- 172.21.15.72:0/2135432281 >> [v2:172.21.15.72:6826/602713131,v1:172.21.15.72:6827/602713131] conn(0x7f4f28074970 0x7f4f28076e10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.800+0000 7f038a59c640 1 --2- 172.21.15.72:0/1175253494 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f036c06b1c0 0x7f036c06d680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f037c036000 tx=0x7f037c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.801+0000 7f49e1d9b640 1 --2- 172.21.15.72:0/551191101 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49e4157320 0x7f49e415b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.801+0000 7f4f397fa640 1 -- 172.21.15.72:0/2135432281 <== osd.1 v2:172.21.15.72:6826/602713131 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4f280774e0 con 0x7f4f28074970 2023-12-13T00:01:09.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.801+0000 7f97277fe640 1 --2- 172.21.15.72:0/3339403226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9728158aa0 0x7f972814cdf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f972000c780 tx=0x7f972000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.804+0000 7f49e2d9d640 1 -- 172.21.15.72:0/551191101 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49e4157320 msgr2=0x7f49e415b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.804+0000 7f49e2d9d640 1 --2- 172.21.15.72:0/551191101 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49e4157320 0x7f49e415b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.804+0000 7f49e2d9d640 1 -- 172.21.15.72:0/551191101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49cc003b50 msgr2=0x7f49e4147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.804+0000 7f49e2d9d640 1 --2- 172.21.15.72:0/551191101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49cc003b50 0x7f49e4147ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.804+0000 7f49e2d9d640 1 -- 172.21.15.72:0/551191101 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e40cf360 con 0x7f49e415be20 2023-12-13T00:01:09.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.804+0000 7f25c67fc640 1 -- 172.21.15.72:0/3773662727 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c00035f0 con 0x7f25c804c440 2023-12-13T00:01:09.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.804+0000 7f25c67fc640 1 -- 172.21.15.72:0/3773662727 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c0003750 con 0x7f25c804c440 2023-12-13T00:01:09.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.804+0000 7f25c67fc640 1 -- 172.21.15.72:0/3773662727 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0003b40 con 0x7f25c804c440 2023-12-13T00:01:09.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.805+0000 7f25d6f75640 1 -- 172.21.15.72:0/3773662727 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c80ccf60 con 0x7f25c804c440 2023-12-13T00:01:09.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.805+0000 7f25d6f75640 1 -- 172.21.15.72:0/3773662727 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c80ccc80 con 0x7f25c804c440 2023-12-13T00:01:09.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.805+0000 7f25d6f75640 1 -- 172.21.15.72:0/3773662727 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25c8006bf0 con 0x7f25c804c440 2023-12-13T00:01:09.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.810+0000 7fa7c93c5640 1 -- 172.21.15.72:0/2325832233 --> [v2:172.21.15.72:6802/1644978744,v1:172.21.15.72:6803/1644978744] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa7bc008140 con 0x7fa7b00749a0 2023-12-13T00:01:09.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.810+0000 7fa7ab7fe640 1 -- 172.21.15.72:0/2325832233 <== osd.2 v2:172.21.15.72:6802/1644978744 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa7b4030760 con 0x7fa7b00749a0 2023-12-13T00:01:09.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.810+0000 7fa7c93c5640 1 -- 172.21.15.72:0/2325832233 >> [v2:172.21.15.72:6802/1644978744,v1:172.21.15.72:6803/1644978744] conn(0x7fa7b00749a0 msgr2=0x7fa7b0076e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.810+0000 7fa7c93c5640 1 --2- 172.21.15.72:0/2325832233 >> [v2:172.21.15.72:6802/1644978744,v1:172.21.15.72:6803/1644978744] conn(0x7fa7b00749a0 0x7fa7b0076e40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.811+0000 7fa7c93c5640 1 -- 172.21.15.72:0/2325832233 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa7b006b240 msgr2=0x7fa7b006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.811+0000 7fa7c93c5640 1 --2- 172.21.15.72:0/2325832233 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa7b006b240 0x7fa7b006d700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa7c402cee0 tx=0x7fa7c4074890 comp rx=0 tx=0).stop 2023-12-13T00:01:09.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.811+0000 7fa7c93c5640 1 -- 172.21.15.72:0/2325832233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7bc006750 msgr2=0x7fa7bc0cd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.811+0000 7fa7c93c5640 1 --2- 172.21.15.72:0/2325832233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7bc006750 0x7fa7bc0cd1e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800c410 tx=0x7fa7b800c8d0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.811+0000 7fa7c37fe640 1 -- 172.21.15.72:0/2325832233 reap_dead start 2023-12-13T00:01:09.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.811+0000 7fa7c93c5640 1 -- 172.21.15.72:0/2325832233 shutdown_connections 2023-12-13T00:01:09.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.811+0000 7fa7c93c5640 1 -- 172.21.15.72:0/2325832233 >> 172.21.15.72:0/2325832233 conn(0x7fa7bc0509e0 msgr2=0x7fa7bc0d3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.811+0000 7fa7c93c5640 1 -- 172.21.15.72:0/2325832233 shutdown_connections 2023-12-13T00:01:09.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.811+0000 7fa7c93c5640 1 -- 172.21.15.72:0/2325832233 wait complete. 2023-12-13T00:01:09.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.813+0000 7f1000ff9640 1 -- 172.21.15.72:0/4106955035 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0ff8003990 con 0x7f10040cbf00 2023-12-13T00:01:09.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.813+0000 7f1000ff9640 1 --2- 172.21.15.72:0/4106955035 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0ff006b1f0 0x7f0ff006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.814+0000 7f1003fff640 1 --2- 172.21.15.72:0/4106955035 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0ff006b1f0 0x7f0ff006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.814+0000 7f1003fff640 1 --2- 172.21.15.72:0/4106955035 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0ff006b1f0 0x7f0ff006d6b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc02bfa0 tx=0x7f0ffc030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.816+0000 7f4f430d3640 1 -- 172.21.15.72:0/2135432281 --> [v2:172.21.15.72:6826/602713131,v1:172.21.15.72:6827/602713131] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4f3c155920 con 0x7f4f28074970 2023-12-13T00:01:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.816+0000 7f4f397fa640 1 -- 172.21.15.72:0/2135432281 <== osd.1 v2:172.21.15.72:6826/602713131 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4f2c00c040 con 0x7f4f28074970 2023-12-13T00:01:09.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.817+0000 7f4f430d3640 1 -- 172.21.15.72:0/2135432281 >> [v2:172.21.15.72:6826/602713131,v1:172.21.15.72:6827/602713131] conn(0x7f4f28074970 msgr2=0x7f4f28076e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.817+0000 7f4f430d3640 1 --2- 172.21.15.72:0/2135432281 >> [v2:172.21.15.72:6826/602713131,v1:172.21.15.72:6827/602713131] conn(0x7f4f28074970 0x7f4f28076e10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.817+0000 7f4f430d3640 1 -- 172.21.15.72:0/2135432281 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f4f2806b210 msgr2=0x7f4f2806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.817+0000 7f4f430d3640 1 --2- 172.21.15.72:0/2135432281 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f4f2806b210 0x7f4f2806d6d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4f30037000 tx=0x7f4f3002f000 comp rx=0 tx=0).stop 2023-12-13T00:01:09.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.817+0000 7f4f430d3640 1 -- 172.21.15.72:0/2135432281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f3c158aa0 msgr2=0x7f4f3c1581a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.817+0000 7f4f430d3640 1 --2- 172.21.15.72:0/2135432281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f3c158aa0 0x7f4f3c1581a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400cd70 tx=0x7f4f3400a660 comp rx=0 tx=0).stop 2023-12-13T00:01:09.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.817+0000 7f4f41670640 1 -- 172.21.15.72:0/2135432281 reap_dead start 2023-12-13T00:01:09.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.817+0000 7f4f430d3640 1 -- 172.21.15.72:0/2135432281 shutdown_connections 2023-12-13T00:01:09.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.817+0000 7f4f430d3640 1 -- 172.21.15.72:0/2135432281 >> 172.21.15.72:0/2135432281 conn(0x7f4f3c06c5f0 msgr2=0x7f4f3c073530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.817+0000 7f4f430d3640 1 -- 172.21.15.72:0/2135432281 shutdown_connections 2023-12-13T00:01:09.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.817+0000 7f4f430d3640 1 -- 172.21.15.72:0/2135432281 wait complete. 2023-12-13T00:01:09.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.819+0000 7f970f7fe640 1 -- 172.21.15.72:0/3339403226 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720003d80 con 0x7f9728158aa0 2023-12-13T00:01:09.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.819+0000 7f970f7fe640 1 -- 172.21.15.72:0/3339403226 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972000ce90 con 0x7f9728158aa0 2023-12-13T00:01:09.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.819+0000 7f970f7fe640 1 -- 172.21.15.72:0/3339403226 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720003d80 con 0x7f9728158aa0 2023-12-13T00:01:09.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.819+0000 7f972d4ad640 1 -- 172.21.15.72:0/3339403226 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9728152fb0 con 0x7f9728158aa0 2023-12-13T00:01:09.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.819+0000 7f972d4ad640 1 -- 172.21.15.72:0/3339403226 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9728153570 con 0x7f9728158aa0 2023-12-13T00:01:09.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.820+0000 7f972d4ad640 1 -- 172.21.15.72:0/3339403226 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9728155c00 con 0x7f9728158aa0 2023-12-13T00:01:09.826 INFO:teuthology.orchestra.run.smithi072.stdout:60129542160 2023-12-13T00:01:09.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-13T00:01:09.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.823+0000 7f1000ff9640 1 -- 172.21.15.72:0/4106955035 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f0ff80580a0 con 0x7f10040cbf00 2023-12-13T00:01:09.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.823+0000 7f1000ff9640 1 --2- 172.21.15.72:0/4106955035 >> [v2:172.21.15.72:6810/1022561321,v1:172.21.15.72:6811/1022561321] conn(0x7f0ff0074950 0x7f0ff0076df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.823+0000 7f1000ff9640 1 -- 172.21.15.72:0/4106955035 --> [v2:172.21.15.72:6810/1022561321,v1:172.21.15.72:6811/1022561321] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0ff00774c0 con 0x7f0ff0074950 2023-12-13T00:01:09.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.823+0000 7f1000ff9640 1 -- 172.21.15.72:0/4106955035 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ff80543e0 con 0x7f10040cbf00 2023-12-13T00:01:09.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.824+0000 7f1008bc8640 1 --2- 172.21.15.72:0/4106955035 >> [v2:172.21.15.72:6810/1022561321,v1:172.21.15.72:6811/1022561321] conn(0x7f0ff0074950 0x7f0ff0076df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.824+0000 7f1008bc8640 1 --2- 172.21.15.72:0/4106955035 >> [v2:172.21.15.72:6810/1022561321,v1:172.21.15.72:6811/1022561321] conn(0x7f0ff0074950 0x7f0ff0076df0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.824+0000 7f037affd640 1 -- 172.21.15.72:0/1175253494 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f03800591f0 con 0x7f038c157820 2023-12-13T00:01:09.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.824+0000 7f037affd640 1 --2- 172.21.15.72:0/1175253494 >> [v2:172.21.15.176:6800/3937462058,v1:172.21.15.176:6801/3937462058] conn(0x7f036c0748a0 0x7f036c076d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.824+0000 7f037affd640 1 -- 172.21.15.72:0/1175253494 --> [v2:172.21.15.176:6800/3937462058,v1:172.21.15.176:6801/3937462058] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f036c077410 con 0x7f036c0748a0 2023-12-13T00:01:09.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.824+0000 7f037affd640 1 -- 172.21.15.72:0/1175253494 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0380054e30 con 0x7f038c157820 2023-12-13T00:01:09.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.824+0000 7f0389d9b640 1 --2- 172.21.15.72:0/1175253494 >> [v2:172.21.15.176:6800/3937462058,v1:172.21.15.176:6801/3937462058] conn(0x7f036c0748a0 0x7f036c076d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.825+0000 7f1000ff9640 1 -- 172.21.15.72:0/4106955035 <== osd.3 v2:172.21.15.72:6810/1022561321 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0ff00774c0 con 0x7f0ff0074950 2023-12-13T00:01:09.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.825+0000 7f0389d9b640 1 --2- 172.21.15.72:0/1175253494 >> [v2:172.21.15.176:6800/3937462058,v1:172.21.15.176:6801/3937462058] conn(0x7f036c0748a0 0x7f036c076d40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.825+0000 7f037affd640 1 -- 172.21.15.72:0/1175253494 <== osd.5 v2:172.21.15.176:6800/3937462058 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f036c077410 con 0x7f036c0748a0 2023-12-13T00:01:09.831 INFO:teuthology.orchestra.run.smithi072.stdout:64424509456 2023-12-13T00:01:09.831 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-13T00:01:09.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.834+0000 7fd7b37fe640 1 -- 172.21.15.72:0/1694360482 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd7bc043910 con 0x7fd7cc0cc420 2023-12-13T00:01:09.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.834+0000 7fd7b37fe640 1 --2- 172.21.15.72:0/1694360482 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd7b806b1c0 0x7fd7b806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.835+0000 7f49e2d9d640 1 --2- 172.21.15.72:0/551191101 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49e415be20 0x7f49e41f2a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f49e40cc430 tx=0x7f49dc00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.835+0000 7fd7ca7fc640 1 --2- 172.21.15.72:0/1694360482 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd7b806b1c0 0x7fd7b806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.835+0000 7fd7ca7fc640 1 --2- 172.21.15.72:0/1694360482 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd7b806b1c0 0x7fd7b806d680 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0b0320 tx=0x7fd7c0006c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.841+0000 7f25c67fc640 1 -- 172.21.15.72:0/3773662727 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f25c0003ca0 con 0x7f25c804c440 2023-12-13T00:01:09.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.842+0000 7f25c67fc640 1 --2- 172.21.15.72:0/3773662727 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f25b406b1c0 0x7f25b406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.842+0000 7fd7b37fe640 1 -- 172.21.15.72:0/1694360482 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fd7bc03e070 con 0x7fd7cc0cc420 2023-12-13T00:01:09.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.842+0000 7fd7b37fe640 1 --2- 172.21.15.72:0/1694360482 >> [v2:172.21.15.176:6816/2976728609,v1:172.21.15.176:6817/2976728609] conn(0x7fd7b8074730 0x7fd7b8076bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.842+0000 7fd7b37fe640 1 -- 172.21.15.72:0/1694360482 --> [v2:172.21.15.176:6816/2976728609,v1:172.21.15.176:6817/2976728609] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7b80772a0 con 0x7fd7b8074730 2023-12-13T00:01:09.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.842+0000 7fd7cb7fe640 1 --2- 172.21.15.72:0/1694360482 >> [v2:172.21.15.176:6816/2976728609,v1:172.21.15.176:6817/2976728609] conn(0x7fd7b8074730 0x7fd7b8076bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.842+0000 7f25d5f73640 1 --2- 172.21.15.72:0/3773662727 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f25b406b1c0 0x7f25b406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.843+0000 7f25d5f73640 1 --2- 172.21.15.72:0/3773662727 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f25b406b1c0 0x7f25b406d680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00a810 tx=0x7f25cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.843+0000 7fd7cb7fe640 1 --2- 172.21.15.72:0/1694360482 >> [v2:172.21.15.176:6816/2976728609,v1:172.21.15.176:6817/2976728609] conn(0x7fd7b8074730 0x7fd7b8076bd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.844+0000 7fd7b37fe640 1 -- 172.21.15.72:0/1694360482 <== osd.7 v2:172.21.15.176:6816/2976728609 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd7b80772a0 con 0x7fd7b8074730 2023-12-13T00:01:09.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.845+0000 7f25c67fc640 1 -- 172.21.15.72:0/3773662727 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f25c0058260 con 0x7f25c804c440 2023-12-13T00:01:09.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.845+0000 7f25c67fc640 1 --2- 172.21.15.72:0/3773662727 >> [v2:172.21.15.176:6824/2380480963,v1:172.21.15.176:6825/2380480963] conn(0x7f25b40748a0 0x7f25b4076d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.845+0000 7f25c67fc640 1 -- 172.21.15.72:0/3773662727 --> [v2:172.21.15.176:6824/2380480963,v1:172.21.15.176:6825/2380480963] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25b4077410 con 0x7f25b40748a0 2023-12-13T00:01:09.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.845+0000 7f25d6774640 1 --2- 172.21.15.72:0/3773662727 >> [v2:172.21.15.176:6824/2380480963,v1:172.21.15.176:6825/2380480963] conn(0x7f25b40748a0 0x7f25b4076d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.845+0000 7f25d6774640 1 --2- 172.21.15.72:0/3773662727 >> [v2:172.21.15.176:6824/2380480963,v1:172.21.15.176:6825/2380480963] conn(0x7f25b40748a0 0x7f25b4076d40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.846+0000 7f100a62b640 1 -- 172.21.15.72:0/4106955035 --> [v2:172.21.15.72:6810/1022561321,v1:172.21.15.72:6811/1022561321] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f10040ce8b0 con 0x7f0ff0074950 2023-12-13T00:01:09.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.846+0000 7f25c67fc640 1 -- 172.21.15.72:0/3773662727 <== osd.6 v2:172.21.15.176:6824/2380480963 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f25b4077410 con 0x7f25b40748a0 2023-12-13T00:01:09.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.846+0000 7f1000ff9640 1 -- 172.21.15.72:0/4106955035 <== osd.3 v2:172.21.15.72:6810/1022561321 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ff4009460 con 0x7f0ff0074950 2023-12-13T00:01:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.848+0000 7f038b59e640 1 -- 172.21.15.72:0/1175253494 --> [v2:172.21.15.176:6800/3937462058,v1:172.21.15.176:6801/3937462058] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f038c0c90d0 con 0x7f036c0748a0 2023-12-13T00:01:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.848+0000 7f100a62b640 1 -- 172.21.15.72:0/4106955035 >> [v2:172.21.15.72:6810/1022561321,v1:172.21.15.72:6811/1022561321] conn(0x7f0ff0074950 msgr2=0x7f0ff0076df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.848+0000 7f100a62b640 1 --2- 172.21.15.72:0/4106955035 >> [v2:172.21.15.72:6810/1022561321,v1:172.21.15.72:6811/1022561321] conn(0x7f0ff0074950 0x7f0ff0076df0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.848+0000 7f037affd640 1 -- 172.21.15.72:0/1175253494 <== osd.5 v2:172.21.15.176:6800/3937462058 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f038400f040 con 0x7f036c0748a0 2023-12-13T00:01:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.848+0000 7f100a62b640 1 -- 172.21.15.72:0/4106955035 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0ff006b1f0 msgr2=0x7f0ff006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.848+0000 7f100a62b640 1 --2- 172.21.15.72:0/4106955035 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0ff006b1f0 0x7f0ff006d6b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc02bfa0 tx=0x7f0ffc030000 comp rx=0 tx=0).stop 2023-12-13T00:01:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.848+0000 7f100a62b640 1 -- 172.21.15.72:0/4106955035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10040cbf00 msgr2=0x7f10040c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.848+0000 7f100a62b640 1 --2- 172.21.15.72:0/4106955035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10040cbf00 0x7f10040c4d60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f10040cc360 tx=0x7f0ff800c820 comp rx=0 tx=0).stop 2023-12-13T00:01:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.848+0000 7f1008bc8640 1 -- 172.21.15.72:0/4106955035 reap_dead start 2023-12-13T00:01:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.848+0000 7f100a62b640 1 -- 172.21.15.72:0/4106955035 shutdown_connections 2023-12-13T00:01:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.848+0000 7f100a62b640 1 -- 172.21.15.72:0/4106955035 >> 172.21.15.72:0/4106955035 conn(0x7f10040b07d0 msgr2=0x7f100406c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.849+0000 7f100a62b640 1 -- 172.21.15.72:0/4106955035 shutdown_connections 2023-12-13T00:01:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.849+0000 7f038b59e640 1 -- 172.21.15.72:0/1175253494 >> [v2:172.21.15.176:6800/3937462058,v1:172.21.15.176:6801/3937462058] conn(0x7f036c0748a0 msgr2=0x7f036c076d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.849+0000 7f038b59e640 1 --2- 172.21.15.72:0/1175253494 >> [v2:172.21.15.176:6800/3937462058,v1:172.21.15.176:6801/3937462058] conn(0x7f036c0748a0 0x7f036c076d40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.849+0000 7f100a62b640 1 -- 172.21.15.72:0/4106955035 wait complete. 2023-12-13T00:01:09.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.852+0000 7f038b59e640 1 -- 172.21.15.72:0/1175253494 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f036c06b1c0 msgr2=0x7f036c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.852+0000 7f038b59e640 1 --2- 172.21.15.72:0/1175253494 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f036c06b1c0 0x7f036c06d680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f037c036000 tx=0x7f037c030000 comp rx=0 tx=0).stop 2023-12-13T00:01:09.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.852+0000 7f038b59e640 1 -- 172.21.15.72:0/1175253494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f038c157820 msgr2=0x7f038c14d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.852+0000 7f038b59e640 1 --2- 172.21.15.72:0/1175253494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f038c157820 0x7f038c14d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0380009fd0 tx=0x7f038000b8e0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.852+0000 7f038ad9d640 1 -- 172.21.15.72:0/1175253494 reap_dead start 2023-12-13T00:01:09.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.852+0000 7f038b59e640 1 -- 172.21.15.72:0/1175253494 shutdown_connections 2023-12-13T00:01:09.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.852+0000 7f038b59e640 1 -- 172.21.15.72:0/1175253494 >> 172.21.15.72:0/1175253494 conn(0x7f038c06a4b0 msgr2=0x7f038c0c7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.852+0000 7f038b59e640 1 -- 172.21.15.72:0/1175253494 shutdown_connections 2023-12-13T00:01:09.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.852+0000 7f038b59e640 1 -- 172.21.15.72:0/1175253494 wait complete. 2023-12-13T00:01:09.865 INFO:teuthology.orchestra.run.smithi072.stdout:64424509458 2023-12-13T00:01:09.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-13T00:01:09.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.865+0000 7f970f7fe640 1 -- 172.21.15.72:0/3339403226 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9720005070 con 0x7f9728158aa0 2023-12-13T00:01:09.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.865+0000 7f970f7fe640 1 --2- 172.21.15.72:0/3339403226 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f971406b280 0x7f971406d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.866+0000 7f9726ffd640 1 --2- 172.21.15.72:0/3339403226 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f971406b280 0x7f971406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.866+0000 7f9726ffd640 1 --2- 172.21.15.72:0/3339403226 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f971406b280 0x7f971406d740 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9718009890 tx=0x7f9718008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.868+0000 7f970f7fe640 1 -- 172.21.15.72:0/3339403226 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f9720058080 con 0x7f9728158aa0 2023-12-13T00:01:09.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.868+0000 7f970f7fe640 1 --2- 172.21.15.72:0/3339403226 >> [v2:172.21.15.72:6818/46778518,v1:172.21.15.72:6819/46778518] conn(0x7f97140755c0 0x7f9714077a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.868+0000 7f970f7fe640 1 -- 172.21.15.72:0/3339403226 --> [v2:172.21.15.72:6818/46778518,v1:172.21.15.72:6819/46778518] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9714078130 con 0x7f97140755c0 2023-12-13T00:01:09.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.869+0000 7f97267fc640 1 --2- 172.21.15.72:0/3339403226 >> [v2:172.21.15.72:6818/46778518,v1:172.21.15.72:6819/46778518] conn(0x7f97140755c0 0x7f9714077a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.869+0000 7f97267fc640 1 --2- 172.21.15.72:0/3339403226 >> [v2:172.21.15.72:6818/46778518,v1:172.21.15.72:6819/46778518] conn(0x7f97140755c0 0x7f9714077a60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.870+0000 7f970f7fe640 1 -- 172.21.15.72:0/3339403226 <== osd.0 v2:172.21.15.72:6818/46778518 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9714078130 con 0x7f97140755c0 2023-12-13T00:01:09.871 INFO:teuthology.orchestra.run.smithi072.stdout:55834574864 2023-12-13T00:01:09.872 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-13T00:01:09.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.875+0000 7fd7d1690640 1 -- 172.21.15.72:0/1694360482 --> [v2:172.21.15.176:6816/2976728609,v1:172.21.15.176:6817/2976728609] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7cc0cb750 con 0x7fd7b8074730 2023-12-13T00:01:09.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.876+0000 7fd7b37fe640 1 -- 172.21.15.72:0/1694360482 <== osd.7 v2:172.21.15.176:6816/2976728609 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd7c4009be0 con 0x7fd7b8074730 2023-12-13T00:01:09.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.877+0000 7fd7d1690640 1 -- 172.21.15.72:0/1694360482 >> [v2:172.21.15.176:6816/2976728609,v1:172.21.15.176:6817/2976728609] conn(0x7fd7b8074730 msgr2=0x7fd7b8076bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.877+0000 7fd7d1690640 1 --2- 172.21.15.72:0/1694360482 >> [v2:172.21.15.176:6816/2976728609,v1:172.21.15.176:6817/2976728609] conn(0x7fd7b8074730 0x7fd7b8076bd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.877+0000 7fd7d1690640 1 -- 172.21.15.72:0/1694360482 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd7b806b1c0 msgr2=0x7fd7b806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.877+0000 7fd7d1690640 1 --2- 172.21.15.72:0/1694360482 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd7b806b1c0 0x7fd7b806d680 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0b0320 tx=0x7fd7c0006c90 comp rx=0 tx=0).stop 2023-12-13T00:01:09.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.877+0000 7fd7d1690640 1 -- 172.21.15.72:0/1694360482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7cc0cc420 msgr2=0x7fd7cc1eeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.877+0000 7fd7d1690640 1 --2- 172.21.15.72:0/1694360482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7cc0cc420 0x7fd7cc1eeeb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc000c00 tx=0x7fd7bc004730 comp rx=0 tx=0).stop 2023-12-13T00:01:09.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.877+0000 7fd7cb7fe640 1 -- 172.21.15.72:0/1694360482 reap_dead start 2023-12-13T00:01:09.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.877+0000 7fd7d1690640 1 -- 172.21.15.72:0/1694360482 shutdown_connections 2023-12-13T00:01:09.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.877+0000 7fd7d1690640 1 -- 172.21.15.72:0/1694360482 >> 172.21.15.72:0/1694360482 conn(0x7fd7cc0b07b0 msgr2=0x7fd7cc0ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.878+0000 7fd7d1690640 1 -- 172.21.15.72:0/1694360482 shutdown_connections 2023-12-13T00:01:09.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.878+0000 7fd7d1690640 1 -- 172.21.15.72:0/1694360482 wait complete. 2023-12-13T00:01:09.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.880+0000 7f25d6f75640 1 -- 172.21.15.72:0/3773662727 --> [v2:172.21.15.176:6824/2380480963,v1:172.21.15.176:6825/2380480963] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f25c8006910 con 0x7f25b40748a0 2023-12-13T00:01:09.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.881+0000 7f25c67fc640 1 -- 172.21.15.72:0/3773662727 <== osd.6 v2:172.21.15.176:6824/2380480963 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f25d00ae440 con 0x7f25b40748a0 2023-12-13T00:01:09.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.882+0000 7f25b3fff640 1 -- 172.21.15.72:0/3773662727 >> [v2:172.21.15.176:6824/2380480963,v1:172.21.15.176:6825/2380480963] conn(0x7f25b40748a0 msgr2=0x7f25b4076d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.882+0000 7f25b3fff640 1 --2- 172.21.15.72:0/3773662727 >> [v2:172.21.15.176:6824/2380480963,v1:172.21.15.176:6825/2380480963] conn(0x7f25b40748a0 0x7f25b4076d40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.882+0000 7f25b3fff640 1 -- 172.21.15.72:0/3773662727 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f25b406b1c0 msgr2=0x7f25b406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.882+0000 7f25b3fff640 1 --2- 172.21.15.72:0/3773662727 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f25b406b1c0 0x7f25b406d680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00a810 tx=0x7f25cc008040 comp rx=0 tx=0).stop 2023-12-13T00:01:09.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.882+0000 7f25b3fff640 1 -- 172.21.15.72:0/3773662727 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25c804c440 msgr2=0x7f25c81766c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.882+0000 7f25b3fff640 1 --2- 172.21.15.72:0/3773662727 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25c804c440 0x7f25c81766c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f25c000c410 tx=0x7f25c000c8d0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.882+0000 7f25d6774640 1 -- 172.21.15.72:0/3773662727 reap_dead start 2023-12-13T00:01:09.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.882+0000 7f25b3fff640 1 -- 172.21.15.72:0/3773662727 shutdown_connections 2023-12-13T00:01:09.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.882+0000 7f25b3fff640 1 -- 172.21.15.72:0/3773662727 >> 172.21.15.72:0/3773662727 conn(0x7f25c8050150 msgr2=0x7f25c80d5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.885+0000 7f25b3fff640 1 -- 172.21.15.72:0/3773662727 shutdown_connections 2023-12-13T00:01:09.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.887+0000 7f25b3fff640 1 -- 172.21.15.72:0/3773662727 wait complete. 2023-12-13T00:01:09.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.894+0000 7f972d4ad640 1 -- 172.21.15.72:0/3339403226 --> [v2:172.21.15.72:6818/46778518,v1:172.21.15.72:6819/46778518] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9728155920 con 0x7f97140755c0 2023-12-13T00:01:09.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.895+0000 7f970f7fe640 1 -- 172.21.15.72:0/3339403226 <== osd.0 v2:172.21.15.72:6818/46778518 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f971c02ebb0 con 0x7f97140755c0 2023-12-13T00:01:09.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.896+0000 7f49d2ffd640 1 -- 172.21.15.72:0/551191101 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc00ed30 con 0x7f49e415be20 2023-12-13T00:01:09.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.896+0000 7f49d2ffd640 1 -- 172.21.15.72:0/551191101 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc00eeb0 con 0x7f49e415be20 2023-12-13T00:01:09.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.896+0000 7f972d4ad640 1 -- 172.21.15.72:0/3339403226 >> [v2:172.21.15.72:6818/46778518,v1:172.21.15.72:6819/46778518] conn(0x7f97140755c0 msgr2=0x7f9714077a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.896+0000 7f972d4ad640 1 --2- 172.21.15.72:0/3339403226 >> [v2:172.21.15.72:6818/46778518,v1:172.21.15.72:6819/46778518] conn(0x7f97140755c0 0x7f9714077a60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.896+0000 7f972d4ad640 1 -- 172.21.15.72:0/3339403226 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f971406b280 msgr2=0x7f971406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.896+0000 7f972d4ad640 1 --2- 172.21.15.72:0/3339403226 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f971406b280 0x7f971406d740 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9718009890 tx=0x7f9718008040 comp rx=0 tx=0).stop 2023-12-13T00:01:09.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.896+0000 7f972d4ad640 1 -- 172.21.15.72:0/3339403226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9728158aa0 msgr2=0x7f972814cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.896+0000 7f972d4ad640 1 --2- 172.21.15.72:0/3339403226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9728158aa0 0x7f972814cdf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f972000c780 tx=0x7f972000cc40 comp rx=0 tx=0).stop 2023-12-13T00:01:09.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.896+0000 7f97277fe640 1 -- 172.21.15.72:0/3339403226 reap_dead start 2023-12-13T00:01:09.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.896+0000 7f972d4ad640 1 -- 172.21.15.72:0/3339403226 shutdown_connections 2023-12-13T00:01:09.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.897+0000 7f972d4ad640 1 -- 172.21.15.72:0/3339403226 >> 172.21.15.72:0/3339403226 conn(0x7f972806c5f0 msgr2=0x7f97280c47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.896+0000 7f49d2ffd640 1 -- 172.21.15.72:0/551191101 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc014640 con 0x7f49e415be20 2023-12-13T00:01:09.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.896+0000 7f49e359e640 1 -- 172.21.15.72:0/551191101 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e40b17d0 con 0x7f49e415be20 2023-12-13T00:01:09.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.896+0000 7f49e359e640 1 -- 172.21.15.72:0/551191101 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e40b1d90 con 0x7f49e415be20 2023-12-13T00:01:09.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.897+0000 7f972d4ad640 1 -- 172.21.15.72:0/3339403226 shutdown_connections 2023-12-13T00:01:09.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.897+0000 7f972d4ad640 1 -- 172.21.15.72:0/3339403226 wait complete. 2023-12-13T00:01:09.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.897+0000 7f49d0ff9640 1 -- 172.21.15.72:0/551191101 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49bc000fc0 con 0x7f49e415be20 2023-12-13T00:01:09.901 INFO:teuthology.orchestra.run.smithi072.stdout:64424509457 2023-12-13T00:01:09.901 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-13T00:01:09.907 INFO:teuthology.orchestra.run.smithi072.stdout:64424509456 2023-12-13T00:01:09.907 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-13T00:01:09.917 INFO:teuthology.orchestra.run.smithi072.stdout:60129542160 2023-12-13T00:01:09.917 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-13T00:01:09.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.917+0000 7f49d2ffd640 1 -- 172.21.15.72:0/551191101 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f49dc0147a0 con 0x7f49e415be20 2023-12-13T00:01:09.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.917+0000 7f49d2ffd640 1 --2- 172.21.15.72:0/551191101 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f49c406b210 0x7f49c406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.918+0000 7f49e259c640 1 --2- 172.21.15.72:0/551191101 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f49c406b210 0x7f49c406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.918+0000 7f49e259c640 1 --2- 172.21.15.72:0/551191101 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f49c406b210 0x7f49c406d6d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f49d4036000 tx=0x7f49d4009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.923+0000 7f49d2ffd640 1 -- 172.21.15.72:0/551191101 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f49dc059b60 con 0x7f49e415be20 2023-12-13T00:01:09.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.923+0000 7f49d2ffd640 1 --2- 172.21.15.72:0/551191101 >> [v2:172.21.15.176:6808/1197403965,v1:172.21.15.176:6809/1197403965] conn(0x7f49c4074970 0x7f49c4076e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.923+0000 7f49d2ffd640 1 -- 172.21.15.72:0/551191101 --> [v2:172.21.15.176:6808/1197403965,v1:172.21.15.176:6809/1197403965] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49c40774e0 con 0x7f49c4074970 2023-12-13T00:01:09.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.924+0000 7f49e1d9b640 1 --2- 172.21.15.72:0/551191101 >> [v2:172.21.15.176:6808/1197403965,v1:172.21.15.176:6809/1197403965] conn(0x7f49c4074970 0x7f49c4076e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:09.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.924+0000 7f49e1d9b640 1 --2- 172.21.15.72:0/551191101 >> [v2:172.21.15.176:6808/1197403965,v1:172.21.15.176:6809/1197403965] conn(0x7f49c4074970 0x7f49c4076e10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:09.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.925+0000 7f49d2ffd640 1 -- 172.21.15.72:0/551191101 <== osd.4 v2:172.21.15.176:6808/1197403965 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f49c40774e0 con 0x7f49c4074970 2023-12-13T00:01:09.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.927+0000 7f49d2ffd640 1 -- 172.21.15.72:0/551191101 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49dc0557a0 con 0x7f49e415be20 2023-12-13T00:01:09.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.955+0000 7f49d0ff9640 1 -- 172.21.15.72:0/551191101 --> [v2:172.21.15.176:6808/1197403965,v1:172.21.15.176:6809/1197403965] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f49bc002c70 con 0x7f49c4074970 2023-12-13T00:01:09.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.956+0000 7f49d2ffd640 1 -- 172.21.15.72:0/551191101 <== osd.4 v2:172.21.15.176:6808/1197403965 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f49bc002c70 con 0x7f49c4074970 2023-12-13T00:01:09.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.957+0000 7f49d0ff9640 1 -- 172.21.15.72:0/551191101 >> [v2:172.21.15.176:6808/1197403965,v1:172.21.15.176:6809/1197403965] conn(0x7f49c4074970 msgr2=0x7f49c4076e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.957+0000 7f49d0ff9640 1 --2- 172.21.15.72:0/551191101 >> [v2:172.21.15.176:6808/1197403965,v1:172.21.15.176:6809/1197403965] conn(0x7f49c4074970 0x7f49c4076e10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.958+0000 7f49d0ff9640 1 -- 172.21.15.72:0/551191101 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f49c406b210 msgr2=0x7f49c406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.958+0000 7f49d0ff9640 1 --2- 172.21.15.72:0/551191101 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f49c406b210 0x7f49c406d6d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f49d4036000 tx=0x7f49d4009030 comp rx=0 tx=0).stop 2023-12-13T00:01:09.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.958+0000 7f49d0ff9640 1 -- 172.21.15.72:0/551191101 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49e415be20 msgr2=0x7f49e41f2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:09.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.958+0000 7f49d0ff9640 1 --2- 172.21.15.72:0/551191101 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49e415be20 0x7f49e41f2a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f49e40cc430 tx=0x7f49dc00e4b0 comp rx=0 tx=0).stop 2023-12-13T00:01:09.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.958+0000 7f49e2d9d640 1 -- 172.21.15.72:0/551191101 reap_dead start 2023-12-13T00:01:09.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.958+0000 7f49d0ff9640 1 -- 172.21.15.72:0/551191101 shutdown_connections 2023-12-13T00:01:09.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.958+0000 7f49d0ff9640 1 -- 172.21.15.72:0/551191101 >> 172.21.15.72:0/551191101 conn(0x7f49e406bb20 msgr2=0x7f49e40c6930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:09.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.958+0000 7f49d0ff9640 1 -- 172.21.15.72:0/551191101 shutdown_connections 2023-12-13T00:01:09.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.958+0000 7f49d0ff9640 1 -- 172.21.15.72:0/551191101 wait complete. 2023-12-13T00:01:09.982 INFO:teuthology.orchestra.run.smithi072.stdout:64424509458 2023-12-13T00:01:09.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-13T00:01:09.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.984+0000 7f0acb09b640 1 Processor -- start 2023-12-13T00:01:09.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.984+0000 7f0acb09b640 1 -- start start 2023-12-13T00:01:09.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.986+0000 7f0acb09b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ac4157b70 0x7f0ac4161a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.986+0000 7f0acb09b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac406f900 con 0x7f0ac406c4e0 2023-12-13T00:01:09.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.986+0000 7f0acb09b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac406b760 con 0x7f0ac4157f50 2023-12-13T00:01:09.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.986+0000 7f0acb09b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac406f620 con 0x7f0ac4157b70 2023-12-13T00:01:09.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.988+0000 7f0ac9638640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0ac406c4e0 0x7f0ac4160f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47990/0 (socket says 172.21.15.72:47990) 2023-12-13T00:01:09.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.988+0000 7f0ac9638640 1 -- 172.21.15.72:0/845025690 learned_addr learned my addr 172.21.15.72:0/845025690 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:09.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.997+0000 7fa4d6c90640 1 Processor -- start 2023-12-13T00:01:09.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.997+0000 7fa4d6c90640 1 -- start start 2023-12-13T00:01:09.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.998+0000 7fa4d6c90640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4d00cf970 0x7fa4d00ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.999+0000 7fa4d6c90640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4d00cd510 0x7fa4d00cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:09.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.999+0000 7fa4d6c90640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d006c460 con 0x7fa4d0161cd0 2023-12-13T00:01:09.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.999+0000 7fa4d6c90640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d00caef0 con 0x7fa4d00cf970 2023-12-13T00:01:10.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.999+0000 7fa4d6c90640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d00c66d0 con 0x7fa4d00cd510 2023-12-13T00:01:10.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:09.999+0000 7f0ac8e37640 1 --2- 172.21.15.72:0/845025690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ac4157b70 0x7f0ac4161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.000+0000 7fa4d522d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4d00cd510 0x7fa4d00cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.002+0000 7f0ac8e37640 1 -- 172.21.15.72:0/845025690 >> v1:172.21.15.176:6789/0 conn(0x7f0ac4157f50 legacy=0x7f0ac40c22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.002+0000 7f0ac8e37640 1 -- 172.21.15.72:0/845025690 >> v1:172.21.15.72:6789/0 conn(0x7f0ac406c4e0 legacy=0x7f0ac4160f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.002+0000 7f0ac8e37640 1 -- 172.21.15.72:0/845025690 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac406ba00 con 0x7f0ac4157b70 2023-12-13T00:01:10.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.003+0000 7fa4d522d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4d00cd510 0x7fa4d00cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:48352/0 (socket says 172.21.15.72:48352) 2023-12-13T00:01:10.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.003+0000 7fa4d522d640 1 -- 172.21.15.72:0/26873269 learned_addr learned my addr 172.21.15.72:0/26873269 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:10.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.005+0000 7f0ac8e37640 1 --2- 172.21.15.72:0/845025690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ac4157b70 0x7f0ac4161a40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40097d0 tx=0x7f0ab402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e67081502eb50fa2 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.007+0000 7fa4d522d640 1 -- 172.21.15.72:0/26873269 >> v2:172.21.15.72:3300/0 conn(0x7fa4d00cf970 msgr2=0x7fa4d00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:10.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.007+0000 7fa4d522d640 1 --2- 172.21.15.72:0/26873269 >> v2:172.21.15.72:3300/0 conn(0x7fa4d00cf970 0x7fa4d00ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.007+0000 7fa4d522d640 1 -- 172.21.15.72:0/26873269 >> v1:172.21.15.72:6789/0 conn(0x7fa4d0161cd0 legacy=0x7fa4d00c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:10.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.007+0000 7fa4d522d640 1 -- 172.21.15.72:0/26873269 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d00c7150 con 0x7fa4d00cd510 2023-12-13T00:01:10.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.012+0000 7f0ac37fe640 1 -- 172.21.15.72:0/845025690 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4030610 con 0x7f0ac4157b70 2023-12-13T00:01:10.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.012+0000 7f0ac37fe640 1 -- 172.21.15.72:0/845025690 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab4030770 con 0x7f0ac4157b70 2023-12-13T00:01:10.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.012+0000 7f0ac37fe640 1 -- 172.21.15.72:0/845025690 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4030b40 con 0x7f0ac4157b70 2023-12-13T00:01:10.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.013+0000 7f0acb09b640 1 -- 172.21.15.72:0/845025690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ac4157b70 msgr2=0x7f0ac4161a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.013+0000 7f0acb09b640 1 --2- 172.21.15.72:0/845025690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ac4157b70 0x7f0ac4161a40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40097d0 tx=0x7f0ab402b960 comp rx=0 tx=0).stop 2023-12-13T00:01:10.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.013+0000 7fa4d522d640 1 --2- 172.21.15.72:0/26873269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4d00cd510 0x7fa4d00cd9c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009870 tx=0x7fa4c402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62313f8095bcc99c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.014+0000 7f0acb09b640 1 -- 172.21.15.72:0/845025690 shutdown_connections 2023-12-13T00:01:10.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.014+0000 7f0acb09b640 1 --2- 172.21.15.72:0/845025690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ac4157b70 0x7f0ac4161a40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.014+0000 7f0acb09b640 1 -- 172.21.15.72:0/845025690 >> 172.21.15.72:0/845025690 conn(0x7f0ac4070850 msgr2=0x7f0ac4070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:10.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.014+0000 7f0acb09b640 1 -- 172.21.15.72:0/845025690 shutdown_connections 2023-12-13T00:01:10.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.014+0000 7f0acb09b640 1 -- 172.21.15.72:0/845025690 wait complete. 2023-12-13T00:01:10.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.016+0000 7f0acb09b640 1 Processor -- start 2023-12-13T00:01:10.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.016+0000 7f0acb09b640 1 -- start start 2023-12-13T00:01:10.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.018+0000 7f0acb09b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ac406c4e0 0x7f0ac40c3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.018+0000 7f0acb09b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac4157b70 0x7f0ac41e8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.018+0000 7f0acb09b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ac41fc960 0x7f0ac41e8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.018+0000 7f0acb09b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac41ede00 con 0x7f0ac4157b70 2023-12-13T00:01:10.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.018+0000 7f0acb09b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac41fce60 con 0x7f0ac41fc960 2023-12-13T00:01:10.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.018+0000 7f0acb09b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac41ed1f0 con 0x7f0ac406c4e0 2023-12-13T00:01:10.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.018+0000 7f0ac9638640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ac41fc960 0x7f0ac41e8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.019+0000 7fa4cf7fe640 1 -- 172.21.15.72:0/26873269 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4030840 con 0x7fa4d00cd510 2023-12-13T00:01:10.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.019+0000 7fa4cf7fe640 1 -- 172.21.15.72:0/26873269 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c40309a0 con 0x7fa4d00cd510 2023-12-13T00:01:10.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.020+0000 7fa4d6c90640 1 -- 172.21.15.72:0/26873269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4d00cd510 msgr2=0x7fa4d00cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.020+0000 7fa4cf7fe640 1 -- 172.21.15.72:0/26873269 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4030840 con 0x7fa4d00cd510 2023-12-13T00:01:10.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.020+0000 7fa4d6c90640 1 --2- 172.21.15.72:0/26873269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4d00cd510 0x7fa4d00cd9c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009870 tx=0x7fa4c402b980 comp rx=0 tx=0).stop 2023-12-13T00:01:10.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.020+0000 7fa4d6c90640 1 -- 172.21.15.72:0/26873269 shutdown_connections 2023-12-13T00:01:10.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.020+0000 7fa4d6c90640 1 --2- 172.21.15.72:0/26873269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4d00cd510 0x7fa4d00cd9c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.020+0000 7fa4d6c90640 1 --2- 172.21.15.72:0/26873269 >> v2:172.21.15.72:3300/0 conn(0x7fa4d00cf970 0x7fa4d00ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.020+0000 7fa4d6c90640 1 -- 172.21.15.72:0/26873269 >> 172.21.15.72:0/26873269 conn(0x7fa4d00cecc0 msgr2=0x7fa4d00cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.019+0000 7f0ac9638640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ac41fc960 0x7f0ac41e8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:60076/0 (socket says 172.21.15.72:60076) 2023-12-13T00:01:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.019+0000 7f0ac9638640 1 -- 172.21.15.72:0/380224351 learned_addr learned my addr 172.21.15.72:0/380224351 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.019+0000 7f0ac8e37640 1 --2- 172.21.15.72:0/380224351 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ac406c4e0 0x7f0ac40c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.020+0000 7fa4d6c90640 1 -- 172.21.15.72:0/26873269 shutdown_connections 2023-12-13T00:01:10.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.020+0000 7fa4d6c90640 1 -- 172.21.15.72:0/26873269 wait complete. 2023-12-13T00:01:10.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.022+0000 7fa4d6c90640 1 Processor -- start 2023-12-13T00:01:10.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.023+0000 7fa4d6c90640 1 -- start start 2023-12-13T00:01:10.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.024+0000 7fa4d6c90640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4d00cd510 0x7fa4d01579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.024+0000 7fa4d6c90640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4d00cf970 0x7fa4d0154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.024+0000 7fa4d6c90640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4d0161cd0 0x7fa4d0154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.024+0000 7fa4d6c90640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d01e7190 con 0x7fa4d0161cd0 2023-12-13T00:01:10.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.024+0000 7fa4d6c90640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d01e7470 con 0x7fa4d00cd510 2023-12-13T00:01:10.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.024+0000 7fa4d6c90640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d01e7750 con 0x7fa4d00cf970 2023-12-13T00:01:10.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.024+0000 7f0ac3fff640 1 --2- 172.21.15.72:0/380224351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac4157b70 0x7f0ac41e8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.024+0000 7f0ac8e37640 1 -- 172.21.15.72:0/380224351 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ac41fc960 msgr2=0x7f0ac41e8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.024+0000 7f0ac8e37640 1 --2- 172.21.15.72:0/380224351 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ac41fc960 0x7f0ac41e8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.024+0000 7f0ac8e37640 1 -- 172.21.15.72:0/380224351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac4157b70 msgr2=0x7f0ac41e8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.024+0000 7f0ac8e37640 1 --2- 172.21.15.72:0/380224351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac4157b70 0x7f0ac41e8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.024+0000 7f0ac8e37640 1 -- 172.21.15.72:0/380224351 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab4009400 con 0x7f0ac406c4e0 2023-12-13T00:01:10.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.025+0000 7fa4d4a2c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4d00cd510 0x7fa4d01579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.026+0000 7fa4d4a2c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4d00cd510 0x7fa4d01579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:60080/0 (socket says 172.21.15.72:60080) 2023-12-13T00:01:10.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.026+0000 7fa4d4a2c640 1 -- 172.21.15.72:0/771784155 learned_addr learned my addr 172.21.15.72:0/771784155 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:10.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.026+0000 7fa4cffff640 1 --2- 172.21.15.72:0/771784155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4d00cf970 0x7fa4d0154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.027+0000 7f0ac8e37640 1 --2- 172.21.15.72:0/380224351 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ac406c4e0 0x7f0ac40c3620 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4033000 tx=0x7f0ab40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.030+0000 7fa4d4a2c640 1 -- 172.21.15.72:0/771784155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4d00cf970 msgr2=0x7fa4d0154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.030+0000 7fa4d4a2c640 1 --2- 172.21.15.72:0/771784155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4d00cf970 0x7fa4d0154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.030+0000 7fa4d4a2c640 1 -- 172.21.15.72:0/771784155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4d0161cd0 msgr2=0x7fa4d0154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.030+0000 7fa4d4a2c640 1 --2- 172.21.15.72:0/771784155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4d0161cd0 0x7fa4d0154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.030+0000 7fa4d4a2c640 1 -- 172.21.15.72:0/771784155 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c40094d0 con 0x7fa4d00cd510 2023-12-13T00:01:10.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.032+0000 7fa4d4a2c640 1 --2- 172.21.15.72:0/771784155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4d00cd510 0x7fa4d01579c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800ba50 tx=0x7fa4c800be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.035+0000 7fa4cd7fa640 1 -- 172.21.15.72:0/771784155 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800cb50 con 0x7fa4d00cd510 2023-12-13T00:01:10.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.036+0000 7fa4d6c90640 1 -- 172.21.15.72:0/771784155 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d01e7a30 con 0x7fa4d00cd510 2023-12-13T00:01:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.036+0000 7fa4d6c90640 1 -- 172.21.15.72:0/771784155 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d01e7ff0 con 0x7fa4d00cd510 2023-12-13T00:01:10.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.036+0000 7f0ac17fa640 1 -- 172.21.15.72:0/380224351 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab403e070 con 0x7f0ac406c4e0 2023-12-13T00:01:10.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.037+0000 7f0ac17fa640 1 -- 172.21.15.72:0/380224351 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab4039780 con 0x7f0ac406c4e0 2023-12-13T00:01:10.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.037+0000 7f0acb09b640 1 -- 172.21.15.72:0/380224351 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac41ed4d0 con 0x7f0ac406c4e0 2023-12-13T00:01:10.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.037+0000 7f0acb09b640 1 -- 172.21.15.72:0/380224351 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac41eda90 con 0x7f0ac406c4e0 2023-12-13T00:01:10.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.037+0000 7f0ac17fa640 1 -- 172.21.15.72:0/380224351 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4039b50 con 0x7f0ac406c4e0 2023-12-13T00:01:10.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.039+0000 7f0acb09b640 1 -- 172.21.15.72:0/380224351 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa4005250 con 0x7f0ac406c4e0 2023-12-13T00:01:10.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.037+0000 7fc616a4b640 1 Processor -- start 2023-12-13T00:01:10.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.037+0000 7fc616a4b640 1 -- start start 2023-12-13T00:01:10.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.039+0000 7fc616a4b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61014f850 0x7fc610071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.039+0000 7fc616a4b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6100c5950 0x7fc6100710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.039+0000 7fc616a4b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc610155380 con 0x7fc6100715f0 2023-12-13T00:01:10.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.039+0000 7fc616a4b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc610155640 con 0x7fc6100c5950 2023-12-13T00:01:10.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.039+0000 7fc616a4b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc610155920 con 0x7fc61014f850 2023-12-13T00:01:10.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.039+0000 7fa4cd7fa640 1 -- 172.21.15.72:0/771784155 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c800ccb0 con 0x7fa4d00cd510 2023-12-13T00:01:10.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.039+0000 7fa4cd7fa640 1 -- 172.21.15.72:0/771784155 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8014680 con 0x7fa4d00cd510 2023-12-13T00:01:10.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.041+0000 7fa4d6c90640 1 -- 172.21.15.72:0/771784155 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d00cc410 con 0x7fa4d00cd510 2023-12-13T00:01:10.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.044+0000 7fc614fe8640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fc6100715f0 0x7fc610158b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:43756/0 (socket says 172.21.15.72:43756) 2023-12-13T00:01:10.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.044+0000 7fc614fe8640 1 -- 172.21.15.72:0/3940110598 learned_addr learned my addr 172.21.15.72:0/3940110598 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:10.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.045+0000 7fc60ffff640 1 --2- 172.21.15.72:0/3940110598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61014f850 0x7fc610071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.052+0000 7fc60f7fe640 1 --2- 172.21.15.72:0/3940110598 >> v2:172.21.15.72:3300/0 conn(0x7fc6100c5950 0x7fc6100710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.054+0000 7f81293c5640 1 Processor -- start 2023-12-13T00:01:10.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.054+0000 7f81293c5640 1 -- start start 2023-12-13T00:01:10.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.055+0000 7f81293c5640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8124150210 0x7f8124156b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.055+0000 7f81293c5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8124157690 0x7f81240cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.055+0000 7f81293c5640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81240c1cd0 con 0x7f81240c0ed0 2023-12-13T00:01:10.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.055+0000 7f81293c5640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81241561a0 con 0x7f8124150210 2023-12-13T00:01:10.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.055+0000 7f81293c5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81240c1430 con 0x7f8124157690 2023-12-13T00:01:10.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.057+0000 7fa4cd7fa640 1 -- 172.21.15.72:0/771784155 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa4c801d3b0 con 0x7fa4d00cd510 2023-12-13T00:01:10.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.057+0000 7fa4cd7fa640 1 --2- 172.21.15.72:0/771784155 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa4bc06b210 0x7fa4bc06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.058+0000 7fa4cffff640 1 --2- 172.21.15.72:0/771784155 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa4bc06b210 0x7fa4bc06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.058+0000 7fa4cffff640 1 --2- 172.21.15.72:0/771784155 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa4bc06b210 0x7fa4bc06d6d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00c89e0 tx=0x7fa4c0009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.069+0000 7f8122ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8124150210 0x7f8124156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.069+0000 7f8122ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8124150210 0x7f8124156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35672/0 (socket says 172.21.15.72:35672) 2023-12-13T00:01:10.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.069+0000 7f8122ffd640 1 -- 172.21.15.72:0/3823294251 learned_addr learned my addr 172.21.15.72:0/3823294251 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:10.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.075+0000 7f8122ffd640 1 -- 172.21.15.72:0/3823294251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8124157690 msgr2=0x7f81240cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:10.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.075+0000 7f8122ffd640 1 --2- 172.21.15.72:0/3823294251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8124157690 0x7f81240cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.075+0000 7f8122ffd640 1 -- 172.21.15.72:0/3823294251 >> v1:172.21.15.72:6789/0 conn(0x7f81240c0ed0 legacy=0x7f81240720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:10.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.075+0000 7f8122ffd640 1 -- 172.21.15.72:0/3823294251 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81240c1710 con 0x7f8124150210 2023-12-13T00:01:10.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.077+0000 7f839722b640 1 Processor -- start 2023-12-13T00:01:10.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.077+0000 7f839722b640 1 -- start start 2023-12-13T00:01:10.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.077+0000 7fc60f7fe640 1 -- 172.21.15.72:0/3940110598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61014f850 msgr2=0x7fc610071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:10.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.077+0000 7fc60f7fe640 1 --2- 172.21.15.72:0/3940110598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61014f850 0x7fc610071e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.077+0000 7fc60f7fe640 1 -- 172.21.15.72:0/3940110598 >> v1:172.21.15.176:6789/0 conn(0x7fc6100715f0 legacy=0x7fc610158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:10.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.077+0000 7fc60f7fe640 1 -- 172.21.15.72:0/3940110598 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc610155c00 con 0x7fc6100c5950 2023-12-13T00:01:10.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.078+0000 7f839722b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f839015b280 0x7f83900ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.078+0000 7f839722b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83900cc8a0 con 0x7f8390151550 2023-12-13T00:01:10.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.078+0000 7f839722b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839015b710 con 0x7f83900ca890 2023-12-13T00:01:10.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.078+0000 7f839722b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83900cac90 con 0x7f839015b280 2023-12-13T00:01:10.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.081+0000 7f8122ffd640 1 --2- 172.21.15.72:0/3823294251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8124150210 0x7f8124156b90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8114009870 tx=0x7f811402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb1c00b56a8ba11 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.082+0000 7f4634fec640 1 Processor -- start 2023-12-13T00:01:10.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.082+0000 7f4634fec640 1 -- start start 2023-12-13T00:01:10.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.083+0000 7f4634fec640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4630157840 0x7f46300c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.083+0000 7f4634fec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46300c82f0 0x7f46300c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.083+0000 7f4634fec640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f46300c40c0 0x7f463015d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.083+0000 7f4634fec640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4630160d80 con 0x7f46300c40c0 2023-12-13T00:01:10.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.083+0000 7f4634fec640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4630161900 con 0x7f4630157840 2023-12-13T00:01:10.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.083+0000 7f4634fec640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4630157c20 con 0x7f46300c82f0 2023-12-13T00:01:10.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.089+0000 7f8394fc7640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8390151550 0x7f839006fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48014/0 (socket says 172.21.15.72:48014) 2023-12-13T00:01:10.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.089+0000 7f8394fc7640 1 -- 172.21.15.72:0/4252233748 learned_addr learned my addr 172.21.15.72:0/4252233748 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:10.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.089+0000 7f8121ffb640 1 -- 172.21.15.72:0/3823294251 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114031640 con 0x7f8124150210 2023-12-13T00:01:10.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.089+0000 7f8121ffb640 1 -- 172.21.15.72:0/3823294251 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81140317a0 con 0x7f8124150210 2023-12-13T00:01:10.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.089+0000 7f8121ffb640 1 -- 172.21.15.72:0/3823294251 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114031b30 con 0x7f8124150210 2023-12-13T00:01:10.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.089+0000 7f462ed9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f46300c40c0 0x7f463015d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.090+0000 7f81293c5640 1 -- 172.21.15.72:0/3823294251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8124150210 msgr2=0x7f8124156b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.090+0000 7f81293c5640 1 --2- 172.21.15.72:0/3823294251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8124150210 0x7f8124156b90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8114009870 tx=0x7f811402b8f0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.090+0000 7f81293c5640 1 -- 172.21.15.72:0/3823294251 shutdown_connections 2023-12-13T00:01:10.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.090+0000 7f81293c5640 1 --2- 172.21.15.72:0/3823294251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8124157690 0x7f81240cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.090+0000 7f81293c5640 1 --2- 172.21.15.72:0/3823294251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8124150210 0x7f8124156b90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.090+0000 7f81293c5640 1 -- 172.21.15.72:0/3823294251 >> 172.21.15.72:0/3823294251 conn(0x7f81240700e0 msgr2=0x7f812406b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:10.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.090+0000 7f81293c5640 1 -- 172.21.15.72:0/3823294251 shutdown_connections 2023-12-13T00:01:10.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.090+0000 7f462ed9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f46300c40c0 0x7f463015d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35678/0 (socket says 172.21.15.72:35678) 2023-12-13T00:01:10.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.090+0000 7f462ed9d640 1 -- 172.21.15.72:0/828025686 learned_addr learned my addr 172.21.15.72:0/828025686 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:10.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.090+0000 7f81293c5640 1 -- 172.21.15.72:0/3823294251 wait complete. 2023-12-13T00:01:10.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.092+0000 7f81293c5640 1 Processor -- start 2023-12-13T00:01:10.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.092+0000 7f81293c5640 1 -- start start 2023-12-13T00:01:10.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.092+0000 7f81293c5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81240c0ed0 0x7f81241ef270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.092+0000 7f81293c5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8124150210 0x7f81241f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.092+0000 7f81293c5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8124157690 0x7f812413b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.092+0000 7f81293c5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81241f0290 con 0x7f8124150210 2023-12-13T00:01:10.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.092+0000 7f81293c5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81240c8100 con 0x7f81240c0ed0 2023-12-13T00:01:10.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.092+0000 7f81293c5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81241f27e0 con 0x7f8124157690 2023-12-13T00:01:10.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.096+0000 7f462ed9d640 1 -- 172.21.15.72:0/828025686 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46300c82f0 msgr2=0x7f46300c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:10.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.096+0000 7f462ed9d640 1 --2- 172.21.15.72:0/828025686 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46300c82f0 0x7f46300c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.096+0000 7f462ed9d640 1 -- 172.21.15.72:0/828025686 >> v2:172.21.15.176:3300/0 conn(0x7f4630157840 msgr2=0x7f46300c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:10.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.096+0000 7f462ed9d640 1 --2- 172.21.15.72:0/828025686 >> v2:172.21.15.176:3300/0 conn(0x7f4630157840 0x7f46300c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.097+0000 7f838f7fe640 1 -- 172.21.15.72:0/4252233748 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062953468 0 0) 0x7f83900cc8a0 con 0x7f8390151550 2023-12-13T00:01:10.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.097+0000 7f838f7fe640 1 -- 172.21.15.72:0/4252233748 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8380003520 con 0x7f8390151550 2023-12-13T00:01:10.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.096+0000 7f462ed9d640 1 -- 172.21.15.72:0/828025686 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463015e590 con 0x7f46300c40c0 2023-12-13T00:01:10.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.097+0000 7fbd0ff3c640 1 Processor -- start 2023-12-13T00:01:10.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.097+0000 7fbd0ff3c640 1 -- start start 2023-12-13T00:01:10.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.098+0000 7fbd0ff3c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbd0814ffa0 0x7fbd080c1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.098+0000 7fbd0ff3c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbd08150380 0x7fbd0806fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.098+0000 7fbd0ff3c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd081570d0 con 0x7fbd0806ffc0 2023-12-13T00:01:10.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.098+0000 7fbd0ff3c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd08156270 con 0x7fbd08150380 2023-12-13T00:01:10.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.098+0000 7fbd0ff3c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd08156550 con 0x7fbd0814ffa0 2023-12-13T00:01:10.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.102+0000 7f462ed9d640 1 --2- 172.21.15.72:0/828025686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46300c40c0 0x7f463015d790 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f46300c7d80 tx=0x7f462802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e44773da8f67cd server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.103+0000 7f838f7fe640 1 -- 172.21.15.72:0/4252233748 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3517943580 0 0) 0x7f8380003520 con 0x7f8390151550 2023-12-13T00:01:10.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.103+0000 7f838f7fe640 1 -- 172.21.15.72:0/4252233748 >> v2:172.21.15.176:3300/0 conn(0x7f839015b280 msgr2=0x7f83900ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:10.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.103+0000 7f838f7fe640 1 --2- 172.21.15.72:0/4252233748 >> v2:172.21.15.176:3300/0 conn(0x7f839015b280 0x7f83900ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.103+0000 7f838f7fe640 1 -- 172.21.15.72:0/4252233748 >> v1:172.21.15.176:6789/0 conn(0x7f83900ca890 legacy=0x7f83901571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:10.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.103+0000 7f838f7fe640 1 -- 172.21.15.72:0/4252233748 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8390151930 con 0x7f8390151550 2023-12-13T00:01:10.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.103+0000 7f838f7fe640 1 -- 172.21.15.72:0/4252233748 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1233568696 0 0) 0x7f8384001670 con 0x7f8390151550 2023-12-13T00:01:10.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.103+0000 7f838f7fe640 1 -- 172.21.15.72:0/4252233748 >> v1:172.21.15.72:6789/0 conn(0x7f8390151550 legacy=0x7f839006fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.103+0000 7f838f7fe640 1 --2- 172.21.15.72:0/4252233748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8380003a30 0x7f8380003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.103+0000 7f838f7fe640 1 --2- 172.21.15.72:0/4252233748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83800047c0 0x7f8380004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.103+0000 7f838f7fe640 1 --2- 172.21.15.72:0/4252233748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8380005380 0x7f838000fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.103+0000 7f838f7fe640 1 -- 172.21.15.72:0/4252233748 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83900cac90 con 0x7f8380003a30 2023-12-13T00:01:10.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.103+0000 7f838f7fe640 1 -- 172.21.15.72:0/4252233748 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8380010650 con 0x7f83800047c0 2023-12-13T00:01:10.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.103+0000 7f838f7fe640 1 -- 172.21.15.72:0/4252233748 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8380010810 con 0x7f8380005380 2023-12-13T00:01:10.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.108+0000 7fc60f7fe640 1 --2- 172.21.15.72:0/3940110598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6100c5950 0x7fc6100710b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc6000097a0 tx=0x7fc60002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6401b2ce46fec85f server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.111+0000 7f81227fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8124150210 0x7f81241f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.112+0000 7fbd0d4d7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbd08150380 0x7fbd0806fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.112+0000 7f81227fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8124150210 0x7f81241f3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35694/0 (socket says 172.21.15.72:35694) 2023-12-13T00:01:10.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.112+0000 7f81227fc640 1 -- 172.21.15.72:0/84167198 learned_addr learned my addr 172.21.15.72:0/84167198 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:10.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.112+0000 7fbd0d4d7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbd08150380 0x7fbd0806fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35710/0 (socket says 172.21.15.72:35710) 2023-12-13T00:01:10.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.112+0000 7fbd0d4d7640 1 -- 172.21.15.72:0/1029288531 learned_addr learned my addr 172.21.15.72:0/1029288531 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:10.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.116+0000 7f81227fc640 1 -- 172.21.15.72:0/84167198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8124157690 msgr2=0x7f812413b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.116+0000 7f81227fc640 1 --2- 172.21.15.72:0/84167198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8124157690 0x7f812413b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.116+0000 7f81227fc640 1 -- 172.21.15.72:0/84167198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81240c0ed0 msgr2=0x7f81241ef270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.116+0000 7f81227fc640 1 --2- 172.21.15.72:0/84167198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81240c0ed0 0x7f81241ef270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.116+0000 7f81227fc640 1 -- 172.21.15.72:0/84167198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81140094d0 con 0x7f8124150210 2023-12-13T00:01:10.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.118+0000 7fbd0d4d7640 1 -- 172.21.15.72:0/1029288531 >> v2:172.21.15.176:3300/0 conn(0x7fbd0814ffa0 msgr2=0x7fbd080c1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:10.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.118+0000 7fbd0d4d7640 1 --2- 172.21.15.72:0/1029288531 >> v2:172.21.15.176:3300/0 conn(0x7fbd0814ffa0 0x7fbd080c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.118+0000 7fbd0d4d7640 1 -- 172.21.15.72:0/1029288531 >> v1:172.21.15.72:6789/0 conn(0x7fbd0806ffc0 legacy=0x7fbd080c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:10.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.118+0000 7fbd0d4d7640 1 -- 172.21.15.72:0/1029288531 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd08156830 con 0x7fbd08150380 2023-12-13T00:01:10.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.121+0000 7f462dd9b640 1 -- 172.21.15.72:0/828025686 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462802ca80 con 0x7f46300c40c0 2023-12-13T00:01:10.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.121+0000 7f462dd9b640 1 -- 172.21.15.72:0/828025686 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462802cbe0 con 0x7f46300c40c0 2023-12-13T00:01:10.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.121+0000 7f462dd9b640 1 -- 172.21.15.72:0/828025686 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46280343f0 con 0x7f46300c40c0 2023-12-13T00:01:10.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.122+0000 7f4634fec640 1 -- 172.21.15.72:0/828025686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46300c40c0 msgr2=0x7f463015d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.122+0000 7f4634fec640 1 --2- 172.21.15.72:0/828025686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46300c40c0 0x7f463015d790 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f46300c7d80 tx=0x7f462802bee0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.122+0000 7f4634fec640 1 -- 172.21.15.72:0/828025686 shutdown_connections 2023-12-13T00:01:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.122+0000 7f4634fec640 1 --2- 172.21.15.72:0/828025686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46300c40c0 0x7f463015d790 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.122+0000 7f4634fec640 1 --2- 172.21.15.72:0/828025686 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46300c82f0 0x7f46300c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.122+0000 7f4634fec640 1 --2- 172.21.15.72:0/828025686 >> v2:172.21.15.176:3300/0 conn(0x7f4630157840 0x7f46300c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.122+0000 7f4634fec640 1 -- 172.21.15.72:0/828025686 >> 172.21.15.72:0/828025686 conn(0x7f46300712f0 msgr2=0x7f46300716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.122+0000 7f4634fec640 1 -- 172.21.15.72:0/828025686 shutdown_connections 2023-12-13T00:01:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.122+0000 7f4634fec640 1 -- 172.21.15.72:0/828025686 wait complete. 2023-12-13T00:01:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.124+0000 7fbd0d4d7640 1 --2- 172.21.15.72:0/1029288531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd08150380 0x7fbd0806fa80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd080c91c0 tx=0x7fbcf802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c515e0fcaa779923 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.124+0000 7fc60effd640 1 -- 172.21.15.72:0/3940110598 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60002e070 con 0x7fc6100c5950 2023-12-13T00:01:10.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.124+0000 7fc60effd640 1 -- 172.21.15.72:0/3940110598 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6000315a0 con 0x7fc6100c5950 2023-12-13T00:01:10.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.124+0000 7f4634fec640 1 Processor -- start 2023-12-13T00:01:10.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.124+0000 7fc60effd640 1 -- 172.21.15.72:0/3940110598 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600031930 con 0x7fc6100c5950 2023-12-13T00:01:10.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.124+0000 7f4634fec640 1 -- start start 2023-12-13T00:01:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.125+0000 7fc616a4b640 1 -- 172.21.15.72:0/3940110598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6100c5950 msgr2=0x7fc6100710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.125+0000 7fc616a4b640 1 --2- 172.21.15.72:0/3940110598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6100c5950 0x7fc6100710b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc6000097a0 tx=0x7fc60002b840 comp rx=0 tx=0).stop 2023-12-13T00:01:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.125+0000 7fc616a4b640 1 -- 172.21.15.72:0/3940110598 shutdown_connections 2023-12-13T00:01:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.125+0000 7fc616a4b640 1 --2- 172.21.15.72:0/3940110598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6100c5950 0x7fc6100710b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.125+0000 7fc616a4b640 1 --2- 172.21.15.72:0/3940110598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61014f850 0x7fc610071e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.125+0000 7fc616a4b640 1 -- 172.21.15.72:0/3940110598 >> 172.21.15.72:0/3940110598 conn(0x7fc61006d330 msgr2=0x7fc61006a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.125+0000 7fc616a4b640 1 -- 172.21.15.72:0/3940110598 shutdown_connections 2023-12-13T00:01:10.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.125+0000 7f4634fec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46300c40c0 0x7f46300c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.125+0000 7f4634fec640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46300c82f0 0x7f463014e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.125+0000 7f4634fec640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4630157840 0x7f46301f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.125+0000 7f4634fec640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46301f46f0 con 0x7f4630157840 2023-12-13T00:01:10.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.125+0000 7f4634fec640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46301f6d90 con 0x7f46300c82f0 2023-12-13T00:01:10.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.125+0000 7f4634fec640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46301f3930 con 0x7f46300c40c0 2023-12-13T00:01:10.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.125+0000 7fc616a4b640 1 -- 172.21.15.72:0/3940110598 wait complete. 2023-12-13T00:01:10.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.127+0000 7fc616a4b640 1 Processor -- start 2023-12-13T00:01:10.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.127+0000 7f81227fc640 1 --2- 172.21.15.72:0/84167198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8124150210 0x7f81241f3230 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f811800b450 tx=0x7f811800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.127+0000 7fc616a4b640 1 -- start start 2023-12-13T00:01:10.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.127+0000 7f7bc62c9640 1 Processor -- start 2023-12-13T00:01:10.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.127+0000 7f7bc62c9640 1 -- start start 2023-12-13T00:01:10.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.128+0000 7f7bc62c9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7bc00721d0 0x7f7bc00725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.128+0000 7f7bc62c9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7bc00c5c40 0x7f7bc00c6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.128+0000 7f7bc62c9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bc00c6b50 0x7f7bc01566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.128+0000 7fc616a4b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6100715f0 0x7fc610152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.128+0000 7fc616a4b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6100c5950 0x7fc6101ed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.128+0000 7fc616a4b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61014f850 0x7fc61015fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.128+0000 7fc616a4b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61014f050 con 0x7fc6100715f0 2023-12-13T00:01:10.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.128+0000 7fc616a4b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6101f1100 con 0x7fc6100c5950 2023-12-13T00:01:10.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.128+0000 7fc616a4b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6101ecc50 con 0x7fc61014f850 2023-12-13T00:01:10.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.128+0000 7f7bc62c9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc00c3c80 con 0x7f7bc00721d0 2023-12-13T00:01:10.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.128+0000 7f7bc62c9640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc00c46a0 con 0x7f7bc00c5c40 2023-12-13T00:01:10.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.128+0000 7f7bc62c9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc0072af0 con 0x7f7bc00c6b50 2023-12-13T00:01:10.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.131+0000 7fbd0ccd6640 1 -- 172.21.15.72:0/1029288531 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8030860 con 0x7fbd08150380 2023-12-13T00:01:10.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.131+0000 7fbd0ccd6640 1 -- 172.21.15.72:0/1029288531 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf80309c0 con 0x7fbd08150380 2023-12-13T00:01:10.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.131+0000 7fbd0ccd6640 1 -- 172.21.15.72:0/1029288531 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8030d50 con 0x7fbd08150380 2023-12-13T00:01:10.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.131+0000 7fbd0ff3c640 1 -- 172.21.15.72:0/1029288531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd08150380 msgr2=0x7fbd0806fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.131+0000 7fbd0ff3c640 1 --2- 172.21.15.72:0/1029288531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd08150380 0x7fbd0806fa80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd080c91c0 tx=0x7fbcf802b9a0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.132+0000 7fbd0ff3c640 1 -- 172.21.15.72:0/1029288531 shutdown_connections 2023-12-13T00:01:10.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.132+0000 7fbd0ff3c640 1 --2- 172.21.15.72:0/1029288531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd08150380 0x7fbd0806fa80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.132+0000 7fbd0ff3c640 1 --2- 172.21.15.72:0/1029288531 >> v2:172.21.15.176:3300/0 conn(0x7fbd0814ffa0 0x7fbd080c1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.132+0000 7fbd0ff3c640 1 -- 172.21.15.72:0/1029288531 >> 172.21.15.72:0/1029288531 conn(0x7fbd0806b5c0 msgr2=0x7fbd0806b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:10.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.132+0000 7fbd0ff3c640 1 -- 172.21.15.72:0/1029288531 shutdown_connections 2023-12-13T00:01:10.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.132+0000 7fbd0ff3c640 1 -- 172.21.15.72:0/1029288531 wait complete. 2023-12-13T00:01:10.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.133+0000 7fbd0ff3c640 1 Processor -- start 2023-12-13T00:01:10.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.133+0000 7fbd0ff3c640 1 -- start start 2023-12-13T00:01:10.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.133+0000 7fbd0ff3c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0806ffc0 0x7fbd080c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.134+0000 7fbd0ff3c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd0814ffa0 0x7fbd081ef410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.134+0000 7fbd0ff3c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd08150380 0x7fbd081488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.134+0000 7fbd0ff3c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd080c5520 con 0x7fbd08150380 2023-12-13T00:01:10.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.134+0000 7fbd0ff3c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd081f2f20 con 0x7fbd0806ffc0 2023-12-13T00:01:10.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.134+0000 7fbd0ff3c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd081eef80 con 0x7fbd0814ffa0 2023-12-13T00:01:10.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.135+0000 7f8394fc7640 1 --2- 172.21.15.72:0/4252233748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8380003a30 0x7f8380003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.138+0000 7fc60ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6100715f0 0x7fc610152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.140+0000 7f8394fc7640 1 -- 172.21.15.72:0/4252233748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8380005380 msgr2=0x7f838000fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:10.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.140+0000 7f8394fc7640 1 --2- 172.21.15.72:0/4252233748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8380005380 0x7f838000fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.140+0000 7f8394fc7640 1 -- 172.21.15.72:0/4252233748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83800047c0 msgr2=0x7f8380004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:10.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.140+0000 7f8394fc7640 1 --2- 172.21.15.72:0/4252233748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83800047c0 0x7f8380004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.140+0000 7f8394fc7640 1 -- 172.21.15.72:0/4252233748 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8380003520 con 0x7f8380003a30 2023-12-13T00:01:10.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.140+0000 7f83957c8640 1 -- 172.21.15.72:0/4252233748 reap_dead start 2023-12-13T00:01:10.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.141+0000 7fc60ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6100715f0 0x7fc610152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35752/0 (socket says 172.21.15.72:35752) 2023-12-13T00:01:10.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.141+0000 7fc60ffff640 1 -- 172.21.15.72:0/1710617473 learned_addr learned my addr 172.21.15.72:0/1710617473 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:10.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.142+0000 7f462ed9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4630157840 0x7f46301f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.143+0000 7f8394fc7640 1 --2- 172.21.15.72:0/4252233748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8380003a30 0x7f8380003e30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f838400c190 tx=0x7f83800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b829ab688ede330 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.143+0000 7f462ed9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4630157840 0x7f46301f7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35736/0 (socket says 172.21.15.72:35736) 2023-12-13T00:01:10.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.143+0000 7f462ed9d640 1 -- 172.21.15.72:0/3650164278 learned_addr learned my addr 172.21.15.72:0/3650164278 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:10.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.146+0000 7fc60ffff640 1 -- 172.21.15.72:0/1710617473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61014f850 msgr2=0x7fc61015fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.146+0000 7fc60ffff640 1 --2- 172.21.15.72:0/1710617473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61014f850 0x7fc61015fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.146+0000 7fc60ffff640 1 -- 172.21.15.72:0/1710617473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6100c5950 msgr2=0x7fc6101ed3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.146+0000 7fc60ffff640 1 --2- 172.21.15.72:0/1710617473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6100c5950 0x7fc6101ed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.146+0000 7fc60ffff640 1 -- 172.21.15.72:0/1710617473 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc600009400 con 0x7fc6100715f0 2023-12-13T00:01:10.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.150+0000 7f810b7fe640 1 -- 172.21.15.72:0/84167198 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8118011890 con 0x7f8124150210 2023-12-13T00:01:10.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.150+0000 7f810b7fe640 1 -- 172.21.15.72:0/84167198 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81180119f0 con 0x7f8124150210 2023-12-13T00:01:10.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.150+0000 7f810b7fe640 1 -- 172.21.15.72:0/84167198 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8118011da0 con 0x7f8124150210 2023-12-13T00:01:10.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.151+0000 7f81293c5640 1 -- 172.21.15.72:0/84167198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81241f2da0 con 0x7f8124150210 2023-12-13T00:01:10.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.151+0000 7f81293c5640 1 -- 172.21.15.72:0/84167198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8124155de0 con 0x7f8124150210 2023-12-13T00:01:10.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.151+0000 7f81293c5640 1 -- 172.21.15.72:0/84167198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8124071da0 con 0x7f8124150210 2023-12-13T00:01:10.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.154+0000 7f462ed9d640 1 -- 172.21.15.72:0/3650164278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46300c40c0 msgr2=0x7f46300c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.154+0000 7f462ed9d640 1 --2- 172.21.15.72:0/3650164278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46300c40c0 0x7f46300c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.154+0000 7f462ed9d640 1 -- 172.21.15.72:0/3650164278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46300c82f0 msgr2=0x7f463014e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.154+0000 7f462ed9d640 1 --2- 172.21.15.72:0/3650164278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46300c82f0 0x7f463014e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.154+0000 7f462ed9d640 1 -- 172.21.15.72:0/3650164278 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4628009b30 con 0x7f4630157840 2023-12-13T00:01:10.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.157+0000 7fc60ffff640 1 --2- 172.21.15.72:0/1710617473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6100715f0 0x7fc610152170 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc60400c820 tx=0x7fc60400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.287+0000 7f0ac17fa640 1 -- 172.21.15.72:0/380224351 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0ab4042070 con 0x7f0ac406c4e0 2023-12-13T00:01:10.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.288+0000 7f0ac17fa640 1 --2- 172.21.15.72:0/380224351 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0ab006b210 0x7f0ab006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.288+0000 7f0ac3fff640 1 --2- 172.21.15.72:0/380224351 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0ab006b210 0x7f0ab006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.288+0000 7f0ac3fff640 1 --2- 172.21.15.72:0/380224351 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0ab006b210 0x7f0ab006d6d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0ac41f9b40 tx=0x7f0abc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.292+0000 7f0ac17fa640 1 -- 172.21.15.72:0/380224351 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f0ab407aa90 con 0x7f0ac406c4e0 2023-12-13T00:01:10.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.300+0000 7fa4cd7fa640 1 -- 172.21.15.72:0/771784155 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fa4c800ce20 con 0x7fa4d00cd510 2023-12-13T00:01:10.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.306+0000 7f0ac17fa640 1 -- 172.21.15.72:0/380224351 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0ab40766d0 con 0x7f0ac406c4e0 2023-12-13T00:01:10.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.314+0000 7fa4cd7fa640 1 -- 172.21.15.72:0/771784155 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa4c8054b50 con 0x7fa4d00cd510 2023-12-13T00:01:10.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.316+0000 7fbd0d4d7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd0814ffa0 0x7fbd081ef410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.317+0000 7f7bc4866640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bc00c6b50 0x7f7bc01566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.317+0000 7fbd0d4d7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd0814ffa0 0x7fbd081ef410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:48442/0 (socket says 172.21.15.72:48442) 2023-12-13T00:01:10.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.317+0000 7fbd0d4d7640 1 -- 172.21.15.72:0/3787790959 learned_addr learned my addr 172.21.15.72:0/3787790959 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:10.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.319+0000 7f7bc4866640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bc00c6b50 0x7f7bc01566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:48430/0 (socket says 172.21.15.72:48430) 2023-12-13T00:01:10.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.319+0000 7f7bc4866640 1 -- 172.21.15.72:0/1098823143 learned_addr learned my addr 172.21.15.72:0/1098823143 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.322+0000 7fbd0d4d7640 1 -- 172.21.15.72:0/3787790959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0806ffc0 msgr2=0x7fbd080c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.322+0000 7fbd0d4d7640 1 --2- 172.21.15.72:0/3787790959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0806ffc0 0x7fbd080c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.322+0000 7fbd0d4d7640 1 -- 172.21.15.72:0/3787790959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd08150380 msgr2=0x7fbd081488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.322+0000 7fbd0d4d7640 1 --2- 172.21.15.72:0/3787790959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd08150380 0x7fbd081488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.322+0000 7fbd0d4d7640 1 -- 172.21.15.72:0/3787790959 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf80094d0 con 0x7fbd0814ffa0 2023-12-13T00:01:10.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.326+0000 7f7bc4866640 1 -- 172.21.15.72:0/1098823143 >> v2:172.21.15.176:3300/0 conn(0x7f7bc00c5c40 msgr2=0x7f7bc00c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.326+0000 7f7bc4866640 1 --2- 172.21.15.72:0/1098823143 >> v2:172.21.15.176:3300/0 conn(0x7f7bc00c5c40 0x7f7bc00c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.326+0000 7f7bc4866640 1 -- 172.21.15.72:0/1098823143 >> v2:172.21.15.72:3300/0 conn(0x7f7bc00721d0 msgr2=0x7f7bc00725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.326+0000 7f7bc4866640 1 --2- 172.21.15.72:0/1098823143 >> v2:172.21.15.72:3300/0 conn(0x7f7bc00721d0 0x7f7bc00725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.326+0000 7f7bc4866640 1 -- 172.21.15.72:0/1098823143 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc0156240 con 0x7f7bc00c6b50 2023-12-13T00:01:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.327+0000 7fbd0d4d7640 1 --2- 172.21.15.72:0/3787790959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd0814ffa0 0x7fbd081ef410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80090b0 tx=0x7fbcf8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.329+0000 7f7bc4866640 1 --2- 172.21.15.72:0/1098823143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bc00c6b50 0x7f7bc01566d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7bc006d260 tx=0x7f7bb802bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbbf3aabc050198e server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.335+0000 7fbcfe7fc640 1 -- 172.21.15.72:0/3787790959 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf803e040 con 0x7fbd0814ffa0 2023-12-13T00:01:10.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.335+0000 7fbcfe7fc640 1 -- 172.21.15.72:0/3787790959 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf8039d60 con 0x7fbd0814ffa0 2023-12-13T00:01:10.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.335+0000 7fbd0ff3c640 1 -- 172.21.15.72:0/3787790959 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd081f29a0 con 0x7fbd0814ffa0 2023-12-13T00:01:10.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.335+0000 7fbcfe7fc640 1 -- 172.21.15.72:0/3787790959 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8044630 con 0x7fbd0814ffa0 2023-12-13T00:01:10.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.336+0000 7fbd0ff3c640 1 -- 172.21.15.72:0/3787790959 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd081f2c40 con 0x7fbd0814ffa0 2023-12-13T00:01:10.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.337+0000 7fbd0ff3c640 1 -- 172.21.15.72:0/3787790959 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd08073dc0 con 0x7fbd0814ffa0 2023-12-13T00:01:10.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.340+0000 7f7bbeffd640 1 -- 172.21.15.72:0/1098823143 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb802ca70 con 0x7f7bc00c6b50 2023-12-13T00:01:10.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.340+0000 7f7bbeffd640 1 -- 172.21.15.72:0/1098823143 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb802cbd0 con 0x7f7bc00c6b50 2023-12-13T00:01:10.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.340+0000 7f7bbeffd640 1 -- 172.21.15.72:0/1098823143 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb80343f0 con 0x7f7bc00c6b50 2023-12-13T00:01:10.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.340+0000 7f7bc62c9640 1 -- 172.21.15.72:0/1098823143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bc00c6b50 msgr2=0x7f7bc01566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.340+0000 7f7bc62c9640 1 --2- 172.21.15.72:0/1098823143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bc00c6b50 0x7f7bc01566d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7bc006d260 tx=0x7f7bb802bed0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.340+0000 7f7bc62c9640 1 -- 172.21.15.72:0/1098823143 shutdown_connections 2023-12-13T00:01:10.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.340+0000 7f7bc62c9640 1 --2- 172.21.15.72:0/1098823143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bc00c6b50 0x7f7bc01566d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.340+0000 7f7bc62c9640 1 --2- 172.21.15.72:0/1098823143 >> v2:172.21.15.176:3300/0 conn(0x7f7bc00c5c40 0x7f7bc00c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.340+0000 7f7bc62c9640 1 --2- 172.21.15.72:0/1098823143 >> v2:172.21.15.72:3300/0 conn(0x7f7bc00721d0 0x7f7bc00725b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.340+0000 7f7bc62c9640 1 -- 172.21.15.72:0/1098823143 >> 172.21.15.72:0/1098823143 conn(0x7f7bc006b5c0 msgr2=0x7f7bc006b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:10.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.340+0000 7f7bc62c9640 1 -- 172.21.15.72:0/1098823143 shutdown_connections 2023-12-13T00:01:10.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.340+0000 7f7bc62c9640 1 -- 172.21.15.72:0/1098823143 wait complete. 2023-12-13T00:01:10.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.342+0000 7f7bc62c9640 1 Processor -- start 2023-12-13T00:01:10.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.342+0000 7f7bc62c9640 1 -- start start 2023-12-13T00:01:10.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.342+0000 7f7bc62c9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7bc00721d0 0x7f7bc01f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.342+0000 7f7bc62c9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc00c5c40 0x7f7bc013c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.342+0000 7f7bc62c9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bc00c6b50 0x7f7bc01ebcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.342+0000 7f7bc62c9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc01544c0 con 0x7f7bc00c5c40 2023-12-13T00:01:10.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.342+0000 7f7bc62c9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc01f2af0 con 0x7f7bc00721d0 2023-12-13T00:01:10.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.342+0000 7f7bc62c9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc01f34c0 con 0x7f7bc00c6b50 2023-12-13T00:01:10.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.353+0000 7f7bbffff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7bc00721d0 0x7f7bc01f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.353+0000 7f7bbffff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7bc00721d0 0x7f7bc01f2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:60168/0 (socket says 172.21.15.72:60168) 2023-12-13T00:01:10.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.353+0000 7f7bbffff640 1 -- 172.21.15.72:0/957392990 learned_addr learned my addr 172.21.15.72:0/957392990 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:10.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.356+0000 7f7bbffff640 1 -- 172.21.15.72:0/957392990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bc00c6b50 msgr2=0x7f7bc01ebcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.356+0000 7f7bbffff640 1 --2- 172.21.15.72:0/957392990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bc00c6b50 0x7f7bc01ebcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.356+0000 7f7bbffff640 1 -- 172.21.15.72:0/957392990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc00c5c40 msgr2=0x7f7bc013c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.356+0000 7f7bbffff640 1 --2- 172.21.15.72:0/957392990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc00c5c40 0x7f7bc013c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.356+0000 7f7bbffff640 1 -- 172.21.15.72:0/957392990 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb8009b30 con 0x7f7bc00721d0 2023-12-13T00:01:10.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.359+0000 7f7bbffff640 1 --2- 172.21.15.72:0/957392990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7bc00721d0 0x7f7bc01f2f80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000b440 tx=0x7f7bb000b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.363+0000 7f7bbcff9640 1 -- 172.21.15.72:0/957392990 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0011830 con 0x7f7bc00721d0 2023-12-13T00:01:10.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.363+0000 7f7bbcff9640 1 -- 172.21.15.72:0/957392990 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb0011990 con 0x7f7bc00721d0 2023-12-13T00:01:10.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.363+0000 7f7bc62c9640 1 -- 172.21.15.72:0/957392990 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc014c790 con 0x7f7bc00721d0 2023-12-13T00:01:10.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.363+0000 7f7bbcff9640 1 -- 172.21.15.72:0/957392990 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0011d40 con 0x7f7bc00721d0 2023-12-13T00:01:10.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.363+0000 7f7bc62c9640 1 -- 172.21.15.72:0/957392990 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc01541e0 con 0x7f7bc00721d0 2023-12-13T00:01:10.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.364+0000 7f7bc62c9640 1 -- 172.21.15.72:0/957392990 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc0073dc0 con 0x7f7bc00721d0 2023-12-13T00:01:10.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.374+0000 7f838f7fe640 1 -- 172.21.15.72:0/4252233748 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8384005ad0 con 0x7f8380003a30 2023-12-13T00:01:10.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.374+0000 7f838f7fe640 1 -- 172.21.15.72:0/4252233748 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8384005c30 con 0x7f8380003a30 2023-12-13T00:01:10.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.375+0000 7f839722b640 1 -- 172.21.15.72:0/4252233748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8380003a30 msgr2=0x7f8380003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.375+0000 7f839722b640 1 --2- 172.21.15.72:0/4252233748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8380003a30 0x7f8380003e30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f838400c190 tx=0x7f83800057f0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.375+0000 7f839722b640 1 -- 172.21.15.72:0/4252233748 shutdown_connections 2023-12-13T00:01:10.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.375+0000 7f839722b640 1 --2- 172.21.15.72:0/4252233748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8380003a30 0x7f8380003e30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.375+0000 7f839722b640 1 -- 172.21.15.72:0/4252233748 >> 172.21.15.72:0/4252233748 conn(0x7f8390061370 msgr2=0x7f8390061780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:10.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.375+0000 7f839722b640 1 -- 172.21.15.72:0/4252233748 shutdown_connections 2023-12-13T00:01:10.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.375+0000 7f839722b640 1 -- 172.21.15.72:0/4252233748 wait complete. 2023-12-13T00:01:10.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.377+0000 7f839722b640 1 Processor -- start 2023-12-13T00:01:10.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.377+0000 7f839722b640 1 -- start start 2023-12-13T00:01:10.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.378+0000 7f839722b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8380003a30 0x7f83901edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.378+0000 7f839722b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83900c2a60 0x7f839006b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.378+0000 7f839722b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f839006d360 0x7f839014bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.378+0000 7f839722b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839006c7c0 con 0x7f8380003a30 2023-12-13T00:01:10.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.378+0000 7f839722b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8390156e60 con 0x7f83900c2a60 2023-12-13T00:01:10.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.378+0000 7f839722b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83901ee8a0 con 0x7f839006d360 2023-12-13T00:01:10.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.388+0000 7f7bbcff9640 1 -- 172.21.15.72:0/957392990 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7bb001b460 con 0x7f7bc00721d0 2023-12-13T00:01:10.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.388+0000 7f7bbcff9640 1 --2- 172.21.15.72:0/957392990 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f7bac06b1f0 0x7f7bac06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.388+0000 7f7bbf7fe640 1 --2- 172.21.15.72:0/957392990 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f7bac06b1f0 0x7f7bac06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.389+0000 7f7bbf7fe640 1 --2- 172.21.15.72:0/957392990 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f7bac06b1f0 0x7f7bac06d6b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7bc006ae00 tx=0x7f7bb4006bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.396+0000 7f462ed9d640 1 --2- 172.21.15.72:0/3650164278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4630157840 0x7f46301f7070 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4628036040 tx=0x7f4628004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.410+0000 7f810b7fe640 1 -- 172.21.15.72:0/84167198 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f811801a400 con 0x7f8124150210 2023-12-13T00:01:10.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.410+0000 7f810b7fe640 1 --2- 172.21.15.72:0/84167198 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f811006b1c0 0x7f811006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.411+0000 7f8122ffd640 1 --2- 172.21.15.72:0/84167198 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f811006b1c0 0x7f811006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.411+0000 7f8122ffd640 1 --2- 172.21.15.72:0/84167198 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f811006b1c0 0x7f811006d680 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8114036000 tx=0x7f8114030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.418+0000 7fc60cff9640 1 -- 172.21.15.72:0/1710617473 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604004220 con 0x7fc6100715f0 2023-12-13T00:01:10.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.418+0000 7fc60cff9640 1 -- 172.21.15.72:0/1710617473 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6040043a0 con 0x7fc6100715f0 2023-12-13T00:01:10.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.418+0000 7fc616a4b640 1 -- 172.21.15.72:0/1710617473 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6100c31d0 con 0x7fc6100715f0 2023-12-13T00:01:10.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.419+0000 7fc60cff9640 1 -- 172.21.15.72:0/1710617473 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604007a70 con 0x7fc6100715f0 2023-12-13T00:01:10.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.419+0000 7fc616a4b640 1 -- 172.21.15.72:0/1710617473 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6101f0e20 con 0x7fc6100715f0 2023-12-13T00:01:10.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.420+0000 7fc616a4b640 1 -- 172.21.15.72:0/1710617473 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6100b09f0 con 0x7fc6100715f0 2023-12-13T00:01:10.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.437+0000 7f810b7fe640 1 -- 172.21.15.72:0/84167198 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f8118021300 con 0x7f8124150210 2023-12-13T00:01:10.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.437+0000 7f810b7fe640 1 -- 172.21.15.72:0/84167198 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8118058bc0 con 0x7f8124150210 2023-12-13T00:01:10.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.497+0000 7fa4d6c90640 1 -- 172.21.15.72:0/771784155 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa4d0073dc0 con 0x7fa4d00cd510 2023-12-13T00:01:10.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.498+0000 7f0acb09b640 1 -- 172.21.15.72:0/380224351 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0aa40050c0 con 0x7f0ac406c4e0 2023-12-13T00:01:10.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.605+0000 7fbcfe7fc640 1 -- 172.21.15.72:0/3787790959 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbcf804d3b0 con 0x7fbd0814ffa0 2023-12-13T00:01:10.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.605+0000 7fbcfe7fc640 1 --2- 172.21.15.72:0/3787790959 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbcec06b1f0 0x7fbcec06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.605+0000 7fbd0dcd8640 1 --2- 172.21.15.72:0/3787790959 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbcec06b1f0 0x7fbcec06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.606+0000 7fbd0dcd8640 1 --2- 172.21.15.72:0/3787790959 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbcec06b1f0 0x7fbcec06d6b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbd04009710 tx=0x7fbd04006c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.608+0000 7f81293c5640 1 -- 172.21.15.72:0/84167198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f81241f2f30 con 0x7f8124150210 2023-12-13T00:01:10.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.608+0000 7fbcfe7fc640 1 -- 172.21.15.72:0/3787790959 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fbcf807b900 con 0x7fbd0814ffa0 2023-12-13T00:01:10.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.619+0000 7fbcfe7fc640 1 -- 172.21.15.72:0/3787790959 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbcf8077540 con 0x7fbd0814ffa0 2023-12-13T00:01:10.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.623+0000 7f7bbcff9640 1 -- 172.21.15.72:0/957392990 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f7bb0059320 con 0x7f7bc00721d0 2023-12-13T00:01:10.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.630+0000 7f0ac17fa640 1 -- 172.21.15.72:0/380224351 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0ab4034020 con 0x7f0ac406c4e0 2023-12-13T00:01:10.631 INFO:teuthology.orchestra.run.smithi072.stdout:60129542159 2023-12-13T00:01:10.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.632+0000 7f0acb09b640 1 -- 172.21.15.72:0/380224351 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0ab006b210 msgr2=0x7f0ab006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.632+0000 7f0acb09b640 1 --2- 172.21.15.72:0/380224351 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0ab006b210 0x7f0ab006d6d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0ac41f9b40 tx=0x7f0abc009040 comp rx=0 tx=0).stop 2023-12-13T00:01:10.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.632+0000 7f0acb09b640 1 -- 172.21.15.72:0/380224351 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ac406c4e0 msgr2=0x7f0ac40c3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.632+0000 7f0acb09b640 1 --2- 172.21.15.72:0/380224351 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ac406c4e0 0x7f0ac40c3620 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4033000 tx=0x7f0ab40046c0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.633+0000 7f0acb09b640 1 -- 172.21.15.72:0/380224351 shutdown_connections 2023-12-13T00:01:10.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.633+0000 7f0acb09b640 1 --2- 172.21.15.72:0/380224351 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0ab006b210 0x7f0ab006d6d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.633+0000 7f0acb09b640 1 --2- 172.21.15.72:0/380224351 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ac41fc960 0x7f0ac41e8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.633+0000 7f0acb09b640 1 --2- 172.21.15.72:0/380224351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac4157b70 0x7f0ac41e8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.633+0000 7f0acb09b640 1 --2- 172.21.15.72:0/380224351 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ac406c4e0 0x7f0ac40c3620 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.633+0000 7f0acb09b640 1 -- 172.21.15.72:0/380224351 >> 172.21.15.72:0/380224351 conn(0x7f0ac4070850 msgr2=0x7f0ac41f26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:10.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.633+0000 7f0acb09b640 1 -- 172.21.15.72:0/380224351 shutdown_connections 2023-12-13T00:01:10.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.633+0000 7f0acb09b640 1 -- 172.21.15.72:0/380224351 wait complete. 2023-12-13T00:01:10.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.634+0000 7f7bbcff9640 1 -- 172.21.15.72:0/957392990 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7bb0054f60 con 0x7f7bc00721d0 2023-12-13T00:01:10.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.639+0000 7f838ffff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83900c2a60 0x7f839006b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.640+0000 7fa4cd7fa640 1 -- 172.21.15.72:0/771784155 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4c8019020 con 0x7fa4d00cd510 2023-12-13T00:01:10.641 INFO:teuthology.orchestra.run.smithi072.stdout:64424509455 2023-12-13T00:01:10.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.641+0000 7f838ffff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83900c2a60 0x7f839006b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:60184/0 (socket says 172.21.15.72:60184) 2023-12-13T00:01:10.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.641+0000 7f838ffff640 1 -- 172.21.15.72:0/346370106 learned_addr learned my addr 172.21.15.72:0/346370106 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.642+0000 7fa4d6c90640 1 -- 172.21.15.72:0/771784155 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa4bc06b210 msgr2=0x7fa4bc06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.642+0000 7fa4d6c90640 1 --2- 172.21.15.72:0/771784155 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa4bc06b210 0x7fa4bc06d6d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00c89e0 tx=0x7fa4c0009110 comp rx=0 tx=0).stop 2023-12-13T00:01:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.642+0000 7fa4d6c90640 1 -- 172.21.15.72:0/771784155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4d00cd510 msgr2=0x7fa4d01579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.642+0000 7fa4d6c90640 1 --2- 172.21.15.72:0/771784155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4d00cd510 0x7fa4d01579c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800ba50 tx=0x7fa4c800be50 comp rx=0 tx=0).stop 2023-12-13T00:01:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.642+0000 7fa4d6c90640 1 -- 172.21.15.72:0/771784155 shutdown_connections 2023-12-13T00:01:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.642+0000 7fa4d6c90640 1 --2- 172.21.15.72:0/771784155 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa4bc06b210 0x7fa4bc06d6d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.642+0000 7fa4d6c90640 1 --2- 172.21.15.72:0/771784155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4d0161cd0 0x7fa4d0154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.642+0000 7fa4d6c90640 1 --2- 172.21.15.72:0/771784155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4d00cf970 0x7fa4d0154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.642+0000 7fa4d6c90640 1 --2- 172.21.15.72:0/771784155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4d00cd510 0x7fa4d01579c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.642+0000 7fa4d6c90640 1 -- 172.21.15.72:0/771784155 >> 172.21.15.72:0/771784155 conn(0x7fa4d00cecc0 msgr2=0x7fa4d00ca3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:10.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.642+0000 7fa4d6c90640 1 -- 172.21.15.72:0/771784155 shutdown_connections 2023-12-13T00:01:10.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.642+0000 7fa4d6c90640 1 -- 172.21.15.72:0/771784155 wait complete. 2023-12-13T00:01:10.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.643+0000 7f83957c8640 1 --2- 172.21.15.72:0/346370106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f839006d360 0x7f839014bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.646+0000 7f838ffff640 1 -- 172.21.15.72:0/346370106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f839006d360 msgr2=0x7f839014bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.646+0000 7f838ffff640 1 --2- 172.21.15.72:0/346370106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f839006d360 0x7f839014bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.646+0000 7f838ffff640 1 -- 172.21.15.72:0/346370106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8380003a30 msgr2=0x7f83901edfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.646+0000 7f838ffff640 1 --2- 172.21.15.72:0/346370106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8380003a30 0x7f83901edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.646+0000 7f838ffff640 1 -- 172.21.15.72:0/346370106 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83901eeb80 con 0x7f83900c2a60 2023-12-13T00:01:10.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542159 for osd.2 2023-12-13T00:01:10.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.648+0000 7f838ffff640 1 --2- 172.21.15.72:0/346370106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83900c2a60 0x7f839006b650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f837c00c410 tx=0x7f837c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.652+0000 7f838d7fa640 1 -- 172.21.15.72:0/346370106 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c0035f0 con 0x7f83900c2a60 2023-12-13T00:01:10.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.652+0000 7f838d7fa640 1 -- 172.21.15.72:0/346370106 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c003750 con 0x7f83900c2a60 2023-12-13T00:01:10.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.652+0000 7f838d7fa640 1 -- 172.21.15.72:0/346370106 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c003b40 con 0x7f83900c2a60 2023-12-13T00:01:10.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.652+0000 7f839722b640 1 -- 172.21.15.72:0/346370106 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839014e2b0 con 0x7f83900c2a60 2023-12-13T00:01:10.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.652+0000 7f839722b640 1 -- 172.21.15.72:0/346370106 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83901570d0 con 0x7f83900c2a60 2023-12-13T00:01:10.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.653+0000 7f839722b640 1 -- 172.21.15.72:0/346370106 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83900b2050 con 0x7f83900c2a60 2023-12-13T00:01:10.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509455 for osd.1 2023-12-13T00:01:10.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.672+0000 7f838d7fa640 1 -- 172.21.15.72:0/346370106 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f837c003ca0 con 0x7f83900c2a60 2023-12-13T00:01:10.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.673+0000 7f838d7fa640 1 --2- 172.21.15.72:0/346370106 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f837406b210 0x7f837406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.673+0000 7f8394fc7640 1 --2- 172.21.15.72:0/346370106 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f837406b210 0x7f837406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.673+0000 7f8394fc7640 1 --2- 172.21.15.72:0/346370106 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f837406b210 0x7f837406d6d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8384034000 tx=0x7f8384039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.707+0000 7fc60cff9640 1 -- 172.21.15.72:0/1710617473 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc604007bd0 con 0x7fc6100715f0 2023-12-13T00:01:10.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.707+0000 7fc60cff9640 1 --2- 172.21.15.72:0/1710617473 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc5fc06b240 0x7fc5fc06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:10.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.707+0000 7fc60f7fe640 1 --2- 172.21.15.72:0/1710617473 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc5fc06b240 0x7fc5fc06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:10.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.708+0000 7fc60f7fe640 1 --2- 172.21.15.72:0/1710617473 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc5fc06b240 0x7fc5fc06d700 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc600036000 tx=0x7fc600030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:10.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.730+0000 7fc60cff9640 1 -- 172.21.15.72:0/1710617473 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fc604058d00 con 0x7fc6100715f0 2023-12-13T00:01:10.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.730+0000 7fc60cff9640 1 -- 172.21.15.72:0/1710617473 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc604054940 con 0x7fc6100715f0 2023-12-13T00:01:10.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.745+0000 7f4626ffd640 1 -- 172.21.15.72:0/3650164278 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462803e450 con 0x7f4630157840 2023-12-13T00:01:10.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.745+0000 7f4626ffd640 1 -- 172.21.15.72:0/3650164278 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462803e5b0 con 0x7f4630157840 2023-12-13T00:01:10.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.745+0000 7f4634fec640 1 -- 172.21.15.72:0/3650164278 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46301f3c10 con 0x7f4630157840 2023-12-13T00:01:10.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.745+0000 7f4626ffd640 1 -- 172.21.15.72:0/3650164278 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462803e960 con 0x7f4630157840 2023-12-13T00:01:10.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.745+0000 7f4634fec640 1 -- 172.21.15.72:0/3650164278 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46301f41d0 con 0x7f4630157840 2023-12-13T00:01:10.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.747+0000 7f4634fec640 1 -- 172.21.15.72:0/3650164278 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46300c2bb0 con 0x7f4630157840 2023-12-13T00:01:10.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.757+0000 7f810b7fe640 1 -- 172.21.15.72:0/84167198 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8118015090 con 0x7f8124150210 2023-12-13T00:01:10.759 INFO:teuthology.orchestra.run.smithi072.stdout:55834574863 2023-12-13T00:01:10.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.759+0000 7f81293c5640 1 -- 172.21.15.72:0/84167198 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f811006b1c0 msgr2=0x7f811006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.759+0000 7f81293c5640 1 --2- 172.21.15.72:0/84167198 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f811006b1c0 0x7f811006d680 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8114036000 tx=0x7f8114030000 comp rx=0 tx=0).stop 2023-12-13T00:01:10.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.759+0000 7f81293c5640 1 -- 172.21.15.72:0/84167198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8124150210 msgr2=0x7f81241f3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.759+0000 7f81293c5640 1 --2- 172.21.15.72:0/84167198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8124150210 0x7f81241f3230 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f811800b450 tx=0x7f811800b910 comp rx=0 tx=0).stop 2023-12-13T00:01:10.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.759+0000 7f81293c5640 1 -- 172.21.15.72:0/84167198 shutdown_connections 2023-12-13T00:01:10.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.759+0000 7f81293c5640 1 --2- 172.21.15.72:0/84167198 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f811006b1c0 0x7f811006d680 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.759+0000 7f81293c5640 1 --2- 172.21.15.72:0/84167198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8124157690 0x7f812413b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.759+0000 7f81293c5640 1 --2- 172.21.15.72:0/84167198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8124150210 0x7f81241f3230 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.760+0000 7f81293c5640 1 --2- 172.21.15.72:0/84167198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81240c0ed0 0x7f81241ef270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.760+0000 7f81293c5640 1 -- 172.21.15.72:0/84167198 >> 172.21.15.72:0/84167198 conn(0x7f81240700e0 msgr2=0x7f81241589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:10.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.760+0000 7f81293c5640 1 -- 172.21.15.72:0/84167198 shutdown_connections 2023-12-13T00:01:10.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.760+0000 7f81293c5640 1 -- 172.21.15.72:0/84167198 wait complete. 2023-12-13T00:01:10.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574864 got 55834574863 for osd.5 2023-12-13T00:01:10.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.835+0000 7fbd0ff3c640 1 -- 172.21.15.72:0/3787790959 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbd08163ae0 con 0x7fbd0814ffa0 2023-12-13T00:01:10.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.840+0000 7f7bc62c9640 1 -- 172.21.15.72:0/957392990 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7bc00c8640 con 0x7f7bc00721d0 2023-12-13T00:01:10.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.884+0000 7fbcfe7fc640 1 -- 172.21.15.72:0/3787790959 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbcf807ab60 con 0x7fbd0814ffa0 2023-12-13T00:01:10.886 INFO:teuthology.orchestra.run.smithi072.stdout:60129542159 2023-12-13T00:01:10.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.886+0000 7fbd0ff3c640 1 -- 172.21.15.72:0/3787790959 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbcec06b1f0 msgr2=0x7fbcec06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.886+0000 7fbd0ff3c640 1 --2- 172.21.15.72:0/3787790959 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbcec06b1f0 0x7fbcec06d6b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbd04009710 tx=0x7fbd04006c90 comp rx=0 tx=0).stop 2023-12-13T00:01:10.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.886+0000 7fbd0ff3c640 1 -- 172.21.15.72:0/3787790959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd0814ffa0 msgr2=0x7fbd081ef410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.886+0000 7fbd0ff3c640 1 --2- 172.21.15.72:0/3787790959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd0814ffa0 0x7fbd081ef410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80090b0 tx=0x7fbcf8004730 comp rx=0 tx=0).stop 2023-12-13T00:01:10.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.886+0000 7fbd0ff3c640 1 -- 172.21.15.72:0/3787790959 shutdown_connections 2023-12-13T00:01:10.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.886+0000 7fbd0ff3c640 1 --2- 172.21.15.72:0/3787790959 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbcec06b1f0 0x7fbcec06d6b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.886+0000 7fbd0ff3c640 1 --2- 172.21.15.72:0/3787790959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd08150380 0x7fbd081488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.886+0000 7fbd0ff3c640 1 --2- 172.21.15.72:0/3787790959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd0814ffa0 0x7fbd081ef410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.886+0000 7fbd0ff3c640 1 --2- 172.21.15.72:0/3787790959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0806ffc0 0x7fbd080c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.887+0000 7fbd0ff3c640 1 -- 172.21.15.72:0/3787790959 >> 172.21.15.72:0/3787790959 conn(0x7fbd0806b5c0 msgr2=0x7fbd080c1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:10.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.887+0000 7fbd0ff3c640 1 -- 172.21.15.72:0/3787790959 shutdown_connections 2023-12-13T00:01:10.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.887+0000 7fbd0ff3c640 1 -- 172.21.15.72:0/3787790959 wait complete. 2023-12-13T00:01:10.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542159 for osd.0 2023-12-13T00:01:10.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.899+0000 7f838d7fa640 1 -- 172.21.15.72:0/346370106 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f837c058630 con 0x7f83900c2a60 2023-12-13T00:01:10.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.909+0000 7f838d7fa640 1 -- 172.21.15.72:0/346370106 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f837c054270 con 0x7f83900c2a60 2023-12-13T00:01:10.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.913+0000 7f7bbcff9640 1 -- 172.21.15.72:0/957392990 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7bb0058580 con 0x7f7bc00721d0 2023-12-13T00:01:10.914 INFO:teuthology.orchestra.run.smithi072.stdout:64424509456 2023-12-13T00:01:10.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.916+0000 7f7bc62c9640 1 -- 172.21.15.72:0/957392990 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f7bac06b1f0 msgr2=0x7f7bac06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.916+0000 7f7bc62c9640 1 --2- 172.21.15.72:0/957392990 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f7bac06b1f0 0x7f7bac06d6b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7bc006ae00 tx=0x7f7bb4006bf0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.916+0000 7f7bc62c9640 1 -- 172.21.15.72:0/957392990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7bc00721d0 msgr2=0x7f7bc01f2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:10.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.916+0000 7f7bc62c9640 1 --2- 172.21.15.72:0/957392990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7bc00721d0 0x7f7bc01f2f80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000b440 tx=0x7f7bb000b900 comp rx=0 tx=0).stop 2023-12-13T00:01:10.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.916+0000 7f7bc62c9640 1 -- 172.21.15.72:0/957392990 shutdown_connections 2023-12-13T00:01:10.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.916+0000 7f7bc62c9640 1 --2- 172.21.15.72:0/957392990 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f7bac06b1f0 0x7f7bac06d6b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.916+0000 7f7bc62c9640 1 --2- 172.21.15.72:0/957392990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bc00c6b50 0x7f7bc01ebcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.916+0000 7f7bc62c9640 1 --2- 172.21.15.72:0/957392990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc00c5c40 0x7f7bc013c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.916+0000 7f7bc62c9640 1 --2- 172.21.15.72:0/957392990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7bc00721d0 0x7f7bc01f2f80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:10.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.916+0000 7f7bc62c9640 1 -- 172.21.15.72:0/957392990 >> 172.21.15.72:0/957392990 conn(0x7f7bc006b5c0 msgr2=0x7f7bc013faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:10.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.916+0000 7f7bc62c9640 1 -- 172.21.15.72:0/957392990 shutdown_connections 2023-12-13T00:01:10.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.916+0000 7f7bc62c9640 1 -- 172.21.15.72:0/957392990 wait complete. 2023-12-13T00:01:10.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509456 for osd.4 2023-12-13T00:01:10.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:10.938+0000 7fc616a4b640 1 -- 172.21.15.72:0/1710617473 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc610071c10 con 0x7fc6100715f0 2023-12-13T00:01:11.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.081+0000 7f839722b640 1 -- 172.21.15.72:0/346370106 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f839014e7d0 con 0x7f83900c2a60 2023-12-13T00:01:11.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.084+0000 7f838d7fa640 1 -- 172.21.15.72:0/346370106 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f839014e7d0 con 0x7f83900c2a60 2023-12-13T00:01:11.084 INFO:teuthology.orchestra.run.smithi072.stdout:64424509455 2023-12-13T00:01:11.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.086+0000 7f839722b640 1 -- 172.21.15.72:0/346370106 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f837406b210 msgr2=0x7f837406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:11.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.086+0000 7f839722b640 1 --2- 172.21.15.72:0/346370106 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f837406b210 0x7f837406d6d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8384034000 tx=0x7f8384039040 comp rx=0 tx=0).stop 2023-12-13T00:01:11.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.086+0000 7f839722b640 1 -- 172.21.15.72:0/346370106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83900c2a60 msgr2=0x7f839006b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:11.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.086+0000 7f839722b640 1 --2- 172.21.15.72:0/346370106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83900c2a60 0x7f839006b650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f837c00c410 tx=0x7f837c00c8d0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.086+0000 7f839722b640 1 -- 172.21.15.72:0/346370106 shutdown_connections 2023-12-13T00:01:11.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.086+0000 7f839722b640 1 --2- 172.21.15.72:0/346370106 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f837406b210 0x7f837406d6d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.086+0000 7f839722b640 1 --2- 172.21.15.72:0/346370106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f839006d360 0x7f839014bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.086+0000 7f839722b640 1 --2- 172.21.15.72:0/346370106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83900c2a60 0x7f839006b650 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.086+0000 7f839722b640 1 --2- 172.21.15.72:0/346370106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8380003a30 0x7f83901edfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.086+0000 7f839722b640 1 -- 172.21.15.72:0/346370106 >> 172.21.15.72:0/346370106 conn(0x7f8390061370 msgr2=0x7f8390150800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:11.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.086+0000 7f839722b640 1 -- 172.21.15.72:0/346370106 shutdown_connections 2023-12-13T00:01:11.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.086+0000 7f839722b640 1 -- 172.21.15.72:0/346370106 wait complete. 2023-12-13T00:01:11.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509457 got 64424509455 for osd.7 2023-12-13T00:01:11.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.113+0000 7f4626ffd640 1 -- 172.21.15.72:0/3650164278 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f462802cd50 con 0x7f4630157840 2023-12-13T00:01:11.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.113+0000 7f4626ffd640 1 --2- 172.21.15.72:0/3650164278 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f461006b1f0 0x7f461006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:11.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.113+0000 7f462e59c640 1 --2- 172.21.15.72:0/3650164278 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f461006b1f0 0x7f461006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.114+0000 7f462e59c640 1 --2- 172.21.15.72:0/3650164278 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f461006b1f0 0x7f461006d6b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4620009710 tx=0x7f4620006c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:11.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.126+0000 7f4626ffd640 1 -- 172.21.15.72:0/3650164278 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f4628049e40 con 0x7f4630157840 2023-12-13T00:01:11.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.126+0000 7f4626ffd640 1 -- 172.21.15.72:0/3650164278 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f46280778e0 con 0x7f4630157840 2023-12-13T00:01:11.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.165+0000 7fc60cff9640 1 -- 172.21.15.72:0/1710617473 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc60401e070 con 0x7fc6100715f0 2023-12-13T00:01:11.166 INFO:teuthology.orchestra.run.smithi072.stdout:64424509456 2023-12-13T00:01:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.167+0000 7fc616a4b640 1 -- 172.21.15.72:0/1710617473 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc5fc06b240 msgr2=0x7fc5fc06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.167+0000 7fc616a4b640 1 --2- 172.21.15.72:0/1710617473 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc5fc06b240 0x7fc5fc06d700 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc600036000 tx=0x7fc600030000 comp rx=0 tx=0).stop 2023-12-13T00:01:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.167+0000 7fc616a4b640 1 -- 172.21.15.72:0/1710617473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6100715f0 msgr2=0x7fc610152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.167+0000 7fc616a4b640 1 --2- 172.21.15.72:0/1710617473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6100715f0 0x7fc610152170 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc60400c820 tx=0x7fc60400cce0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.167+0000 7fc616a4b640 1 -- 172.21.15.72:0/1710617473 shutdown_connections 2023-12-13T00:01:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.167+0000 7fc616a4b640 1 --2- 172.21.15.72:0/1710617473 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc5fc06b240 0x7fc5fc06d700 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.167+0000 7fc616a4b640 1 --2- 172.21.15.72:0/1710617473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61014f850 0x7fc61015fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.167+0000 7fc616a4b640 1 --2- 172.21.15.72:0/1710617473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6100c5950 0x7fc6101ed3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.167+0000 7fc616a4b640 1 --2- 172.21.15.72:0/1710617473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6100715f0 0x7fc610152170 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.167+0000 7fc616a4b640 1 -- 172.21.15.72:0/1710617473 >> 172.21.15.72:0/1710617473 conn(0x7fc61006d330 msgr2=0x7fc61014d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.167+0000 7fc616a4b640 1 -- 172.21.15.72:0/1710617473 shutdown_connections 2023-12-13T00:01:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.167+0000 7fc616a4b640 1 -- 172.21.15.72:0/1710617473 wait complete. 2023-12-13T00:01:11.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509456 for osd.3 2023-12-13T00:01:11.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.317+0000 7f4634fec640 1 -- 172.21.15.72:0/3650164278 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4630073dc0 con 0x7f4630157840 2023-12-13T00:01:11.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.320+0000 7f4626ffd640 1 -- 172.21.15.72:0/3650164278 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4628043020 con 0x7f4630157840 2023-12-13T00:01:11.321 INFO:teuthology.orchestra.run.smithi072.stdout:64424509454 2023-12-13T00:01:11.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.322+0000 7f4634fec640 1 -- 172.21.15.72:0/3650164278 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f461006b1f0 msgr2=0x7f461006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:11.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.322+0000 7f4634fec640 1 --2- 172.21.15.72:0/3650164278 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f461006b1f0 0x7f461006d6b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4620009710 tx=0x7f4620006c90 comp rx=0 tx=0).stop 2023-12-13T00:01:11.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.322+0000 7f4634fec640 1 -- 172.21.15.72:0/3650164278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4630157840 msgr2=0x7f46301f7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:11.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.322+0000 7f4634fec640 1 --2- 172.21.15.72:0/3650164278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4630157840 0x7f46301f7070 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4628036040 tx=0x7f4628004a40 comp rx=0 tx=0).stop 2023-12-13T00:01:11.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.322+0000 7f4634fec640 1 -- 172.21.15.72:0/3650164278 shutdown_connections 2023-12-13T00:01:11.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.322+0000 7f4634fec640 1 --2- 172.21.15.72:0/3650164278 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f461006b1f0 0x7f461006d6b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.322+0000 7f4634fec640 1 --2- 172.21.15.72:0/3650164278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4630157840 0x7f46301f7070 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.322+0000 7f4634fec640 1 --2- 172.21.15.72:0/3650164278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46300c82f0 0x7f463014e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.322+0000 7f4634fec640 1 --2- 172.21.15.72:0/3650164278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46300c40c0 0x7f46300c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.322+0000 7f4634fec640 1 -- 172.21.15.72:0/3650164278 >> 172.21.15.72:0/3650164278 conn(0x7f46300712f0 msgr2=0x7f463015f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:11.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.323+0000 7f4634fec640 1 -- 172.21.15.72:0/3650164278 shutdown_connections 2023-12-13T00:01:11.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.323+0000 7f4634fec640 1 -- 172.21.15.72:0/3650164278 wait complete. 2023-12-13T00:01:11.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509454 for osd.6 2023-12-13T00:01:11.650 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-13T00:01:11.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-13T00:01:11.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.754+0000 7f9be669b640 1 Processor -- start 2023-12-13T00:01:11.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.754+0000 7f9be669b640 1 -- start start 2023-12-13T00:01:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.755+0000 7f9be669b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9be01571d0 0x7f9be00c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.755+0000 7f9be669b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9be00ccac0 0x7f9be00ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.755+0000 7f9be669b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be01575f0 con 0x7f9be0151680 2023-12-13T00:01:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.755+0000 7f9be669b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be006fb00 con 0x7f9be01571d0 2023-12-13T00:01:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.755+0000 7f9be669b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be0157880 con 0x7f9be00ccac0 2023-12-13T00:01:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.756+0000 7f9be4c38640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9be00ccac0 0x7f9be00ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.756+0000 7f9bdffff640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f9be0151680 0x7f9be006f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:43770/0 (socket says 172.21.15.72:43770) 2023-12-13T00:01:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.756+0000 7f9bdffff640 1 -- 172.21.15.72:0/486433558 learned_addr learned my addr 172.21.15.72:0/486433558 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.756+0000 7f9bdf7fe640 1 --2- 172.21.15.72:0/486433558 >> v2:172.21.15.176:3300/0 conn(0x7f9be01571d0 0x7f9be00c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:11.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.759+0000 7f9be4c38640 1 -- 172.21.15.72:0/486433558 >> v2:172.21.15.176:3300/0 conn(0x7f9be01571d0 msgr2=0x7f9be00c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:11.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.759+0000 7f9be4c38640 1 --2- 172.21.15.72:0/486433558 >> v2:172.21.15.176:3300/0 conn(0x7f9be01571d0 0x7f9be00c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.759+0000 7f9be4c38640 1 -- 172.21.15.72:0/486433558 >> v1:172.21.15.176:6789/0 conn(0x7f9be0151680 legacy=0x7f9be006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:11.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.759+0000 7f9be4c38640 1 -- 172.21.15.72:0/486433558 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be0157b60 con 0x7f9be00ccac0 2023-12-13T00:01:11.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.761+0000 7f9be4c38640 1 --2- 172.21.15.72:0/486433558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9be00ccac0 0x7f9be00ccf10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009d90 tx=0x7f9bd802bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6eb1faeb1318500 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:11.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.766+0000 7f9bdeffd640 1 -- 172.21.15.72:0/486433558 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd802cce0 con 0x7f9be00ccac0 2023-12-13T00:01:11.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.766+0000 7f9bdeffd640 1 -- 172.21.15.72:0/486433558 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd802ce40 con 0x7f9be00ccac0 2023-12-13T00:01:11.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.766+0000 7f9bdeffd640 1 -- 172.21.15.72:0/486433558 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8034660 con 0x7f9be00ccac0 2023-12-13T00:01:11.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.766+0000 7f9be669b640 1 -- 172.21.15.72:0/486433558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9be00ccac0 msgr2=0x7f9be00ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:11.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.766+0000 7f9be669b640 1 --2- 172.21.15.72:0/486433558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9be00ccac0 0x7f9be00ccf10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009d90 tx=0x7f9bd802bf30 comp rx=0 tx=0).stop 2023-12-13T00:01:11.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.766+0000 7f9be669b640 1 -- 172.21.15.72:0/486433558 shutdown_connections 2023-12-13T00:01:11.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.766+0000 7f9be669b640 1 --2- 172.21.15.72:0/486433558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9be00ccac0 0x7f9be00ccf10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.766+0000 7f9be669b640 1 --2- 172.21.15.72:0/486433558 >> v2:172.21.15.176:3300/0 conn(0x7f9be01571d0 0x7f9be00c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.766+0000 7f9be669b640 1 -- 172.21.15.72:0/486433558 >> 172.21.15.72:0/486433558 conn(0x7f9be00707f0 msgr2=0x7f9be0070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:11.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.766+0000 7f9be669b640 1 -- 172.21.15.72:0/486433558 shutdown_connections 2023-12-13T00:01:11.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.767+0000 7f9be669b640 1 -- 172.21.15.72:0/486433558 wait complete. 2023-12-13T00:01:11.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.768+0000 7f9be669b640 1 Processor -- start 2023-12-13T00:01:11.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.768+0000 7f9be669b640 1 -- start start 2023-12-13T00:01:11.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.768+0000 7f9be669b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9be00ccac0 0x7f9be00cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:11.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.768+0000 7f9be669b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be0151680 0x7f9be0146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:11.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.769+0000 7f9be669b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9be01571d0 0x7f9be0146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:11.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.769+0000 7f9be669b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be014eb30 con 0x7f9be0151680 2023-12-13T00:01:11.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.769+0000 7f9be669b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be014b0c0 con 0x7f9be00ccac0 2023-12-13T00:01:11.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.769+0000 7f9be669b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be014e850 con 0x7f9be01571d0 2023-12-13T00:01:11.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.769+0000 7f9bdf7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be0151680 0x7f9be0146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:11.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.769+0000 7f9bdf7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be0151680 0x7f9be0146940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35786/0 (socket says 172.21.15.72:35786) 2023-12-13T00:01:11.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.769+0000 7f9bdf7fe640 1 -- 172.21.15.72:0/64057565 learned_addr learned my addr 172.21.15.72:0/64057565 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:11.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.770+0000 7f9be4c38640 1 --2- 172.21.15.72:0/64057565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9be01571d0 0x7f9be0146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:11.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.770+0000 7f9bdffff640 1 --2- 172.21.15.72:0/64057565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9be00ccac0 0x7f9be00cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:11.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-13T00:01:11.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.773+0000 7f9bdf7fe640 1 -- 172.21.15.72:0/64057565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9be01571d0 msgr2=0x7f9be0146e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:11.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.773+0000 7f9bdf7fe640 1 --2- 172.21.15.72:0/64057565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9be01571d0 0x7f9be0146e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.773+0000 7f9bdf7fe640 1 -- 172.21.15.72:0/64057565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9be00ccac0 msgr2=0x7f9be00cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:11.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.773+0000 7f9bdf7fe640 1 --2- 172.21.15.72:0/64057565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9be00ccac0 0x7f9be00cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.773+0000 7f9bdf7fe640 1 -- 172.21.15.72:0/64057565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd8009a70 con 0x7f9be0151680 2023-12-13T00:01:11.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.776+0000 7f9bdf7fe640 1 --2- 172.21.15.72:0/64057565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be0151680 0x7f9be0146940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400e8a0 tx=0x7f9bd400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:11.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.780+0000 7f9bdcff9640 1 -- 172.21.15.72:0/64057565 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd40094f0 con 0x7f9be0151680 2023-12-13T00:01:11.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.780+0000 7f9be669b640 1 -- 172.21.15.72:0/64057565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be01ed840 con 0x7f9be0151680 2023-12-13T00:01:11.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.780+0000 7f9be669b640 1 -- 172.21.15.72:0/64057565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be01e4630 con 0x7f9be0151680 2023-12-13T00:01:11.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.781+0000 7f9be669b640 1 -- 172.21.15.72:0/64057565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be0073dc0 con 0x7f9be0151680 2023-12-13T00:01:11.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.804+0000 7f6d68d01640 1 Processor -- start 2023-12-13T00:01:11.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.804+0000 7f6d68d01640 1 -- start start 2023-12-13T00:01:11.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.805+0000 7f6d68d01640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d640c2ab0 0x7f6d640cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:11.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.805+0000 7f6d68d01640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d64159ee0 con 0x7f6d6406aae0 2023-12-13T00:01:11.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.805+0000 7f6d68d01640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d64072a80 con 0x7f6d64153470 2023-12-13T00:01:11.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.805+0000 7f6d68d01640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6415a370 con 0x7f6d640c2ab0 2023-12-13T00:01:11.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.805+0000 7f6d6259c640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f6d64153470 0x7f6d640c83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:43780/0 (socket says 172.21.15.72:43780) 2023-12-13T00:01:11.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.805+0000 7f6d6259c640 1 -- 172.21.15.72:0/3990616850 learned_addr learned my addr 172.21.15.72:0/3990616850 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:11.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.805+0000 7f6d61d9b640 1 --2- 172.21.15.72:0/3990616850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d640c2ab0 0x7f6d640cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:11.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.807+0000 7f6d61d9b640 1 -- 172.21.15.72:0/3990616850 >> v1:172.21.15.176:6789/0 conn(0x7f6d64153470 legacy=0x7f6d640c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:11.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.807+0000 7f6d61d9b640 1 -- 172.21.15.72:0/3990616850 >> v1:172.21.15.72:6789/0 conn(0x7f6d6406aae0 legacy=0x7f6d64163d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:11.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.807+0000 7f6d61d9b640 1 -- 172.21.15.72:0/3990616850 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d640727a0 con 0x7f6d640c2ab0 2023-12-13T00:01:11.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.809+0000 7f6d61d9b640 1 --2- 172.21.15.72:0/3990616850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d640c2ab0 0x7f6d640cbb00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6d580097d0 tx=0x7f6d5802b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=521ed43c8385a9d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:11.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.813+0000 7f6d6159a640 1 -- 172.21.15.72:0/3990616850 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58031770 con 0x7f6d640c2ab0 2023-12-13T00:01:11.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.813+0000 7f6d6159a640 1 -- 172.21.15.72:0/3990616850 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d580318d0 con 0x7f6d640c2ab0 2023-12-13T00:01:11.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.813+0000 7f6d6159a640 1 -- 172.21.15.72:0/3990616850 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58031c60 con 0x7f6d640c2ab0 2023-12-13T00:01:11.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.813+0000 7f6d68d01640 1 -- 172.21.15.72:0/3990616850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d640c2ab0 msgr2=0x7f6d640cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:11.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.813+0000 7f6d68d01640 1 --2- 172.21.15.72:0/3990616850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d640c2ab0 0x7f6d640cbb00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6d580097d0 tx=0x7f6d5802b810 comp rx=0 tx=0).stop 2023-12-13T00:01:11.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.813+0000 7f6d68d01640 1 -- 172.21.15.72:0/3990616850 shutdown_connections 2023-12-13T00:01:11.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.813+0000 7f6d68d01640 1 --2- 172.21.15.72:0/3990616850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d640c2ab0 0x7f6d640cbb00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.813+0000 7f6d68d01640 1 -- 172.21.15.72:0/3990616850 >> 172.21.15.72:0/3990616850 conn(0x7f6d640700e0 msgr2=0x7f6d6406b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:11.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.813+0000 7f6d68d01640 1 -- 172.21.15.72:0/3990616850 shutdown_connections 2023-12-13T00:01:11.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.813+0000 7f6d68d01640 1 -- 172.21.15.72:0/3990616850 wait complete. 2023-12-13T00:01:11.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.815+0000 7f6d68d01640 1 Processor -- start 2023-12-13T00:01:11.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.815+0000 7f6d68d01640 1 -- start start 2023-12-13T00:01:11.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.815+0000 7f6d68d01640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d6406aae0 0x7f6d641f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:11.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.815+0000 7f6d68d01640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d640c2ab0 0x7f6d640c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:11.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.815+0000 7f6d68d01640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d64153470 0x7f6d641ef0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:11.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.815+0000 7f6d68d01640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d641e2c00 con 0x7f6d6406aae0 2023-12-13T00:01:11.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.815+0000 7f6d68d01640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d641e2ee0 con 0x7f6d64153470 2023-12-13T00:01:11.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.815+0000 7f6d68d01640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d641589e0 con 0x7f6d640c2ab0 2023-12-13T00:01:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.816+0000 7f6d62d9d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d64153470 0x7f6d641ef0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.816+0000 7f6d61d9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d640c2ab0 0x7f6d640c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.816+0000 7f6d62d9d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d64153470 0x7f6d641ef0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:60196/0 (socket says 172.21.15.72:60196) 2023-12-13T00:01:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.816+0000 7f6d62d9d640 1 -- 172.21.15.72:0/2762118313 learned_addr learned my addr 172.21.15.72:0/2762118313 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:11.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.820+0000 7f6d62d9d640 1 -- 172.21.15.72:0/2762118313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d640c2ab0 msgr2=0x7f6d640c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:11.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.820+0000 7f6d62d9d640 1 --2- 172.21.15.72:0/2762118313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d640c2ab0 0x7f6d640c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.820+0000 7f6d62d9d640 1 -- 172.21.15.72:0/2762118313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d6406aae0 msgr2=0x7f6d641f2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:11.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.820+0000 7f6d62d9d640 1 --2- 172.21.15.72:0/2762118313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d6406aae0 0x7f6d641f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:11.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.820+0000 7f6d62d9d640 1 -- 172.21.15.72:0/2762118313 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d58009400 con 0x7f6d64153470 2023-12-13T00:01:11.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.822+0000 7f6d62d9d640 1 --2- 172.21.15.72:0/2762118313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d64153470 0x7f6d641ef0b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00b9e0 tx=0x7f6d5c00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:11.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.825+0000 7f6d52ffd640 1 -- 172.21.15.72:0/2762118313 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c00cb20 con 0x7f6d64153470 2023-12-13T00:01:11.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.826+0000 7f6d52ffd640 1 -- 172.21.15.72:0/2762118313 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c00cc80 con 0x7f6d64153470 2023-12-13T00:01:11.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.826+0000 7f6d52ffd640 1 -- 172.21.15.72:0/2762118313 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c014680 con 0x7f6d64153470 2023-12-13T00:01:11.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.826+0000 7f6d68d01640 1 -- 172.21.15.72:0/2762118313 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d64158cc0 con 0x7f6d64153470 2023-12-13T00:01:11.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.826+0000 7f6d68d01640 1 -- 172.21.15.72:0/2762118313 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d641e31c0 con 0x7f6d64153470 2023-12-13T00:01:11.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.827+0000 7f6d68d01640 1 -- 172.21.15.72:0/2762118313 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d641eef00 con 0x7f6d64153470 2023-12-13T00:01:11.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.846+0000 7f6d52ffd640 1 -- 172.21.15.72:0/2762118313 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6d5c01c360 con 0x7f6d64153470 2023-12-13T00:01:11.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.846+0000 7f6d52ffd640 1 --2- 172.21.15.72:0/2762118313 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f6d4406b240 0x7f6d4406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:11.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.847+0000 7f6d6259c640 1 --2- 172.21.15.72:0/2762118313 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f6d4406b240 0x7f6d4406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:11.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.847+0000 7f6d6259c640 1 --2- 172.21.15.72:0/2762118313 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f6d4406b240 0x7f6d4406d700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6d540015f0 tx=0x7f6d54007a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:11.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.877+0000 7f447f209640 1 Processor -- start 2023-12-13T00:01:11.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.877+0000 7f447f209640 1 -- start start 2023-12-13T00:01:11.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.878+0000 7f447f209640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f44780c9620 0x7f44780c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:11.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.878+0000 7f447f209640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44780cbda0 con 0x7f44780cda70 2023-12-13T00:01:11.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.878+0000 7f447f209640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44780cea60 con 0x7f44780cc420 2023-12-13T00:01:11.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.878+0000 7f447f209640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44780cc230 con 0x7f44780c9620 2023-12-13T00:01:11.899 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-13T00:01:11.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-13T00:01:11.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:11.990+0000 7f9bdcff9640 1 -- 172.21.15.72:0/64057565 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd4005990 con 0x7f9be0151680 2023-12-13T00:01:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.001+0000 7fcf13989640 1 Processor -- start 2023-12-13T00:01:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.001+0000 7fcf13989640 1 -- start start 2023-12-13T00:01:12.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.002+0000 7fcf13989640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcf0c0c9620 0x7fcf0c0c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.002+0000 7fcf13989640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0c0cbda0 con 0x7fcf0c0cda70 2023-12-13T00:01:12.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.002+0000 7fcf13989640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0c0cea60 con 0x7fcf0c0cc420 2023-12-13T00:01:12.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.002+0000 7fcf13989640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0c0cc230 con 0x7fcf0c0c9620 2023-12-13T00:01:12.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.044+0000 7f811fe48640 1 Processor -- start 2023-12-13T00:01:12.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.044+0000 7f811fe48640 1 -- start start 2023-12-13T00:01:12.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.045+0000 7f811fe48640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f81180ccac0 0x7f81180cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.045+0000 7f811fe48640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81180c8240 con 0x7f8118151680 2023-12-13T00:01:12.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.045+0000 7f811fe48640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81181575f0 con 0x7f81181571d0 2023-12-13T00:01:12.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.045+0000 7f811fe48640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81180cd410 con 0x7f81180ccac0 2023-12-13T00:01:12.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.069+0000 7f6d52ffd640 1 -- 172.21.15.72:0/2762118313 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f6d5c00ce30 con 0x7f6d64153470 2023-12-13T00:01:12.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.079+0000 7f6d52ffd640 1 -- 172.21.15.72:0/2762118313 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6d5c054b10 con 0x7f6d64153470 2023-12-13T00:01:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.082+0000 7f9bdcff9640 1 -- 172.21.15.72:0/64057565 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4005d00 con 0x7f9be0151680 2023-12-13T00:01:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.082+0000 7f9bdcff9640 1 -- 172.21.15.72:0/64057565 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9bd400c940 con 0x7f9be0151680 2023-12-13T00:01:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.083+0000 7fcf11f26640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcf0c0c9620 0x7fcf0c0c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.083+0000 7f9bdcff9640 1 --2- 172.21.15.72:0/64057565 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9bcc06b1c0 0x7f9bcc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.083+0000 7f9bdffff640 1 --2- 172.21.15.72:0/64057565 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9bcc06b1c0 0x7f9bcc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.083+0000 7fcf11f26640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcf0c0c9620 0x7fcf0c0c9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:60208/0 (socket says 172.21.15.72:60208) 2023-12-13T00:01:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.083+0000 7fcf11f26640 1 -- 172.21.15.72:0/2953869310 learned_addr learned my addr 172.21.15.72:0/2953869310 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.083+0000 7f9bdffff640 1 --2- 172.21.15.72:0/64057565 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9bcc06b1c0 0x7f9bcc06d680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0007fd0 tx=0x7f9bd0007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.085+0000 7f811e3e5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f81180ccac0 0x7f81180cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.097+0000 7f9bdcff9640 1 -- 172.21.15.72:0/64057565 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f9bd4058d20 con 0x7f9be0151680 2023-12-13T00:01:12.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.097+0000 7f9bdcff9640 1 -- 172.21.15.72:0/64057565 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9bd4055060 con 0x7f9be0151680 2023-12-13T00:01:12.099 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-13T00:01:12.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.103+0000 7f447d7a6640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f44780c9620 0x7f44780c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.104+0000 7f447d7a6640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f44780c9620 0x7f44780c9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35802/0 (socket says 172.21.15.72:35802) 2023-12-13T00:01:12.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.104+0000 7f447d7a6640 1 -- 172.21.15.72:0/849154162 learned_addr learned my addr 172.21.15.72:0/849154162 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:12.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.106+0000 7f811dbe4640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8118151680 0x7f811806f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48044/0 (socket says 172.21.15.72:48044) 2023-12-13T00:01:12.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.106+0000 7f811dbe4640 1 -- 172.21.15.72:0/3536041556 learned_addr learned my addr 172.21.15.72:0/3536041556 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:12.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.108+0000 7f447d7a6640 1 -- 172.21.15.72:0/849154162 >> v1:172.21.15.176:6789/0 conn(0x7f44780cc420 legacy=0x7f4478159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:12.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.108+0000 7f447d7a6640 1 -- 172.21.15.72:0/849154162 >> v1:172.21.15.72:6789/0 conn(0x7f44780cda70 legacy=0x7f44780ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.108+0000 7f447d7a6640 1 -- 172.21.15.72:0/849154162 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44780cb4e0 con 0x7f44780c9620 2023-12-13T00:01:12.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.112+0000 7f447d7a6640 1 --2- 172.21.15.72:0/849154162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44780c9620 0x7f44780c9a50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4460009870 tx=0x7f446002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d9daf58c07b330 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.117+0000 7f811cbe2640 1 -- 172.21.15.72:0/3536041556 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636271347 0 0) 0x7f81180c8240 con 0x7f8118151680 2023-12-13T00:01:12.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.117+0000 7f811cbe2640 1 -- 172.21.15.72:0/3536041556 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8104003520 con 0x7f8118151680 2023-12-13T00:01:12.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.125+0000 7f811cbe2640 1 -- 172.21.15.72:0/3536041556 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4123636051 0 0) 0x7f8104003520 con 0x7f8118151680 2023-12-13T00:01:12.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.125+0000 7f811cbe2640 1 -- 172.21.15.72:0/3536041556 >> v2:172.21.15.176:3300/0 conn(0x7f81180ccac0 msgr2=0x7f81180cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:12.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.125+0000 7f811cbe2640 1 --2- 172.21.15.72:0/3536041556 >> v2:172.21.15.176:3300/0 conn(0x7f81180ccac0 0x7f81180cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.125+0000 7f811cbe2640 1 -- 172.21.15.72:0/3536041556 >> v1:172.21.15.176:6789/0 conn(0x7f81181571d0 legacy=0x7f81180c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:12.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.125+0000 7f811cbe2640 1 -- 172.21.15.72:0/3536041556 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8118157880 con 0x7f8118151680 2023-12-13T00:01:12.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.125+0000 7f811cbe2640 1 -- 172.21.15.72:0/3536041556 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1233568696 0 0) 0x7f8114001690 con 0x7f8118151680 2023-12-13T00:01:12.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.125+0000 7f811cbe2640 1 -- 172.21.15.72:0/3536041556 >> v1:172.21.15.72:6789/0 conn(0x7f8118151680 legacy=0x7f811806f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.125+0000 7f811cbe2640 1 --2- 172.21.15.72:0/3536041556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8104003a30 0x7f8104003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.125+0000 7f811cbe2640 1 --2- 172.21.15.72:0/3536041556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81040047c0 0x7f8104004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.125+0000 7f811cbe2640 1 --2- 172.21.15.72:0/3536041556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8104005380 0x7f810400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.125+0000 7f811cbe2640 1 -- 172.21.15.72:0/3536041556 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81180cd410 con 0x7f8104003a30 2023-12-13T00:01:12.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.125+0000 7f811cbe2640 1 -- 172.21.15.72:0/3536041556 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810400c230 con 0x7f8104005380 2023-12-13T00:01:12.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.125+0000 7f811cbe2640 1 -- 172.21.15.72:0/3536041556 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810400c3f0 con 0x7f81040047c0 2023-12-13T00:01:12.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.131+0000 7f811dbe4640 1 --2- 172.21.15.72:0/3536041556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8104003a30 0x7f8104003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.134+0000 7fcf11f26640 1 -- 172.21.15.72:0/2953869310 >> v1:172.21.15.176:6789/0 conn(0x7fcf0c0cc420 legacy=0x7fcf0c159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.134+0000 7fcf11f26640 1 -- 172.21.15.72:0/2953869310 >> v1:172.21.15.72:6789/0 conn(0x7fcf0c0cda70 legacy=0x7fcf0c0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.134+0000 7fcf11f26640 1 -- 172.21.15.72:0/2953869310 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c0cb4e0 con 0x7fcf0c0c9620 2023-12-13T00:01:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.134+0000 7f44777fe640 1 -- 172.21.15.72:0/849154162 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446002f850 con 0x7f44780c9620 2023-12-13T00:01:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.134+0000 7f44777fe640 1 -- 172.21.15.72:0/849154162 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446002f9b0 con 0x7f44780c9620 2023-12-13T00:01:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.134+0000 7f44777fe640 1 -- 172.21.15.72:0/849154162 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446002fd40 con 0x7f44780c9620 2023-12-13T00:01:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.135+0000 7f447f209640 1 -- 172.21.15.72:0/849154162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44780c9620 msgr2=0x7f44780c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.135+0000 7f447f209640 1 --2- 172.21.15.72:0/849154162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44780c9620 0x7f44780c9a50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4460009870 tx=0x7f446002ba30 comp rx=0 tx=0).stop 2023-12-13T00:01:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.135+0000 7f447f209640 1 -- 172.21.15.72:0/849154162 shutdown_connections 2023-12-13T00:01:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.135+0000 7f447f209640 1 --2- 172.21.15.72:0/849154162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44780c9620 0x7f44780c9a50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.135+0000 7f447f209640 1 -- 172.21.15.72:0/849154162 >> 172.21.15.72:0/849154162 conn(0x7f44780b07b0 msgr2=0x7f44780b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.135+0000 7f447f209640 1 -- 172.21.15.72:0/849154162 shutdown_connections 2023-12-13T00:01:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.135+0000 7f447f209640 1 -- 172.21.15.72:0/849154162 wait complete. 2023-12-13T00:01:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.136+0000 7f811e3e5640 1 --2- 172.21.15.72:0/3536041556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8104005380 0x7f810400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.136+0000 7f811dbe4640 1 -- 172.21.15.72:0/3536041556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81040047c0 msgr2=0x7f8104004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.136+0000 7f811dbe4640 1 --2- 172.21.15.72:0/3536041556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81040047c0 0x7f8104004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.136+0000 7f811dbe4640 1 -- 172.21.15.72:0/3536041556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8104005380 msgr2=0x7f810400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.136+0000 7f811dbe4640 1 --2- 172.21.15.72:0/3536041556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8104005380 0x7f810400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.137+0000 7f811dbe4640 1 -- 172.21.15.72:0/3536041556 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8104003520 con 0x7f8104003a30 2023-12-13T00:01:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.137+0000 7f811e3e5640 1 -- 172.21.15.72:0/3536041556 reap_dead start 2023-12-13T00:01:12.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.137+0000 7f447f209640 1 Processor -- start 2023-12-13T00:01:12.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.137+0000 7f447f209640 1 -- start start 2023-12-13T00:01:12.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.139+0000 7f447f209640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44780c9620 0x7f44780ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.139+0000 7f447f209640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44780cc420 0x7f44780aa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.139+0000 7f447f209640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44780cda70 0x7f44781efbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.139+0000 7f447f209640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44781f27f0 con 0x7f44780cda70 2023-12-13T00:01:12.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.139+0000 7f447f209640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44781520f0 con 0x7f44780cc420 2023-12-13T00:01:12.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.139+0000 7f447f209640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44781523d0 con 0x7f44780c9620 2023-12-13T00:01:12.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.142+0000 7fcf11f26640 1 --2- 172.21.15.72:0/2953869310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf0c0c9620 0x7fcf0c0c9a50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009e50 tx=0x7fcf0402c090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70fc9a2b6bea8f37 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.142+0000 7f811dbe4640 1 --2- 172.21.15.72:0/3536041556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8104003a30 0x7f8104003e30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f811400c160 tx=0x7f81040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccda5e86758188ff server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.142+0000 7f447d7a6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44780cda70 0x7f44781efbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.143+0000 7f447d7a6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44780cda70 0x7f44781efbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35832/0 (socket says 172.21.15.72:35832) 2023-12-13T00:01:12.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.143+0000 7f447d7a6640 1 -- 172.21.15.72:0/1321153895 learned_addr learned my addr 172.21.15.72:0/1321153895 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:12.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.145+0000 7f4477fff640 1 --2- 172.21.15.72:0/1321153895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44780cc420 0x7f44780aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.147+0000 7f447d7a6640 1 -- 172.21.15.72:0/1321153895 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44780c9620 msgr2=0x7f44780ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.147+0000 7f447d7a6640 1 --2- 172.21.15.72:0/1321153895 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44780c9620 0x7f44780ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.147+0000 7f447d7a6640 1 -- 172.21.15.72:0/1321153895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44780cc420 msgr2=0x7f44780aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.147+0000 7f447d7a6640 1 --2- 172.21.15.72:0/1321153895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44780cc420 0x7f44780aa350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.147+0000 7f447d7a6640 1 -- 172.21.15.72:0/1321153895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44600094d0 con 0x7f44780cda70 2023-12-13T00:01:12.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.150+0000 7fcf03fff640 1 -- 172.21.15.72:0/2953869310 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0402cc30 con 0x7fcf0c0c9620 2023-12-13T00:01:12.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.150+0000 7fcf03fff640 1 -- 172.21.15.72:0/2953869310 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0402cd90 con 0x7fcf0c0c9620 2023-12-13T00:01:12.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.150+0000 7fcf03fff640 1 -- 172.21.15.72:0/2953869310 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04034610 con 0x7fcf0c0c9620 2023-12-13T00:01:12.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.151+0000 7fcf13989640 1 -- 172.21.15.72:0/2953869310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf0c0c9620 msgr2=0x7fcf0c0c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.151+0000 7fcf13989640 1 --2- 172.21.15.72:0/2953869310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf0c0c9620 0x7fcf0c0c9a50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009e50 tx=0x7fcf0402c090 comp rx=0 tx=0).stop 2023-12-13T00:01:12.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.151+0000 7fcf13989640 1 -- 172.21.15.72:0/2953869310 shutdown_connections 2023-12-13T00:01:12.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.151+0000 7fcf13989640 1 --2- 172.21.15.72:0/2953869310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf0c0c9620 0x7fcf0c0c9a50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.151+0000 7fcf13989640 1 -- 172.21.15.72:0/2953869310 >> 172.21.15.72:0/2953869310 conn(0x7fcf0c0b07b0 msgr2=0x7fcf0c0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:12.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.151+0000 7fcf13989640 1 -- 172.21.15.72:0/2953869310 shutdown_connections 2023-12-13T00:01:12.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.151+0000 7fcf13989640 1 -- 172.21.15.72:0/2953869310 wait complete. 2023-12-13T00:01:12.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.153+0000 7fcf13989640 1 Processor -- start 2023-12-13T00:01:12.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.153+0000 7fcf13989640 1 -- start start 2023-12-13T00:01:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.154+0000 7fcf13989640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf0c0c9620 0x7fcf0c15a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.154+0000 7fcf13989640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf0c0cc420 0x7fcf0c159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.154+0000 7fcf13989640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf0c0cda70 0x7fcf0c1e5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.155+0000 7fcf13989640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c1540e0 con 0x7fcf0c0cc420 2023-12-13T00:01:12.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.155+0000 7fcf13989640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c159670 con 0x7fcf0c0cda70 2023-12-13T00:01:12.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.155+0000 7fcf13989640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c157480 con 0x7fcf0c0c9620 2023-12-13T00:01:12.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.155+0000 7fcf11725640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf0c0c9620 0x7fcf0c15a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.155+0000 7fcf11f26640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf0c0cda70 0x7fcf0c1e5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.155+0000 7fcf11725640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf0c0c9620 0x7fcf0c15a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:48512/0 (socket says 172.21.15.72:48512) 2023-12-13T00:01:12.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.155+0000 7fcf11f26640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf0c0cda70 0x7fcf0c1e5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:60252/0 (socket says 172.21.15.72:60252) 2023-12-13T00:01:12.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.155+0000 7fcf11f26640 1 -- 172.21.15.72:0/3235289694 learned_addr learned my addr 172.21.15.72:0/3235289694 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:12.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.159+0000 7fcf11f26640 1 -- 172.21.15.72:0/3235289694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf0c0c9620 msgr2=0x7fcf0c15a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.159+0000 7fcf11f26640 1 --2- 172.21.15.72:0/3235289694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf0c0c9620 0x7fcf0c15a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.159+0000 7fcf11f26640 1 -- 172.21.15.72:0/3235289694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf0c0cc420 msgr2=0x7fcf0c159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.159+0000 7fcf11f26640 1 --2- 172.21.15.72:0/3235289694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf0c0cc420 0x7fcf0c159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.159+0000 7fcf11f26640 1 -- 172.21.15.72:0/3235289694 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf04009b30 con 0x7fcf0c0cda70 2023-12-13T00:01:12.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.161+0000 7fcf11f26640 1 --2- 172.21.15.72:0/3235289694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf0c0cda70 0x7fcf0c1e5c70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009e50 tx=0x7fcf04004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.162+0000 7f447d7a6640 1 --2- 172.21.15.72:0/1321153895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44780cda70 0x7f44781efbd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f446002ba70 tx=0x7f4460004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.162+0000 7f811cbe2640 1 -- 172.21.15.72:0/3536041556 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114005ad0 con 0x7f8104003a30 2023-12-13T00:01:12.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.162+0000 7f811cbe2640 1 -- 172.21.15.72:0/3536041556 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8114005c50 con 0x7f8104003a30 2023-12-13T00:01:12.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.162+0000 7f811cbe2640 1 -- 172.21.15.72:0/3536041556 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811402c810 con 0x7f8104003a30 2023-12-13T00:01:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.163+0000 7f811fe48640 1 -- 172.21.15.72:0/3536041556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8104003a30 msgr2=0x7f8104003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.163+0000 7f811fe48640 1 --2- 172.21.15.72:0/3536041556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8104003a30 0x7f8104003e30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f811400c160 tx=0x7f81040057f0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.163+0000 7f811fe48640 1 -- 172.21.15.72:0/3536041556 shutdown_connections 2023-12-13T00:01:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.163+0000 7f811fe48640 1 --2- 172.21.15.72:0/3536041556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8104003a30 0x7f8104003e30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.163+0000 7f811fe48640 1 -- 172.21.15.72:0/3536041556 >> 172.21.15.72:0/3536041556 conn(0x7f81180707f0 msgr2=0x7f8118070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.164+0000 7f811fe48640 1 -- 172.21.15.72:0/3536041556 shutdown_connections 2023-12-13T00:01:12.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.164+0000 7f811fe48640 1 -- 172.21.15.72:0/3536041556 wait complete. 2023-12-13T00:01:12.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.165+0000 7fcf01ffb640 1 -- 172.21.15.72:0/3235289694 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04009510 con 0x7fcf0c0cda70 2023-12-13T00:01:12.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.165+0000 7fcf01ffb640 1 -- 172.21.15.72:0/3235289694 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0403e450 con 0x7fcf0c0cda70 2023-12-13T00:01:12.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.165+0000 7fcf01ffb640 1 -- 172.21.15.72:0/3235289694 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0403e800 con 0x7fcf0c0cda70 2023-12-13T00:01:12.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.165+0000 7fcf13989640 1 -- 172.21.15.72:0/3235289694 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0c157740 con 0x7fcf0c0cda70 2023-12-13T00:01:12.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.166+0000 7fcf13989640 1 -- 172.21.15.72:0/3235289694 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0c157d00 con 0x7fcf0c0cda70 2023-12-13T00:01:12.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.166+0000 7f811fe48640 1 Processor -- start 2023-12-13T00:01:12.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.166+0000 7f811fe48640 1 -- start start 2023-12-13T00:01:12.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.167+0000 7fcf13989640 1 -- 172.21.15.72:0/3235289694 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0c067470 con 0x7fcf0c0cda70 2023-12-13T00:01:12.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.167+0000 7f811fe48640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8104003a30 0x7f81180c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.167+0000 7f811fe48640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81180cb4c0 0x7f81181ec730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.167+0000 7f811fe48640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81180cc5a0 0x7f8118149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.167+0000 7f811fe48640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81180c4b00 con 0x7f81180cc5a0 2023-12-13T00:01:12.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.167+0000 7f811fe48640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81180cbe70 con 0x7f81180cb4c0 2023-12-13T00:01:12.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.167+0000 7f811fe48640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81180c4860 con 0x7f8104003a30 2023-12-13T00:01:12.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.168+0000 7f811dbe4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8104003a30 0x7f81180c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.168+0000 7f811dbe4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8104003a30 0x7f81180c2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:48528/0 (socket says 172.21.15.72:48528) 2023-12-13T00:01:12.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.168+0000 7f811dbe4640 1 -- 172.21.15.72:0/2564064002 learned_addr learned my addr 172.21.15.72:0/2564064002 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.173+0000 7f811dbe4640 1 -- 172.21.15.72:0/2564064002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81180cb4c0 msgr2=0x7f81181ec730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.173+0000 7f811dbe4640 1 --2- 172.21.15.72:0/2564064002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81180cb4c0 0x7f81181ec730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.173+0000 7f811dbe4640 1 -- 172.21.15.72:0/2564064002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81180cc5a0 msgr2=0x7f8118149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.173+0000 7f811dbe4640 1 --2- 172.21.15.72:0/2564064002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81180cc5a0 0x7f8118149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.173+0000 7f811dbe4640 1 -- 172.21.15.72:0/2564064002 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81180cbb90 con 0x7f8104003a30 2023-12-13T00:01:12.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.174+0000 7f44757fa640 1 -- 172.21.15.72:0/1321153895 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4460037dd0 con 0x7f44780cda70 2023-12-13T00:01:12.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.174+0000 7f44757fa640 1 -- 172.21.15.72:0/1321153895 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4460041400 con 0x7f44780cda70 2023-12-13T00:01:12.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.174+0000 7f44757fa640 1 -- 172.21.15.72:0/1321153895 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44600417b0 con 0x7f44780cda70 2023-12-13T00:01:12.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.174+0000 7f447f209640 1 -- 172.21.15.72:0/1321153895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44781526b0 con 0x7f44780cda70 2023-12-13T00:01:12.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.174+0000 7f447f209640 1 -- 172.21.15.72:0/1321153895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44781f2a40 con 0x7f44780cda70 2023-12-13T00:01:12.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.176+0000 7f447f209640 1 -- 172.21.15.72:0/1321153895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447806d340 con 0x7f44780cda70 2023-12-13T00:01:12.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.176+0000 7f811dbe4640 1 --2- 172.21.15.72:0/2564064002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8104003a30 0x7f81180c2c50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f811400c280 tx=0x7f8114001950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-13T00:01:12.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.181+0000 7f810e7fc640 1 -- 172.21.15.72:0/2564064002 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811402dea0 con 0x7f8104003a30 2023-12-13T00:01:12.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.181+0000 7f810e7fc640 1 -- 172.21.15.72:0/2564064002 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811403a070 con 0x7f8104003a30 2023-12-13T00:01:12.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.181+0000 7f810e7fc640 1 -- 172.21.15.72:0/2564064002 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114004c00 con 0x7f8104003a30 2023-12-13T00:01:12.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.181+0000 7f811fe48640 1 -- 172.21.15.72:0/2564064002 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81181f07c0 con 0x7f8104003a30 2023-12-13T00:01:12.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.181+0000 7f811fe48640 1 -- 172.21.15.72:0/2564064002 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81180c3f30 con 0x7f8104003a30 2023-12-13T00:01:12.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.183+0000 7f811fe48640 1 -- 172.21.15.72:0/2564064002 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8118073dc0 con 0x7f8104003a30 2023-12-13T00:01:12.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.194+0000 7fcf01ffb640 1 -- 172.21.15.72:0/3235289694 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcf0403e960 con 0x7fcf0c0cda70 2023-12-13T00:01:12.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.194+0000 7fcf01ffb640 1 --2- 172.21.15.72:0/3235289694 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fcef006b1f0 0x7fcef006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.195+0000 7fcf11725640 1 --2- 172.21.15.72:0/3235289694 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fcef006b1f0 0x7fcef006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.196+0000 7fcf11725640 1 --2- 172.21.15.72:0/3235289694 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fcef006b1f0 0x7fcef006d6b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcf08000f60 tx=0x7fcf08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.197+0000 7f44757fa640 1 -- 172.21.15.72:0/1321153895 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4460041910 con 0x7f44780cda70 2023-12-13T00:01:12.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.198+0000 7fcf01ffb640 1 -- 172.21.15.72:0/3235289694 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fcf0407bd20 con 0x7fcf0c0cda70 2023-12-13T00:01:12.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.198+0000 7f44757fa640 1 --2- 172.21.15.72:0/1321153895 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f445806b1c0 0x7f445806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.198+0000 7f447cfa5640 1 --2- 172.21.15.72:0/1321153895 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f445806b1c0 0x7f445806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.199+0000 7f447cfa5640 1 --2- 172.21.15.72:0/1321153895 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f445806b1c0 0x7f445806d680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4470000f60 tx=0x7f44700079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.203+0000 7f44757fa640 1 -- 172.21.15.72:0/1321153895 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f446003c070 con 0x7f44780cda70 2023-12-13T00:01:12.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.224+0000 7f322d5c5640 1 Processor -- start 2023-12-13T00:01:12.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.224+0000 7f322d5c5640 1 -- start start 2023-12-13T00:01:12.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.225+0000 7f322d5c5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3228153790 0x7f32280723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.225+0000 7f322d5c5640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32280c2dc0 con 0x7f32280c8370 2023-12-13T00:01:12.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.226+0000 7f322d5c5640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322806fe60 con 0x7f322806f1f0 2023-12-13T00:01:12.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.226+0000 7f322d5c5640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32281597b0 con 0x7f3228153790 2023-12-13T00:01:12.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.233+0000 7f32277fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f32280c8370 0x7f3228163da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48058/0 (socket says 172.21.15.72:48058) 2023-12-13T00:01:12.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.233+0000 7f32277fe640 1 -- 172.21.15.72:0/1890269382 learned_addr learned my addr 172.21.15.72:0/1890269382 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:12.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.280+0000 7f6d68d01640 1 -- 172.21.15.72:0/2762118313 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6d641eed60 con 0x7f6d64153470 2023-12-13T00:01:12.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.292+0000 7feaa0f39640 1 Processor -- start 2023-12-13T00:01:12.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.292+0000 7feaa0f39640 1 -- start start 2023-12-13T00:01:12.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.293+0000 7feaa0f39640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea9c0cda70 0x7fea9c0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.293+0000 7feaa0f39640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c0cbda0 con 0x7fea9c0cc420 2023-12-13T00:01:12.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.293+0000 7feaa0f39640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c0cb4e0 con 0x7fea9c0c9620 2023-12-13T00:01:12.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.293+0000 7feaa0f39640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0cc230 con 0x7fea9c0cda70 2023-12-13T00:01:12.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.302+0000 7f9be669b640 1 -- 172.21.15.72:0/64057565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9be014b200 con 0x7f9be0151680 2023-12-13T00:01:12.336 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-13T00:01:12.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.437+0000 7fd09634c640 1 Processor -- start 2023-12-13T00:01:12.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.437+0000 7fd09634c640 1 -- start start 2023-12-13T00:01:12.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.437+0000 7fd09634c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd090157a40 0x7fd0900ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.437+0000 7fd09634c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd090158340 con 0x7fd0901514a0 2023-12-13T00:01:12.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.437+0000 7fd09634c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd090157e50 con 0x7fd0900ccb60 2023-12-13T00:01:12.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.437+0000 7fd09634c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0901580a0 con 0x7fd090157a40 2023-12-13T00:01:12.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.441+0000 7f810e7fc640 1 -- 172.21.15.72:0/2564064002 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8114032070 con 0x7f8104003a30 2023-12-13T00:01:12.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.441+0000 7f810e7fc640 1 --2- 172.21.15.72:0/2564064002 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f80fc06b1f0 0x7f80fc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.441+0000 7f811d3e3640 1 --2- 172.21.15.72:0/2564064002 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f80fc06b1f0 0x7f80fc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.441+0000 7f811d3e3640 1 --2- 172.21.15.72:0/2564064002 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f80fc06b1f0 0x7f80fc06d6b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f81180c6f30 tx=0x7f8108007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.444+0000 7f3225ffb640 1 -- 172.21.15.72:0/1890269382 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036743455 0 0) 0x7f32280c2dc0 con 0x7f32280c8370 2023-12-13T00:01:12.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.444+0000 7f3225ffb640 1 -- 172.21.15.72:0/1890269382 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3210003520 con 0x7f32280c8370 2023-12-13T00:01:12.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.444+0000 7fcf01ffb640 1 -- 172.21.15.72:0/3235289694 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcf04077960 con 0x7fcf0c0cda70 2023-12-13T00:01:12.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.445+0000 7f810e7fc640 1 -- 172.21.15.72:0/2564064002 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f811404be70 con 0x7f8104003a30 2023-12-13T00:01:12.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.448+0000 7f3226ffd640 1 --2- 172.21.15.72:0/1890269382 >> v2:172.21.15.176:3300/0 conn(0x7f3228153790 0x7f32280723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.448+0000 7fea9ad9d640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fea9c0c9620 0x7fea9c163eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:43840/0 (socket says 172.21.15.72:43840) 2023-12-13T00:01:12.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.448+0000 7fea9ad9d640 1 -- 172.21.15.72:0/2282349852 learned_addr learned my addr 172.21.15.72:0/2282349852 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:12.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.451+0000 7fd08f7fe640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fd0900ccb60 0x7fd090157330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:43850/0 (socket says 172.21.15.72:43850) 2023-12-13T00:01:12.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.451+0000 7fd08f7fe640 1 -- 172.21.15.72:0/3186970567 learned_addr learned my addr 172.21.15.72:0/3186970567 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:12.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.452+0000 7f3226ffd640 1 -- 172.21.15.72:0/1890269382 >> v1:172.21.15.176:6789/0 conn(0x7f322806f1f0 legacy=0x7f3228159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.452+0000 7f3226ffd640 1 -- 172.21.15.72:0/1890269382 >> v1:172.21.15.72:6789/0 conn(0x7f32280c8370 legacy=0x7f3228163da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.452+0000 7f3226ffd640 1 -- 172.21.15.72:0/1890269382 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322815ca10 con 0x7f3228153790 2023-12-13T00:01:12.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.455+0000 7f3226ffd640 1 --2- 172.21.15.72:0/1890269382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3228153790 0x7f32280723f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f32180097a0 tx=0x7f321802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e68668856a5a45b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.455+0000 7fea9a59c640 1 --2- 172.21.15.72:0/2282349852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea9c0cda70 0x7fea9c0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.456+0000 7f810e7fc640 1 -- 172.21.15.72:0/2564064002 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8114076720 con 0x7f8104003a30 2023-12-13T00:01:12.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.456+0000 7fd0948e9640 1 --2- 172.21.15.72:0/3186970567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd090157a40 0x7fd0900ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.458+0000 7f44757fa640 1 -- 172.21.15.72:0/1321153895 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f44600782b0 con 0x7f44780cda70 2023-12-13T00:01:12.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.460+0000 7fea9a59c640 1 -- 172.21.15.72:0/2282349852 >> v1:172.21.15.176:6789/0 conn(0x7fea9c0c9620 legacy=0x7fea9c163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.460+0000 7fea9a59c640 1 -- 172.21.15.72:0/2282349852 >> v1:172.21.15.72:6789/0 conn(0x7fea9c0cc420 legacy=0x7fea9c159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:12.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.460+0000 7fea9a59c640 1 -- 172.21.15.72:0/2282349852 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c0cce00 con 0x7fea9c0cda70 2023-12-13T00:01:12.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.464+0000 7fea9a59c640 1 --2- 172.21.15.72:0/2282349852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea9c0cda70 0x7fea9c0ce350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0097d0 tx=0x7fea8c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d19b28937ca09ca1 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.467+0000 7fd0948e9640 1 -- 172.21.15.72:0/3186970567 >> v1:172.21.15.176:6789/0 conn(0x7fd0900ccb60 legacy=0x7fd090157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.467+0000 7fd0948e9640 1 -- 172.21.15.72:0/3186970567 >> v1:172.21.15.72:6789/0 conn(0x7fd0901514a0 legacy=0x7fd0900c3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:12.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.467+0000 7fd0948e9640 1 -- 172.21.15.72:0/3186970567 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0900c2370 con 0x7fd090157a40 2023-12-13T00:01:12.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.470+0000 7f9bdcff9640 1 -- 172.21.15.72:0/64057565 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9bd4021090 con 0x7f9be0151680 2023-12-13T00:01:12.471 INFO:teuthology.orchestra.run.smithi072.stdout:60129542160 2023-12-13T00:01:12.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.472+0000 7f9be669b640 1 -- 172.21.15.72:0/64057565 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9bcc06b1c0 msgr2=0x7f9bcc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.472+0000 7f9be669b640 1 --2- 172.21.15.72:0/64057565 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9bcc06b1c0 0x7f9bcc06d680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0007fd0 tx=0x7f9bd0007e80 comp rx=0 tx=0).stop 2023-12-13T00:01:12.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.472+0000 7f9be669b640 1 -- 172.21.15.72:0/64057565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be0151680 msgr2=0x7f9be0146940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.472+0000 7f9be669b640 1 --2- 172.21.15.72:0/64057565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be0151680 0x7f9be0146940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400e8a0 tx=0x7f9bd400ed60 comp rx=0 tx=0).stop 2023-12-13T00:01:12.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.472+0000 7f9be669b640 1 -- 172.21.15.72:0/64057565 shutdown_connections 2023-12-13T00:01:12.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.472+0000 7f9be669b640 1 --2- 172.21.15.72:0/64057565 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9bcc06b1c0 0x7f9bcc06d680 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.472+0000 7f9be669b640 1 --2- 172.21.15.72:0/64057565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9be01571d0 0x7f9be0146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.472+0000 7f9be669b640 1 --2- 172.21.15.72:0/64057565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be0151680 0x7f9be0146940 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.472+0000 7f9be669b640 1 --2- 172.21.15.72:0/64057565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9be00ccac0 0x7f9be00cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.472+0000 7f9be669b640 1 -- 172.21.15.72:0/64057565 >> 172.21.15.72:0/64057565 conn(0x7f9be00707f0 msgr2=0x7f9be0154ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:12.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.472+0000 7f9be669b640 1 -- 172.21.15.72:0/64057565 shutdown_connections 2023-12-13T00:01:12.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.472+0000 7f9be669b640 1 -- 172.21.15.72:0/64057565 wait complete. 2023-12-13T00:01:12.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.473+0000 7fea9959a640 1 -- 172.21.15.72:0/2282349852 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c031890 con 0x7fea9c0cda70 2023-12-13T00:01:12.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.473+0000 7fea9959a640 1 -- 172.21.15.72:0/2282349852 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8c0319f0 con 0x7fea9c0cda70 2023-12-13T00:01:12.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.473+0000 7fea9959a640 1 -- 172.21.15.72:0/2282349852 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c031d80 con 0x7fea9c0cda70 2023-12-13T00:01:12.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.474+0000 7feaa0f39640 1 -- 172.21.15.72:0/2282349852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea9c0cda70 msgr2=0x7fea9c0ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.474+0000 7feaa0f39640 1 --2- 172.21.15.72:0/2282349852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea9c0cda70 0x7fea9c0ce350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0097d0 tx=0x7fea8c02b930 comp rx=0 tx=0).stop 2023-12-13T00:01:12.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.474+0000 7feaa0f39640 1 -- 172.21.15.72:0/2282349852 shutdown_connections 2023-12-13T00:01:12.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.474+0000 7feaa0f39640 1 --2- 172.21.15.72:0/2282349852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea9c0cda70 0x7fea9c0ce350 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.474+0000 7feaa0f39640 1 -- 172.21.15.72:0/2282349852 >> 172.21.15.72:0/2282349852 conn(0x7fea9c0b07b0 msgr2=0x7fea9c0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:12.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.474+0000 7feaa0f39640 1 -- 172.21.15.72:0/2282349852 shutdown_connections 2023-12-13T00:01:12.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.474+0000 7feaa0f39640 1 -- 172.21.15.72:0/2282349852 wait complete. 2023-12-13T00:01:12.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.475+0000 7fd0948e9640 1 --2- 172.21.15.72:0/3186970567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd090157a40 0x7fd0900ccf90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd088009dc0 tx=0x7fd08802be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=658e7ff1c6ab40b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.476+0000 7feaa0f39640 1 Processor -- start 2023-12-13T00:01:12.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.476+0000 7feaa0f39640 1 -- start start 2023-12-13T00:01:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.477+0000 7feaa0f39640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea9c0c9620 0x7fea9c1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.477+0000 7feaa0f39640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea9c0cc420 0x7fea9c1f0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.477+0000 7feaa0f39640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea9c0cda70 0x7fea9c1ef120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.477+0000 7feaa0f39640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c1f2730 con 0x7fea9c0c9620 2023-12-13T00:01:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.477+0000 7feaa0f39640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c1efd20 con 0x7fea9c0cc420 2023-12-13T00:01:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.477+0000 7feaa0f39640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c1f29d0 con 0x7fea9c0cda70 2023-12-13T00:01:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.479+0000 7fea9ad9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea9c0cda70 0x7fea9c1ef120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.482+0000 7fea9ad9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea9c0cda70 0x7fea9c1ef120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:48536/0 (socket says 172.21.15.72:48536) 2023-12-13T00:01:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.482+0000 7fea9ad9d640 1 -- 172.21.15.72:0/4279954561 learned_addr learned my addr 172.21.15.72:0/4279954561 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.482+0000 7fea9a59c640 1 --2- 172.21.15.72:0/4279954561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea9c0c9620 0x7fea9c1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.482+0000 7fd08effd640 1 -- 172.21.15.72:0/3186970567 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08802cc40 con 0x7fd090157a40 2023-12-13T00:01:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.483+0000 7fd08effd640 1 -- 172.21.15.72:0/3186970567 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08802cda0 con 0x7fd090157a40 2023-12-13T00:01:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.483+0000 7fd08effd640 1 -- 172.21.15.72:0/3186970567 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088034660 con 0x7fd090157a40 2023-12-13T00:01:12.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.483+0000 7fd09634c640 1 -- 172.21.15.72:0/3186970567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd090157a40 msgr2=0x7fd0900ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.483+0000 7fd09634c640 1 --2- 172.21.15.72:0/3186970567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd090157a40 0x7fd0900ccf90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd088009dc0 tx=0x7fd08802be90 comp rx=0 tx=0).stop 2023-12-13T00:01:12.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.483+0000 7fd09634c640 1 -- 172.21.15.72:0/3186970567 shutdown_connections 2023-12-13T00:01:12.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.483+0000 7fd09634c640 1 --2- 172.21.15.72:0/3186970567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd090157a40 0x7fd0900ccf90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.483+0000 7fd09634c640 1 -- 172.21.15.72:0/3186970567 >> 172.21.15.72:0/3186970567 conn(0x7fd090070790 msgr2=0x7fd090070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:12.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.483+0000 7fd09634c640 1 -- 172.21.15.72:0/3186970567 shutdown_connections 2023-12-13T00:01:12.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.484+0000 7fd09634c640 1 -- 172.21.15.72:0/3186970567 wait complete. 2023-12-13T00:01:12.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.485+0000 7fd09634c640 1 Processor -- start 2023-12-13T00:01:12.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.485+0000 7fd09634c640 1 -- start start 2023-12-13T00:01:12.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.486+0000 7fd09634c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0900ccb60 0x7fd09015a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.486+0000 7fd09634c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0901514a0 0x7fd09014ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.486+0000 7fd09634c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd090157a40 0x7fd0901584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.486+0000 7fd09634c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09015ae10 con 0x7fd0900ccb60 2023-12-13T00:01:12.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.486+0000 7fd09634c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0901ecf60 con 0x7fd090157a40 2023-12-13T00:01:12.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.486+0000 7fd09634c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0901f0f70 con 0x7fd0901514a0 2023-12-13T00:01:12.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.486+0000 7fea9ad9d640 1 -- 172.21.15.72:0/4279954561 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea9c0cc420 msgr2=0x7fea9c1f0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.486+0000 7fea9ad9d640 1 --2- 172.21.15.72:0/4279954561 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea9c0cc420 0x7fea9c1f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.486+0000 7fea9ad9d640 1 -- 172.21.15.72:0/4279954561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea9c0c9620 msgr2=0x7fea9c1585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.486+0000 7fea9ad9d640 1 --2- 172.21.15.72:0/4279954561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea9c0c9620 0x7fea9c1585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542160 for osd.2 2023-12-13T00:01:12.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.486+0000 7fea9ad9d640 1 -- 172.21.15.72:0/4279954561 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c009400 con 0x7fea9c0cda70 2023-12-13T00:01:12.489 DEBUG:teuthology.parallel:result is None 2023-12-13T00:01:12.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.489+0000 7fea9ad9d640 1 --2- 172.21.15.72:0/4279954561 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea9c0cda70 0x7fea9c1ef120 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fea9400ca70 tx=0x7fea9400cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.489+0000 7fd08ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0900ccb60 0x7fd09015a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.490+0000 7fd08ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0900ccb60 0x7fd09015a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35872/0 (socket says 172.21.15.72:35872) 2023-12-13T00:01:12.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.490+0000 7fd08ffff640 1 -- 172.21.15.72:0/1273269011 learned_addr learned my addr 172.21.15.72:0/1273269011 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:12.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.492+0000 7f3225ffb640 1 -- 172.21.15.72:0/1890269382 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3218030610 con 0x7f3228153790 2023-12-13T00:01:12.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.492+0000 7f3225ffb640 1 -- 172.21.15.72:0/1890269382 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3218030770 con 0x7f3228153790 2023-12-13T00:01:12.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.492+0000 7f3225ffb640 1 -- 172.21.15.72:0/1890269382 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3218030b00 con 0x7f3228153790 2023-12-13T00:01:12.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.493+0000 7f6d52ffd640 1 -- 172.21.15.72:0/2762118313 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6d641eed60 con 0x7f6d64153470 2023-12-13T00:01:12.494 INFO:teuthology.orchestra.run.smithi072.stdout:64424509456 2023-12-13T00:01:12.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.493+0000 7fd08f7fe640 1 --2- 172.21.15.72:0/1273269011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0901514a0 0x7fd09014ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.493+0000 7f322d5c5640 1 -- 172.21.15.72:0/1890269382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3228153790 msgr2=0x7f32280723f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.493+0000 7f322d5c5640 1 --2- 172.21.15.72:0/1890269382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3228153790 0x7f32280723f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f32180097a0 tx=0x7f321802b960 comp rx=0 tx=0).stop 2023-12-13T00:01:12.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.493+0000 7fd08ffff640 1 -- 172.21.15.72:0/1273269011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0901514a0 msgr2=0x7fd09014ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.493+0000 7fd08ffff640 1 --2- 172.21.15.72:0/1273269011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0901514a0 0x7fd09014ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.493+0000 7fd08ffff640 1 -- 172.21.15.72:0/1273269011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd090157a40 msgr2=0x7fd0901584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.493+0000 7fd08ffff640 1 --2- 172.21.15.72:0/1273269011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd090157a40 0x7fd0901584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.493+0000 7fd08ffff640 1 -- 172.21.15.72:0/1273269011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd088009a70 con 0x7fd0900ccb60 2023-12-13T00:01:12.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.494+0000 7f322d5c5640 1 -- 172.21.15.72:0/1890269382 shutdown_connections 2023-12-13T00:01:12.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.494+0000 7f322d5c5640 1 --2- 172.21.15.72:0/1890269382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3228153790 0x7f32280723f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.494+0000 7f322d5c5640 1 -- 172.21.15.72:0/1890269382 >> 172.21.15.72:0/1890269382 conn(0x7f322806b5c0 msgr2=0x7f322806b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:12.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.494+0000 7f322d5c5640 1 -- 172.21.15.72:0/1890269382 shutdown_connections 2023-12-13T00:01:12.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.494+0000 7f322d5c5640 1 -- 172.21.15.72:0/1890269382 wait complete. 2023-12-13T00:01:12.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.494+0000 7fea8affd640 1 -- 172.21.15.72:0/4279954561 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9400abd0 con 0x7fea9c0cda70 2023-12-13T00:01:12.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.494+0000 7feaa0f39640 1 -- 172.21.15.72:0/4279954561 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c1f2cb0 con 0x7fea9c0cda70 2023-12-13T00:01:12.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.494+0000 7feaa0f39640 1 -- 172.21.15.72:0/4279954561 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c1f0000 con 0x7fea9c0cda70 2023-12-13T00:01:12.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.495+0000 7feaa0f39640 1 -- 172.21.15.72:0/4279954561 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9c1f3170 con 0x7fea9c0cda70 2023-12-13T00:01:12.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.496+0000 7f6d68d01640 1 -- 172.21.15.72:0/2762118313 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f6d4406b240 msgr2=0x7f6d4406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.496+0000 7f6d68d01640 1 --2- 172.21.15.72:0/2762118313 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f6d4406b240 0x7f6d4406d700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6d540015f0 tx=0x7f6d54007a40 comp rx=0 tx=0).stop 2023-12-13T00:01:12.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.496+0000 7f6d68d01640 1 -- 172.21.15.72:0/2762118313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d64153470 msgr2=0x7f6d641ef0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.496+0000 7f6d68d01640 1 --2- 172.21.15.72:0/2762118313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d64153470 0x7f6d641ef0b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00b9e0 tx=0x7f6d5c00bea0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.496+0000 7f6d68d01640 1 -- 172.21.15.72:0/2762118313 shutdown_connections 2023-12-13T00:01:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.496+0000 7f6d68d01640 1 --2- 172.21.15.72:0/2762118313 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f6d4406b240 0x7f6d4406d700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.496+0000 7f6d68d01640 1 --2- 172.21.15.72:0/2762118313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d64153470 0x7f6d641ef0b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.496+0000 7f6d68d01640 1 --2- 172.21.15.72:0/2762118313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d640c2ab0 0x7f6d640c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.496+0000 7f6d68d01640 1 --2- 172.21.15.72:0/2762118313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d6406aae0 0x7f6d641f2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.496+0000 7f6d68d01640 1 -- 172.21.15.72:0/2762118313 >> 172.21.15.72:0/2762118313 conn(0x7f6d640700e0 msgr2=0x7f6d640ca840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.496+0000 7f6d68d01640 1 -- 172.21.15.72:0/2762118313 shutdown_connections 2023-12-13T00:01:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.496+0000 7f6d68d01640 1 -- 172.21.15.72:0/2762118313 wait complete. 2023-12-13T00:01:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.496+0000 7f322d5c5640 1 Processor -- start 2023-12-13T00:01:12.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.496+0000 7f322d5c5640 1 -- start start 2023-12-13T00:01:12.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.497+0000 7fd08ffff640 1 --2- 172.21.15.72:0/1273269011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0900ccb60 0x7fd09015a8d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd08000c430 tx=0x7fd08000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.497+0000 7f322d5c5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f322806f1f0 0x7f3228153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.497+0000 7f322d5c5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32280c8370 0x7f32280c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.497+0000 7f322d5c5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3228153790 0x7f32281ef730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.497+0000 7f322d5c5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322814d780 con 0x7f322806f1f0 2023-12-13T00:01:12.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.497+0000 7f322d5c5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322814da40 con 0x7f3228153790 2023-12-13T00:01:12.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.497+0000 7f322d5c5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322814dd20 con 0x7f32280c8370 2023-12-13T00:01:12.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.497+0000 7fea8affd640 1 -- 172.21.15.72:0/4279954561 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9400ad30 con 0x7fea9c0cda70 2023-12-13T00:01:12.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.497+0000 7fea8affd640 1 -- 172.21.15.72:0/4279954561 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9401c640 con 0x7fea9c0cda70 2023-12-13T00:01:12.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.502+0000 7f32277fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3228153790 0x7f32281ef730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.503+0000 7f32277fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3228153790 0x7f32281ef730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:60300/0 (socket says 172.21.15.72:60300) 2023-12-13T00:01:12.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.503+0000 7f32277fe640 1 -- 172.21.15.72:0/332216532 learned_addr learned my addr 172.21.15.72:0/332216532 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:12.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509456 for osd.1 2023-12-13T00:01:12.509 DEBUG:teuthology.parallel:result is None 2023-12-13T00:01:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.509+0000 7f32277fe640 1 -- 172.21.15.72:0/332216532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32280c8370 msgr2=0x7f32280c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.509+0000 7f32277fe640 1 --2- 172.21.15.72:0/332216532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32280c8370 0x7f32280c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.509+0000 7f32277fe640 1 -- 172.21.15.72:0/332216532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f322806f1f0 msgr2=0x7f3228153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.509+0000 7f32277fe640 1 --2- 172.21.15.72:0/332216532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f322806f1f0 0x7f3228153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.509+0000 7f32277fe640 1 -- 172.21.15.72:0/332216532 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3218009400 con 0x7f3228153790 2023-12-13T00:01:12.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.511+0000 7f32277fe640 1 --2- 172.21.15.72:0/332216532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3228153790 0x7f32281ef730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f322000caa0 tx=0x7f322000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.515+0000 7f320f7fe640 1 -- 172.21.15.72:0/332216532 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322000ac00 con 0x7f3228153790 2023-12-13T00:01:12.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.515+0000 7f320f7fe640 1 -- 172.21.15.72:0/332216532 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322000ad60 con 0x7f3228153790 2023-12-13T00:01:12.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.515+0000 7f320f7fe640 1 -- 172.21.15.72:0/332216532 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220012620 con 0x7f3228153790 2023-12-13T00:01:12.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.515+0000 7f322d5c5640 1 -- 172.21.15.72:0/332216532 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322814e000 con 0x7f3228153790 2023-12-13T00:01:12.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.515+0000 7f322d5c5640 1 -- 172.21.15.72:0/332216532 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32281ef210 con 0x7f3228153790 2023-12-13T00:01:12.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.516+0000 7f322d5c5640 1 -- 172.21.15.72:0/332216532 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32281ef400 con 0x7f3228153790 2023-12-13T00:01:12.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.521+0000 7fd08cff9640 1 -- 172.21.15.72:0/1273269011 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080011790 con 0x7fd0900ccb60 2023-12-13T00:01:12.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.521+0000 7fd08cff9640 1 -- 172.21.15.72:0/1273269011 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0800118f0 con 0x7fd0900ccb60 2023-12-13T00:01:12.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.521+0000 7fd08cff9640 1 -- 172.21.15.72:0/1273269011 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080011ce0 con 0x7fd0900ccb60 2023-12-13T00:01:12.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.522+0000 7fd09634c640 1 -- 172.21.15.72:0/1273269011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0901ed200 con 0x7fd0900ccb60 2023-12-13T00:01:12.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.522+0000 7fd09634c640 1 -- 172.21.15.72:0/1273269011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0901ed7c0 con 0x7fd0900ccb60 2023-12-13T00:01:12.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.523+0000 7fd09634c640 1 -- 172.21.15.72:0/1273269011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0901ed9e0 con 0x7fd0900ccb60 2023-12-13T00:01:12.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.533+0000 7f320f7fe640 1 -- 172.21.15.72:0/332216532 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3220007070 con 0x7f3228153790 2023-12-13T00:01:12.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.534+0000 7f320f7fe640 1 --2- 172.21.15.72:0/332216532 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f321406b1c0 0x7f321406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.534+0000 7f3226ffd640 1 --2- 172.21.15.72:0/332216532 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f321406b1c0 0x7f321406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.534+0000 7f3226ffd640 1 --2- 172.21.15.72:0/332216532 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f321406b1c0 0x7f321406d680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3218036000 tx=0x7f321803b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.536+0000 7f320f7fe640 1 -- 172.21.15.72:0/332216532 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f3220058fa0 con 0x7f3228153790 2023-12-13T00:01:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.665+0000 7f811fe48640 1 -- 172.21.15.72:0/2564064002 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f81180c8400 con 0x7f8104003a30 2023-12-13T00:01:12.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.675+0000 7f447f209640 1 -- 172.21.15.72:0/1321153895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f44780c74d0 con 0x7f44780cda70 2023-12-13T00:01:12.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.683+0000 7fcf13989640 1 -- 172.21.15.72:0/3235289694 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcf0c0b4c20 con 0x7fcf0c0cda70 2023-12-13T00:01:12.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.753+0000 7fea8affd640 1 -- 172.21.15.72:0/4279954561 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fea94012400 con 0x7fea9c0cda70 2023-12-13T00:01:12.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.754+0000 7fea8affd640 1 --2- 172.21.15.72:0/4279954561 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fea7c06b1f0 0x7fea7c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.754+0000 7fea9a59c640 1 --2- 172.21.15.72:0/4279954561 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fea7c06b1f0 0x7fea7c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.754+0000 7fea9a59c640 1 --2- 172.21.15.72:0/4279954561 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fea7c06b1f0 0x7fea7c06d6b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea8c036000 tx=0x7fea8c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.759+0000 7fea8affd640 1 -- 172.21.15.72:0/4279954561 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fea94058b80 con 0x7fea9c0cda70 2023-12-13T00:01:12.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.771+0000 7fea8affd640 1 -- 172.21.15.72:0/4279954561 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fea94054ec0 con 0x7fea9c0cda70 2023-12-13T00:01:12.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.772+0000 7fcf01ffb640 1 -- 172.21.15.72:0/3235289694 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf0407af80 con 0x7fcf0c0cda70 2023-12-13T00:01:12.772 INFO:teuthology.orchestra.run.smithi072.stdout:60129542160 2023-12-13T00:01:12.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.774+0000 7fcf13989640 1 -- 172.21.15.72:0/3235289694 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fcef006b1f0 msgr2=0x7fcef006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.774+0000 7fcf13989640 1 --2- 172.21.15.72:0/3235289694 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fcef006b1f0 0x7fcef006d6b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcf08000f60 tx=0x7fcf08009040 comp rx=0 tx=0).stop 2023-12-13T00:01:12.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.774+0000 7fcf13989640 1 -- 172.21.15.72:0/3235289694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf0c0cda70 msgr2=0x7fcf0c1e5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.774+0000 7fcf13989640 1 --2- 172.21.15.72:0/3235289694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf0c0cda70 0x7fcf0c1e5c70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009e50 tx=0x7fcf04004a40 comp rx=0 tx=0).stop 2023-12-13T00:01:12.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.774+0000 7fcf13989640 1 -- 172.21.15.72:0/3235289694 shutdown_connections 2023-12-13T00:01:12.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.774+0000 7fcf13989640 1 --2- 172.21.15.72:0/3235289694 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fcef006b1f0 0x7fcef006d6b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.774+0000 7fcf13989640 1 --2- 172.21.15.72:0/3235289694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf0c0cda70 0x7fcf0c1e5c70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.774+0000 7fcf13989640 1 --2- 172.21.15.72:0/3235289694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf0c0cc420 0x7fcf0c159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.774+0000 7fcf13989640 1 --2- 172.21.15.72:0/3235289694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf0c0c9620 0x7fcf0c15a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.774+0000 7fcf13989640 1 -- 172.21.15.72:0/3235289694 >> 172.21.15.72:0/3235289694 conn(0x7fcf0c0b07b0 msgr2=0x7fcf0c0c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:12.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.774+0000 7fcf13989640 1 -- 172.21.15.72:0/3235289694 shutdown_connections 2023-12-13T00:01:12.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.774+0000 7fcf13989640 1 -- 172.21.15.72:0/3235289694 wait complete. 2023-12-13T00:01:12.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542160 for osd.0 2023-12-13T00:01:12.785 DEBUG:teuthology.parallel:result is None 2023-12-13T00:01:12.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.786+0000 7f810e7fc640 1 -- 172.21.15.72:0/2564064002 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f811404f070 con 0x7f8104003a30 2023-12-13T00:01:12.786 INFO:teuthology.orchestra.run.smithi072.stdout:64424509458 2023-12-13T00:01:12.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.787+0000 7f320f7fe640 1 -- 172.21.15.72:0/332216532 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3220054be0 con 0x7f3228153790 2023-12-13T00:01:12.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.788+0000 7f811fe48640 1 -- 172.21.15.72:0/2564064002 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f80fc06b1f0 msgr2=0x7f80fc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.788+0000 7f811fe48640 1 --2- 172.21.15.72:0/2564064002 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f80fc06b1f0 0x7f80fc06d6b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f81180c6f30 tx=0x7f8108007990 comp rx=0 tx=0).stop 2023-12-13T00:01:12.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.788+0000 7f811fe48640 1 -- 172.21.15.72:0/2564064002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8104003a30 msgr2=0x7f81180c2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.788+0000 7f811fe48640 1 --2- 172.21.15.72:0/2564064002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8104003a30 0x7f81180c2c50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f811400c280 tx=0x7f8114001950 comp rx=0 tx=0).stop 2023-12-13T00:01:12.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.788+0000 7f811fe48640 1 -- 172.21.15.72:0/2564064002 shutdown_connections 2023-12-13T00:01:12.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.788+0000 7f811fe48640 1 --2- 172.21.15.72:0/2564064002 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f80fc06b1f0 0x7f80fc06d6b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.788+0000 7f811fe48640 1 --2- 172.21.15.72:0/2564064002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81180cc5a0 0x7f8118149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.788+0000 7f811fe48640 1 --2- 172.21.15.72:0/2564064002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81180cb4c0 0x7f81181ec730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.788+0000 7f811fe48640 1 --2- 172.21.15.72:0/2564064002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8104003a30 0x7f81180c2c50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.788+0000 7f811fe48640 1 -- 172.21.15.72:0/2564064002 >> 172.21.15.72:0/2564064002 conn(0x7f81180707f0 msgr2=0x7f8118155040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:12.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.788+0000 7f811fe48640 1 -- 172.21.15.72:0/2564064002 shutdown_connections 2023-12-13T00:01:12.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.788+0000 7f811fe48640 1 -- 172.21.15.72:0/2564064002 wait complete. 2023-12-13T00:01:12.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.789+0000 7fd08cff9640 1 -- 172.21.15.72:0/1273269011 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd08001c460 con 0x7fd0900ccb60 2023-12-13T00:01:12.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.790+0000 7fd08cff9640 1 --2- 172.21.15.72:0/1273269011 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd07c06b1c0 0x7fd07c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:12.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.790+0000 7fd08f7fe640 1 --2- 172.21.15.72:0/1273269011 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd07c06b1c0 0x7fd07c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:12.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.790+0000 7fd08f7fe640 1 --2- 172.21.15.72:0/1273269011 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd07c06b1c0 0x7fd07c06d680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd0901e1490 tx=0x7fd084009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:12.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509458 for osd.4 2023-12-13T00:01:12.800 DEBUG:teuthology.parallel:result is None 2023-12-13T00:01:12.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.821+0000 7fd08cff9640 1 -- 172.21.15.72:0/1273269011 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fd080011e40 con 0x7fd0900ccb60 2023-12-13T00:01:12.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.822+0000 7fd08cff9640 1 -- 172.21.15.72:0/1273269011 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd080058c30 con 0x7fd0900ccb60 2023-12-13T00:01:12.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.944+0000 7f44757fa640 1 -- 172.21.15.72:0/1321153895 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f446007b8d0 con 0x7f44780cda70 2023-12-13T00:01:12.945 INFO:teuthology.orchestra.run.smithi072.stdout:55834574865 2023-12-13T00:01:12.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.947+0000 7f447f209640 1 -- 172.21.15.72:0/1321153895 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f445806b1c0 msgr2=0x7f445806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.947+0000 7f447f209640 1 --2- 172.21.15.72:0/1321153895 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f445806b1c0 0x7f445806d680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4470000f60 tx=0x7f44700079b0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.947+0000 7f447f209640 1 -- 172.21.15.72:0/1321153895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44780cda70 msgr2=0x7f44781efbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.947+0000 7f447f209640 1 --2- 172.21.15.72:0/1321153895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44780cda70 0x7f44781efbd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f446002ba70 tx=0x7f4460004730 comp rx=0 tx=0).stop 2023-12-13T00:01:12.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.947+0000 7f447f209640 1 -- 172.21.15.72:0/1321153895 shutdown_connections 2023-12-13T00:01:12.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.947+0000 7f447f209640 1 --2- 172.21.15.72:0/1321153895 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f445806b1c0 0x7f445806d680 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.947+0000 7f447f209640 1 --2- 172.21.15.72:0/1321153895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44780cda70 0x7f44781efbd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.947+0000 7f447f209640 1 --2- 172.21.15.72:0/1321153895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44780cc420 0x7f44780aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.947+0000 7f447f209640 1 --2- 172.21.15.72:0/1321153895 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44780c9620 0x7f44780ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.947+0000 7f447f209640 1 -- 172.21.15.72:0/1321153895 >> 172.21.15.72:0/1321153895 conn(0x7f44780b07b0 msgr2=0x7f44780afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:12.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.948+0000 7f447f209640 1 -- 172.21.15.72:0/1321153895 shutdown_connections 2023-12-13T00:01:12.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.948+0000 7f447f209640 1 -- 172.21.15.72:0/1321153895 wait complete. 2023-12-13T00:01:12.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574864 got 55834574865 for osd.5 2023-12-13T00:01:12.963 DEBUG:teuthology.parallel:result is None 2023-12-13T00:01:12.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.976+0000 7f322d5c5640 1 -- 172.21.15.72:0/332216532 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3228073dc0 con 0x7f3228153790 2023-12-13T00:01:12.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.980+0000 7f320f7fe640 1 -- 172.21.15.72:0/332216532 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3220017090 con 0x7f3228153790 2023-12-13T00:01:12.980 INFO:teuthology.orchestra.run.smithi072.stdout:64424509457 2023-12-13T00:01:12.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.982+0000 7f322d5c5640 1 -- 172.21.15.72:0/332216532 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f321406b1c0 msgr2=0x7f321406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.982+0000 7f322d5c5640 1 --2- 172.21.15.72:0/332216532 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f321406b1c0 0x7f321406d680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3218036000 tx=0x7f321803b040 comp rx=0 tx=0).stop 2023-12-13T00:01:12.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.982+0000 7f322d5c5640 1 -- 172.21.15.72:0/332216532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3228153790 msgr2=0x7f32281ef730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:12.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.982+0000 7f322d5c5640 1 --2- 172.21.15.72:0/332216532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3228153790 0x7f32281ef730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f322000caa0 tx=0x7f322000cf60 comp rx=0 tx=0).stop 2023-12-13T00:01:12.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.982+0000 7f322d5c5640 1 -- 172.21.15.72:0/332216532 shutdown_connections 2023-12-13T00:01:12.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.982+0000 7f322d5c5640 1 --2- 172.21.15.72:0/332216532 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f321406b1c0 0x7f321406d680 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.982+0000 7f322d5c5640 1 --2- 172.21.15.72:0/332216532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3228153790 0x7f32281ef730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.982+0000 7f322d5c5640 1 --2- 172.21.15.72:0/332216532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32280c8370 0x7f32280c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.982+0000 7f322d5c5640 1 --2- 172.21.15.72:0/332216532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f322806f1f0 0x7f3228153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:12.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.982+0000 7f322d5c5640 1 -- 172.21.15.72:0/332216532 >> 172.21.15.72:0/332216532 conn(0x7f322806b5c0 msgr2=0x7f322806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:12.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.982+0000 7f322d5c5640 1 -- 172.21.15.72:0/332216532 shutdown_connections 2023-12-13T00:01:12.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.982+0000 7f322d5c5640 1 -- 172.21.15.72:0/332216532 wait complete. 2023-12-13T00:01:12.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509457 got 64424509457 for osd.7 2023-12-13T00:01:12.993 DEBUG:teuthology.parallel:result is None 2023-12-13T00:01:12.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:12.998+0000 7feaa0f39640 1 -- 172.21.15.72:0/4279954561 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fea9c1f2b10 con 0x7fea9c0cda70 2023-12-13T00:01:13.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.002+0000 7fea8affd640 1 -- 172.21.15.72:0/4279954561 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea9c1f2b10 con 0x7fea9c0cda70 2023-12-13T00:01:13.002 INFO:teuthology.orchestra.run.smithi072.stdout:64424509458 2023-12-13T00:01:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.004+0000 7feaa0f39640 1 -- 172.21.15.72:0/4279954561 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fea7c06b1f0 msgr2=0x7fea7c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.004+0000 7feaa0f39640 1 --2- 172.21.15.72:0/4279954561 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fea7c06b1f0 0x7fea7c06d6b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea8c036000 tx=0x7fea8c03c040 comp rx=0 tx=0).stop 2023-12-13T00:01:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.004+0000 7feaa0f39640 1 -- 172.21.15.72:0/4279954561 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea9c0cda70 msgr2=0x7fea9c1ef120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.004+0000 7feaa0f39640 1 --2- 172.21.15.72:0/4279954561 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea9c0cda70 0x7fea9c1ef120 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fea9400ca70 tx=0x7fea9400cf30 comp rx=0 tx=0).stop 2023-12-13T00:01:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.004+0000 7feaa0f39640 1 -- 172.21.15.72:0/4279954561 shutdown_connections 2023-12-13T00:01:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.004+0000 7feaa0f39640 1 --2- 172.21.15.72:0/4279954561 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fea7c06b1f0 0x7fea7c06d6b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.004+0000 7feaa0f39640 1 --2- 172.21.15.72:0/4279954561 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea9c0cda70 0x7fea9c1ef120 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.004+0000 7feaa0f39640 1 --2- 172.21.15.72:0/4279954561 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea9c0cc420 0x7fea9c1f0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.004+0000 7feaa0f39640 1 --2- 172.21.15.72:0/4279954561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea9c0c9620 0x7fea9c1585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.004+0000 7feaa0f39640 1 -- 172.21.15.72:0/4279954561 >> 172.21.15.72:0/4279954561 conn(0x7fea9c0b07b0 msgr2=0x7fea9c0c7060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.004+0000 7feaa0f39640 1 -- 172.21.15.72:0/4279954561 shutdown_connections 2023-12-13T00:01:13.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.004+0000 7feaa0f39640 1 -- 172.21.15.72:0/4279954561 wait complete. 2023-12-13T00:01:13.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509458 for osd.3 2023-12-13T00:01:13.015 DEBUG:teuthology.parallel:result is None 2023-12-13T00:01:13.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.032+0000 7fd09634c640 1 -- 172.21.15.72:0/1273269011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd090067470 con 0x7fd0900ccb60 2023-12-13T00:01:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.036+0000 7fd08cff9640 1 -- 172.21.15.72:0/1273269011 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd0800587c0 con 0x7fd0900ccb60 2023-12-13T00:01:13.037 INFO:teuthology.orchestra.run.smithi072.stdout:64424509456 2023-12-13T00:01:13.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.038+0000 7fd09634c640 1 -- 172.21.15.72:0/1273269011 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd07c06b1c0 msgr2=0x7fd07c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:13.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.038+0000 7fd09634c640 1 --2- 172.21.15.72:0/1273269011 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd07c06b1c0 0x7fd07c06d680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd0901e1490 tx=0x7fd084009040 comp rx=0 tx=0).stop 2023-12-13T00:01:13.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.038+0000 7fd09634c640 1 -- 172.21.15.72:0/1273269011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0900ccb60 msgr2=0x7fd09015a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:13.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.038+0000 7fd09634c640 1 --2- 172.21.15.72:0/1273269011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0900ccb60 0x7fd09015a8d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd08000c430 tx=0x7fd08000c8f0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.038+0000 7fd09634c640 1 -- 172.21.15.72:0/1273269011 shutdown_connections 2023-12-13T00:01:13.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.038+0000 7fd09634c640 1 --2- 172.21.15.72:0/1273269011 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd07c06b1c0 0x7fd07c06d680 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.038+0000 7fd09634c640 1 --2- 172.21.15.72:0/1273269011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd090157a40 0x7fd0901584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.038+0000 7fd09634c640 1 --2- 172.21.15.72:0/1273269011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0901514a0 0x7fd09014ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.038+0000 7fd09634c640 1 --2- 172.21.15.72:0/1273269011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0900ccb60 0x7fd09015a8d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.038+0000 7fd09634c640 1 -- 172.21.15.72:0/1273269011 >> 172.21.15.72:0/1273269011 conn(0x7fd090070790 msgr2=0x7fd0900c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:13.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.038+0000 7fd09634c640 1 -- 172.21.15.72:0/1273269011 shutdown_connections 2023-12-13T00:01:13.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.038+0000 7fd09634c640 1 -- 172.21.15.72:0/1273269011 wait complete. 2023-12-13T00:01:13.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509456 for osd.6 2023-12-13T00:01:13.050 DEBUG:teuthology.parallel:result is None 2023-12-13T00:01:13.050 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-13T00:01:13.050 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T00:01:13.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.190+0000 7f7091856640 1 Processor -- start 2023-12-13T00:01:13.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.190+0000 7f7091856640 1 -- start start 2023-12-13T00:01:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.190+0000 7f7091856640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f708c0cda70 0x7f708c0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.190+0000 7f7091856640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f708c0c9620 0x7f708c0c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.190+0000 7f7091856640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f708c0cbda0 con 0x7f708c0cc420 2023-12-13T00:01:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.190+0000 7f7091856640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708c0cc230 con 0x7f708c0c9620 2023-12-13T00:01:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.190+0000 7f7091856640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708c0cb4e0 con 0x7f708c0cda70 2023-12-13T00:01:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.191+0000 7f708b7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f708c0c9620 0x7f708c0c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.191+0000 7f708b7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f708c0c9620 0x7f708c0c9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35894/0 (socket says 172.21.15.72:35894) 2023-12-13T00:01:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.191+0000 7f708b7fe640 1 -- 172.21.15.72:0/2301538022 learned_addr learned my addr 172.21.15.72:0/2301538022 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.191+0000 7f708affd640 1 --2- 172.21.15.72:0/2301538022 >> v2:172.21.15.176:3300/0 conn(0x7f708c0cda70 0x7f708c0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:13.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.194+0000 7f708b7fe640 1 -- 172.21.15.72:0/2301538022 >> v2:172.21.15.176:3300/0 conn(0x7f708c0cda70 msgr2=0x7f708c0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:13.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.194+0000 7f708b7fe640 1 --2- 172.21.15.72:0/2301538022 >> v2:172.21.15.176:3300/0 conn(0x7f708c0cda70 0x7f708c0ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.194+0000 7f708b7fe640 1 -- 172.21.15.72:0/2301538022 >> v1:172.21.15.176:6789/0 conn(0x7f708c0cc420 legacy=0x7f708c159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:13.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.194+0000 7f708b7fe640 1 -- 172.21.15.72:0/2301538022 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c0cce00 con 0x7f708c0c9620 2023-12-13T00:01:13.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.195+0000 7f708b7fe640 1 --2- 172.21.15.72:0/2301538022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c0c9620 0x7f708c0c9a50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f708c072a20 tx=0x7f708402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1392b241b99fa2cf server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:13.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.200+0000 7f7089ffb640 1 -- 172.21.15.72:0/2301538022 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708402cbb0 con 0x7f708c0c9620 2023-12-13T00:01:13.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.200+0000 7f7089ffb640 1 -- 172.21.15.72:0/2301538022 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708402cd10 con 0x7f708c0c9620 2023-12-13T00:01:13.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.200+0000 7f7089ffb640 1 -- 172.21.15.72:0/2301538022 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7084034610 con 0x7f708c0c9620 2023-12-13T00:01:13.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.200+0000 7f7091856640 1 -- 172.21.15.72:0/2301538022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c0c9620 msgr2=0x7f708c0c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:13.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.200+0000 7f7091856640 1 --2- 172.21.15.72:0/2301538022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c0c9620 0x7f708c0c9a50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f708c072a20 tx=0x7f708402c010 comp rx=0 tx=0).stop 2023-12-13T00:01:13.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.200+0000 7f7091856640 1 -- 172.21.15.72:0/2301538022 shutdown_connections 2023-12-13T00:01:13.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.200+0000 7f7091856640 1 --2- 172.21.15.72:0/2301538022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c0c9620 0x7f708c0c9a50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.200+0000 7f7091856640 1 --2- 172.21.15.72:0/2301538022 >> v2:172.21.15.176:3300/0 conn(0x7f708c0cda70 0x7f708c0ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.200+0000 7f7091856640 1 -- 172.21.15.72:0/2301538022 >> 172.21.15.72:0/2301538022 conn(0x7f708c0b07b0 msgr2=0x7f708c0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:13.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.200+0000 7f7091856640 1 -- 172.21.15.72:0/2301538022 shutdown_connections 2023-12-13T00:01:13.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.200+0000 7f7091856640 1 -- 172.21.15.72:0/2301538022 wait complete. 2023-12-13T00:01:13.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.201+0000 7f7091856640 1 Processor -- start 2023-12-13T00:01:13.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.201+0000 7f7091856640 1 -- start start 2023-12-13T00:01:13.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.202+0000 7f7091856640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f708c0c9620 0x7f708c0c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:13.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.202+0000 7f7091856640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c0cc420 0x7f708c0aa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:13.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.202+0000 7f7091856640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f708c0cda70 0x7f708c0aabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:13.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.202+0000 7f7091856640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c1eff00 con 0x7f708c0cc420 2023-12-13T00:01:13.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.202+0000 7f7091856640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c0ac3e0 con 0x7f708c0c9620 2023-12-13T00:01:13.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.202+0000 7f7091856640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708c1ef0a0 con 0x7f708c0cda70 2023-12-13T00:01:13.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.202+0000 7f708a7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c0cc420 0x7f708c0aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:13.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.202+0000 7f708a7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c0cc420 0x7f708c0aa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35902/0 (socket says 172.21.15.72:35902) 2023-12-13T00:01:13.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.202+0000 7f708a7fc640 1 -- 172.21.15.72:0/2317038142 learned_addr learned my addr 172.21.15.72:0/2317038142 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:13.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.202+0000 7f708affd640 1 --2- 172.21.15.72:0/2317038142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f708c0c9620 0x7f708c0c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:13.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.203+0000 7f708b7fe640 1 --2- 172.21.15.72:0/2317038142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f708c0cda70 0x7f708c0aabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:13.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.206+0000 7f708a7fc640 1 -- 172.21.15.72:0/2317038142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f708c0cda70 msgr2=0x7f708c0aabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:13.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.206+0000 7f708a7fc640 1 --2- 172.21.15.72:0/2317038142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f708c0cda70 0x7f708c0aabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.206+0000 7f708a7fc640 1 -- 172.21.15.72:0/2317038142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f708c0c9620 msgr2=0x7f708c0c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:13.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.206+0000 7f708a7fc640 1 --2- 172.21.15.72:0/2317038142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f708c0c9620 0x7f708c0c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.206+0000 7f708a7fc640 1 -- 172.21.15.72:0/2317038142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7084009b30 con 0x7f708c0cc420 2023-12-13T00:01:13.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.208+0000 7f708a7fc640 1 --2- 172.21.15.72:0/2317038142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c0cc420 0x7f708c0aa680 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f708000c440 tx=0x7f7080001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:13.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.210+0000 7f7073fff640 1 -- 172.21.15.72:0/2317038142 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70800052d0 con 0x7f708c0cc420 2023-12-13T00:01:13.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.211+0000 7f7091856640 1 -- 172.21.15.72:0/2317038142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f708c1ef380 con 0x7f708c0cc420 2023-12-13T00:01:13.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.211+0000 7f7091856640 1 -- 172.21.15.72:0/2317038142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708c1ef940 con 0x7f708c0cc420 2023-12-13T00:01:13.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.212+0000 7f7091856640 1 -- 172.21.15.72:0/2317038142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708c067470 con 0x7f708c0cc420 2023-12-13T00:01:13.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.212+0000 7f7073fff640 1 -- 172.21.15.72:0/2317038142 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7080001120 con 0x7f708c0cc420 2023-12-13T00:01:13.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.212+0000 7f7073fff640 1 -- 172.21.15.72:0/2317038142 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7080007020 con 0x7f708c0cc420 2023-12-13T00:01:13.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.451+0000 7f7073fff640 1 -- 172.21.15.72:0/2317038142 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7080007180 con 0x7f708c0cc420 2023-12-13T00:01:13.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.451+0000 7f7073fff640 1 --2- 172.21.15.72:0/2317038142 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f707806b1c0 0x7f707806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:13.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.451+0000 7f708affd640 1 --2- 172.21.15.72:0/2317038142 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f707806b1c0 0x7f707806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:13.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.452+0000 7f708affd640 1 --2- 172.21.15.72:0/2317038142 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f707806b1c0 0x7f707806d680 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f707c009aa0 tx=0x7f707c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:13.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.463+0000 7f7073fff640 1 -- 172.21.15.72:0/2317038142 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f7080058080 con 0x7f708c0cc420 2023-12-13T00:01:13.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.463+0000 7f7073fff640 1 -- 172.21.15.72:0/2317038142 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f70800543c0 con 0x7f708c0cc420 2023-12-13T00:01:13.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.629+0000 7f7091856640 1 -- 172.21.15.72:0/2317038142 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f708c0cba30 con 0x7f707806b1c0 2023-12-13T00:01:13.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.637+0000 7f7073fff640 1 -- 172.21.15.72:0/2317038142 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361170 (secure 0 0 0) 0x7f707c011a00 con 0x7f707806b1c0 2023-12-13T00:01:13.642 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:01:13.644 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-12-13T00:01:13.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.641+0000 7f7091856640 1 -- 172.21.15.72:0/2317038142 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f707806b1c0 msgr2=0x7f707806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:13.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.641+0000 7f7091856640 1 --2- 172.21.15.72:0/2317038142 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f707806b1c0 0x7f707806d680 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f707c009aa0 tx=0x7f707c009190 comp rx=0 tx=0).stop 2023-12-13T00:01:13.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.641+0000 7f7091856640 1 -- 172.21.15.72:0/2317038142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c0cc420 msgr2=0x7f708c0aa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:13.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.641+0000 7f7091856640 1 --2- 172.21.15.72:0/2317038142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c0cc420 0x7f708c0aa680 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f708000c440 tx=0x7f7080001e70 comp rx=0 tx=0).stop 2023-12-13T00:01:13.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.641+0000 7f7091856640 1 -- 172.21.15.72:0/2317038142 shutdown_connections 2023-12-13T00:01:13.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.641+0000 7f7091856640 1 --2- 172.21.15.72:0/2317038142 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f707806b1c0 0x7f707806d680 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.641+0000 7f7091856640 1 --2- 172.21.15.72:0/2317038142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f708c0cda70 0x7f708c0aabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.641+0000 7f7091856640 1 --2- 172.21.15.72:0/2317038142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c0cc420 0x7f708c0aa680 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.641+0000 7f7091856640 1 --2- 172.21.15.72:0/2317038142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f708c0c9620 0x7f708c0c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.641+0000 7f7091856640 1 -- 172.21.15.72:0/2317038142 >> 172.21.15.72:0/2317038142 conn(0x7f708c0b07b0 msgr2=0x7f708c0aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:13.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.641+0000 7f7091856640 1 -- 172.21.15.72:0/2317038142 shutdown_connections 2023-12-13T00:01:13.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.641+0000 7f7091856640 1 -- 172.21.15.72:0/2317038142 wait complete. 2023-12-13T00:01:13.652 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-12-13T00:01:12.535027+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597819,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":287,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219656,"kb_used_data":3528,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755064,"statfs":{"total":773094113280,"available":772869185536,"internally_reserved":0,"allocated":3612672,"data_stored":2119430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2812,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.998536"},"pg_stats":[{"pgid":"2.1f","version":"27'9","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.447285+0000","last_change":"2023-12-13T00:00:29.997631+0000","last_active":"2023-12-13T00:01:06.447285+0000","last_peered":"2023-12-13T00:01:06.447285+0000","last_clean":"2023-12-13T00:01:06.447285+0000","last_became_active":"2023-12-13T00:00:29.997381+0000","last_became_peered":"2023-12-13T00:00:29.997381+0000","last_unstale":"2023-12-13T00:01:06.447285+0000","last_undegraded":"2023-12-13T00:01:06.447285+0000","last_fullsized":"2023-12-13T00:01:06.447285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:33:37.976462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465727+0000","last_change":"2023-12-13T00:00:31.138533+0000","last_active":"2023-12-13T00:00:59.465727+0000","last_peered":"2023-12-13T00:00:59.465727+0000","last_clean":"2023-12-13T00:00:59.465727+0000","last_became_active":"2023-12-13T00:00:31.138242+0000","last_became_peered":"2023-12-13T00:00:31.138242+0000","last_unstale":"2023-12-13T00:00:59.465727+0000","last_undegraded":"2023-12-13T00:00:59.465727+0000","last_fullsized":"2023-12-13T00:00:59.465727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:39:59.955103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461340+0000","last_change":"2023-12-13T00:00:35.667840+0000","last_active":"2023-12-13T00:00:59.461340+0000","last_peered":"2023-12-13T00:00:59.461340+0000","last_clean":"2023-12-13T00:00:59.461340+0000","last_became_active":"2023-12-13T00:00:35.667498+0000","last_became_peered":"2023-12-13T00:00:35.667498+0000","last_unstale":"2023-12-13T00:00:59.461340+0000","last_undegraded":"2023-12-13T00:00:59.461340+0000","last_fullsized":"2023-12-13T00:00:59.461340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:17.304722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.531812+0000","last_change":"2023-12-13T00:00:30.001888+0000","last_active":"2023-12-13T00:01:00.531812+0000","last_peered":"2023-12-13T00:01:00.531812+0000","last_clean":"2023-12-13T00:01:00.531812+0000","last_became_active":"2023-12-13T00:00:30.001628+0000","last_became_peered":"2023-12-13T00:00:30.001628+0000","last_unstale":"2023-12-13T00:01:00.531812+0000","last_undegraded":"2023-12-13T00:01:00.531812+0000","last_fullsized":"2023-12-13T00:01:00.531812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:48:30.422214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465657+0000","last_change":"2023-12-13T00:00:31.036420+0000","last_active":"2023-12-13T00:00:59.465657+0000","last_peered":"2023-12-13T00:00:59.465657+0000","last_clean":"2023-12-13T00:00:59.465657+0000","last_became_active":"2023-12-13T00:00:31.036197+0000","last_became_peered":"2023-12-13T00:00:31.036197+0000","last_unstale":"2023-12-13T00:00:59.465657+0000","last_undegraded":"2023-12-13T00:00:59.465657+0000","last_fullsized":"2023-12-13T00:00:59.465657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:05:56.876593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461830+0000","last_change":"2023-12-13T00:00:35.665348+0000","last_active":"2023-12-13T00:00:59.461830+0000","last_peered":"2023-12-13T00:00:59.461830+0000","last_clean":"2023-12-13T00:00:59.461830+0000","last_became_active":"2023-12-13T00:00:35.664981+0000","last_became_peered":"2023-12-13T00:00:35.664981+0000","last_unstale":"2023-12-13T00:00:59.461830+0000","last_undegraded":"2023-12-13T00:00:59.461830+0000","last_fullsized":"2023-12-13T00:00:59.461830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:55.759392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.522665+0000","last_change":"2023-12-13T00:00:30.009983+0000","last_active":"2023-12-13T00:01:06.522665+0000","last_peered":"2023-12-13T00:01:06.522665+0000","last_clean":"2023-12-13T00:01:06.522665+0000","last_became_active":"2023-12-13T00:00:30.009724+0000","last_became_peered":"2023-12-13T00:00:30.009724+0000","last_unstale":"2023-12-13T00:01:06.522665+0000","last_undegraded":"2023-12-13T00:01:06.522665+0000","last_fullsized":"2023-12-13T00:01:06.522665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:20:28.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456667+0000","last_change":"2023-12-13T00:00:31.151042+0000","last_active":"2023-12-13T00:00:59.456667+0000","last_peered":"2023-12-13T00:00:59.456667+0000","last_clean":"2023-12-13T00:00:59.456667+0000","last_became_active":"2023-12-13T00:00:31.150735+0000","last_became_peered":"2023-12-13T00:00:31.150735+0000","last_unstale":"2023-12-13T00:00:59.456667+0000","last_undegraded":"2023-12-13T00:00:59.456667+0000","last_fullsized":"2023-12-13T00:00:59.456667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:36.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462064+0000","last_change":"2023-12-13T00:00:35.668759+0000","last_active":"2023-12-13T00:00:59.462064+0000","last_peered":"2023-12-13T00:00:59.462064+0000","last_clean":"2023-12-13T00:00:59.462064+0000","last_became_active":"2023-12-13T00:00:35.668361+0000","last_became_peered":"2023-12-13T00:00:35.668361+0000","last_unstale":"2023-12-13T00:00:59.462064+0000","last_undegraded":"2023-12-13T00:00:59.462064+0000","last_fullsized":"2023-12-13T00:00:59.462064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:05.770014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461073+0000","last_change":"2023-12-13T00:00:30.009921+0000","last_active":"2023-12-13T00:00:59.461073+0000","last_peered":"2023-12-13T00:00:59.461073+0000","last_clean":"2023-12-13T00:00:59.461073+0000","last_became_active":"2023-12-13T00:00:30.009644+0000","last_became_peered":"2023-12-13T00:00:30.009644+0000","last_unstale":"2023-12-13T00:00:59.461073+0000","last_undegraded":"2023-12-13T00:00:59.461073+0000","last_fullsized":"2023-12-13T00:00:59.461073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:48:30.422214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457963+0000","last_change":"2023-12-13T00:00:31.146801+0000","last_active":"2023-12-13T00:00:59.457963+0000","last_peered":"2023-12-13T00:00:59.457963+0000","last_clean":"2023-12-13T00:00:59.457963+0000","last_became_active":"2023-12-13T00:00:31.146516+0000","last_became_peered":"2023-12-13T00:00:31.146516+0000","last_unstale":"2023-12-13T00:00:59.457963+0000","last_undegraded":"2023-12-13T00:00:59.457963+0000","last_fullsized":"2023-12-13T00:00:59.457963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:44:23.442162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461875+0000","last_change":"2023-12-13T00:00:35.668621+0000","last_active":"2023-12-13T00:00:59.461875+0000","last_peered":"2023-12-13T00:00:59.461875+0000","last_clean":"2023-12-13T00:00:59.461875+0000","last_became_active":"2023-12-13T00:00:35.668298+0000","last_became_peered":"2023-12-13T00:00:35.668298+0000","last_unstale":"2023-12-13T00:00:59.461875+0000","last_undegraded":"2023-12-13T00:00:59.461875+0000","last_fullsized":"2023-12-13T00:00:59.461875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:40:04.506084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457767+0000","last_change":"2023-12-13T00:00:31.036347+0000","last_active":"2023-12-13T00:00:59.457767+0000","last_peered":"2023-12-13T00:00:59.457767+0000","last_clean":"2023-12-13T00:00:59.457767+0000","last_became_active":"2023-12-13T00:00:31.036062+0000","last_became_peered":"2023-12-13T00:00:31.036062+0000","last_unstale":"2023-12-13T00:00:59.457767+0000","last_undegraded":"2023-12-13T00:00:59.457767+0000","last_fullsized":"2023-12-13T00:00:59.457767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:15:29.783257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:03.925024+0000","last_change":"2023-12-13T00:00:30.001066+0000","last_active":"2023-12-13T00:01:03.925024+0000","last_peered":"2023-12-13T00:01:03.925024+0000","last_clean":"2023-12-13T00:01:03.925024+0000","last_became_active":"2023-12-13T00:00:30.000782+0000","last_became_peered":"2023-12-13T00:00:30.000782+0000","last_unstale":"2023-12-13T00:01:03.925024+0000","last_undegraded":"2023-12-13T00:01:03.925024+0000","last_fullsized":"2023-12-13T00:01:03.925024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:53.977921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457740+0000","last_change":"2023-12-13T00:00:35.662038+0000","last_active":"2023-12-13T00:00:59.457740+0000","last_peered":"2023-12-13T00:00:59.457740+0000","last_clean":"2023-12-13T00:00:59.457740+0000","last_became_active":"2023-12-13T00:00:35.661458+0000","last_became_peered":"2023-12-13T00:00:35.661458+0000","last_unstale":"2023-12-13T00:00:59.457740+0000","last_undegraded":"2023-12-13T00:00:59.457740+0000","last_fullsized":"2023-12-13T00:00:59.457740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:12:27.307277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462675+0000","last_change":"2023-12-13T00:00:31.119718+0000","last_active":"2023-12-13T00:00:59.462675+0000","last_peered":"2023-12-13T00:00:59.462675+0000","last_clean":"2023-12-13T00:00:59.462675+0000","last_became_active":"2023-12-13T00:00:31.119447+0000","last_became_peered":"2023-12-13T00:00:31.119447+0000","last_unstale":"2023-12-13T00:00:59.462675+0000","last_undegraded":"2023-12-13T00:00:59.462675+0000","last_fullsized":"2023-12-13T00:00:59.462675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:08.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.539985+0000","last_change":"2023-12-13T00:00:29.968425+0000","last_active":"2023-12-13T00:01:00.539985+0000","last_peered":"2023-12-13T00:01:00.539985+0000","last_clean":"2023-12-13T00:01:00.539985+0000","last_became_active":"2023-12-13T00:00:29.967929+0000","last_became_peered":"2023-12-13T00:00:29.967929+0000","last_unstale":"2023-12-13T00:01:00.539985+0000","last_undegraded":"2023-12-13T00:01:00.539985+0000","last_fullsized":"2023-12-13T00:01:00.539985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:53.977921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460657+0000","last_change":"2023-12-13T00:00:35.662848+0000","last_active":"2023-12-13T00:00:59.460657+0000","last_peered":"2023-12-13T00:00:59.460657+0000","last_clean":"2023-12-13T00:00:59.460657+0000","last_became_active":"2023-12-13T00:00:35.662469+0000","last_became_peered":"2023-12-13T00:00:35.662469+0000","last_unstale":"2023-12-13T00:00:59.460657+0000","last_undegraded":"2023-12-13T00:00:59.460657+0000","last_fullsized":"2023-12-13T00:00:59.460657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:17:20.456996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461523+0000","last_change":"2023-12-13T00:00:31.143108+0000","last_active":"2023-12-13T00:00:59.461523+0000","last_peered":"2023-12-13T00:00:59.461523+0000","last_clean":"2023-12-13T00:00:59.461523+0000","last_became_active":"2023-12-13T00:00:31.142847+0000","last_became_peered":"2023-12-13T00:00:31.142847+0000","last_unstale":"2023-12-13T00:00:59.461523+0000","last_undegraded":"2023-12-13T00:00:59.461523+0000","last_fullsized":"2023-12-13T00:00:59.461523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:20.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:03.924526+0000","last_change":"2023-12-13T00:00:30.004483+0000","last_active":"2023-12-13T00:01:03.924526+0000","last_peered":"2023-12-13T00:01:03.924526+0000","last_clean":"2023-12-13T00:01:03.924526+0000","last_became_active":"2023-12-13T00:00:30.004195+0000","last_became_peered":"2023-12-13T00:00:30.004195+0000","last_unstale":"2023-12-13T00:01:03.924526+0000","last_undegraded":"2023-12-13T00:01:03.924526+0000","last_fullsized":"2023-12-13T00:01:03.924526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:35.192132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462443+0000","last_change":"2023-12-13T00:00:35.660024+0000","last_active":"2023-12-13T00:00:59.462443+0000","last_peered":"2023-12-13T00:00:59.462443+0000","last_clean":"2023-12-13T00:00:59.462443+0000","last_became_active":"2023-12-13T00:00:35.659637+0000","last_became_peered":"2023-12-13T00:00:35.659637+0000","last_unstale":"2023-12-13T00:00:59.462443+0000","last_undegraded":"2023-12-13T00:00:59.462443+0000","last_fullsized":"2023-12-13T00:00:59.462443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:19.752973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457668+0000","last_change":"2023-12-13T00:00:31.143938+0000","last_active":"2023-12-13T00:00:59.457668+0000","last_peered":"2023-12-13T00:00:59.457668+0000","last_clean":"2023-12-13T00:00:59.457668+0000","last_became_active":"2023-12-13T00:00:31.143673+0000","last_became_peered":"2023-12-13T00:00:31.143673+0000","last_unstale":"2023-12-13T00:00:59.457668+0000","last_undegraded":"2023-12-13T00:00:59.457668+0000","last_fullsized":"2023-12-13T00:00:59.457668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:56:04.585998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:04.028525+0000","last_change":"2023-12-13T00:00:30.005987+0000","last_active":"2023-12-13T00:01:04.028525+0000","last_peered":"2023-12-13T00:01:04.028525+0000","last_clean":"2023-12-13T00:01:04.028525+0000","last_became_active":"2023-12-13T00:00:30.005740+0000","last_became_peered":"2023-12-13T00:00:30.005740+0000","last_unstale":"2023-12-13T00:01:04.028525+0000","last_undegraded":"2023-12-13T00:01:04.028525+0000","last_fullsized":"2023-12-13T00:01:04.028525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:03:55.109283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462647+0000","last_change":"2023-12-13T00:00:35.666041+0000","last_active":"2023-12-13T00:00:59.462647+0000","last_peered":"2023-12-13T00:00:59.462647+0000","last_clean":"2023-12-13T00:00:59.462647+0000","last_became_active":"2023-12-13T00:00:35.665670+0000","last_became_peered":"2023-12-13T00:00:35.665670+0000","last_unstale":"2023-12-13T00:00:59.462647+0000","last_undegraded":"2023-12-13T00:00:59.462647+0000","last_fullsized":"2023-12-13T00:00:59.462647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:10.984025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462081+0000","last_change":"2023-12-13T00:00:31.146677+0000","last_active":"2023-12-13T00:00:59.462081+0000","last_peered":"2023-12-13T00:00:59.462081+0000","last_clean":"2023-12-13T00:00:59.462081+0000","last_became_active":"2023-12-13T00:00:31.146435+0000","last_became_peered":"2023-12-13T00:00:31.146435+0000","last_unstale":"2023-12-13T00:00:59.462081+0000","last_undegraded":"2023-12-13T00:00:59.462081+0000","last_fullsized":"2023-12-13T00:00:59.462081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:32:52.059012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:03.923794+0000","last_change":"2023-12-13T00:00:30.006240+0000","last_active":"2023-12-13T00:01:03.923794+0000","last_peered":"2023-12-13T00:01:03.923794+0000","last_clean":"2023-12-13T00:01:03.923794+0000","last_became_active":"2023-12-13T00:00:30.005909+0000","last_became_peered":"2023-12-13T00:00:30.005909+0000","last_unstale":"2023-12-13T00:01:03.923794+0000","last_undegraded":"2023-12-13T00:01:03.923794+0000","last_fullsized":"2023-12-13T00:01:03.923794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:59:20.687032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462982+0000","last_change":"2023-12-13T00:00:35.665918+0000","last_active":"2023-12-13T00:00:59.462982+0000","last_peered":"2023-12-13T00:00:59.462982+0000","last_clean":"2023-12-13T00:00:59.462982+0000","last_became_active":"2023-12-13T00:00:35.665521+0000","last_became_peered":"2023-12-13T00:00:35.665521+0000","last_unstale":"2023-12-13T00:00:59.462982+0000","last_undegraded":"2023-12-13T00:00:59.462982+0000","last_fullsized":"2023-12-13T00:00:59.462982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:05.461575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462472+0000","last_change":"2023-12-13T00:00:31.145392+0000","last_active":"2023-12-13T00:00:59.462472+0000","last_peered":"2023-12-13T00:00:59.462472+0000","last_clean":"2023-12-13T00:00:59.462472+0000","last_became_active":"2023-12-13T00:00:31.145115+0000","last_became_peered":"2023-12-13T00:00:31.145115+0000","last_unstale":"2023-12-13T00:00:59.462472+0000","last_undegraded":"2023-12-13T00:00:59.462472+0000","last_fullsized":"2023-12-13T00:00:59.462472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:15.201991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.443231+0000","last_change":"2023-12-13T00:00:30.006295+0000","last_active":"2023-12-13T00:01:06.443231+0000","last_peered":"2023-12-13T00:01:06.443231+0000","last_clean":"2023-12-13T00:01:06.443231+0000","last_became_active":"2023-12-13T00:00:30.005988+0000","last_became_peered":"2023-12-13T00:00:30.005988+0000","last_unstale":"2023-12-13T00:01:06.443231+0000","last_undegraded":"2023-12-13T00:01:06.443231+0000","last_fullsized":"2023-12-13T00:01:06.443231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:15:15.243155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461393+0000","last_change":"2023-12-13T00:00:35.662996+0000","last_active":"2023-12-13T00:00:59.461393+0000","last_peered":"2023-12-13T00:00:59.461393+0000","last_clean":"2023-12-13T00:00:59.461393+0000","last_became_active":"2023-12-13T00:00:35.662612+0000","last_became_peered":"2023-12-13T00:00:35.662612+0000","last_unstale":"2023-12-13T00:00:59.461393+0000","last_undegraded":"2023-12-13T00:00:59.461393+0000","last_fullsized":"2023-12-13T00:00:59.461393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:58.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463941+0000","last_change":"2023-12-13T00:00:31.118054+0000","last_active":"2023-12-13T00:00:59.463941+0000","last_peered":"2023-12-13T00:00:59.463941+0000","last_clean":"2023-12-13T00:00:59.463941+0000","last_became_active":"2023-12-13T00:00:31.117814+0000","last_became_peered":"2023-12-13T00:00:31.117814+0000","last_unstale":"2023-12-13T00:00:59.463941+0000","last_undegraded":"2023-12-13T00:00:59.463941+0000","last_fullsized":"2023-12-13T00:00:59.463941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:15.201991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.540849+0000","last_change":"2023-12-13T00:00:30.001001+0000","last_active":"2023-12-13T00:01:00.540849+0000","last_peered":"2023-12-13T00:01:00.540849+0000","last_clean":"2023-12-13T00:01:00.540849+0000","last_became_active":"2023-12-13T00:00:30.000755+0000","last_became_peered":"2023-12-13T00:00:30.000755+0000","last_unstale":"2023-12-13T00:01:00.540849+0000","last_undegraded":"2023-12-13T00:01:00.540849+0000","last_fullsized":"2023-12-13T00:01:00.540849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:02:11.314721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.545340+0000","last_change":"2023-12-13T00:01:00.545340+0000","last_active":"2023-12-13T00:01:00.545340+0000","last_peered":"2023-12-13T00:01:00.545340+0000","last_clean":"2023-12-13T00:01:00.545340+0000","last_became_active":"2023-12-13T00:01:00.544906+0000","last_became_peered":"2023-12-13T00:01:00.544906+0000","last_unstale":"2023-12-13T00:01:00.545340+0000","last_undegraded":"2023-12-13T00:01:00.545340+0000","last_fullsized":"2023-12-13T00:01:00.545340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:44:27.993144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,5],"acting":[6,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462448+0000","last_change":"2023-12-13T00:00:31.143429+0000","last_active":"2023-12-13T00:00:59.462448+0000","last_peered":"2023-12-13T00:00:59.462448+0000","last_clean":"2023-12-13T00:00:59.462448+0000","last_became_active":"2023-12-13T00:00:31.143182+0000","last_became_peered":"2023-12-13T00:00:31.143182+0000","last_unstale":"2023-12-13T00:00:59.462448+0000","last_undegraded":"2023-12-13T00:00:59.462448+0000","last_fullsized":"2023-12-13T00:00:59.462448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:09:34.339195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465302+0000","last_change":"2023-12-13T00:00:29.969160+0000","last_active":"2023-12-13T00:00:59.465302+0000","last_peered":"2023-12-13T00:00:59.465302+0000","last_clean":"2023-12-13T00:00:59.465302+0000","last_became_active":"2023-12-13T00:00:29.968860+0000","last_became_peered":"2023-12-13T00:00:29.968860+0000","last_unstale":"2023-12-13T00:00:59.465302+0000","last_undegraded":"2023-12-13T00:00:59.465302+0000","last_fullsized":"2023-12-13T00:00:59.465302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:42:13.602889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463519+0000","last_change":"2023-12-13T00:00:35.642597+0000","last_active":"2023-12-13T00:00:59.463519+0000","last_peered":"2023-12-13T00:00:59.463519+0000","last_clean":"2023-12-13T00:00:59.463519+0000","last_became_active":"2023-12-13T00:00:35.642215+0000","last_became_peered":"2023-12-13T00:00:35.642215+0000","last_unstale":"2023-12-13T00:00:59.463519+0000","last_undegraded":"2023-12-13T00:00:59.463519+0000","last_fullsized":"2023-12-13T00:00:59.463519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:54:48.007993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460583+0000","last_change":"2023-12-13T00:00:31.149832+0000","last_active":"2023-12-13T00:00:59.460583+0000","last_peered":"2023-12-13T00:00:59.460583+0000","last_clean":"2023-12-13T00:00:59.460583+0000","last_became_active":"2023-12-13T00:00:31.149587+0000","last_became_peered":"2023-12-13T00:00:31.149587+0000","last_unstale":"2023-12-13T00:00:59.460583+0000","last_undegraded":"2023-12-13T00:00:59.460583+0000","last_fullsized":"2023-12-13T00:00:59.460583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:00.910594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.540630+0000","last_change":"2023-12-13T00:00:29.998103+0000","last_active":"2023-12-13T00:01:00.540630+0000","last_peered":"2023-12-13T00:01:00.540630+0000","last_clean":"2023-12-13T00:01:00.540630+0000","last_became_active":"2023-12-13T00:00:29.997848+0000","last_became_peered":"2023-12-13T00:00:29.997848+0000","last_unstale":"2023-12-13T00:01:00.540630+0000","last_undegraded":"2023-12-13T00:01:00.540630+0000","last_fullsized":"2023-12-13T00:01:00.540630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:52:58.951228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463768+0000","last_change":"2023-12-13T00:00:35.652104+0000","last_active":"2023-12-13T00:00:59.463768+0000","last_peered":"2023-12-13T00:00:59.463768+0000","last_clean":"2023-12-13T00:00:59.463768+0000","last_became_active":"2023-12-13T00:00:35.651766+0000","last_became_peered":"2023-12-13T00:00:35.651766+0000","last_unstale":"2023-12-13T00:00:59.463768+0000","last_undegraded":"2023-12-13T00:00:59.463768+0000","last_fullsized":"2023-12-13T00:00:59.463768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:08:10.211533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465392+0000","last_change":"2023-12-13T00:00:31.120580+0000","last_active":"2023-12-13T00:00:59.465392+0000","last_peered":"2023-12-13T00:00:59.465392+0000","last_clean":"2023-12-13T00:00:59.465392+0000","last_became_active":"2023-12-13T00:00:31.120330+0000","last_became_peered":"2023-12-13T00:00:31.120330+0000","last_unstale":"2023-12-13T00:00:59.465392+0000","last_undegraded":"2023-12-13T00:00:59.465392+0000","last_fullsized":"2023-12-13T00:00:59.465392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:04:30.356287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.442733+0000","last_change":"2023-12-13T00:00:30.000752+0000","last_active":"2023-12-13T00:01:06.442733+0000","last_peered":"2023-12-13T00:01:06.442733+0000","last_clean":"2023-12-13T00:01:06.442733+0000","last_became_active":"2023-12-13T00:00:30.000015+0000","last_became_peered":"2023-12-13T00:00:30.000015+0000","last_unstale":"2023-12-13T00:01:06.442733+0000","last_undegraded":"2023-12-13T00:01:06.442733+0000","last_fullsized":"2023-12-13T00:01:06.442733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:20:46.566684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463425+0000","last_change":"2023-12-13T00:00:35.667415+0000","last_active":"2023-12-13T00:00:59.463425+0000","last_peered":"2023-12-13T00:00:59.463425+0000","last_clean":"2023-12-13T00:00:59.463425+0000","last_became_active":"2023-12-13T00:00:35.667028+0000","last_became_peered":"2023-12-13T00:00:35.667028+0000","last_unstale":"2023-12-13T00:00:59.463425+0000","last_undegraded":"2023-12-13T00:00:59.463425+0000","last_fullsized":"2023-12-13T00:00:59.463425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:58.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.464043+0000","last_change":"2023-12-13T00:00:31.140853+0000","last_active":"2023-12-13T00:00:59.464043+0000","last_peered":"2023-12-13T00:00:59.464043+0000","last_clean":"2023-12-13T00:00:59.464043+0000","last_became_active":"2023-12-13T00:00:31.140597+0000","last_became_peered":"2023-12-13T00:00:31.140597+0000","last_unstale":"2023-12-13T00:00:59.464043+0000","last_undegraded":"2023-12-13T00:00:59.464043+0000","last_fullsized":"2023-12-13T00:00:59.464043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:13.923453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.444460+0000","last_change":"2023-12-13T00:00:29.998765+0000","last_active":"2023-12-13T00:01:06.444460+0000","last_peered":"2023-12-13T00:01:06.444460+0000","last_clean":"2023-12-13T00:01:06.444460+0000","last_became_active":"2023-12-13T00:00:29.998552+0000","last_became_peered":"2023-12-13T00:00:29.998552+0000","last_unstale":"2023-12-13T00:01:06.444460+0000","last_undegraded":"2023-12-13T00:01:06.444460+0000","last_fullsized":"2023-12-13T00:01:06.444460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:54:42.351946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465621+0000","last_change":"2023-12-13T00:00:35.666575+0000","last_active":"2023-12-13T00:00:59.465621+0000","last_peered":"2023-12-13T00:00:59.465621+0000","last_clean":"2023-12-13T00:00:59.465621+0000","last_became_active":"2023-12-13T00:00:35.666135+0000","last_became_peered":"2023-12-13T00:00:35.666135+0000","last_unstale":"2023-12-13T00:00:59.465621+0000","last_undegraded":"2023-12-13T00:00:59.465621+0000","last_fullsized":"2023-12-13T00:00:59.465621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:02:03.031651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462174+0000","last_change":"2023-12-13T00:00:31.148698+0000","last_active":"2023-12-13T00:00:59.462174+0000","last_peered":"2023-12-13T00:00:59.462174+0000","last_clean":"2023-12-13T00:00:59.462174+0000","last_became_active":"2023-12-13T00:00:31.148421+0000","last_became_peered":"2023-12-13T00:00:31.148421+0000","last_unstale":"2023-12-13T00:00:59.462174+0000","last_undegraded":"2023-12-13T00:00:59.462174+0000","last_fullsized":"2023-12-13T00:00:59.462174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:53:00.056294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:03.925407+0000","last_change":"2023-12-13T00:00:30.001220+0000","last_active":"2023-12-13T00:01:03.925407+0000","last_peered":"2023-12-13T00:01:03.925407+0000","last_clean":"2023-12-13T00:01:03.925407+0000","last_became_active":"2023-12-13T00:00:30.000854+0000","last_became_peered":"2023-12-13T00:00:30.000854+0000","last_unstale":"2023-12-13T00:01:03.925407+0000","last_undegraded":"2023-12-13T00:01:03.925407+0000","last_fullsized":"2023-12-13T00:01:03.925407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:50:11.243011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456321+0000","last_change":"2023-12-13T00:00:08.575071+0000","last_active":"2023-12-13T00:00:59.456321+0000","last_peered":"2023-12-13T00:00:59.456321+0000","last_clean":"2023-12-13T00:00:59.456321+0000","last_became_active":"2023-12-13T00:00:08.574464+0000","last_became_peered":"2023-12-13T00:00:08.574464+0000","last_unstale":"2023-12-13T00:00:59.456321+0000","last_undegraded":"2023-12-13T00:00:59.456321+0000","last_fullsized":"2023-12-13T00:00:59.456321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:07.226606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:07.226606+0000","last_clean_scrub_stamp":"2023-12-13T00:00:07.226606+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:51:39.168480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458245+0000","last_change":"2023-12-13T00:00:35.661806+0000","last_active":"2023-12-13T00:00:59.458245+0000","last_peered":"2023-12-13T00:00:59.458245+0000","last_clean":"2023-12-13T00:00:59.458245+0000","last_became_active":"2023-12-13T00:00:35.660976+0000","last_became_peered":"2023-12-13T00:00:35.660976+0000","last_unstale":"2023-12-13T00:00:59.458245+0000","last_undegraded":"2023-12-13T00:00:59.458245+0000","last_fullsized":"2023-12-13T00:00:59.458245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:04:57.617925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458767+0000","last_change":"2023-12-13T00:00:31.036383+0000","last_active":"2023-12-13T00:00:59.458767+0000","last_peered":"2023-12-13T00:00:59.458767+0000","last_clean":"2023-12-13T00:00:59.458767+0000","last_became_active":"2023-12-13T00:00:31.036127+0000","last_became_peered":"2023-12-13T00:00:31.036127+0000","last_unstale":"2023-12-13T00:00:59.458767+0000","last_undegraded":"2023-12-13T00:00:59.458767+0000","last_fullsized":"2023-12-13T00:00:59.458767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:12:16.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.449621+0000","last_change":"2023-12-13T00:00:30.006258+0000","last_active":"2023-12-13T00:01:06.449621+0000","last_peered":"2023-12-13T00:01:06.449621+0000","last_clean":"2023-12-13T00:01:06.449621+0000","last_became_active":"2023-12-13T00:00:30.005943+0000","last_became_peered":"2023-12-13T00:00:30.005943+0000","last_unstale":"2023-12-13T00:01:06.449621+0000","last_undegraded":"2023-12-13T00:01:06.449621+0000","last_fullsized":"2023-12-13T00:01:06.449621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:52:45.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461955+0000","last_change":"2023-12-13T00:00:35.665140+0000","last_active":"2023-12-13T00:00:59.461955+0000","last_peered":"2023-12-13T00:00:59.461955+0000","last_clean":"2023-12-13T00:00:59.461955+0000","last_became_active":"2023-12-13T00:00:35.664071+0000","last_became_peered":"2023-12-13T00:00:35.664071+0000","last_unstale":"2023-12-13T00:00:59.461955+0000","last_undegraded":"2023-12-13T00:00:59.461955+0000","last_fullsized":"2023-12-13T00:00:59.461955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:06:01.427574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460927+0000","last_change":"2023-12-13T00:00:31.147760+0000","last_active":"2023-12-13T00:00:59.460927+0000","last_peered":"2023-12-13T00:00:59.460927+0000","last_clean":"2023-12-13T00:00:59.460927+0000","last_became_active":"2023-12-13T00:00:31.147523+0000","last_became_peered":"2023-12-13T00:00:31.147523+0000","last_unstale":"2023-12-13T00:00:59.460927+0000","last_undegraded":"2023-12-13T00:00:59.460927+0000","last_fullsized":"2023-12-13T00:00:59.460927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:56:28.188041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465526+0000","last_change":"2023-12-13T00:00:30.002705+0000","last_active":"2023-12-13T00:00:59.465526+0000","last_peered":"2023-12-13T00:00:59.465526+0000","last_clean":"2023-12-13T00:00:59.465526+0000","last_became_active":"2023-12-13T00:00:30.002427+0000","last_became_peered":"2023-12-13T00:00:30.002427+0000","last_unstale":"2023-12-13T00:00:59.465526+0000","last_undegraded":"2023-12-13T00:00:59.465526+0000","last_fullsized":"2023-12-13T00:00:59.465526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:06:37.325239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465997+0000","last_change":"2023-12-13T00:00:35.661309+0000","last_active":"2023-12-13T00:00:59.465997+0000","last_peered":"2023-12-13T00:00:59.465997+0000","last_clean":"2023-12-13T00:00:59.465997+0000","last_became_active":"2023-12-13T00:00:35.660939+0000","last_became_peered":"2023-12-13T00:00:35.660939+0000","last_unstale":"2023-12-13T00:00:59.465997+0000","last_undegraded":"2023-12-13T00:00:59.465997+0000","last_fullsized":"2023-12-13T00:00:59.465997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:49:19.372464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459530+0000","last_change":"2023-12-13T00:00:31.146265+0000","last_active":"2023-12-13T00:00:59.459530+0000","last_peered":"2023-12-13T00:00:59.459530+0000","last_clean":"2023-12-13T00:00:59.459530+0000","last_became_active":"2023-12-13T00:00:31.145997+0000","last_became_peered":"2023-12-13T00:00:31.145997+0000","last_unstale":"2023-12-13T00:00:59.459530+0000","last_undegraded":"2023-12-13T00:00:59.459530+0000","last_fullsized":"2023-12-13T00:00:59.459530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:53:32.846210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462169+0000","last_change":"2023-12-13T00:00:29.968222+0000","last_active":"2023-12-13T00:00:59.462169+0000","last_peered":"2023-12-13T00:00:59.462169+0000","last_clean":"2023-12-13T00:00:59.462169+0000","last_became_active":"2023-12-13T00:00:29.967916+0000","last_became_peered":"2023-12-13T00:00:29.967916+0000","last_unstale":"2023-12-13T00:00:59.462169+0000","last_undegraded":"2023-12-13T00:00:59.462169+0000","last_fullsized":"2023-12-13T00:00:59.462169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:12.818387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457105+0000","last_change":"2023-12-13T00:00:35.667745+0000","last_active":"2023-12-13T00:00:59.457105+0000","last_peered":"2023-12-13T00:00:59.457105+0000","last_clean":"2023-12-13T00:00:59.457105+0000","last_became_active":"2023-12-13T00:00:35.666891+0000","last_became_peered":"2023-12-13T00:00:35.666891+0000","last_unstale":"2023-12-13T00:00:59.457105+0000","last_undegraded":"2023-12-13T00:00:59.457105+0000","last_fullsized":"2023-12-13T00:00:59.457105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:30:53.285154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462868+0000","last_change":"2023-12-13T00:00:31.148279+0000","last_active":"2023-12-13T00:00:59.462868+0000","last_peered":"2023-12-13T00:00:59.462868+0000","last_clean":"2023-12-13T00:00:59.462868+0000","last_became_active":"2023-12-13T00:00:31.148016+0000","last_became_peered":"2023-12-13T00:00:31.148016+0000","last_unstale":"2023-12-13T00:00:59.462868+0000","last_undegraded":"2023-12-13T00:00:59.462868+0000","last_fullsized":"2023-12-13T00:00:59.462868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:37:40.762676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459753+0000","last_change":"2023-12-13T00:00:30.008152+0000","last_active":"2023-12-13T00:00:59.459753+0000","last_peered":"2023-12-13T00:00:59.459753+0000","last_clean":"2023-12-13T00:00:59.459753+0000","last_became_active":"2023-12-13T00:00:30.007907+0000","last_became_peered":"2023-12-13T00:00:30.007907+0000","last_unstale":"2023-12-13T00:00:59.459753+0000","last_undegraded":"2023-12-13T00:00:59.459753+0000","last_fullsized":"2023-12-13T00:00:59.459753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:46:40.001298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456332+0000","last_change":"2023-12-13T00:00:35.660971+0000","last_active":"2023-12-13T00:00:59.456332+0000","last_peered":"2023-12-13T00:00:59.456332+0000","last_clean":"2023-12-13T00:00:59.456332+0000","last_became_active":"2023-12-13T00:00:35.660627+0000","last_became_peered":"2023-12-13T00:00:35.660627+0000","last_unstale":"2023-12-13T00:00:59.456332+0000","last_undegraded":"2023-12-13T00:00:59.456332+0000","last_fullsized":"2023-12-13T00:00:59.456332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:18.474434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457469+0000","last_change":"2023-12-13T00:00:31.142437+0000","last_active":"2023-12-13T00:00:59.457469+0000","last_peered":"2023-12-13T00:00:59.457469+0000","last_clean":"2023-12-13T00:00:59.457469+0000","last_became_active":"2023-12-13T00:00:31.142150+0000","last_became_peered":"2023-12-13T00:00:31.142150+0000","last_unstale":"2023-12-13T00:00:59.457469+0000","last_undegraded":"2023-12-13T00:00:59.457469+0000","last_fullsized":"2023-12-13T00:00:59.457469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:10:54.020587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'15","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.446875+0000","last_change":"2023-12-13T00:00:30.000646+0000","last_active":"2023-12-13T00:01:06.446875+0000","last_peered":"2023-12-13T00:01:06.446875+0000","last_clean":"2023-12-13T00:01:06.446875+0000","last_became_active":"2023-12-13T00:00:30.000388+0000","last_became_peered":"2023-12-13T00:00:30.000388+0000","last_unstale":"2023-12-13T00:01:06.446875+0000","last_undegraded":"2023-12-13T00:01:06.446875+0000","last_fullsized":"2023-12-13T00:01:06.446875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:07.704455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465717+0000","last_change":"2023-12-13T00:00:35.666659+0000","last_active":"2023-12-13T00:00:59.465717+0000","last_peered":"2023-12-13T00:00:59.465717+0000","last_clean":"2023-12-13T00:00:59.465717+0000","last_became_active":"2023-12-13T00:00:35.666304+0000","last_became_peered":"2023-12-13T00:00:35.666304+0000","last_unstale":"2023-12-13T00:00:59.465717+0000","last_undegraded":"2023-12-13T00:00:59.465717+0000","last_fullsized":"2023-12-13T00:00:59.465717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:35:49.956369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456174+0000","last_change":"2023-12-13T00:00:31.037568+0000","last_active":"2023-12-13T00:00:59.456174+0000","last_peered":"2023-12-13T00:00:59.456174+0000","last_clean":"2023-12-13T00:00:59.456174+0000","last_became_active":"2023-12-13T00:00:31.037398+0000","last_became_peered":"2023-12-13T00:00:31.037398+0000","last_unstale":"2023-12-13T00:00:59.456174+0000","last_undegraded":"2023-12-13T00:00:59.456174+0000","last_fullsized":"2023-12-13T00:00:59.456174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:08.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.522696+0000","last_change":"2023-12-13T00:00:30.006086+0000","last_active":"2023-12-13T00:01:06.522696+0000","last_peered":"2023-12-13T00:01:06.522696+0000","last_clean":"2023-12-13T00:01:06.522696+0000","last_became_active":"2023-12-13T00:00:30.005752+0000","last_became_peered":"2023-12-13T00:00:30.005752+0000","last_unstale":"2023-12-13T00:01:06.522696+0000","last_undegraded":"2023-12-13T00:01:06.522696+0000","last_fullsized":"2023-12-13T00:01:06.522696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:06:37.325239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465548+0000","last_change":"2023-12-13T00:00:35.666467+0000","last_active":"2023-12-13T00:00:59.465548+0000","last_peered":"2023-12-13T00:00:59.465548+0000","last_clean":"2023-12-13T00:00:59.465548+0000","last_became_active":"2023-12-13T00:00:35.666061+0000","last_became_peered":"2023-12-13T00:00:35.666061+0000","last_unstale":"2023-12-13T00:00:59.465548+0000","last_undegraded":"2023-12-13T00:00:59.465548+0000","last_fullsized":"2023-12-13T00:00:59.465548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:19:16.858246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.702387+0000","last_change":"2023-12-13T00:01:00.702387+0000","last_active":"2023-12-13T00:01:00.702387+0000","last_peered":"2023-12-13T00:01:00.702387+0000","last_clean":"2023-12-13T00:01:00.702387+0000","last_became_active":"2023-12-13T00:01:00.702089+0000","last_became_peered":"2023-12-13T00:01:00.702089+0000","last_unstale":"2023-12-13T00:01:00.702387+0000","last_undegraded":"2023-12-13T00:01:00.702387+0000","last_fullsized":"2023-12-13T00:01:00.702387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:48:49.380742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:03.924396+0000","last_change":"2023-12-13T00:00:30.001171+0000","last_active":"2023-12-13T00:01:03.924396+0000","last_peered":"2023-12-13T00:01:03.924396+0000","last_clean":"2023-12-13T00:01:03.924396+0000","last_became_active":"2023-12-13T00:00:30.000803+0000","last_became_peered":"2023-12-13T00:00:30.000803+0000","last_unstale":"2023-12-13T00:01:03.924396+0000","last_undegraded":"2023-12-13T00:01:03.924396+0000","last_fullsized":"2023-12-13T00:01:03.924396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:19.012092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463671+0000","last_change":"2023-12-13T00:00:35.649561+0000","last_active":"2023-12-13T00:00:59.463671+0000","last_peered":"2023-12-13T00:00:59.463671+0000","last_clean":"2023-12-13T00:00:59.463671+0000","last_became_active":"2023-12-13T00:00:35.649151+0000","last_became_peered":"2023-12-13T00:00:35.649151+0000","last_unstale":"2023-12-13T00:00:59.463671+0000","last_undegraded":"2023-12-13T00:00:59.463671+0000","last_fullsized":"2023-12-13T00:00:59.463671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:06:34.023899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463669+0000","last_change":"2023-12-13T00:00:31.116002+0000","last_active":"2023-12-13T00:00:59.463669+0000","last_peered":"2023-12-13T00:00:59.463669+0000","last_clean":"2023-12-13T00:00:59.463669+0000","last_became_active":"2023-12-13T00:00:31.115678+0000","last_became_peered":"2023-12-13T00:00:31.115678+0000","last_unstale":"2023-12-13T00:00:59.463669+0000","last_undegraded":"2023-12-13T00:00:59.463669+0000","last_fullsized":"2023-12-13T00:00:59.463669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:21:51.967408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'6","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.441646+0000","last_change":"2023-12-13T00:00:30.004329+0000","last_active":"2023-12-13T00:01:06.441646+0000","last_peered":"2023-12-13T00:01:06.441646+0000","last_clean":"2023-12-13T00:01:06.441646+0000","last_became_active":"2023-12-13T00:00:30.004089+0000","last_became_peered":"2023-12-13T00:00:30.004089+0000","last_unstale":"2023-12-13T00:01:06.441646+0000","last_undegraded":"2023-12-13T00:01:06.441646+0000","last_fullsized":"2023-12-13T00:01:06.441646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:05:04.403249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457886+0000","last_change":"2023-12-13T00:00:35.652272+0000","last_active":"2023-12-13T00:00:59.457886+0000","last_peered":"2023-12-13T00:00:59.457886+0000","last_clean":"2023-12-13T00:00:59.457886+0000","last_became_active":"2023-12-13T00:00:35.651907+0000","last_became_peered":"2023-12-13T00:00:35.651907+0000","last_unstale":"2023-12-13T00:00:59.457886+0000","last_undegraded":"2023-12-13T00:00:59.457886+0000","last_fullsized":"2023-12-13T00:00:59.457886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:15:01.873129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461182+0000","last_change":"2023-12-13T00:00:31.148754+0000","last_active":"2023-12-13T00:00:59.461182+0000","last_peered":"2023-12-13T00:00:59.461182+0000","last_clean":"2023-12-13T00:00:59.461182+0000","last_became_active":"2023-12-13T00:00:31.147846+0000","last_became_peered":"2023-12-13T00:00:31.147846+0000","last_unstale":"2023-12-13T00:00:59.461182+0000","last_undegraded":"2023-12-13T00:00:59.461182+0000","last_fullsized":"2023-12-13T00:00:59.461182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:39:59.955103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'12","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:03.987972+0000","last_change":"2023-12-13T00:00:30.001703+0000","last_active":"2023-12-13T00:01:03.987972+0000","last_peered":"2023-12-13T00:01:03.987972+0000","last_clean":"2023-12-13T00:01:03.987972+0000","last_became_active":"2023-12-13T00:00:30.001420+0000","last_became_peered":"2023-12-13T00:00:30.001420+0000","last_unstale":"2023-12-13T00:01:03.987972+0000","last_undegraded":"2023-12-13T00:01:03.987972+0000","last_fullsized":"2023-12-13T00:01:03.987972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:02:06.211723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.546607+0000","last_change":"2023-12-13T00:01:00.546607+0000","last_active":"2023-12-13T00:01:00.546607+0000","last_peered":"2023-12-13T00:01:00.546607+0000","last_clean":"2023-12-13T00:01:00.546607+0000","last_became_active":"2023-12-13T00:01:00.546264+0000","last_became_peered":"2023-12-13T00:01:00.546264+0000","last_unstale":"2023-12-13T00:01:00.546607+0000","last_undegraded":"2023-12-13T00:01:00.546607+0000","last_fullsized":"2023-12-13T00:01:00.546607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:12:57.696627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457889+0000","last_change":"2023-12-13T00:00:31.138998+0000","last_active":"2023-12-13T00:00:59.457889+0000","last_peered":"2023-12-13T00:00:59.457889+0000","last_clean":"2023-12-13T00:00:59.457889+0000","last_became_active":"2023-12-13T00:00:31.138723+0000","last_became_peered":"2023-12-13T00:00:31.138723+0000","last_unstale":"2023-12-13T00:00:59.457889+0000","last_undegraded":"2023-12-13T00:00:59.457889+0000","last_fullsized":"2023-12-13T00:00:59.457889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:24:05.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.696460+0000","last_change":"2023-12-13T00:00:30.003079+0000","last_active":"2023-12-13T00:01:00.696460+0000","last_peered":"2023-12-13T00:01:00.696460+0000","last_clean":"2023-12-13T00:01:00.696460+0000","last_became_active":"2023-12-13T00:00:30.002823+0000","last_became_peered":"2023-12-13T00:00:30.002823+0000","last_unstale":"2023-12-13T00:01:00.696460+0000","last_undegraded":"2023-12-13T00:01:00.696460+0000","last_fullsized":"2023-12-13T00:01:00.696460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:07.829448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.697705+0000","last_change":"2023-12-13T00:01:00.697705+0000","last_active":"2023-12-13T00:01:00.697705+0000","last_peered":"2023-12-13T00:01:00.697705+0000","last_clean":"2023-12-13T00:01:00.697705+0000","last_became_active":"2023-12-13T00:01:00.697231+0000","last_became_peered":"2023-12-13T00:01:00.697231+0000","last_unstale":"2023-12-13T00:01:00.697705+0000","last_undegraded":"2023-12-13T00:01:00.697705+0000","last_fullsized":"2023-12-13T00:01:00.697705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:54:04.994059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465742+0000","last_change":"2023-12-13T00:00:31.027503+0000","last_active":"2023-12-13T00:00:59.465742+0000","last_peered":"2023-12-13T00:00:59.465742+0000","last_clean":"2023-12-13T00:00:59.465742+0000","last_became_active":"2023-12-13T00:00:31.027239+0000","last_became_peered":"2023-12-13T00:00:31.027239+0000","last_unstale":"2023-12-13T00:00:59.465742+0000","last_undegraded":"2023-12-13T00:00:59.465742+0000","last_fullsized":"2023-12-13T00:00:59.465742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:50:58.339436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:04.030851+0000","last_change":"2023-12-13T00:00:30.009592+0000","last_active":"2023-12-13T00:01:04.030851+0000","last_peered":"2023-12-13T00:01:04.030851+0000","last_clean":"2023-12-13T00:01:04.030851+0000","last_became_active":"2023-12-13T00:00:30.009351+0000","last_became_peered":"2023-12-13T00:00:30.009351+0000","last_unstale":"2023-12-13T00:01:04.030851+0000","last_undegraded":"2023-12-13T00:01:04.030851+0000","last_fullsized":"2023-12-13T00:01:04.030851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:46:22.716022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.720435+0000","last_change":"2023-12-13T00:01:00.717446+0000","last_active":"2023-12-13T00:01:00.720435+0000","last_peered":"2023-12-13T00:01:00.720435+0000","last_clean":"2023-12-13T00:01:00.720435+0000","last_became_active":"2023-12-13T00:01:00.717019+0000","last_became_peered":"2023-12-13T00:01:00.717019+0000","last_unstale":"2023-12-13T00:01:00.720435+0000","last_undegraded":"2023-12-13T00:01:00.720435+0000","last_fullsized":"2023-12-13T00:01:00.720435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:22:05.566928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462796+0000","last_change":"2023-12-13T00:00:31.139946+0000","last_active":"2023-12-13T00:00:59.462796+0000","last_peered":"2023-12-13T00:00:59.462796+0000","last_clean":"2023-12-13T00:00:59.462796+0000","last_became_active":"2023-12-13T00:00:31.139656+0000","last_became_peered":"2023-12-13T00:00:31.139656+0000","last_unstale":"2023-12-13T00:00:59.462796+0000","last_undegraded":"2023-12-13T00:00:59.462796+0000","last_fullsized":"2023-12-13T00:00:59.462796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:13:39.042325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:04.030793+0000","last_change":"2023-12-13T00:00:30.003511+0000","last_active":"2023-12-13T00:01:04.030793+0000","last_peered":"2023-12-13T00:01:04.030793+0000","last_clean":"2023-12-13T00:01:04.030793+0000","last_became_active":"2023-12-13T00:00:30.002630+0000","last_became_peered":"2023-12-13T00:00:30.002630+0000","last_unstale":"2023-12-13T00:01:04.030793+0000","last_undegraded":"2023-12-13T00:01:04.030793+0000","last_fullsized":"2023-12-13T00:01:04.030793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:58:21.724544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462429+0000","last_change":"2023-12-13T00:00:35.649725+0000","last_active":"2023-12-13T00:00:59.462429+0000","last_peered":"2023-12-13T00:00:59.462429+0000","last_clean":"2023-12-13T00:00:59.462429+0000","last_became_active":"2023-12-13T00:00:35.649401+0000","last_became_peered":"2023-12-13T00:00:35.649401+0000","last_unstale":"2023-12-13T00:00:59.462429+0000","last_undegraded":"2023-12-13T00:00:59.462429+0000","last_fullsized":"2023-12-13T00:00:59.462429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:56:09.136979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462981+0000","last_change":"2023-12-13T00:00:35.662790+0000","last_active":"2023-12-13T00:00:59.462981+0000","last_peered":"2023-12-13T00:00:59.462981+0000","last_clean":"2023-12-13T00:00:59.462981+0000","last_became_active":"2023-12-13T00:00:35.662406+0000","last_became_peered":"2023-12-13T00:00:35.662406+0000","last_unstale":"2023-12-13T00:00:59.462981+0000","last_undegraded":"2023-12-13T00:00:59.462981+0000","last_fullsized":"2023-12-13T00:00:59.462981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:10:58.571569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462513+0000","last_change":"2023-12-13T00:00:31.143141+0000","last_active":"2023-12-13T00:00:59.462513+0000","last_peered":"2023-12-13T00:00:59.462513+0000","last_clean":"2023-12-13T00:00:59.462513+0000","last_became_active":"2023-12-13T00:00:31.142823+0000","last_became_peered":"2023-12-13T00:00:31.142823+0000","last_unstale":"2023-12-13T00:00:59.462513+0000","last_undegraded":"2023-12-13T00:00:59.462513+0000","last_fullsized":"2023-12-13T00:00:59.462513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:22:51.335464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.540120+0000","last_change":"2023-12-13T00:00:30.004773+0000","last_active":"2023-12-13T00:01:00.540120+0000","last_peered":"2023-12-13T00:01:00.540120+0000","last_clean":"2023-12-13T00:01:00.540120+0000","last_became_active":"2023-12-13T00:00:30.004496+0000","last_became_peered":"2023-12-13T00:00:30.004496+0000","last_unstale":"2023-12-13T00:01:00.540120+0000","last_undegraded":"2023-12-13T00:01:00.540120+0000","last_fullsized":"2023-12-13T00:01:00.540120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:51:20.708568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457933+0000","last_change":"2023-12-13T00:00:35.666457+0000","last_active":"2023-12-13T00:00:59.457933+0000","last_peered":"2023-12-13T00:00:59.457933+0000","last_clean":"2023-12-13T00:00:59.457933+0000","last_became_active":"2023-12-13T00:00:35.666075+0000","last_became_peered":"2023-12-13T00:00:35.666075+0000","last_unstale":"2023-12-13T00:00:59.457933+0000","last_undegraded":"2023-12-13T00:00:59.457933+0000","last_fullsized":"2023-12-13T00:00:59.457933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:18:38.741479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465799+0000","last_change":"2023-12-13T00:00:31.116511+0000","last_active":"2023-12-13T00:00:59.465799+0000","last_peered":"2023-12-13T00:00:59.465799+0000","last_clean":"2023-12-13T00:00:59.465799+0000","last_became_active":"2023-12-13T00:00:31.116209+0000","last_became_peered":"2023-12-13T00:00:31.116209+0000","last_unstale":"2023-12-13T00:00:59.465799+0000","last_undegraded":"2023-12-13T00:00:59.465799+0000","last_fullsized":"2023-12-13T00:00:59.465799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:06.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.446859+0000","last_change":"2023-12-13T00:00:30.006475+0000","last_active":"2023-12-13T00:01:06.446859+0000","last_peered":"2023-12-13T00:01:06.446859+0000","last_clean":"2023-12-13T00:01:06.446859+0000","last_became_active":"2023-12-13T00:00:30.006026+0000","last_became_peered":"2023-12-13T00:00:30.006026+0000","last_unstale":"2023-12-13T00:01:06.446859+0000","last_undegraded":"2023-12-13T00:01:06.446859+0000","last_fullsized":"2023-12-13T00:01:06.446859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:29.225167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.444234+0000","last_change":"2023-12-13T00:00:30.004483+0000","last_active":"2023-12-13T00:01:06.444234+0000","last_peered":"2023-12-13T00:01:06.444234+0000","last_clean":"2023-12-13T00:01:06.444234+0000","last_became_active":"2023-12-13T00:00:30.004214+0000","last_became_peered":"2023-12-13T00:00:30.004214+0000","last_unstale":"2023-12-13T00:01:06.444234+0000","last_undegraded":"2023-12-13T00:01:06.444234+0000","last_fullsized":"2023-12-13T00:01:06.444234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:14.096925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461971+0000","last_change":"2023-12-13T00:00:31.147121+0000","last_active":"2023-12-13T00:00:59.461971+0000","last_peered":"2023-12-13T00:00:59.461971+0000","last_clean":"2023-12-13T00:00:59.461971+0000","last_became_active":"2023-12-13T00:00:31.146818+0000","last_became_peered":"2023-12-13T00:00:31.146818+0000","last_unstale":"2023-12-13T00:00:59.461971+0000","last_undegraded":"2023-12-13T00:00:59.461971+0000","last_fullsized":"2023-12-13T00:00:59.461971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:12.753740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461393+0000","last_change":"2023-12-13T00:00:35.642485+0000","last_active":"2023-12-13T00:00:59.461393+0000","last_peered":"2023-12-13T00:00:59.461393+0000","last_clean":"2023-12-13T00:00:59.461393+0000","last_became_active":"2023-12-13T00:00:35.642114+0000","last_became_peered":"2023-12-13T00:00:35.642114+0000","last_unstale":"2023-12-13T00:00:59.461393+0000","last_undegraded":"2023-12-13T00:00:59.461393+0000","last_fullsized":"2023-12-13T00:00:59.461393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:24:10.067039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:04.029541+0000","last_change":"2023-12-13T00:00:29.972296+0000","last_active":"2023-12-13T00:01:04.029541+0000","last_peered":"2023-12-13T00:01:04.029541+0000","last_clean":"2023-12-13T00:01:04.029541+0000","last_became_active":"2023-12-13T00:00:29.972018+0000","last_became_peered":"2023-12-13T00:00:29.972018+0000","last_unstale":"2023-12-13T00:01:04.029541+0000","last_undegraded":"2023-12-13T00:01:04.029541+0000","last_fullsized":"2023-12-13T00:01:04.029541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:30:26.126361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456414+0000","last_change":"2023-12-13T00:00:31.037679+0000","last_active":"2023-12-13T00:00:59.456414+0000","last_peered":"2023-12-13T00:00:59.456414+0000","last_clean":"2023-12-13T00:00:59.456414+0000","last_became_active":"2023-12-13T00:00:31.037445+0000","last_became_peered":"2023-12-13T00:00:31.037445+0000","last_unstale":"2023-12-13T00:00:59.456414+0000","last_undegraded":"2023-12-13T00:00:59.456414+0000","last_fullsized":"2023-12-13T00:00:59.456414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:55.082987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461668+0000","last_change":"2023-12-13T00:00:35.661405+0000","last_active":"2023-12-13T00:00:59.461668+0000","last_peered":"2023-12-13T00:00:59.461668+0000","last_clean":"2023-12-13T00:00:59.461668+0000","last_became_active":"2023-12-13T00:00:35.660984+0000","last_became_peered":"2023-12-13T00:00:35.660984+0000","last_unstale":"2023-12-13T00:00:59.461668+0000","last_undegraded":"2023-12-13T00:00:59.461668+0000","last_fullsized":"2023-12-13T00:00:59.461668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:24.668139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462010+0000","last_change":"2023-12-13T00:00:31.147104+0000","last_active":"2023-12-13T00:00:59.462010+0000","last_peered":"2023-12-13T00:00:59.462010+0000","last_clean":"2023-12-13T00:00:59.462010+0000","last_became_active":"2023-12-13T00:00:31.145225+0000","last_became_peered":"2023-12-13T00:00:31.145225+0000","last_unstale":"2023-12-13T00:00:59.462010+0000","last_undegraded":"2023-12-13T00:00:59.462010+0000","last_fullsized":"2023-12-13T00:00:59.462010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:42:14.707955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461433+0000","last_change":"2023-12-13T00:00:31.119735+0000","last_active":"2023-12-13T00:00:59.461433+0000","last_peered":"2023-12-13T00:00:59.461433+0000","last_clean":"2023-12-13T00:00:59.461433+0000","last_became_active":"2023-12-13T00:00:31.119474+0000","last_became_peered":"2023-12-13T00:00:31.119474+0000","last_unstale":"2023-12-13T00:00:59.461433+0000","last_undegraded":"2023-12-13T00:00:59.461433+0000","last_fullsized":"2023-12-13T00:00:59.461433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:30.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457690+0000","last_change":"2023-12-13T00:00:31.027180+0000","last_active":"2023-12-13T00:00:59.457690+0000","last_peered":"2023-12-13T00:00:59.457690+0000","last_clean":"2023-12-13T00:00:59.457690+0000","last_became_active":"2023-12-13T00:00:31.026922+0000","last_became_peered":"2023-12-13T00:00:31.026922+0000","last_unstale":"2023-12-13T00:00:59.457690+0000","last_undegraded":"2023-12-13T00:00:59.457690+0000","last_fullsized":"2023-12-13T00:00:59.457690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:58:37.933386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.466020+0000","last_change":"2023-12-13T00:00:31.119937+0000","last_active":"2023-12-13T00:00:59.466020+0000","last_peered":"2023-12-13T00:00:59.466020+0000","last_clean":"2023-12-13T00:00:59.466020+0000","last_became_active":"2023-12-13T00:00:31.119685+0000","last_became_peered":"2023-12-13T00:00:31.119685+0000","last_unstale":"2023-12-13T00:00:59.466020+0000","last_undegraded":"2023-12-13T00:00:59.466020+0000","last_fullsized":"2023-12-13T00:00:59.466020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:00.910594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463856+0000","last_change":"2023-12-13T00:00:31.150597+0000","last_active":"2023-12-13T00:00:59.463856+0000","last_peered":"2023-12-13T00:00:59.463856+0000","last_clean":"2023-12-13T00:00:59.463856+0000","last_became_active":"2023-12-13T00:00:31.150275+0000","last_became_peered":"2023-12-13T00:00:31.150275+0000","last_unstale":"2023-12-13T00:00:59.463856+0000","last_undegraded":"2023-12-13T00:00:59.463856+0000","last_fullsized":"2023-12-13T00:00:59.463856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:20.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463111+0000","last_change":"2023-12-13T00:00:31.117688+0000","last_active":"2023-12-13T00:00:59.463111+0000","last_peered":"2023-12-13T00:00:59.463111+0000","last_clean":"2023-12-13T00:00:59.463111+0000","last_became_active":"2023-12-13T00:00:31.117409+0000","last_became_peered":"2023-12-13T00:00:31.117409+0000","last_unstale":"2023-12-13T00:00:59.463111+0000","last_undegraded":"2023-12-13T00:00:59.463111+0000","last_fullsized":"2023-12-13T00:00:59.463111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:12.753740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462722+0000","last_change":"2023-12-13T00:00:31.142584+0000","last_active":"2023-12-13T00:00:59.462722+0000","last_peered":"2023-12-13T00:00:59.462722+0000","last_clean":"2023-12-13T00:00:59.462722+0000","last_became_active":"2023-12-13T00:00:31.141656+0000","last_became_peered":"2023-12-13T00:00:31.141656+0000","last_unstale":"2023-12-13T00:00:59.462722+0000","last_undegraded":"2023-12-13T00:00:59.462722+0000","last_fullsized":"2023-12-13T00:00:59.462722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:49:22.676243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465450+0000","last_change":"2023-12-13T00:00:31.036263+0000","last_active":"2023-12-13T00:00:59.465450+0000","last_peered":"2023-12-13T00:00:59.465450+0000","last_clean":"2023-12-13T00:00:59.465450+0000","last_became_active":"2023-12-13T00:00:31.036113+0000","last_became_peered":"2023-12-13T00:00:31.036113+0000","last_unstale":"2023-12-13T00:00:59.465450+0000","last_undegraded":"2023-12-13T00:00:59.465450+0000","last_fullsized":"2023-12-13T00:00:59.465450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:01.219033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457279+0000","last_change":"2023-12-13T00:00:31.027230+0000","last_active":"2023-12-13T00:00:59.457279+0000","last_peered":"2023-12-13T00:00:59.457279+0000","last_clean":"2023-12-13T00:00:59.457279+0000","last_became_active":"2023-12-13T00:00:31.026968+0000","last_became_peered":"2023-12-13T00:00:31.026968+0000","last_unstale":"2023-12-13T00:00:59.457279+0000","last_undegraded":"2023-12-13T00:00:59.457279+0000","last_fullsized":"2023-12-13T00:00:59.457279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:53.920022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465839+0000","last_change":"2023-12-13T00:00:31.139140+0000","last_active":"2023-12-13T00:00:59.465839+0000","last_peered":"2023-12-13T00:00:59.465839+0000","last_clean":"2023-12-13T00:00:59.465839+0000","last_became_active":"2023-12-13T00:00:31.138869+0000","last_became_peered":"2023-12-13T00:00:31.138869+0000","last_unstale":"2023-12-13T00:00:59.465839+0000","last_undegraded":"2023-12-13T00:00:59.465839+0000","last_fullsized":"2023-12-13T00:00:59.465839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:03:13.913502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456333+0000","last_change":"2023-12-13T00:00:31.146522+0000","last_active":"2023-12-13T00:00:59.456333+0000","last_peered":"2023-12-13T00:00:59.456333+0000","last_clean":"2023-12-13T00:00:59.456333+0000","last_became_active":"2023-12-13T00:00:31.146264+0000","last_became_peered":"2023-12-13T00:00:31.146264+0000","last_unstale":"2023-12-13T00:00:59.456333+0000","last_undegraded":"2023-12-13T00:00:59.456333+0000","last_fullsized":"2023-12-13T00:00:59.456333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:20:47.671750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461891+0000","last_change":"2023-12-13T00:00:31.143709+0000","last_active":"2023-12-13T00:00:59.461891+0000","last_peered":"2023-12-13T00:00:59.461891+0000","last_clean":"2023-12-13T00:00:59.461891+0000","last_became_active":"2023-12-13T00:00:31.143472+0000","last_became_peered":"2023-12-13T00:00:31.143472+0000","last_unstale":"2023-12-13T00:00:59.461891+0000","last_undegraded":"2023-12-13T00:00:59.461891+0000","last_fullsized":"2023-12-13T00:00:59.461891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:21:51.967408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460848+0000","last_change":"2023-12-13T00:00:31.146698+0000","last_active":"2023-12-13T00:00:59.460848+0000","last_peered":"2023-12-13T00:00:59.460848+0000","last_clean":"2023-12-13T00:00:59.460848+0000","last_became_active":"2023-12-13T00:00:31.146159+0000","last_became_peered":"2023-12-13T00:00:31.146159+0000","last_unstale":"2023-12-13T00:00:59.460848+0000","last_undegraded":"2023-12-13T00:00:59.460848+0000","last_fullsized":"2023-12-13T00:00:59.460848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:05:56.876593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458930+0000","last_change":"2023-12-13T00:00:31.143946+0000","last_active":"2023-12-13T00:00:59.458930+0000","last_peered":"2023-12-13T00:00:59.458930+0000","last_clean":"2023-12-13T00:00:59.458930+0000","last_became_active":"2023-12-13T00:00:31.143663+0000","last_became_peered":"2023-12-13T00:00:31.143663+0000","last_unstale":"2023-12-13T00:00:59.458930+0000","last_undegraded":"2023-12-13T00:00:59.458930+0000","last_fullsized":"2023-12-13T00:00:59.458930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:27:24.026750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462145+0000","last_change":"2023-12-13T00:00:31.142314+0000","last_active":"2023-12-13T00:00:59.462145+0000","last_peered":"2023-12-13T00:00:59.462145+0000","last_clean":"2023-12-13T00:00:59.462145+0000","last_became_active":"2023-12-13T00:00:31.142067+0000","last_became_peered":"2023-12-13T00:00:31.142067+0000","last_unstale":"2023-12-13T00:00:59.462145+0000","last_undegraded":"2023-12-13T00:00:59.462145+0000","last_fullsized":"2023-12-13T00:00:59.462145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:36.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458609+0000","last_change":"2023-12-13T00:00:31.146764+0000","last_active":"2023-12-13T00:00:59.458609+0000","last_peered":"2023-12-13T00:00:59.458609+0000","last_clean":"2023-12-13T00:00:59.458609+0000","last_became_active":"2023-12-13T00:00:31.146501+0000","last_became_peered":"2023-12-13T00:00:31.146501+0000","last_unstale":"2023-12-13T00:00:59.458609+0000","last_undegraded":"2023-12-13T00:00:59.458609+0000","last_fullsized":"2023-12-13T00:00:59.458609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:20:36.334790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457190+0000","last_change":"2023-12-13T00:00:31.138982+0000","last_active":"2023-12-13T00:00:59.457190+0000","last_peered":"2023-12-13T00:00:59.457190+0000","last_clean":"2023-12-13T00:00:59.457190+0000","last_became_active":"2023-12-13T00:00:31.138738+0000","last_became_peered":"2023-12-13T00:00:31.138738+0000","last_unstale":"2023-12-13T00:00:59.457190+0000","last_undegraded":"2023-12-13T00:00:59.457190+0000","last_fullsized":"2023-12-13T00:00:59.457190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:08:05.660552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465686+0000","last_change":"2023-12-13T00:00:31.148499+0000","last_active":"2023-12-13T00:00:59.465686+0000","last_peered":"2023-12-13T00:00:59.465686+0000","last_clean":"2023-12-13T00:00:59.465686+0000","last_became_active":"2023-12-13T00:00:31.148251+0000","last_became_peered":"2023-12-13T00:00:31.148251+0000","last_unstale":"2023-12-13T00:00:59.465686+0000","last_undegraded":"2023-12-13T00:00:59.465686+0000","last_fullsized":"2023-12-13T00:00:59.465686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:46:41.106364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463595+0000","last_change":"2023-12-13T00:00:31.117684+0000","last_active":"2023-12-13T00:00:59.463595+0000","last_peered":"2023-12-13T00:00:59.463595+0000","last_clean":"2023-12-13T00:00:59.463595+0000","last_became_active":"2023-12-13T00:00:31.117423+0000","last_became_peered":"2023-12-13T00:00:31.117423+0000","last_unstale":"2023-12-13T00:00:59.463595+0000","last_undegraded":"2023-12-13T00:00:59.463595+0000","last_fullsized":"2023-12-13T00:00:59.463595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:33:39.081529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.464860+0000","last_change":"2023-12-13T00:00:31.150615+0000","last_active":"2023-12-13T00:00:59.464860+0000","last_peered":"2023-12-13T00:00:59.464860+0000","last_clean":"2023-12-13T00:00:59.464860+0000","last_became_active":"2023-12-13T00:00:31.150324+0000","last_became_peered":"2023-12-13T00:00:31.150324+0000","last_unstale":"2023-12-13T00:00:59.464860+0000","last_undegraded":"2023-12-13T00:00:59.464860+0000","last_fullsized":"2023-12-13T00:00:59.464860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:15:16.348222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461196+0000","last_change":"2023-12-13T00:00:31.147145+0000","last_active":"2023-12-13T00:00:59.461196+0000","last_peered":"2023-12-13T00:00:59.461196+0000","last_clean":"2023-12-13T00:00:59.461196+0000","last_became_active":"2023-12-13T00:00:31.146444+0000","last_became_peered":"2023-12-13T00:00:31.146444+0000","last_unstale":"2023-12-13T00:00:59.461196+0000","last_undegraded":"2023-12-13T00:00:59.461196+0000","last_fullsized":"2023-12-13T00:00:59.461196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:52:46.548248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461101+0000","last_change":"2023-12-13T00:00:31.148920+0000","last_active":"2023-12-13T00:00:59.461101+0000","last_peered":"2023-12-13T00:00:59.461101+0000","last_clean":"2023-12-13T00:00:59.461101+0000","last_became_active":"2023-12-13T00:00:31.148529+0000","last_became_peered":"2023-12-13T00:00:31.148529+0000","last_unstale":"2023-12-13T00:00:59.461101+0000","last_undegraded":"2023-12-13T00:00:59.461101+0000","last_fullsized":"2023-12-13T00:00:59.461101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:51.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461057+0000","last_change":"2023-12-13T00:00:31.149934+0000","last_active":"2023-12-13T00:00:59.461057+0000","last_peered":"2023-12-13T00:00:59.461057+0000","last_clean":"2023-12-13T00:00:59.461057+0000","last_became_active":"2023-12-13T00:00:31.149685+0000","last_became_peered":"2023-12-13T00:00:31.149685+0000","last_unstale":"2023-12-13T00:00:59.461057+0000","last_undegraded":"2023-12-13T00:00:59.461057+0000","last_fullsized":"2023-12-13T00:00:59.461057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:06.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458537+0000","last_change":"2023-12-13T00:00:31.035879+0000","last_active":"2023-12-13T00:00:59.458537+0000","last_peered":"2023-12-13T00:00:59.458537+0000","last_clean":"2023-12-13T00:00:59.458537+0000","last_became_active":"2023-12-13T00:00:31.035672+0000","last_became_peered":"2023-12-13T00:00:31.035672+0000","last_unstale":"2023-12-13T00:00:59.458537+0000","last_undegraded":"2023-12-13T00:00:59.458537+0000","last_fullsized":"2023-12-13T00:00:59.458537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:30.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465289+0000","last_change":"2023-12-13T00:00:31.146556+0000","last_active":"2023-12-13T00:00:59.465289+0000","last_peered":"2023-12-13T00:00:59.465289+0000","last_clean":"2023-12-13T00:00:59.465289+0000","last_became_active":"2023-12-13T00:00:31.146186+0000","last_became_peered":"2023-12-13T00:00:31.146186+0000","last_unstale":"2023-12-13T00:00:59.465289+0000","last_undegraded":"2023-12-13T00:00:59.465289+0000","last_fullsized":"2023-12-13T00:00:59.465289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:20:30.098687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459678+0000","last_change":"2023-12-13T00:00:31.145365+0000","last_active":"2023-12-13T00:00:59.459678+0000","last_peered":"2023-12-13T00:00:59.459678+0000","last_clean":"2023-12-13T00:00:59.459678+0000","last_became_active":"2023-12-13T00:00:31.144458+0000","last_became_peered":"2023-12-13T00:00:31.144458+0000","last_unstale":"2023-12-13T00:00:59.459678+0000","last_undegraded":"2023-12-13T00:00:59.459678+0000","last_fullsized":"2023-12-13T00:00:59.459678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:03:13.913502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462069+0000","last_change":"2023-12-13T00:00:31.145052+0000","last_active":"2023-12-13T00:00:59.462069+0000","last_peered":"2023-12-13T00:00:59.462069+0000","last_clean":"2023-12-13T00:00:59.462069+0000","last_became_active":"2023-12-13T00:00:31.144792+0000","last_became_peered":"2023-12-13T00:00:31.144792+0000","last_unstale":"2023-12-13T00:00:59.462069+0000","last_undegraded":"2023-12-13T00:00:59.462069+0000","last_fullsized":"2023-12-13T00:00:59.462069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:30:27.231427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460654+0000","last_change":"2023-12-13T00:00:31.149527+0000","last_active":"2023-12-13T00:00:59.460654+0000","last_peered":"2023-12-13T00:00:59.460654+0000","last_clean":"2023-12-13T00:00:59.460654+0000","last_became_active":"2023-12-13T00:00:31.148875+0000","last_became_peered":"2023-12-13T00:00:31.148875+0000","last_unstale":"2023-12-13T00:00:59.460654+0000","last_undegraded":"2023-12-13T00:00:59.460654+0000","last_fullsized":"2023-12-13T00:00:59.460654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:01.219033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462203+0000","last_change":"2023-12-13T00:00:31.144423+0000","last_active":"2023-12-13T00:00:59.462203+0000","last_peered":"2023-12-13T00:00:59.462203+0000","last_clean":"2023-12-13T00:00:59.462203+0000","last_became_active":"2023-12-13T00:00:31.144174+0000","last_became_peered":"2023-12-13T00:00:31.144174+0000","last_unstale":"2023-12-13T00:00:59.462203+0000","last_undegraded":"2023-12-13T00:00:59.462203+0000","last_fullsized":"2023-12-13T00:00:59.462203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:10:31.724460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465379+0000","last_change":"2023-12-13T00:00:31.144074+0000","last_active":"2023-12-13T00:00:59.465379+0000","last_peered":"2023-12-13T00:00:59.465379+0000","last_clean":"2023-12-13T00:00:59.465379+0000","last_became_active":"2023-12-13T00:00:31.143809+0000","last_became_peered":"2023-12-13T00:00:31.143809+0000","last_unstale":"2023-12-13T00:00:59.465379+0000","last_undegraded":"2023-12-13T00:00:59.465379+0000","last_fullsized":"2023-12-13T00:00:59.465379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:51.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465650+0000","last_change":"2023-12-13T00:00:31.116522+0000","last_active":"2023-12-13T00:00:59.465650+0000","last_peered":"2023-12-13T00:00:59.465650+0000","last_clean":"2023-12-13T00:00:59.465650+0000","last_became_active":"2023-12-13T00:00:31.116230+0000","last_became_peered":"2023-12-13T00:00:31.116230+0000","last_unstale":"2023-12-13T00:00:59.465650+0000","last_undegraded":"2023-12-13T00:00:59.465650+0000","last_fullsized":"2023-12-13T00:00:59.465650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:52:46.548248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459456+0000","last_change":"2023-12-13T00:00:31.149691+0000","last_active":"2023-12-13T00:00:59.459456+0000","last_peered":"2023-12-13T00:00:59.459456+0000","last_clean":"2023-12-13T00:00:59.459456+0000","last_became_active":"2023-12-13T00:00:31.149410+0000","last_became_peered":"2023-12-13T00:00:31.149410+0000","last_unstale":"2023-12-13T00:00:59.459456+0000","last_undegraded":"2023-12-13T00:00:59.459456+0000","last_fullsized":"2023-12-13T00:00:59.459456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:50:58.339436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7451,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":116382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.442}]},{"osd":1,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.49299999999999999}]},{"osd":2,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.502},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.51300000000000001}]},{"osd":3,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.47699999999999998}]},{"osd":4,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.53400000000000003}]},{"osd":6,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.52500000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":116678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":120883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":116700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":1.24},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.82499999999999996}]},{"osd":1,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.2729999999999999}]},{"osd":2,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":1.202}]},{"osd":4,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.50900000000000001}]},{"osd":5,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.63900000000000001}]},{"osd":6,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.71099999999999997}]},{"osd":7,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58599999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":884736,"data_stored":706002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":119349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.45500000000000002}]},{"osd":1,"last update":"Wed Dec 13 00:01:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.48899999999999999}]},{"osd":3,"last update":"Wed Dec 13 00:01:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.52400000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:01:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.41099999999999998}]},{"osd":5,"last update":"Wed Dec 13 00:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.38200000000000001}]},{"osd":6,"last update":"Wed Dec 13 00:01:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.85099999999999998}]},{"osd":7,"last update":"Wed Dec 13 00:01:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.59299999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 00:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.35699999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.316}]},{"osd":3,"last update":"Wed Dec 13 00:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.249},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.33600000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.437}]},{"osd":5,"last update":"Wed Dec 13 00:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.55800000000000005}]},{"osd":6,"last update":"Wed Dec 13 00:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed Dec 13 00:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.61799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":897024,"data_stored":706646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.44500000000000001}]},{"osd":1,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.42599999999999999}]},{"osd":2,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.375}]},{"osd":3,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.437},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.503}]},{"osd":4,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.32400000000000001}]},{"osd":6,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.39500000000000002}]},{"osd":7,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.41299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T00:01:13.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T00:01:13.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.794+0000 7fe477f0f640 1 Processor -- start 2023-12-13T00:01:13.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.794+0000 7fe477f0f640 1 -- start start 2023-12-13T00:01:13.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.794+0000 7fe477f0f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4700cda70 0x7fe4700ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:13.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.794+0000 7fe477f0f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4700cc420 0x7fe470159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:13.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.794+0000 7fe477f0f640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4700cbda0 con 0x7fe470159b50 2023-12-13T00:01:13.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.794+0000 7fe477f0f640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4700cc230 con 0x7fe4700cc420 2023-12-13T00:01:13.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.794+0000 7fe477f0f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700cb4e0 con 0x7fe4700cda70 2023-12-13T00:01:13.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.795+0000 7fe475cab640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4700cda70 0x7fe4700ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:13.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.796+0000 7fe475cab640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4700cda70 0x7fe4700ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:48578/0 (socket says 172.21.15.72:48578) 2023-12-13T00:01:13.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.796+0000 7fe475cab640 1 -- 172.21.15.72:0/363605491 learned_addr learned my addr 172.21.15.72:0/363605491 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.798+0000 7fe475cab640 1 -- 172.21.15.72:0/363605491 >> v2:172.21.15.72:3300/0 conn(0x7fe4700cc420 msgr2=0x7fe470159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.798+0000 7fe475cab640 1 --2- 172.21.15.72:0/363605491 >> v2:172.21.15.72:3300/0 conn(0x7fe4700cc420 0x7fe470159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.798+0000 7fe475cab640 1 -- 172.21.15.72:0/363605491 >> v1:172.21.15.72:6789/0 conn(0x7fe470159b50 legacy=0x7fe4700c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.798+0000 7fe475cab640 1 -- 172.21.15.72:0/363605491 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4700cce00 con 0x7fe4700cda70 2023-12-13T00:01:13.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.800+0000 7fe475cab640 1 --2- 172.21.15.72:0/363605491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4700cda70 0x7fe4700ce350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009870 tx=0x7fe46c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28cee1f8a970287d server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:13.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.804+0000 7fe474ca9640 1 -- 172.21.15.72:0/363605491 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c030840 con 0x7fe4700cda70 2023-12-13T00:01:13.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.804+0000 7fe474ca9640 1 -- 172.21.15.72:0/363605491 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c0309a0 con 0x7fe4700cda70 2023-12-13T00:01:13.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.804+0000 7fe474ca9640 1 -- 172.21.15.72:0/363605491 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c030d30 con 0x7fe4700cda70 2023-12-13T00:01:13.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.804+0000 7fe477f0f640 1 -- 172.21.15.72:0/363605491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4700cda70 msgr2=0x7fe4700ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:13.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.804+0000 7fe477f0f640 1 --2- 172.21.15.72:0/363605491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4700cda70 0x7fe4700ce350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009870 tx=0x7fe46c02b980 comp rx=0 tx=0).stop 2023-12-13T00:01:13.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.804+0000 7fe477f0f640 1 -- 172.21.15.72:0/363605491 shutdown_connections 2023-12-13T00:01:13.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.804+0000 7fe477f0f640 1 --2- 172.21.15.72:0/363605491 >> v2:172.21.15.72:3300/0 conn(0x7fe4700cc420 0x7fe470159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.804+0000 7fe477f0f640 1 --2- 172.21.15.72:0/363605491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4700cda70 0x7fe4700ce350 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.804+0000 7fe477f0f640 1 -- 172.21.15.72:0/363605491 >> 172.21.15.72:0/363605491 conn(0x7fe4700b07b0 msgr2=0x7fe4700b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:13.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.804+0000 7fe477f0f640 1 -- 172.21.15.72:0/363605491 shutdown_connections 2023-12-13T00:01:13.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.804+0000 7fe477f0f640 1 -- 172.21.15.72:0/363605491 wait complete. 2023-12-13T00:01:13.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.805+0000 7fe477f0f640 1 Processor -- start 2023-12-13T00:01:13.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.805+0000 7fe477f0f640 1 -- start start 2023-12-13T00:01:13.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.806+0000 7fe477f0f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4700cc420 0x7fe4700ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:13.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.806+0000 7fe477f0f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4700cda70 0x7fe4700c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:13.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.806+0000 7fe477f0f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe470159b50 0x7fe470154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:13.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.806+0000 7fe477f0f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700c3880 con 0x7fe470159b50 2023-12-13T00:01:13.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.806+0000 7fe477f0f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700c4150 con 0x7fe4700cda70 2023-12-13T00:01:13.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.806+0000 7fe477f0f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe470158bb0 con 0x7fe4700cc420 2023-12-13T00:01:13.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.807+0000 7fe475cab640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4700cc420 0x7fe4700ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:13.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.807+0000 7fe4754aa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4700cda70 0x7fe4700c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:13.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.807+0000 7fe475cab640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4700cc420 0x7fe4700ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:48586/0 (socket says 172.21.15.72:48586) 2023-12-13T00:01:13.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.807+0000 7fe475cab640 1 -- 172.21.15.72:0/3485119080 learned_addr learned my addr 172.21.15.72:0/3485119080 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:13.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.811+0000 7fe475cab640 1 -- 172.21.15.72:0/3485119080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4700cda70 msgr2=0x7fe4700c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:13.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.811+0000 7fe475cab640 1 --2- 172.21.15.72:0/3485119080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4700cda70 0x7fe4700c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.811+0000 7fe475cab640 1 -- 172.21.15.72:0/3485119080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe470159b50 msgr2=0x7fe470154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:13.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.811+0000 7fe475cab640 1 --2- 172.21.15.72:0/3485119080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe470159b50 0x7fe470154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:13.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.811+0000 7fe475cab640 1 -- 172.21.15.72:0/3485119080 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c0094d0 con 0x7fe4700cc420 2023-12-13T00:01:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.814+0000 7fe475cab640 1 --2- 172.21.15.72:0/3485119080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4700cc420 0x7fe4700ce8c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009990 tx=0x7fe46c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.818+0000 7fe4667fc640 1 -- 172.21.15.72:0/3485119080 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c039e20 con 0x7fe4700cc420 2023-12-13T00:01:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.818+0000 7fe4667fc640 1 -- 172.21.15.72:0/3485119080 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c043400 con 0x7fe4700cc420 2023-12-13T00:01:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.818+0000 7fe477f0f640 1 -- 172.21.15.72:0/3485119080 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4701588d0 con 0x7fe4700cc420 2023-12-13T00:01:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.818+0000 7fe4667fc640 1 -- 172.21.15.72:0/3485119080 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c0437b0 con 0x7fe4700cc420 2023-12-13T00:01:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.818+0000 7fe477f0f640 1 -- 172.21.15.72:0/3485119080 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4700c4840 con 0x7fe4700cc420 2023-12-13T00:01:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.819+0000 7fe477f0f640 1 -- 172.21.15.72:0/3485119080 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe470153f60 con 0x7fe4700cc420 2023-12-13T00:01:13.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.840+0000 7fe4667fc640 1 -- 172.21.15.72:0/3485119080 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe46c043910 con 0x7fe4700cc420 2023-12-13T00:01:13.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.840+0000 7fe4667fc640 1 --2- 172.21.15.72:0/3485119080 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe45406b240 0x7fe45406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:13.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.840+0000 7fe4754aa640 1 --2- 172.21.15.72:0/3485119080 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe45406b240 0x7fe45406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:13.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:13.840+0000 7fe4754aa640 1 --2- 172.21.15.72:0/3485119080 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe45406b240 0x7fe45406d700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe4701e9ce0 tx=0x7fe460009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:14.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.065+0000 7fe4667fc640 1 -- 172.21.15.72:0/3485119080 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fe46c03e070 con 0x7fe4700cc420 2023-12-13T00:01:14.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.076+0000 7fe4667fc640 1 -- 172.21.15.72:0/3485119080 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe46c078300 con 0x7fe4700cc420 2023-12-13T00:01:14.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.270+0000 7fe477f0f640 1 -- 172.21.15.72:0/3485119080 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4700b0b90 con 0x7fe45406b240 2023-12-13T00:01:14.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.278+0000 7fe4667fc640 1 -- 172.21.15.72:0/3485119080 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361170 (secure 0 0 0) 0x7fe4700b0b90 con 0x7fe45406b240 2023-12-13T00:01:14.284 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:01:14.287 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-12-13T00:01:14.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.282+0000 7fe477f0f640 1 -- 172.21.15.72:0/3485119080 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe45406b240 msgr2=0x7fe45406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:14.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.282+0000 7fe477f0f640 1 --2- 172.21.15.72:0/3485119080 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe45406b240 0x7fe45406d700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe4701e9ce0 tx=0x7fe460009060 comp rx=0 tx=0).stop 2023-12-13T00:01:14.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.282+0000 7fe477f0f640 1 -- 172.21.15.72:0/3485119080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4700cc420 msgr2=0x7fe4700ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:14.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.282+0000 7fe477f0f640 1 --2- 172.21.15.72:0/3485119080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4700cc420 0x7fe4700ce8c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009990 tx=0x7fe46c004730 comp rx=0 tx=0).stop 2023-12-13T00:01:14.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.282+0000 7fe477f0f640 1 -- 172.21.15.72:0/3485119080 shutdown_connections 2023-12-13T00:01:14.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.282+0000 7fe477f0f640 1 --2- 172.21.15.72:0/3485119080 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe45406b240 0x7fe45406d700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:14.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.282+0000 7fe477f0f640 1 --2- 172.21.15.72:0/3485119080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe470159b50 0x7fe470154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:14.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.282+0000 7fe477f0f640 1 --2- 172.21.15.72:0/3485119080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4700cda70 0x7fe4700c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:14.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.282+0000 7fe477f0f640 1 --2- 172.21.15.72:0/3485119080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4700cc420 0x7fe4700ce8c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:14.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.282+0000 7fe477f0f640 1 -- 172.21.15.72:0/3485119080 >> 172.21.15.72:0/3485119080 conn(0x7fe4700b07b0 msgr2=0x7fe470152f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:14.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.282+0000 7fe477f0f640 1 -- 172.21.15.72:0/3485119080 shutdown_connections 2023-12-13T00:01:14.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.282+0000 7fe477f0f640 1 -- 172.21.15.72:0/3485119080 wait complete. 2023-12-13T00:01:14.294 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-12-13T00:01:12.535027+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597819,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":287,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219656,"kb_used_data":3528,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755064,"statfs":{"total":773094113280,"available":772869185536,"internally_reserved":0,"allocated":3612672,"data_stored":2119430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2812,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.998536"},"pg_stats":[{"pgid":"2.1f","version":"27'9","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.447285+0000","last_change":"2023-12-13T00:00:29.997631+0000","last_active":"2023-12-13T00:01:06.447285+0000","last_peered":"2023-12-13T00:01:06.447285+0000","last_clean":"2023-12-13T00:01:06.447285+0000","last_became_active":"2023-12-13T00:00:29.997381+0000","last_became_peered":"2023-12-13T00:00:29.997381+0000","last_unstale":"2023-12-13T00:01:06.447285+0000","last_undegraded":"2023-12-13T00:01:06.447285+0000","last_fullsized":"2023-12-13T00:01:06.447285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:33:37.976462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465727+0000","last_change":"2023-12-13T00:00:31.138533+0000","last_active":"2023-12-13T00:00:59.465727+0000","last_peered":"2023-12-13T00:00:59.465727+0000","last_clean":"2023-12-13T00:00:59.465727+0000","last_became_active":"2023-12-13T00:00:31.138242+0000","last_became_peered":"2023-12-13T00:00:31.138242+0000","last_unstale":"2023-12-13T00:00:59.465727+0000","last_undegraded":"2023-12-13T00:00:59.465727+0000","last_fullsized":"2023-12-13T00:00:59.465727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:39:59.955103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461340+0000","last_change":"2023-12-13T00:00:35.667840+0000","last_active":"2023-12-13T00:00:59.461340+0000","last_peered":"2023-12-13T00:00:59.461340+0000","last_clean":"2023-12-13T00:00:59.461340+0000","last_became_active":"2023-12-13T00:00:35.667498+0000","last_became_peered":"2023-12-13T00:00:35.667498+0000","last_unstale":"2023-12-13T00:00:59.461340+0000","last_undegraded":"2023-12-13T00:00:59.461340+0000","last_fullsized":"2023-12-13T00:00:59.461340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:17.304722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.531812+0000","last_change":"2023-12-13T00:00:30.001888+0000","last_active":"2023-12-13T00:01:00.531812+0000","last_peered":"2023-12-13T00:01:00.531812+0000","last_clean":"2023-12-13T00:01:00.531812+0000","last_became_active":"2023-12-13T00:00:30.001628+0000","last_became_peered":"2023-12-13T00:00:30.001628+0000","last_unstale":"2023-12-13T00:01:00.531812+0000","last_undegraded":"2023-12-13T00:01:00.531812+0000","last_fullsized":"2023-12-13T00:01:00.531812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:48:30.422214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465657+0000","last_change":"2023-12-13T00:00:31.036420+0000","last_active":"2023-12-13T00:00:59.465657+0000","last_peered":"2023-12-13T00:00:59.465657+0000","last_clean":"2023-12-13T00:00:59.465657+0000","last_became_active":"2023-12-13T00:00:31.036197+0000","last_became_peered":"2023-12-13T00:00:31.036197+0000","last_unstale":"2023-12-13T00:00:59.465657+0000","last_undegraded":"2023-12-13T00:00:59.465657+0000","last_fullsized":"2023-12-13T00:00:59.465657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:05:56.876593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461830+0000","last_change":"2023-12-13T00:00:35.665348+0000","last_active":"2023-12-13T00:00:59.461830+0000","last_peered":"2023-12-13T00:00:59.461830+0000","last_clean":"2023-12-13T00:00:59.461830+0000","last_became_active":"2023-12-13T00:00:35.664981+0000","last_became_peered":"2023-12-13T00:00:35.664981+0000","last_unstale":"2023-12-13T00:00:59.461830+0000","last_undegraded":"2023-12-13T00:00:59.461830+0000","last_fullsized":"2023-12-13T00:00:59.461830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:55.759392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.522665+0000","last_change":"2023-12-13T00:00:30.009983+0000","last_active":"2023-12-13T00:01:06.522665+0000","last_peered":"2023-12-13T00:01:06.522665+0000","last_clean":"2023-12-13T00:01:06.522665+0000","last_became_active":"2023-12-13T00:00:30.009724+0000","last_became_peered":"2023-12-13T00:00:30.009724+0000","last_unstale":"2023-12-13T00:01:06.522665+0000","last_undegraded":"2023-12-13T00:01:06.522665+0000","last_fullsized":"2023-12-13T00:01:06.522665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:20:28.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456667+0000","last_change":"2023-12-13T00:00:31.151042+0000","last_active":"2023-12-13T00:00:59.456667+0000","last_peered":"2023-12-13T00:00:59.456667+0000","last_clean":"2023-12-13T00:00:59.456667+0000","last_became_active":"2023-12-13T00:00:31.150735+0000","last_became_peered":"2023-12-13T00:00:31.150735+0000","last_unstale":"2023-12-13T00:00:59.456667+0000","last_undegraded":"2023-12-13T00:00:59.456667+0000","last_fullsized":"2023-12-13T00:00:59.456667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:36.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462064+0000","last_change":"2023-12-13T00:00:35.668759+0000","last_active":"2023-12-13T00:00:59.462064+0000","last_peered":"2023-12-13T00:00:59.462064+0000","last_clean":"2023-12-13T00:00:59.462064+0000","last_became_active":"2023-12-13T00:00:35.668361+0000","last_became_peered":"2023-12-13T00:00:35.668361+0000","last_unstale":"2023-12-13T00:00:59.462064+0000","last_undegraded":"2023-12-13T00:00:59.462064+0000","last_fullsized":"2023-12-13T00:00:59.462064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:05.770014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461073+0000","last_change":"2023-12-13T00:00:30.009921+0000","last_active":"2023-12-13T00:00:59.461073+0000","last_peered":"2023-12-13T00:00:59.461073+0000","last_clean":"2023-12-13T00:00:59.461073+0000","last_became_active":"2023-12-13T00:00:30.009644+0000","last_became_peered":"2023-12-13T00:00:30.009644+0000","last_unstale":"2023-12-13T00:00:59.461073+0000","last_undegraded":"2023-12-13T00:00:59.461073+0000","last_fullsized":"2023-12-13T00:00:59.461073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:48:30.422214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457963+0000","last_change":"2023-12-13T00:00:31.146801+0000","last_active":"2023-12-13T00:00:59.457963+0000","last_peered":"2023-12-13T00:00:59.457963+0000","last_clean":"2023-12-13T00:00:59.457963+0000","last_became_active":"2023-12-13T00:00:31.146516+0000","last_became_peered":"2023-12-13T00:00:31.146516+0000","last_unstale":"2023-12-13T00:00:59.457963+0000","last_undegraded":"2023-12-13T00:00:59.457963+0000","last_fullsized":"2023-12-13T00:00:59.457963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:44:23.442162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461875+0000","last_change":"2023-12-13T00:00:35.668621+0000","last_active":"2023-12-13T00:00:59.461875+0000","last_peered":"2023-12-13T00:00:59.461875+0000","last_clean":"2023-12-13T00:00:59.461875+0000","last_became_active":"2023-12-13T00:00:35.668298+0000","last_became_peered":"2023-12-13T00:00:35.668298+0000","last_unstale":"2023-12-13T00:00:59.461875+0000","last_undegraded":"2023-12-13T00:00:59.461875+0000","last_fullsized":"2023-12-13T00:00:59.461875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:40:04.506084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457767+0000","last_change":"2023-12-13T00:00:31.036347+0000","last_active":"2023-12-13T00:00:59.457767+0000","last_peered":"2023-12-13T00:00:59.457767+0000","last_clean":"2023-12-13T00:00:59.457767+0000","last_became_active":"2023-12-13T00:00:31.036062+0000","last_became_peered":"2023-12-13T00:00:31.036062+0000","last_unstale":"2023-12-13T00:00:59.457767+0000","last_undegraded":"2023-12-13T00:00:59.457767+0000","last_fullsized":"2023-12-13T00:00:59.457767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:15:29.783257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:03.925024+0000","last_change":"2023-12-13T00:00:30.001066+0000","last_active":"2023-12-13T00:01:03.925024+0000","last_peered":"2023-12-13T00:01:03.925024+0000","last_clean":"2023-12-13T00:01:03.925024+0000","last_became_active":"2023-12-13T00:00:30.000782+0000","last_became_peered":"2023-12-13T00:00:30.000782+0000","last_unstale":"2023-12-13T00:01:03.925024+0000","last_undegraded":"2023-12-13T00:01:03.925024+0000","last_fullsized":"2023-12-13T00:01:03.925024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:53.977921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457740+0000","last_change":"2023-12-13T00:00:35.662038+0000","last_active":"2023-12-13T00:00:59.457740+0000","last_peered":"2023-12-13T00:00:59.457740+0000","last_clean":"2023-12-13T00:00:59.457740+0000","last_became_active":"2023-12-13T00:00:35.661458+0000","last_became_peered":"2023-12-13T00:00:35.661458+0000","last_unstale":"2023-12-13T00:00:59.457740+0000","last_undegraded":"2023-12-13T00:00:59.457740+0000","last_fullsized":"2023-12-13T00:00:59.457740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:12:27.307277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462675+0000","last_change":"2023-12-13T00:00:31.119718+0000","last_active":"2023-12-13T00:00:59.462675+0000","last_peered":"2023-12-13T00:00:59.462675+0000","last_clean":"2023-12-13T00:00:59.462675+0000","last_became_active":"2023-12-13T00:00:31.119447+0000","last_became_peered":"2023-12-13T00:00:31.119447+0000","last_unstale":"2023-12-13T00:00:59.462675+0000","last_undegraded":"2023-12-13T00:00:59.462675+0000","last_fullsized":"2023-12-13T00:00:59.462675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:08.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.539985+0000","last_change":"2023-12-13T00:00:29.968425+0000","last_active":"2023-12-13T00:01:00.539985+0000","last_peered":"2023-12-13T00:01:00.539985+0000","last_clean":"2023-12-13T00:01:00.539985+0000","last_became_active":"2023-12-13T00:00:29.967929+0000","last_became_peered":"2023-12-13T00:00:29.967929+0000","last_unstale":"2023-12-13T00:01:00.539985+0000","last_undegraded":"2023-12-13T00:01:00.539985+0000","last_fullsized":"2023-12-13T00:01:00.539985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:53.977921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460657+0000","last_change":"2023-12-13T00:00:35.662848+0000","last_active":"2023-12-13T00:00:59.460657+0000","last_peered":"2023-12-13T00:00:59.460657+0000","last_clean":"2023-12-13T00:00:59.460657+0000","last_became_active":"2023-12-13T00:00:35.662469+0000","last_became_peered":"2023-12-13T00:00:35.662469+0000","last_unstale":"2023-12-13T00:00:59.460657+0000","last_undegraded":"2023-12-13T00:00:59.460657+0000","last_fullsized":"2023-12-13T00:00:59.460657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:17:20.456996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461523+0000","last_change":"2023-12-13T00:00:31.143108+0000","last_active":"2023-12-13T00:00:59.461523+0000","last_peered":"2023-12-13T00:00:59.461523+0000","last_clean":"2023-12-13T00:00:59.461523+0000","last_became_active":"2023-12-13T00:00:31.142847+0000","last_became_peered":"2023-12-13T00:00:31.142847+0000","last_unstale":"2023-12-13T00:00:59.461523+0000","last_undegraded":"2023-12-13T00:00:59.461523+0000","last_fullsized":"2023-12-13T00:00:59.461523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:20.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:03.924526+0000","last_change":"2023-12-13T00:00:30.004483+0000","last_active":"2023-12-13T00:01:03.924526+0000","last_peered":"2023-12-13T00:01:03.924526+0000","last_clean":"2023-12-13T00:01:03.924526+0000","last_became_active":"2023-12-13T00:00:30.004195+0000","last_became_peered":"2023-12-13T00:00:30.004195+0000","last_unstale":"2023-12-13T00:01:03.924526+0000","last_undegraded":"2023-12-13T00:01:03.924526+0000","last_fullsized":"2023-12-13T00:01:03.924526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:35.192132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462443+0000","last_change":"2023-12-13T00:00:35.660024+0000","last_active":"2023-12-13T00:00:59.462443+0000","last_peered":"2023-12-13T00:00:59.462443+0000","last_clean":"2023-12-13T00:00:59.462443+0000","last_became_active":"2023-12-13T00:00:35.659637+0000","last_became_peered":"2023-12-13T00:00:35.659637+0000","last_unstale":"2023-12-13T00:00:59.462443+0000","last_undegraded":"2023-12-13T00:00:59.462443+0000","last_fullsized":"2023-12-13T00:00:59.462443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:19.752973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457668+0000","last_change":"2023-12-13T00:00:31.143938+0000","last_active":"2023-12-13T00:00:59.457668+0000","last_peered":"2023-12-13T00:00:59.457668+0000","last_clean":"2023-12-13T00:00:59.457668+0000","last_became_active":"2023-12-13T00:00:31.143673+0000","last_became_peered":"2023-12-13T00:00:31.143673+0000","last_unstale":"2023-12-13T00:00:59.457668+0000","last_undegraded":"2023-12-13T00:00:59.457668+0000","last_fullsized":"2023-12-13T00:00:59.457668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:56:04.585998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:04.028525+0000","last_change":"2023-12-13T00:00:30.005987+0000","last_active":"2023-12-13T00:01:04.028525+0000","last_peered":"2023-12-13T00:01:04.028525+0000","last_clean":"2023-12-13T00:01:04.028525+0000","last_became_active":"2023-12-13T00:00:30.005740+0000","last_became_peered":"2023-12-13T00:00:30.005740+0000","last_unstale":"2023-12-13T00:01:04.028525+0000","last_undegraded":"2023-12-13T00:01:04.028525+0000","last_fullsized":"2023-12-13T00:01:04.028525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:03:55.109283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462647+0000","last_change":"2023-12-13T00:00:35.666041+0000","last_active":"2023-12-13T00:00:59.462647+0000","last_peered":"2023-12-13T00:00:59.462647+0000","last_clean":"2023-12-13T00:00:59.462647+0000","last_became_active":"2023-12-13T00:00:35.665670+0000","last_became_peered":"2023-12-13T00:00:35.665670+0000","last_unstale":"2023-12-13T00:00:59.462647+0000","last_undegraded":"2023-12-13T00:00:59.462647+0000","last_fullsized":"2023-12-13T00:00:59.462647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:10.984025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462081+0000","last_change":"2023-12-13T00:00:31.146677+0000","last_active":"2023-12-13T00:00:59.462081+0000","last_peered":"2023-12-13T00:00:59.462081+0000","last_clean":"2023-12-13T00:00:59.462081+0000","last_became_active":"2023-12-13T00:00:31.146435+0000","last_became_peered":"2023-12-13T00:00:31.146435+0000","last_unstale":"2023-12-13T00:00:59.462081+0000","last_undegraded":"2023-12-13T00:00:59.462081+0000","last_fullsized":"2023-12-13T00:00:59.462081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:32:52.059012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:03.923794+0000","last_change":"2023-12-13T00:00:30.006240+0000","last_active":"2023-12-13T00:01:03.923794+0000","last_peered":"2023-12-13T00:01:03.923794+0000","last_clean":"2023-12-13T00:01:03.923794+0000","last_became_active":"2023-12-13T00:00:30.005909+0000","last_became_peered":"2023-12-13T00:00:30.005909+0000","last_unstale":"2023-12-13T00:01:03.923794+0000","last_undegraded":"2023-12-13T00:01:03.923794+0000","last_fullsized":"2023-12-13T00:01:03.923794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:59:20.687032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462982+0000","last_change":"2023-12-13T00:00:35.665918+0000","last_active":"2023-12-13T00:00:59.462982+0000","last_peered":"2023-12-13T00:00:59.462982+0000","last_clean":"2023-12-13T00:00:59.462982+0000","last_became_active":"2023-12-13T00:00:35.665521+0000","last_became_peered":"2023-12-13T00:00:35.665521+0000","last_unstale":"2023-12-13T00:00:59.462982+0000","last_undegraded":"2023-12-13T00:00:59.462982+0000","last_fullsized":"2023-12-13T00:00:59.462982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:05.461575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462472+0000","last_change":"2023-12-13T00:00:31.145392+0000","last_active":"2023-12-13T00:00:59.462472+0000","last_peered":"2023-12-13T00:00:59.462472+0000","last_clean":"2023-12-13T00:00:59.462472+0000","last_became_active":"2023-12-13T00:00:31.145115+0000","last_became_peered":"2023-12-13T00:00:31.145115+0000","last_unstale":"2023-12-13T00:00:59.462472+0000","last_undegraded":"2023-12-13T00:00:59.462472+0000","last_fullsized":"2023-12-13T00:00:59.462472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:15.201991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.443231+0000","last_change":"2023-12-13T00:00:30.006295+0000","last_active":"2023-12-13T00:01:06.443231+0000","last_peered":"2023-12-13T00:01:06.443231+0000","last_clean":"2023-12-13T00:01:06.443231+0000","last_became_active":"2023-12-13T00:00:30.005988+0000","last_became_peered":"2023-12-13T00:00:30.005988+0000","last_unstale":"2023-12-13T00:01:06.443231+0000","last_undegraded":"2023-12-13T00:01:06.443231+0000","last_fullsized":"2023-12-13T00:01:06.443231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:15:15.243155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461393+0000","last_change":"2023-12-13T00:00:35.662996+0000","last_active":"2023-12-13T00:00:59.461393+0000","last_peered":"2023-12-13T00:00:59.461393+0000","last_clean":"2023-12-13T00:00:59.461393+0000","last_became_active":"2023-12-13T00:00:35.662612+0000","last_became_peered":"2023-12-13T00:00:35.662612+0000","last_unstale":"2023-12-13T00:00:59.461393+0000","last_undegraded":"2023-12-13T00:00:59.461393+0000","last_fullsized":"2023-12-13T00:00:59.461393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:58.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463941+0000","last_change":"2023-12-13T00:00:31.118054+0000","last_active":"2023-12-13T00:00:59.463941+0000","last_peered":"2023-12-13T00:00:59.463941+0000","last_clean":"2023-12-13T00:00:59.463941+0000","last_became_active":"2023-12-13T00:00:31.117814+0000","last_became_peered":"2023-12-13T00:00:31.117814+0000","last_unstale":"2023-12-13T00:00:59.463941+0000","last_undegraded":"2023-12-13T00:00:59.463941+0000","last_fullsized":"2023-12-13T00:00:59.463941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:15.201991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.540849+0000","last_change":"2023-12-13T00:00:30.001001+0000","last_active":"2023-12-13T00:01:00.540849+0000","last_peered":"2023-12-13T00:01:00.540849+0000","last_clean":"2023-12-13T00:01:00.540849+0000","last_became_active":"2023-12-13T00:00:30.000755+0000","last_became_peered":"2023-12-13T00:00:30.000755+0000","last_unstale":"2023-12-13T00:01:00.540849+0000","last_undegraded":"2023-12-13T00:01:00.540849+0000","last_fullsized":"2023-12-13T00:01:00.540849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:02:11.314721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.545340+0000","last_change":"2023-12-13T00:01:00.545340+0000","last_active":"2023-12-13T00:01:00.545340+0000","last_peered":"2023-12-13T00:01:00.545340+0000","last_clean":"2023-12-13T00:01:00.545340+0000","last_became_active":"2023-12-13T00:01:00.544906+0000","last_became_peered":"2023-12-13T00:01:00.544906+0000","last_unstale":"2023-12-13T00:01:00.545340+0000","last_undegraded":"2023-12-13T00:01:00.545340+0000","last_fullsized":"2023-12-13T00:01:00.545340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:44:27.993144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,5],"acting":[6,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462448+0000","last_change":"2023-12-13T00:00:31.143429+0000","last_active":"2023-12-13T00:00:59.462448+0000","last_peered":"2023-12-13T00:00:59.462448+0000","last_clean":"2023-12-13T00:00:59.462448+0000","last_became_active":"2023-12-13T00:00:31.143182+0000","last_became_peered":"2023-12-13T00:00:31.143182+0000","last_unstale":"2023-12-13T00:00:59.462448+0000","last_undegraded":"2023-12-13T00:00:59.462448+0000","last_fullsized":"2023-12-13T00:00:59.462448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:09:34.339195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465302+0000","last_change":"2023-12-13T00:00:29.969160+0000","last_active":"2023-12-13T00:00:59.465302+0000","last_peered":"2023-12-13T00:00:59.465302+0000","last_clean":"2023-12-13T00:00:59.465302+0000","last_became_active":"2023-12-13T00:00:29.968860+0000","last_became_peered":"2023-12-13T00:00:29.968860+0000","last_unstale":"2023-12-13T00:00:59.465302+0000","last_undegraded":"2023-12-13T00:00:59.465302+0000","last_fullsized":"2023-12-13T00:00:59.465302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:42:13.602889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463519+0000","last_change":"2023-12-13T00:00:35.642597+0000","last_active":"2023-12-13T00:00:59.463519+0000","last_peered":"2023-12-13T00:00:59.463519+0000","last_clean":"2023-12-13T00:00:59.463519+0000","last_became_active":"2023-12-13T00:00:35.642215+0000","last_became_peered":"2023-12-13T00:00:35.642215+0000","last_unstale":"2023-12-13T00:00:59.463519+0000","last_undegraded":"2023-12-13T00:00:59.463519+0000","last_fullsized":"2023-12-13T00:00:59.463519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:54:48.007993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460583+0000","last_change":"2023-12-13T00:00:31.149832+0000","last_active":"2023-12-13T00:00:59.460583+0000","last_peered":"2023-12-13T00:00:59.460583+0000","last_clean":"2023-12-13T00:00:59.460583+0000","last_became_active":"2023-12-13T00:00:31.149587+0000","last_became_peered":"2023-12-13T00:00:31.149587+0000","last_unstale":"2023-12-13T00:00:59.460583+0000","last_undegraded":"2023-12-13T00:00:59.460583+0000","last_fullsized":"2023-12-13T00:00:59.460583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:00.910594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.540630+0000","last_change":"2023-12-13T00:00:29.998103+0000","last_active":"2023-12-13T00:01:00.540630+0000","last_peered":"2023-12-13T00:01:00.540630+0000","last_clean":"2023-12-13T00:01:00.540630+0000","last_became_active":"2023-12-13T00:00:29.997848+0000","last_became_peered":"2023-12-13T00:00:29.997848+0000","last_unstale":"2023-12-13T00:01:00.540630+0000","last_undegraded":"2023-12-13T00:01:00.540630+0000","last_fullsized":"2023-12-13T00:01:00.540630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:52:58.951228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463768+0000","last_change":"2023-12-13T00:00:35.652104+0000","last_active":"2023-12-13T00:00:59.463768+0000","last_peered":"2023-12-13T00:00:59.463768+0000","last_clean":"2023-12-13T00:00:59.463768+0000","last_became_active":"2023-12-13T00:00:35.651766+0000","last_became_peered":"2023-12-13T00:00:35.651766+0000","last_unstale":"2023-12-13T00:00:59.463768+0000","last_undegraded":"2023-12-13T00:00:59.463768+0000","last_fullsized":"2023-12-13T00:00:59.463768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:08:10.211533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465392+0000","last_change":"2023-12-13T00:00:31.120580+0000","last_active":"2023-12-13T00:00:59.465392+0000","last_peered":"2023-12-13T00:00:59.465392+0000","last_clean":"2023-12-13T00:00:59.465392+0000","last_became_active":"2023-12-13T00:00:31.120330+0000","last_became_peered":"2023-12-13T00:00:31.120330+0000","last_unstale":"2023-12-13T00:00:59.465392+0000","last_undegraded":"2023-12-13T00:00:59.465392+0000","last_fullsized":"2023-12-13T00:00:59.465392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:04:30.356287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.442733+0000","last_change":"2023-12-13T00:00:30.000752+0000","last_active":"2023-12-13T00:01:06.442733+0000","last_peered":"2023-12-13T00:01:06.442733+0000","last_clean":"2023-12-13T00:01:06.442733+0000","last_became_active":"2023-12-13T00:00:30.000015+0000","last_became_peered":"2023-12-13T00:00:30.000015+0000","last_unstale":"2023-12-13T00:01:06.442733+0000","last_undegraded":"2023-12-13T00:01:06.442733+0000","last_fullsized":"2023-12-13T00:01:06.442733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:20:46.566684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463425+0000","last_change":"2023-12-13T00:00:35.667415+0000","last_active":"2023-12-13T00:00:59.463425+0000","last_peered":"2023-12-13T00:00:59.463425+0000","last_clean":"2023-12-13T00:00:59.463425+0000","last_became_active":"2023-12-13T00:00:35.667028+0000","last_became_peered":"2023-12-13T00:00:35.667028+0000","last_unstale":"2023-12-13T00:00:59.463425+0000","last_undegraded":"2023-12-13T00:00:59.463425+0000","last_fullsized":"2023-12-13T00:00:59.463425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:58.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.464043+0000","last_change":"2023-12-13T00:00:31.140853+0000","last_active":"2023-12-13T00:00:59.464043+0000","last_peered":"2023-12-13T00:00:59.464043+0000","last_clean":"2023-12-13T00:00:59.464043+0000","last_became_active":"2023-12-13T00:00:31.140597+0000","last_became_peered":"2023-12-13T00:00:31.140597+0000","last_unstale":"2023-12-13T00:00:59.464043+0000","last_undegraded":"2023-12-13T00:00:59.464043+0000","last_fullsized":"2023-12-13T00:00:59.464043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:13.923453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.444460+0000","last_change":"2023-12-13T00:00:29.998765+0000","last_active":"2023-12-13T00:01:06.444460+0000","last_peered":"2023-12-13T00:01:06.444460+0000","last_clean":"2023-12-13T00:01:06.444460+0000","last_became_active":"2023-12-13T00:00:29.998552+0000","last_became_peered":"2023-12-13T00:00:29.998552+0000","last_unstale":"2023-12-13T00:01:06.444460+0000","last_undegraded":"2023-12-13T00:01:06.444460+0000","last_fullsized":"2023-12-13T00:01:06.444460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:54:42.351946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465621+0000","last_change":"2023-12-13T00:00:35.666575+0000","last_active":"2023-12-13T00:00:59.465621+0000","last_peered":"2023-12-13T00:00:59.465621+0000","last_clean":"2023-12-13T00:00:59.465621+0000","last_became_active":"2023-12-13T00:00:35.666135+0000","last_became_peered":"2023-12-13T00:00:35.666135+0000","last_unstale":"2023-12-13T00:00:59.465621+0000","last_undegraded":"2023-12-13T00:00:59.465621+0000","last_fullsized":"2023-12-13T00:00:59.465621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:02:03.031651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462174+0000","last_change":"2023-12-13T00:00:31.148698+0000","last_active":"2023-12-13T00:00:59.462174+0000","last_peered":"2023-12-13T00:00:59.462174+0000","last_clean":"2023-12-13T00:00:59.462174+0000","last_became_active":"2023-12-13T00:00:31.148421+0000","last_became_peered":"2023-12-13T00:00:31.148421+0000","last_unstale":"2023-12-13T00:00:59.462174+0000","last_undegraded":"2023-12-13T00:00:59.462174+0000","last_fullsized":"2023-12-13T00:00:59.462174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:53:00.056294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:03.925407+0000","last_change":"2023-12-13T00:00:30.001220+0000","last_active":"2023-12-13T00:01:03.925407+0000","last_peered":"2023-12-13T00:01:03.925407+0000","last_clean":"2023-12-13T00:01:03.925407+0000","last_became_active":"2023-12-13T00:00:30.000854+0000","last_became_peered":"2023-12-13T00:00:30.000854+0000","last_unstale":"2023-12-13T00:01:03.925407+0000","last_undegraded":"2023-12-13T00:01:03.925407+0000","last_fullsized":"2023-12-13T00:01:03.925407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:50:11.243011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456321+0000","last_change":"2023-12-13T00:00:08.575071+0000","last_active":"2023-12-13T00:00:59.456321+0000","last_peered":"2023-12-13T00:00:59.456321+0000","last_clean":"2023-12-13T00:00:59.456321+0000","last_became_active":"2023-12-13T00:00:08.574464+0000","last_became_peered":"2023-12-13T00:00:08.574464+0000","last_unstale":"2023-12-13T00:00:59.456321+0000","last_undegraded":"2023-12-13T00:00:59.456321+0000","last_fullsized":"2023-12-13T00:00:59.456321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:07.226606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:07.226606+0000","last_clean_scrub_stamp":"2023-12-13T00:00:07.226606+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:51:39.168480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458245+0000","last_change":"2023-12-13T00:00:35.661806+0000","last_active":"2023-12-13T00:00:59.458245+0000","last_peered":"2023-12-13T00:00:59.458245+0000","last_clean":"2023-12-13T00:00:59.458245+0000","last_became_active":"2023-12-13T00:00:35.660976+0000","last_became_peered":"2023-12-13T00:00:35.660976+0000","last_unstale":"2023-12-13T00:00:59.458245+0000","last_undegraded":"2023-12-13T00:00:59.458245+0000","last_fullsized":"2023-12-13T00:00:59.458245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:04:57.617925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458767+0000","last_change":"2023-12-13T00:00:31.036383+0000","last_active":"2023-12-13T00:00:59.458767+0000","last_peered":"2023-12-13T00:00:59.458767+0000","last_clean":"2023-12-13T00:00:59.458767+0000","last_became_active":"2023-12-13T00:00:31.036127+0000","last_became_peered":"2023-12-13T00:00:31.036127+0000","last_unstale":"2023-12-13T00:00:59.458767+0000","last_undegraded":"2023-12-13T00:00:59.458767+0000","last_fullsized":"2023-12-13T00:00:59.458767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:12:16.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.449621+0000","last_change":"2023-12-13T00:00:30.006258+0000","last_active":"2023-12-13T00:01:06.449621+0000","last_peered":"2023-12-13T00:01:06.449621+0000","last_clean":"2023-12-13T00:01:06.449621+0000","last_became_active":"2023-12-13T00:00:30.005943+0000","last_became_peered":"2023-12-13T00:00:30.005943+0000","last_unstale":"2023-12-13T00:01:06.449621+0000","last_undegraded":"2023-12-13T00:01:06.449621+0000","last_fullsized":"2023-12-13T00:01:06.449621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:52:45.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461955+0000","last_change":"2023-12-13T00:00:35.665140+0000","last_active":"2023-12-13T00:00:59.461955+0000","last_peered":"2023-12-13T00:00:59.461955+0000","last_clean":"2023-12-13T00:00:59.461955+0000","last_became_active":"2023-12-13T00:00:35.664071+0000","last_became_peered":"2023-12-13T00:00:35.664071+0000","last_unstale":"2023-12-13T00:00:59.461955+0000","last_undegraded":"2023-12-13T00:00:59.461955+0000","last_fullsized":"2023-12-13T00:00:59.461955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:06:01.427574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460927+0000","last_change":"2023-12-13T00:00:31.147760+0000","last_active":"2023-12-13T00:00:59.460927+0000","last_peered":"2023-12-13T00:00:59.460927+0000","last_clean":"2023-12-13T00:00:59.460927+0000","last_became_active":"2023-12-13T00:00:31.147523+0000","last_became_peered":"2023-12-13T00:00:31.147523+0000","last_unstale":"2023-12-13T00:00:59.460927+0000","last_undegraded":"2023-12-13T00:00:59.460927+0000","last_fullsized":"2023-12-13T00:00:59.460927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:56:28.188041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465526+0000","last_change":"2023-12-13T00:00:30.002705+0000","last_active":"2023-12-13T00:00:59.465526+0000","last_peered":"2023-12-13T00:00:59.465526+0000","last_clean":"2023-12-13T00:00:59.465526+0000","last_became_active":"2023-12-13T00:00:30.002427+0000","last_became_peered":"2023-12-13T00:00:30.002427+0000","last_unstale":"2023-12-13T00:00:59.465526+0000","last_undegraded":"2023-12-13T00:00:59.465526+0000","last_fullsized":"2023-12-13T00:00:59.465526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:06:37.325239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465997+0000","last_change":"2023-12-13T00:00:35.661309+0000","last_active":"2023-12-13T00:00:59.465997+0000","last_peered":"2023-12-13T00:00:59.465997+0000","last_clean":"2023-12-13T00:00:59.465997+0000","last_became_active":"2023-12-13T00:00:35.660939+0000","last_became_peered":"2023-12-13T00:00:35.660939+0000","last_unstale":"2023-12-13T00:00:59.465997+0000","last_undegraded":"2023-12-13T00:00:59.465997+0000","last_fullsized":"2023-12-13T00:00:59.465997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:49:19.372464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459530+0000","last_change":"2023-12-13T00:00:31.146265+0000","last_active":"2023-12-13T00:00:59.459530+0000","last_peered":"2023-12-13T00:00:59.459530+0000","last_clean":"2023-12-13T00:00:59.459530+0000","last_became_active":"2023-12-13T00:00:31.145997+0000","last_became_peered":"2023-12-13T00:00:31.145997+0000","last_unstale":"2023-12-13T00:00:59.459530+0000","last_undegraded":"2023-12-13T00:00:59.459530+0000","last_fullsized":"2023-12-13T00:00:59.459530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:53:32.846210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462169+0000","last_change":"2023-12-13T00:00:29.968222+0000","last_active":"2023-12-13T00:00:59.462169+0000","last_peered":"2023-12-13T00:00:59.462169+0000","last_clean":"2023-12-13T00:00:59.462169+0000","last_became_active":"2023-12-13T00:00:29.967916+0000","last_became_peered":"2023-12-13T00:00:29.967916+0000","last_unstale":"2023-12-13T00:00:59.462169+0000","last_undegraded":"2023-12-13T00:00:59.462169+0000","last_fullsized":"2023-12-13T00:00:59.462169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:12.818387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457105+0000","last_change":"2023-12-13T00:00:35.667745+0000","last_active":"2023-12-13T00:00:59.457105+0000","last_peered":"2023-12-13T00:00:59.457105+0000","last_clean":"2023-12-13T00:00:59.457105+0000","last_became_active":"2023-12-13T00:00:35.666891+0000","last_became_peered":"2023-12-13T00:00:35.666891+0000","last_unstale":"2023-12-13T00:00:59.457105+0000","last_undegraded":"2023-12-13T00:00:59.457105+0000","last_fullsized":"2023-12-13T00:00:59.457105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:30:53.285154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462868+0000","last_change":"2023-12-13T00:00:31.148279+0000","last_active":"2023-12-13T00:00:59.462868+0000","last_peered":"2023-12-13T00:00:59.462868+0000","last_clean":"2023-12-13T00:00:59.462868+0000","last_became_active":"2023-12-13T00:00:31.148016+0000","last_became_peered":"2023-12-13T00:00:31.148016+0000","last_unstale":"2023-12-13T00:00:59.462868+0000","last_undegraded":"2023-12-13T00:00:59.462868+0000","last_fullsized":"2023-12-13T00:00:59.462868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:37:40.762676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459753+0000","last_change":"2023-12-13T00:00:30.008152+0000","last_active":"2023-12-13T00:00:59.459753+0000","last_peered":"2023-12-13T00:00:59.459753+0000","last_clean":"2023-12-13T00:00:59.459753+0000","last_became_active":"2023-12-13T00:00:30.007907+0000","last_became_peered":"2023-12-13T00:00:30.007907+0000","last_unstale":"2023-12-13T00:00:59.459753+0000","last_undegraded":"2023-12-13T00:00:59.459753+0000","last_fullsized":"2023-12-13T00:00:59.459753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:46:40.001298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456332+0000","last_change":"2023-12-13T00:00:35.660971+0000","last_active":"2023-12-13T00:00:59.456332+0000","last_peered":"2023-12-13T00:00:59.456332+0000","last_clean":"2023-12-13T00:00:59.456332+0000","last_became_active":"2023-12-13T00:00:35.660627+0000","last_became_peered":"2023-12-13T00:00:35.660627+0000","last_unstale":"2023-12-13T00:00:59.456332+0000","last_undegraded":"2023-12-13T00:00:59.456332+0000","last_fullsized":"2023-12-13T00:00:59.456332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:18.474434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457469+0000","last_change":"2023-12-13T00:00:31.142437+0000","last_active":"2023-12-13T00:00:59.457469+0000","last_peered":"2023-12-13T00:00:59.457469+0000","last_clean":"2023-12-13T00:00:59.457469+0000","last_became_active":"2023-12-13T00:00:31.142150+0000","last_became_peered":"2023-12-13T00:00:31.142150+0000","last_unstale":"2023-12-13T00:00:59.457469+0000","last_undegraded":"2023-12-13T00:00:59.457469+0000","last_fullsized":"2023-12-13T00:00:59.457469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:10:54.020587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'15","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.446875+0000","last_change":"2023-12-13T00:00:30.000646+0000","last_active":"2023-12-13T00:01:06.446875+0000","last_peered":"2023-12-13T00:01:06.446875+0000","last_clean":"2023-12-13T00:01:06.446875+0000","last_became_active":"2023-12-13T00:00:30.000388+0000","last_became_peered":"2023-12-13T00:00:30.000388+0000","last_unstale":"2023-12-13T00:01:06.446875+0000","last_undegraded":"2023-12-13T00:01:06.446875+0000","last_fullsized":"2023-12-13T00:01:06.446875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:07.704455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465717+0000","last_change":"2023-12-13T00:00:35.666659+0000","last_active":"2023-12-13T00:00:59.465717+0000","last_peered":"2023-12-13T00:00:59.465717+0000","last_clean":"2023-12-13T00:00:59.465717+0000","last_became_active":"2023-12-13T00:00:35.666304+0000","last_became_peered":"2023-12-13T00:00:35.666304+0000","last_unstale":"2023-12-13T00:00:59.465717+0000","last_undegraded":"2023-12-13T00:00:59.465717+0000","last_fullsized":"2023-12-13T00:00:59.465717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:35:49.956369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456174+0000","last_change":"2023-12-13T00:00:31.037568+0000","last_active":"2023-12-13T00:00:59.456174+0000","last_peered":"2023-12-13T00:00:59.456174+0000","last_clean":"2023-12-13T00:00:59.456174+0000","last_became_active":"2023-12-13T00:00:31.037398+0000","last_became_peered":"2023-12-13T00:00:31.037398+0000","last_unstale":"2023-12-13T00:00:59.456174+0000","last_undegraded":"2023-12-13T00:00:59.456174+0000","last_fullsized":"2023-12-13T00:00:59.456174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:08.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.522696+0000","last_change":"2023-12-13T00:00:30.006086+0000","last_active":"2023-12-13T00:01:06.522696+0000","last_peered":"2023-12-13T00:01:06.522696+0000","last_clean":"2023-12-13T00:01:06.522696+0000","last_became_active":"2023-12-13T00:00:30.005752+0000","last_became_peered":"2023-12-13T00:00:30.005752+0000","last_unstale":"2023-12-13T00:01:06.522696+0000","last_undegraded":"2023-12-13T00:01:06.522696+0000","last_fullsized":"2023-12-13T00:01:06.522696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:06:37.325239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465548+0000","last_change":"2023-12-13T00:00:35.666467+0000","last_active":"2023-12-13T00:00:59.465548+0000","last_peered":"2023-12-13T00:00:59.465548+0000","last_clean":"2023-12-13T00:00:59.465548+0000","last_became_active":"2023-12-13T00:00:35.666061+0000","last_became_peered":"2023-12-13T00:00:35.666061+0000","last_unstale":"2023-12-13T00:00:59.465548+0000","last_undegraded":"2023-12-13T00:00:59.465548+0000","last_fullsized":"2023-12-13T00:00:59.465548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:19:16.858246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.702387+0000","last_change":"2023-12-13T00:01:00.702387+0000","last_active":"2023-12-13T00:01:00.702387+0000","last_peered":"2023-12-13T00:01:00.702387+0000","last_clean":"2023-12-13T00:01:00.702387+0000","last_became_active":"2023-12-13T00:01:00.702089+0000","last_became_peered":"2023-12-13T00:01:00.702089+0000","last_unstale":"2023-12-13T00:01:00.702387+0000","last_undegraded":"2023-12-13T00:01:00.702387+0000","last_fullsized":"2023-12-13T00:01:00.702387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:48:49.380742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:03.924396+0000","last_change":"2023-12-13T00:00:30.001171+0000","last_active":"2023-12-13T00:01:03.924396+0000","last_peered":"2023-12-13T00:01:03.924396+0000","last_clean":"2023-12-13T00:01:03.924396+0000","last_became_active":"2023-12-13T00:00:30.000803+0000","last_became_peered":"2023-12-13T00:00:30.000803+0000","last_unstale":"2023-12-13T00:01:03.924396+0000","last_undegraded":"2023-12-13T00:01:03.924396+0000","last_fullsized":"2023-12-13T00:01:03.924396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:19.012092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463671+0000","last_change":"2023-12-13T00:00:35.649561+0000","last_active":"2023-12-13T00:00:59.463671+0000","last_peered":"2023-12-13T00:00:59.463671+0000","last_clean":"2023-12-13T00:00:59.463671+0000","last_became_active":"2023-12-13T00:00:35.649151+0000","last_became_peered":"2023-12-13T00:00:35.649151+0000","last_unstale":"2023-12-13T00:00:59.463671+0000","last_undegraded":"2023-12-13T00:00:59.463671+0000","last_fullsized":"2023-12-13T00:00:59.463671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:06:34.023899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463669+0000","last_change":"2023-12-13T00:00:31.116002+0000","last_active":"2023-12-13T00:00:59.463669+0000","last_peered":"2023-12-13T00:00:59.463669+0000","last_clean":"2023-12-13T00:00:59.463669+0000","last_became_active":"2023-12-13T00:00:31.115678+0000","last_became_peered":"2023-12-13T00:00:31.115678+0000","last_unstale":"2023-12-13T00:00:59.463669+0000","last_undegraded":"2023-12-13T00:00:59.463669+0000","last_fullsized":"2023-12-13T00:00:59.463669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:21:51.967408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'6","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.441646+0000","last_change":"2023-12-13T00:00:30.004329+0000","last_active":"2023-12-13T00:01:06.441646+0000","last_peered":"2023-12-13T00:01:06.441646+0000","last_clean":"2023-12-13T00:01:06.441646+0000","last_became_active":"2023-12-13T00:00:30.004089+0000","last_became_peered":"2023-12-13T00:00:30.004089+0000","last_unstale":"2023-12-13T00:01:06.441646+0000","last_undegraded":"2023-12-13T00:01:06.441646+0000","last_fullsized":"2023-12-13T00:01:06.441646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:05:04.403249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457886+0000","last_change":"2023-12-13T00:00:35.652272+0000","last_active":"2023-12-13T00:00:59.457886+0000","last_peered":"2023-12-13T00:00:59.457886+0000","last_clean":"2023-12-13T00:00:59.457886+0000","last_became_active":"2023-12-13T00:00:35.651907+0000","last_became_peered":"2023-12-13T00:00:35.651907+0000","last_unstale":"2023-12-13T00:00:59.457886+0000","last_undegraded":"2023-12-13T00:00:59.457886+0000","last_fullsized":"2023-12-13T00:00:59.457886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:15:01.873129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461182+0000","last_change":"2023-12-13T00:00:31.148754+0000","last_active":"2023-12-13T00:00:59.461182+0000","last_peered":"2023-12-13T00:00:59.461182+0000","last_clean":"2023-12-13T00:00:59.461182+0000","last_became_active":"2023-12-13T00:00:31.147846+0000","last_became_peered":"2023-12-13T00:00:31.147846+0000","last_unstale":"2023-12-13T00:00:59.461182+0000","last_undegraded":"2023-12-13T00:00:59.461182+0000","last_fullsized":"2023-12-13T00:00:59.461182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:39:59.955103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'12","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:03.987972+0000","last_change":"2023-12-13T00:00:30.001703+0000","last_active":"2023-12-13T00:01:03.987972+0000","last_peered":"2023-12-13T00:01:03.987972+0000","last_clean":"2023-12-13T00:01:03.987972+0000","last_became_active":"2023-12-13T00:00:30.001420+0000","last_became_peered":"2023-12-13T00:00:30.001420+0000","last_unstale":"2023-12-13T00:01:03.987972+0000","last_undegraded":"2023-12-13T00:01:03.987972+0000","last_fullsized":"2023-12-13T00:01:03.987972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:02:06.211723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.546607+0000","last_change":"2023-12-13T00:01:00.546607+0000","last_active":"2023-12-13T00:01:00.546607+0000","last_peered":"2023-12-13T00:01:00.546607+0000","last_clean":"2023-12-13T00:01:00.546607+0000","last_became_active":"2023-12-13T00:01:00.546264+0000","last_became_peered":"2023-12-13T00:01:00.546264+0000","last_unstale":"2023-12-13T00:01:00.546607+0000","last_undegraded":"2023-12-13T00:01:00.546607+0000","last_fullsized":"2023-12-13T00:01:00.546607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:12:57.696627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457889+0000","last_change":"2023-12-13T00:00:31.138998+0000","last_active":"2023-12-13T00:00:59.457889+0000","last_peered":"2023-12-13T00:00:59.457889+0000","last_clean":"2023-12-13T00:00:59.457889+0000","last_became_active":"2023-12-13T00:00:31.138723+0000","last_became_peered":"2023-12-13T00:00:31.138723+0000","last_unstale":"2023-12-13T00:00:59.457889+0000","last_undegraded":"2023-12-13T00:00:59.457889+0000","last_fullsized":"2023-12-13T00:00:59.457889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:24:05.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.696460+0000","last_change":"2023-12-13T00:00:30.003079+0000","last_active":"2023-12-13T00:01:00.696460+0000","last_peered":"2023-12-13T00:01:00.696460+0000","last_clean":"2023-12-13T00:01:00.696460+0000","last_became_active":"2023-12-13T00:00:30.002823+0000","last_became_peered":"2023-12-13T00:00:30.002823+0000","last_unstale":"2023-12-13T00:01:00.696460+0000","last_undegraded":"2023-12-13T00:01:00.696460+0000","last_fullsized":"2023-12-13T00:01:00.696460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:07.829448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.697705+0000","last_change":"2023-12-13T00:01:00.697705+0000","last_active":"2023-12-13T00:01:00.697705+0000","last_peered":"2023-12-13T00:01:00.697705+0000","last_clean":"2023-12-13T00:01:00.697705+0000","last_became_active":"2023-12-13T00:01:00.697231+0000","last_became_peered":"2023-12-13T00:01:00.697231+0000","last_unstale":"2023-12-13T00:01:00.697705+0000","last_undegraded":"2023-12-13T00:01:00.697705+0000","last_fullsized":"2023-12-13T00:01:00.697705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:54:04.994059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465742+0000","last_change":"2023-12-13T00:00:31.027503+0000","last_active":"2023-12-13T00:00:59.465742+0000","last_peered":"2023-12-13T00:00:59.465742+0000","last_clean":"2023-12-13T00:00:59.465742+0000","last_became_active":"2023-12-13T00:00:31.027239+0000","last_became_peered":"2023-12-13T00:00:31.027239+0000","last_unstale":"2023-12-13T00:00:59.465742+0000","last_undegraded":"2023-12-13T00:00:59.465742+0000","last_fullsized":"2023-12-13T00:00:59.465742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:50:58.339436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:04.030851+0000","last_change":"2023-12-13T00:00:30.009592+0000","last_active":"2023-12-13T00:01:04.030851+0000","last_peered":"2023-12-13T00:01:04.030851+0000","last_clean":"2023-12-13T00:01:04.030851+0000","last_became_active":"2023-12-13T00:00:30.009351+0000","last_became_peered":"2023-12-13T00:00:30.009351+0000","last_unstale":"2023-12-13T00:01:04.030851+0000","last_undegraded":"2023-12-13T00:01:04.030851+0000","last_fullsized":"2023-12-13T00:01:04.030851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:46:22.716022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.720435+0000","last_change":"2023-12-13T00:01:00.717446+0000","last_active":"2023-12-13T00:01:00.720435+0000","last_peered":"2023-12-13T00:01:00.720435+0000","last_clean":"2023-12-13T00:01:00.720435+0000","last_became_active":"2023-12-13T00:01:00.717019+0000","last_became_peered":"2023-12-13T00:01:00.717019+0000","last_unstale":"2023-12-13T00:01:00.720435+0000","last_undegraded":"2023-12-13T00:01:00.720435+0000","last_fullsized":"2023-12-13T00:01:00.720435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:22:05.566928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462796+0000","last_change":"2023-12-13T00:00:31.139946+0000","last_active":"2023-12-13T00:00:59.462796+0000","last_peered":"2023-12-13T00:00:59.462796+0000","last_clean":"2023-12-13T00:00:59.462796+0000","last_became_active":"2023-12-13T00:00:31.139656+0000","last_became_peered":"2023-12-13T00:00:31.139656+0000","last_unstale":"2023-12-13T00:00:59.462796+0000","last_undegraded":"2023-12-13T00:00:59.462796+0000","last_fullsized":"2023-12-13T00:00:59.462796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:13:39.042325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:04.030793+0000","last_change":"2023-12-13T00:00:30.003511+0000","last_active":"2023-12-13T00:01:04.030793+0000","last_peered":"2023-12-13T00:01:04.030793+0000","last_clean":"2023-12-13T00:01:04.030793+0000","last_became_active":"2023-12-13T00:00:30.002630+0000","last_became_peered":"2023-12-13T00:00:30.002630+0000","last_unstale":"2023-12-13T00:01:04.030793+0000","last_undegraded":"2023-12-13T00:01:04.030793+0000","last_fullsized":"2023-12-13T00:01:04.030793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:58:21.724544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462429+0000","last_change":"2023-12-13T00:00:35.649725+0000","last_active":"2023-12-13T00:00:59.462429+0000","last_peered":"2023-12-13T00:00:59.462429+0000","last_clean":"2023-12-13T00:00:59.462429+0000","last_became_active":"2023-12-13T00:00:35.649401+0000","last_became_peered":"2023-12-13T00:00:35.649401+0000","last_unstale":"2023-12-13T00:00:59.462429+0000","last_undegraded":"2023-12-13T00:00:59.462429+0000","last_fullsized":"2023-12-13T00:00:59.462429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:56:09.136979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462981+0000","last_change":"2023-12-13T00:00:35.662790+0000","last_active":"2023-12-13T00:00:59.462981+0000","last_peered":"2023-12-13T00:00:59.462981+0000","last_clean":"2023-12-13T00:00:59.462981+0000","last_became_active":"2023-12-13T00:00:35.662406+0000","last_became_peered":"2023-12-13T00:00:35.662406+0000","last_unstale":"2023-12-13T00:00:59.462981+0000","last_undegraded":"2023-12-13T00:00:59.462981+0000","last_fullsized":"2023-12-13T00:00:59.462981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:10:58.571569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462513+0000","last_change":"2023-12-13T00:00:31.143141+0000","last_active":"2023-12-13T00:00:59.462513+0000","last_peered":"2023-12-13T00:00:59.462513+0000","last_clean":"2023-12-13T00:00:59.462513+0000","last_became_active":"2023-12-13T00:00:31.142823+0000","last_became_peered":"2023-12-13T00:00:31.142823+0000","last_unstale":"2023-12-13T00:00:59.462513+0000","last_undegraded":"2023-12-13T00:00:59.462513+0000","last_fullsized":"2023-12-13T00:00:59.462513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:22:51.335464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:00.540120+0000","last_change":"2023-12-13T00:00:30.004773+0000","last_active":"2023-12-13T00:01:00.540120+0000","last_peered":"2023-12-13T00:01:00.540120+0000","last_clean":"2023-12-13T00:01:00.540120+0000","last_became_active":"2023-12-13T00:00:30.004496+0000","last_became_peered":"2023-12-13T00:00:30.004496+0000","last_unstale":"2023-12-13T00:01:00.540120+0000","last_undegraded":"2023-12-13T00:01:00.540120+0000","last_fullsized":"2023-12-13T00:01:00.540120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:51:20.708568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457933+0000","last_change":"2023-12-13T00:00:35.666457+0000","last_active":"2023-12-13T00:00:59.457933+0000","last_peered":"2023-12-13T00:00:59.457933+0000","last_clean":"2023-12-13T00:00:59.457933+0000","last_became_active":"2023-12-13T00:00:35.666075+0000","last_became_peered":"2023-12-13T00:00:35.666075+0000","last_unstale":"2023-12-13T00:00:59.457933+0000","last_undegraded":"2023-12-13T00:00:59.457933+0000","last_fullsized":"2023-12-13T00:00:59.457933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:18:38.741479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465799+0000","last_change":"2023-12-13T00:00:31.116511+0000","last_active":"2023-12-13T00:00:59.465799+0000","last_peered":"2023-12-13T00:00:59.465799+0000","last_clean":"2023-12-13T00:00:59.465799+0000","last_became_active":"2023-12-13T00:00:31.116209+0000","last_became_peered":"2023-12-13T00:00:31.116209+0000","last_unstale":"2023-12-13T00:00:59.465799+0000","last_undegraded":"2023-12-13T00:00:59.465799+0000","last_fullsized":"2023-12-13T00:00:59.465799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:06.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.446859+0000","last_change":"2023-12-13T00:00:30.006475+0000","last_active":"2023-12-13T00:01:06.446859+0000","last_peered":"2023-12-13T00:01:06.446859+0000","last_clean":"2023-12-13T00:01:06.446859+0000","last_became_active":"2023-12-13T00:00:30.006026+0000","last_became_peered":"2023-12-13T00:00:30.006026+0000","last_unstale":"2023-12-13T00:01:06.446859+0000","last_undegraded":"2023-12-13T00:01:06.446859+0000","last_fullsized":"2023-12-13T00:01:06.446859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:29.225167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:06.444234+0000","last_change":"2023-12-13T00:00:30.004483+0000","last_active":"2023-12-13T00:01:06.444234+0000","last_peered":"2023-12-13T00:01:06.444234+0000","last_clean":"2023-12-13T00:01:06.444234+0000","last_became_active":"2023-12-13T00:00:30.004214+0000","last_became_peered":"2023-12-13T00:00:30.004214+0000","last_unstale":"2023-12-13T00:01:06.444234+0000","last_undegraded":"2023-12-13T00:01:06.444234+0000","last_fullsized":"2023-12-13T00:01:06.444234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:14.096925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461971+0000","last_change":"2023-12-13T00:00:31.147121+0000","last_active":"2023-12-13T00:00:59.461971+0000","last_peered":"2023-12-13T00:00:59.461971+0000","last_clean":"2023-12-13T00:00:59.461971+0000","last_became_active":"2023-12-13T00:00:31.146818+0000","last_became_peered":"2023-12-13T00:00:31.146818+0000","last_unstale":"2023-12-13T00:00:59.461971+0000","last_undegraded":"2023-12-13T00:00:59.461971+0000","last_fullsized":"2023-12-13T00:00:59.461971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:12.753740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461393+0000","last_change":"2023-12-13T00:00:35.642485+0000","last_active":"2023-12-13T00:00:59.461393+0000","last_peered":"2023-12-13T00:00:59.461393+0000","last_clean":"2023-12-13T00:00:59.461393+0000","last_became_active":"2023-12-13T00:00:35.642114+0000","last_became_peered":"2023-12-13T00:00:35.642114+0000","last_unstale":"2023-12-13T00:00:59.461393+0000","last_undegraded":"2023-12-13T00:00:59.461393+0000","last_fullsized":"2023-12-13T00:00:59.461393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:24:10.067039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:01:04.029541+0000","last_change":"2023-12-13T00:00:29.972296+0000","last_active":"2023-12-13T00:01:04.029541+0000","last_peered":"2023-12-13T00:01:04.029541+0000","last_clean":"2023-12-13T00:01:04.029541+0000","last_became_active":"2023-12-13T00:00:29.972018+0000","last_became_peered":"2023-12-13T00:00:29.972018+0000","last_unstale":"2023-12-13T00:01:04.029541+0000","last_undegraded":"2023-12-13T00:01:04.029541+0000","last_fullsized":"2023-12-13T00:01:04.029541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:30:26.126361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456414+0000","last_change":"2023-12-13T00:00:31.037679+0000","last_active":"2023-12-13T00:00:59.456414+0000","last_peered":"2023-12-13T00:00:59.456414+0000","last_clean":"2023-12-13T00:00:59.456414+0000","last_became_active":"2023-12-13T00:00:31.037445+0000","last_became_peered":"2023-12-13T00:00:31.037445+0000","last_unstale":"2023-12-13T00:00:59.456414+0000","last_undegraded":"2023-12-13T00:00:59.456414+0000","last_fullsized":"2023-12-13T00:00:59.456414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:55.082987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461668+0000","last_change":"2023-12-13T00:00:35.661405+0000","last_active":"2023-12-13T00:00:59.461668+0000","last_peered":"2023-12-13T00:00:59.461668+0000","last_clean":"2023-12-13T00:00:59.461668+0000","last_became_active":"2023-12-13T00:00:35.660984+0000","last_became_peered":"2023-12-13T00:00:35.660984+0000","last_unstale":"2023-12-13T00:00:59.461668+0000","last_undegraded":"2023-12-13T00:00:59.461668+0000","last_fullsized":"2023-12-13T00:00:59.461668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:24.668139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462010+0000","last_change":"2023-12-13T00:00:31.147104+0000","last_active":"2023-12-13T00:00:59.462010+0000","last_peered":"2023-12-13T00:00:59.462010+0000","last_clean":"2023-12-13T00:00:59.462010+0000","last_became_active":"2023-12-13T00:00:31.145225+0000","last_became_peered":"2023-12-13T00:00:31.145225+0000","last_unstale":"2023-12-13T00:00:59.462010+0000","last_undegraded":"2023-12-13T00:00:59.462010+0000","last_fullsized":"2023-12-13T00:00:59.462010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:42:14.707955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461433+0000","last_change":"2023-12-13T00:00:31.119735+0000","last_active":"2023-12-13T00:00:59.461433+0000","last_peered":"2023-12-13T00:00:59.461433+0000","last_clean":"2023-12-13T00:00:59.461433+0000","last_became_active":"2023-12-13T00:00:31.119474+0000","last_became_peered":"2023-12-13T00:00:31.119474+0000","last_unstale":"2023-12-13T00:00:59.461433+0000","last_undegraded":"2023-12-13T00:00:59.461433+0000","last_fullsized":"2023-12-13T00:00:59.461433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:30.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457690+0000","last_change":"2023-12-13T00:00:31.027180+0000","last_active":"2023-12-13T00:00:59.457690+0000","last_peered":"2023-12-13T00:00:59.457690+0000","last_clean":"2023-12-13T00:00:59.457690+0000","last_became_active":"2023-12-13T00:00:31.026922+0000","last_became_peered":"2023-12-13T00:00:31.026922+0000","last_unstale":"2023-12-13T00:00:59.457690+0000","last_undegraded":"2023-12-13T00:00:59.457690+0000","last_fullsized":"2023-12-13T00:00:59.457690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:58:37.933386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.466020+0000","last_change":"2023-12-13T00:00:31.119937+0000","last_active":"2023-12-13T00:00:59.466020+0000","last_peered":"2023-12-13T00:00:59.466020+0000","last_clean":"2023-12-13T00:00:59.466020+0000","last_became_active":"2023-12-13T00:00:31.119685+0000","last_became_peered":"2023-12-13T00:00:31.119685+0000","last_unstale":"2023-12-13T00:00:59.466020+0000","last_undegraded":"2023-12-13T00:00:59.466020+0000","last_fullsized":"2023-12-13T00:00:59.466020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:00.910594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463856+0000","last_change":"2023-12-13T00:00:31.150597+0000","last_active":"2023-12-13T00:00:59.463856+0000","last_peered":"2023-12-13T00:00:59.463856+0000","last_clean":"2023-12-13T00:00:59.463856+0000","last_became_active":"2023-12-13T00:00:31.150275+0000","last_became_peered":"2023-12-13T00:00:31.150275+0000","last_unstale":"2023-12-13T00:00:59.463856+0000","last_undegraded":"2023-12-13T00:00:59.463856+0000","last_fullsized":"2023-12-13T00:00:59.463856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:20.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463111+0000","last_change":"2023-12-13T00:00:31.117688+0000","last_active":"2023-12-13T00:00:59.463111+0000","last_peered":"2023-12-13T00:00:59.463111+0000","last_clean":"2023-12-13T00:00:59.463111+0000","last_became_active":"2023-12-13T00:00:31.117409+0000","last_became_peered":"2023-12-13T00:00:31.117409+0000","last_unstale":"2023-12-13T00:00:59.463111+0000","last_undegraded":"2023-12-13T00:00:59.463111+0000","last_fullsized":"2023-12-13T00:00:59.463111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:12.753740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462722+0000","last_change":"2023-12-13T00:00:31.142584+0000","last_active":"2023-12-13T00:00:59.462722+0000","last_peered":"2023-12-13T00:00:59.462722+0000","last_clean":"2023-12-13T00:00:59.462722+0000","last_became_active":"2023-12-13T00:00:31.141656+0000","last_became_peered":"2023-12-13T00:00:31.141656+0000","last_unstale":"2023-12-13T00:00:59.462722+0000","last_undegraded":"2023-12-13T00:00:59.462722+0000","last_fullsized":"2023-12-13T00:00:59.462722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:49:22.676243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465450+0000","last_change":"2023-12-13T00:00:31.036263+0000","last_active":"2023-12-13T00:00:59.465450+0000","last_peered":"2023-12-13T00:00:59.465450+0000","last_clean":"2023-12-13T00:00:59.465450+0000","last_became_active":"2023-12-13T00:00:31.036113+0000","last_became_peered":"2023-12-13T00:00:31.036113+0000","last_unstale":"2023-12-13T00:00:59.465450+0000","last_undegraded":"2023-12-13T00:00:59.465450+0000","last_fullsized":"2023-12-13T00:00:59.465450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:01.219033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457279+0000","last_change":"2023-12-13T00:00:31.027230+0000","last_active":"2023-12-13T00:00:59.457279+0000","last_peered":"2023-12-13T00:00:59.457279+0000","last_clean":"2023-12-13T00:00:59.457279+0000","last_became_active":"2023-12-13T00:00:31.026968+0000","last_became_peered":"2023-12-13T00:00:31.026968+0000","last_unstale":"2023-12-13T00:00:59.457279+0000","last_undegraded":"2023-12-13T00:00:59.457279+0000","last_fullsized":"2023-12-13T00:00:59.457279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:53.920022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465839+0000","last_change":"2023-12-13T00:00:31.139140+0000","last_active":"2023-12-13T00:00:59.465839+0000","last_peered":"2023-12-13T00:00:59.465839+0000","last_clean":"2023-12-13T00:00:59.465839+0000","last_became_active":"2023-12-13T00:00:31.138869+0000","last_became_peered":"2023-12-13T00:00:31.138869+0000","last_unstale":"2023-12-13T00:00:59.465839+0000","last_undegraded":"2023-12-13T00:00:59.465839+0000","last_fullsized":"2023-12-13T00:00:59.465839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:03:13.913502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.456333+0000","last_change":"2023-12-13T00:00:31.146522+0000","last_active":"2023-12-13T00:00:59.456333+0000","last_peered":"2023-12-13T00:00:59.456333+0000","last_clean":"2023-12-13T00:00:59.456333+0000","last_became_active":"2023-12-13T00:00:31.146264+0000","last_became_peered":"2023-12-13T00:00:31.146264+0000","last_unstale":"2023-12-13T00:00:59.456333+0000","last_undegraded":"2023-12-13T00:00:59.456333+0000","last_fullsized":"2023-12-13T00:00:59.456333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:20:47.671750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461891+0000","last_change":"2023-12-13T00:00:31.143709+0000","last_active":"2023-12-13T00:00:59.461891+0000","last_peered":"2023-12-13T00:00:59.461891+0000","last_clean":"2023-12-13T00:00:59.461891+0000","last_became_active":"2023-12-13T00:00:31.143472+0000","last_became_peered":"2023-12-13T00:00:31.143472+0000","last_unstale":"2023-12-13T00:00:59.461891+0000","last_undegraded":"2023-12-13T00:00:59.461891+0000","last_fullsized":"2023-12-13T00:00:59.461891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:21:51.967408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460848+0000","last_change":"2023-12-13T00:00:31.146698+0000","last_active":"2023-12-13T00:00:59.460848+0000","last_peered":"2023-12-13T00:00:59.460848+0000","last_clean":"2023-12-13T00:00:59.460848+0000","last_became_active":"2023-12-13T00:00:31.146159+0000","last_became_peered":"2023-12-13T00:00:31.146159+0000","last_unstale":"2023-12-13T00:00:59.460848+0000","last_undegraded":"2023-12-13T00:00:59.460848+0000","last_fullsized":"2023-12-13T00:00:59.460848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:05:56.876593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458930+0000","last_change":"2023-12-13T00:00:31.143946+0000","last_active":"2023-12-13T00:00:59.458930+0000","last_peered":"2023-12-13T00:00:59.458930+0000","last_clean":"2023-12-13T00:00:59.458930+0000","last_became_active":"2023-12-13T00:00:31.143663+0000","last_became_peered":"2023-12-13T00:00:31.143663+0000","last_unstale":"2023-12-13T00:00:59.458930+0000","last_undegraded":"2023-12-13T00:00:59.458930+0000","last_fullsized":"2023-12-13T00:00:59.458930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:27:24.026750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462145+0000","last_change":"2023-12-13T00:00:31.142314+0000","last_active":"2023-12-13T00:00:59.462145+0000","last_peered":"2023-12-13T00:00:59.462145+0000","last_clean":"2023-12-13T00:00:59.462145+0000","last_became_active":"2023-12-13T00:00:31.142067+0000","last_became_peered":"2023-12-13T00:00:31.142067+0000","last_unstale":"2023-12-13T00:00:59.462145+0000","last_undegraded":"2023-12-13T00:00:59.462145+0000","last_fullsized":"2023-12-13T00:00:59.462145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:36.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458609+0000","last_change":"2023-12-13T00:00:31.146764+0000","last_active":"2023-12-13T00:00:59.458609+0000","last_peered":"2023-12-13T00:00:59.458609+0000","last_clean":"2023-12-13T00:00:59.458609+0000","last_became_active":"2023-12-13T00:00:31.146501+0000","last_became_peered":"2023-12-13T00:00:31.146501+0000","last_unstale":"2023-12-13T00:00:59.458609+0000","last_undegraded":"2023-12-13T00:00:59.458609+0000","last_fullsized":"2023-12-13T00:00:59.458609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:20:36.334790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.457190+0000","last_change":"2023-12-13T00:00:31.138982+0000","last_active":"2023-12-13T00:00:59.457190+0000","last_peered":"2023-12-13T00:00:59.457190+0000","last_clean":"2023-12-13T00:00:59.457190+0000","last_became_active":"2023-12-13T00:00:31.138738+0000","last_became_peered":"2023-12-13T00:00:31.138738+0000","last_unstale":"2023-12-13T00:00:59.457190+0000","last_undegraded":"2023-12-13T00:00:59.457190+0000","last_fullsized":"2023-12-13T00:00:59.457190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:08:05.660552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465686+0000","last_change":"2023-12-13T00:00:31.148499+0000","last_active":"2023-12-13T00:00:59.465686+0000","last_peered":"2023-12-13T00:00:59.465686+0000","last_clean":"2023-12-13T00:00:59.465686+0000","last_became_active":"2023-12-13T00:00:31.148251+0000","last_became_peered":"2023-12-13T00:00:31.148251+0000","last_unstale":"2023-12-13T00:00:59.465686+0000","last_undegraded":"2023-12-13T00:00:59.465686+0000","last_fullsized":"2023-12-13T00:00:59.465686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:46:41.106364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.463595+0000","last_change":"2023-12-13T00:00:31.117684+0000","last_active":"2023-12-13T00:00:59.463595+0000","last_peered":"2023-12-13T00:00:59.463595+0000","last_clean":"2023-12-13T00:00:59.463595+0000","last_became_active":"2023-12-13T00:00:31.117423+0000","last_became_peered":"2023-12-13T00:00:31.117423+0000","last_unstale":"2023-12-13T00:00:59.463595+0000","last_undegraded":"2023-12-13T00:00:59.463595+0000","last_fullsized":"2023-12-13T00:00:59.463595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:33:39.081529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.464860+0000","last_change":"2023-12-13T00:00:31.150615+0000","last_active":"2023-12-13T00:00:59.464860+0000","last_peered":"2023-12-13T00:00:59.464860+0000","last_clean":"2023-12-13T00:00:59.464860+0000","last_became_active":"2023-12-13T00:00:31.150324+0000","last_became_peered":"2023-12-13T00:00:31.150324+0000","last_unstale":"2023-12-13T00:00:59.464860+0000","last_undegraded":"2023-12-13T00:00:59.464860+0000","last_fullsized":"2023-12-13T00:00:59.464860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:15:16.348222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461196+0000","last_change":"2023-12-13T00:00:31.147145+0000","last_active":"2023-12-13T00:00:59.461196+0000","last_peered":"2023-12-13T00:00:59.461196+0000","last_clean":"2023-12-13T00:00:59.461196+0000","last_became_active":"2023-12-13T00:00:31.146444+0000","last_became_peered":"2023-12-13T00:00:31.146444+0000","last_unstale":"2023-12-13T00:00:59.461196+0000","last_undegraded":"2023-12-13T00:00:59.461196+0000","last_fullsized":"2023-12-13T00:00:59.461196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:52:46.548248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461101+0000","last_change":"2023-12-13T00:00:31.148920+0000","last_active":"2023-12-13T00:00:59.461101+0000","last_peered":"2023-12-13T00:00:59.461101+0000","last_clean":"2023-12-13T00:00:59.461101+0000","last_became_active":"2023-12-13T00:00:31.148529+0000","last_became_peered":"2023-12-13T00:00:31.148529+0000","last_unstale":"2023-12-13T00:00:59.461101+0000","last_undegraded":"2023-12-13T00:00:59.461101+0000","last_fullsized":"2023-12-13T00:00:59.461101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:51.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.461057+0000","last_change":"2023-12-13T00:00:31.149934+0000","last_active":"2023-12-13T00:00:59.461057+0000","last_peered":"2023-12-13T00:00:59.461057+0000","last_clean":"2023-12-13T00:00:59.461057+0000","last_became_active":"2023-12-13T00:00:31.149685+0000","last_became_peered":"2023-12-13T00:00:31.149685+0000","last_unstale":"2023-12-13T00:00:59.461057+0000","last_undegraded":"2023-12-13T00:00:59.461057+0000","last_fullsized":"2023-12-13T00:00:59.461057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:06.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.458537+0000","last_change":"2023-12-13T00:00:31.035879+0000","last_active":"2023-12-13T00:00:59.458537+0000","last_peered":"2023-12-13T00:00:59.458537+0000","last_clean":"2023-12-13T00:00:59.458537+0000","last_became_active":"2023-12-13T00:00:31.035672+0000","last_became_peered":"2023-12-13T00:00:31.035672+0000","last_unstale":"2023-12-13T00:00:59.458537+0000","last_undegraded":"2023-12-13T00:00:59.458537+0000","last_fullsized":"2023-12-13T00:00:59.458537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:30.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465289+0000","last_change":"2023-12-13T00:00:31.146556+0000","last_active":"2023-12-13T00:00:59.465289+0000","last_peered":"2023-12-13T00:00:59.465289+0000","last_clean":"2023-12-13T00:00:59.465289+0000","last_became_active":"2023-12-13T00:00:31.146186+0000","last_became_peered":"2023-12-13T00:00:31.146186+0000","last_unstale":"2023-12-13T00:00:59.465289+0000","last_undegraded":"2023-12-13T00:00:59.465289+0000","last_fullsized":"2023-12-13T00:00:59.465289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:20:30.098687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459678+0000","last_change":"2023-12-13T00:00:31.145365+0000","last_active":"2023-12-13T00:00:59.459678+0000","last_peered":"2023-12-13T00:00:59.459678+0000","last_clean":"2023-12-13T00:00:59.459678+0000","last_became_active":"2023-12-13T00:00:31.144458+0000","last_became_peered":"2023-12-13T00:00:31.144458+0000","last_unstale":"2023-12-13T00:00:59.459678+0000","last_undegraded":"2023-12-13T00:00:59.459678+0000","last_fullsized":"2023-12-13T00:00:59.459678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:03:13.913502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462069+0000","last_change":"2023-12-13T00:00:31.145052+0000","last_active":"2023-12-13T00:00:59.462069+0000","last_peered":"2023-12-13T00:00:59.462069+0000","last_clean":"2023-12-13T00:00:59.462069+0000","last_became_active":"2023-12-13T00:00:31.144792+0000","last_became_peered":"2023-12-13T00:00:31.144792+0000","last_unstale":"2023-12-13T00:00:59.462069+0000","last_undegraded":"2023-12-13T00:00:59.462069+0000","last_fullsized":"2023-12-13T00:00:59.462069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:30:27.231427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.460654+0000","last_change":"2023-12-13T00:00:31.149527+0000","last_active":"2023-12-13T00:00:59.460654+0000","last_peered":"2023-12-13T00:00:59.460654+0000","last_clean":"2023-12-13T00:00:59.460654+0000","last_became_active":"2023-12-13T00:00:31.148875+0000","last_became_peered":"2023-12-13T00:00:31.148875+0000","last_unstale":"2023-12-13T00:00:59.460654+0000","last_undegraded":"2023-12-13T00:00:59.460654+0000","last_fullsized":"2023-12-13T00:00:59.460654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:01.219033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.462203+0000","last_change":"2023-12-13T00:00:31.144423+0000","last_active":"2023-12-13T00:00:59.462203+0000","last_peered":"2023-12-13T00:00:59.462203+0000","last_clean":"2023-12-13T00:00:59.462203+0000","last_became_active":"2023-12-13T00:00:31.144174+0000","last_became_peered":"2023-12-13T00:00:31.144174+0000","last_unstale":"2023-12-13T00:00:59.462203+0000","last_undegraded":"2023-12-13T00:00:59.462203+0000","last_fullsized":"2023-12-13T00:00:59.462203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:10:31.724460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465379+0000","last_change":"2023-12-13T00:00:31.144074+0000","last_active":"2023-12-13T00:00:59.465379+0000","last_peered":"2023-12-13T00:00:59.465379+0000","last_clean":"2023-12-13T00:00:59.465379+0000","last_became_active":"2023-12-13T00:00:31.143809+0000","last_became_peered":"2023-12-13T00:00:31.143809+0000","last_unstale":"2023-12-13T00:00:59.465379+0000","last_undegraded":"2023-12-13T00:00:59.465379+0000","last_fullsized":"2023-12-13T00:00:59.465379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:51.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.465650+0000","last_change":"2023-12-13T00:00:31.116522+0000","last_active":"2023-12-13T00:00:59.465650+0000","last_peered":"2023-12-13T00:00:59.465650+0000","last_clean":"2023-12-13T00:00:59.465650+0000","last_became_active":"2023-12-13T00:00:31.116230+0000","last_became_peered":"2023-12-13T00:00:31.116230+0000","last_unstale":"2023-12-13T00:00:59.465650+0000","last_undegraded":"2023-12-13T00:00:59.465650+0000","last_fullsized":"2023-12-13T00:00:59.465650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:52:46.548248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-13T00:00:59.459456+0000","last_change":"2023-12-13T00:00:31.149691+0000","last_active":"2023-12-13T00:00:59.459456+0000","last_peered":"2023-12-13T00:00:59.459456+0000","last_clean":"2023-12-13T00:00:59.459456+0000","last_became_active":"2023-12-13T00:00:31.149410+0000","last_became_peered":"2023-12-13T00:00:31.149410+0000","last_unstale":"2023-12-13T00:00:59.459456+0000","last_undegraded":"2023-12-13T00:00:59.459456+0000","last_fullsized":"2023-12-13T00:00:59.459456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:50:58.339436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7451,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":116382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.442}]},{"osd":1,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.49299999999999999}]},{"osd":2,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.502},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.51300000000000001}]},{"osd":3,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.47699999999999998}]},{"osd":4,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.53400000000000003}]},{"osd":6,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.52500000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":116678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":120883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":116700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":1.24},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.82499999999999996}]},{"osd":1,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.2729999999999999}]},{"osd":2,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":1.202}]},{"osd":4,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.50900000000000001}]},{"osd":5,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.63900000000000001}]},{"osd":6,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.71099999999999997}]},{"osd":7,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58599999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":884736,"data_stored":706002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":119349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.45500000000000002}]},{"osd":1,"last update":"Wed Dec 13 00:01:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.48899999999999999}]},{"osd":3,"last update":"Wed Dec 13 00:01:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.52400000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:01:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.41099999999999998}]},{"osd":5,"last update":"Wed Dec 13 00:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.38200000000000001}]},{"osd":6,"last update":"Wed Dec 13 00:01:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.85099999999999998}]},{"osd":7,"last update":"Wed Dec 13 00:01:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.59299999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 00:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.35699999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.316}]},{"osd":3,"last update":"Wed Dec 13 00:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.249},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.33600000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.437}]},{"osd":5,"last update":"Wed Dec 13 00:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.55800000000000005}]},{"osd":6,"last update":"Wed Dec 13 00:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed Dec 13 00:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.61799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":897024,"data_stored":706646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.44500000000000001}]},{"osd":1,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.42599999999999999}]},{"osd":2,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.375}]},{"osd":3,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.437},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.503}]},{"osd":4,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.32400000000000001}]},{"osd":6,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.39500000000000002}]},{"osd":7,"last update":"Wed Dec 13 00:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.41299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T00:01:14.303 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-13T00:01:14.303 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-13T00:01:14.303 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-13T00:01:14.303 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-13T00:01:14.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.433+0000 7f75db305640 1 Processor -- start 2023-12-13T00:01:14.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.434+0000 7f75db305640 1 -- start start 2023-12-13T00:01:14.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.434+0000 7f75db305640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d40c46c0 0x7f75d40c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:14.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.434+0000 7f75db305640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75d40c4aa0 0x7f75d414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:14.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.434+0000 7f75db305640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d40c76f0 con 0x7f75d4150290 2023-12-13T00:01:14.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.434+0000 7f75db305640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d40c2bc0 con 0x7f75d40c4aa0 2023-12-13T00:01:14.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.434+0000 7f75db305640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d40c6dc0 con 0x7f75d40c46c0 2023-12-13T00:01:14.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.435+0000 7f75d88a0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75d40c4aa0 0x7f75d414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:14.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.435+0000 7f75d98a2640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f75d4150290 0x7f75d40c1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:43868/0 (socket says 172.21.15.72:43868) 2023-12-13T00:01:14.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.435+0000 7f75d98a2640 1 -- 172.21.15.72:0/434389356 learned_addr learned my addr 172.21.15.72:0/434389356 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:14.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.435+0000 7f75d90a1640 1 --2- 172.21.15.72:0/434389356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d40c46c0 0x7f75d40c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:14.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.438+0000 7f75d88a0640 1 -- 172.21.15.72:0/434389356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d40c46c0 msgr2=0x7f75d40c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:14.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.438+0000 7f75d88a0640 1 --2- 172.21.15.72:0/434389356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d40c46c0 0x7f75d40c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:14.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.438+0000 7f75d88a0640 1 -- 172.21.15.72:0/434389356 >> v1:172.21.15.176:6789/0 conn(0x7f75d4150290 legacy=0x7f75d40c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:14.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.438+0000 7f75d88a0640 1 -- 172.21.15.72:0/434389356 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d40c70a0 con 0x7f75d40c4aa0 2023-12-13T00:01:14.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.440+0000 7f75d88a0640 1 --2- 172.21.15.72:0/434389356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d40c4aa0 0x7f75d414fd50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f75d00097a0 tx=0x7f75d002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e6c450eb2a8a88 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:14.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.443+0000 7f75cbfff640 1 -- 172.21.15.72:0/434389356 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d0031830 con 0x7f75d40c4aa0 2023-12-13T00:01:14.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.443+0000 7f75cbfff640 1 -- 172.21.15.72:0/434389356 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d0031990 con 0x7f75d40c4aa0 2023-12-13T00:01:14.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.443+0000 7f75cbfff640 1 -- 172.21.15.72:0/434389356 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d0031d20 con 0x7f75d40c4aa0 2023-12-13T00:01:14.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.444+0000 7f75db305640 1 -- 172.21.15.72:0/434389356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d40c4aa0 msgr2=0x7f75d414fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:14.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.444+0000 7f75db305640 1 --2- 172.21.15.72:0/434389356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d40c4aa0 0x7f75d414fd50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f75d00097a0 tx=0x7f75d002b8d0 comp rx=0 tx=0).stop 2023-12-13T00:01:14.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.444+0000 7f75db305640 1 -- 172.21.15.72:0/434389356 shutdown_connections 2023-12-13T00:01:14.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.444+0000 7f75db305640 1 --2- 172.21.15.72:0/434389356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d40c4aa0 0x7f75d414fd50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:14.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.444+0000 7f75db305640 1 --2- 172.21.15.72:0/434389356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d40c46c0 0x7f75d40c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:14.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.444+0000 7f75db305640 1 -- 172.21.15.72:0/434389356 >> 172.21.15.72:0/434389356 conn(0x7f75d406c5f0 msgr2=0x7f75d406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:14.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.444+0000 7f75db305640 1 -- 172.21.15.72:0/434389356 shutdown_connections 2023-12-13T00:01:14.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.444+0000 7f75db305640 1 -- 172.21.15.72:0/434389356 wait complete. 2023-12-13T00:01:14.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.446+0000 7f75db305640 1 Processor -- start 2023-12-13T00:01:14.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.446+0000 7f75db305640 1 -- start start 2023-12-13T00:01:14.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.446+0000 7f75db305640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75d40c46c0 0x7f75d4152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:14.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.446+0000 7f75db305640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d40c4aa0 0x7f75d40ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:14.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.446+0000 7f75db305640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4150290 0x7f75d413c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:14.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.446+0000 7f75db305640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d40cb890 con 0x7f75d4150290 2023-12-13T00:01:14.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.446+0000 7f75db305640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d4153fe0 con 0x7f75d40c46c0 2023-12-13T00:01:14.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.446+0000 7f75db305640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d4153270 con 0x7f75d40c4aa0 2023-12-13T00:01:14.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.447+0000 7f75d98a2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4150290 0x7f75d413c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:14.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.447+0000 7f75d90a1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75d40c46c0 0x7f75d4152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:14.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.447+0000 7f75d88a0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d40c4aa0 0x7f75d40ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:14.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.447+0000 7f75d98a2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4150290 0x7f75d413c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35948/0 (socket says 172.21.15.72:35948) 2023-12-13T00:01:14.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.447+0000 7f75d98a2640 1 -- 172.21.15.72:0/3216984398 learned_addr learned my addr 172.21.15.72:0/3216984398 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:14.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.450+0000 7f75d98a2640 1 -- 172.21.15.72:0/3216984398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d40c4aa0 msgr2=0x7f75d40ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:14.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.450+0000 7f75d98a2640 1 --2- 172.21.15.72:0/3216984398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d40c4aa0 0x7f75d40ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:14.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.450+0000 7f75d98a2640 1 -- 172.21.15.72:0/3216984398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75d40c46c0 msgr2=0x7f75d4152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:14.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.450+0000 7f75d98a2640 1 --2- 172.21.15.72:0/3216984398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75d40c46c0 0x7f75d4152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:14.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.450+0000 7f75d98a2640 1 -- 172.21.15.72:0/3216984398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d0009400 con 0x7f75d4150290 2023-12-13T00:01:14.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.452+0000 7f75d98a2640 1 --2- 172.21.15.72:0/3216984398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4150290 0x7f75d413c660 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00cab0 tx=0x7f75cc00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:14.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.456+0000 7f75c9ffb640 1 -- 172.21.15.72:0/3216984398 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc00ac30 con 0x7f75d4150290 2023-12-13T00:01:14.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.456+0000 7f75c9ffb640 1 -- 172.21.15.72:0/3216984398 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75cc00ad90 con 0x7f75d4150290 2023-12-13T00:01:14.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.456+0000 7f75db305640 1 -- 172.21.15.72:0/3216984398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d40cb010 con 0x7f75d4150290 2023-12-13T00:01:14.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.456+0000 7f75c9ffb640 1 -- 172.21.15.72:0/3216984398 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc012600 con 0x7f75d4150290 2023-12-13T00:01:14.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.456+0000 7f75db305640 1 -- 172.21.15.72:0/3216984398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d41537c0 con 0x7f75d4150290 2023-12-13T00:01:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.457+0000 7f75db305640 1 -- 172.21.15.72:0/3216984398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d40711f0 con 0x7f75d4150290 2023-12-13T00:01:14.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.697+0000 7f75c9ffb640 1 -- 172.21.15.72:0/3216984398 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f75cc012760 con 0x7f75d4150290 2023-12-13T00:01:14.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.697+0000 7f75c9ffb640 1 --2- 172.21.15.72:0/3216984398 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f75b806b1c0 0x7f75b806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:14.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.697+0000 7f75d90a1640 1 --2- 172.21.15.72:0/3216984398 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f75b806b1c0 0x7f75b806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:14.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.698+0000 7f75d90a1640 1 --2- 172.21.15.72:0/3216984398 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f75b806b1c0 0x7f75b806d680 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009b40 tx=0x7f75c4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:14.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.711+0000 7f75c9ffb640 1 -- 172.21.15.72:0/3216984398 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f75cc058ae0 con 0x7f75d4150290 2023-12-13T00:01:14.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.712+0000 7f75c9ffb640 1 -- 172.21.15.72:0/3216984398 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f75cc054e20 con 0x7f75d4150290 2023-12-13T00:01:14.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.918+0000 7f75db305640 1 -- 172.21.15.72:0/3216984398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f75d40c9d60 con 0x7f75d4150290 2023-12-13T00:01:14.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.923+0000 7f75c9ffb640 1 -- 172.21.15.72:0/3216984398 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f75cc058440 con 0x7f75d4150290 2023-12-13T00:01:14.923 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:01:14.923 INFO:teuthology.orchestra.run.smithi072.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-13T00:01:14.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.925+0000 7f75db305640 1 -- 172.21.15.72:0/3216984398 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f75b806b1c0 msgr2=0x7f75b806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:14.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.925+0000 7f75db305640 1 --2- 172.21.15.72:0/3216984398 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f75b806b1c0 0x7f75b806d680 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009b40 tx=0x7f75c4009190 comp rx=0 tx=0).stop 2023-12-13T00:01:14.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.925+0000 7f75db305640 1 -- 172.21.15.72:0/3216984398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4150290 msgr2=0x7f75d413c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:14.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.925+0000 7f75db305640 1 --2- 172.21.15.72:0/3216984398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4150290 0x7f75d413c660 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00cab0 tx=0x7f75cc00cf70 comp rx=0 tx=0).stop 2023-12-13T00:01:14.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.925+0000 7f75db305640 1 -- 172.21.15.72:0/3216984398 shutdown_connections 2023-12-13T00:01:14.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.925+0000 7f75db305640 1 --2- 172.21.15.72:0/3216984398 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f75b806b1c0 0x7f75b806d680 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:14.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.925+0000 7f75db305640 1 --2- 172.21.15.72:0/3216984398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4150290 0x7f75d413c660 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:14.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.925+0000 7f75db305640 1 --2- 172.21.15.72:0/3216984398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d40c4aa0 0x7f75d40ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:14.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.925+0000 7f75db305640 1 --2- 172.21.15.72:0/3216984398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75d40c46c0 0x7f75d4152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:14.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.925+0000 7f75db305640 1 -- 172.21.15.72:0/3216984398 >> 172.21.15.72:0/3216984398 conn(0x7f75d406c5f0 msgr2=0x7f75d4145520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:14.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.926+0000 7f75db305640 1 -- 172.21.15.72:0/3216984398 shutdown_connections 2023-12-13T00:01:14.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:14.926+0000 7f75db305640 1 -- 172.21.15.72:0/3216984398 wait complete. 2023-12-13T00:01:14.936 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-13T00:01:14.936 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:01:15.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.036+0000 7f066130c640 1 Processor -- start 2023-12-13T00:01:15.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.036+0000 7f066130c640 1 -- start start 2023-12-13T00:01:15.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.037+0000 7f066130c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f065c0cc420 0x7f065c159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:15.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.037+0000 7f066130c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f065c159b50 0x7f065c0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:15.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.037+0000 7f066130c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065c0cbda0 con 0x7f065c0cda70 2023-12-13T00:01:15.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.037+0000 7f066130c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065c0cc230 con 0x7f065c159b50 2023-12-13T00:01:15.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.037+0000 7f066130c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065c0cea60 con 0x7f065c0cc420 2023-12-13T00:01:15.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.037+0000 7f065b7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f065c159b50 0x7f065c0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:15.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.037+0000 7f065affd640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f065c0cda70 0x7f065c0ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:43872/0 (socket says 172.21.15.72:43872) 2023-12-13T00:01:15.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.037+0000 7f065affd640 1 -- 172.21.15.72:0/2157281241 learned_addr learned my addr 172.21.15.72:0/2157281241 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:15.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.037+0000 7f06527fc640 1 --2- 172.21.15.72:0/2157281241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f065c0cc420 0x7f065c159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.040+0000 7f065b7fe640 1 -- 172.21.15.72:0/2157281241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f065c0cc420 msgr2=0x7f065c159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.040+0000 7f065b7fe640 1 --2- 172.21.15.72:0/2157281241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f065c0cc420 0x7f065c159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.040+0000 7f065b7fe640 1 -- 172.21.15.72:0/2157281241 >> v1:172.21.15.176:6789/0 conn(0x7f065c0cda70 legacy=0x7f065c0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.040+0000 7f065b7fe640 1 -- 172.21.15.72:0/2157281241 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c0cb4e0 con 0x7f065c159b50 2023-12-13T00:01:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.040+0000 7f065a7fc640 1 -- 172.21.15.72:0/2157281241 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188261860 0 0) 0x7f065c0cbda0 con 0x7f065c0cda70 2023-12-13T00:01:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.042+0000 7f065b7fe640 1 --2- 172.21.15.72:0/2157281241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f065c159b50 0x7f065c0c9620 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0654009d90 tx=0x7f065402bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3570010fc2ec38bd server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.045+0000 7f065a7fc640 1 -- 172.21.15.72:0/2157281241 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065402cce0 con 0x7f065c159b50 2023-12-13T00:01:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.045+0000 7f065a7fc640 1 -- 172.21.15.72:0/2157281241 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065402ce40 con 0x7f065c159b50 2023-12-13T00:01:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.045+0000 7f065a7fc640 1 -- 172.21.15.72:0/2157281241 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654034660 con 0x7f065c159b50 2023-12-13T00:01:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.046+0000 7f066130c640 1 -- 172.21.15.72:0/2157281241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f065c159b50 msgr2=0x7f065c0c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.046+0000 7f066130c640 1 --2- 172.21.15.72:0/2157281241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f065c159b50 0x7f065c0c9620 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0654009d90 tx=0x7f065402bf30 comp rx=0 tx=0).stop 2023-12-13T00:01:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.046+0000 7f066130c640 1 -- 172.21.15.72:0/2157281241 shutdown_connections 2023-12-13T00:01:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.046+0000 7f066130c640 1 --2- 172.21.15.72:0/2157281241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f065c159b50 0x7f065c0c9620 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.046+0000 7f066130c640 1 --2- 172.21.15.72:0/2157281241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f065c0cc420 0x7f065c159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.046+0000 7f066130c640 1 -- 172.21.15.72:0/2157281241 >> 172.21.15.72:0/2157281241 conn(0x7f065c0b07b0 msgr2=0x7f065c0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:15.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.046+0000 7f066130c640 1 -- 172.21.15.72:0/2157281241 shutdown_connections 2023-12-13T00:01:15.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.046+0000 7f066130c640 1 -- 172.21.15.72:0/2157281241 wait complete. 2023-12-13T00:01:15.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.047+0000 7f066130c640 1 Processor -- start 2023-12-13T00:01:15.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.047+0000 7f066130c640 1 -- start start 2023-12-13T00:01:15.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.048+0000 7f066130c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f065c0cc420 0x7f065c0c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.048+0000 7f066130c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f065c0cda70 0x7f065c0ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.048+0000 7f066130c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f065c159b50 0x7f065c0ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.048+0000 7f066130c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c0ab2e0 con 0x7f065c0cda70 2023-12-13T00:01:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.048+0000 7f066130c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c0aa690 con 0x7f065c159b50 2023-12-13T00:01:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.048+0000 7f066130c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065c0c41e0 con 0x7f065c0cc420 2023-12-13T00:01:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.048+0000 7f06527fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f065c0cda70 0x7f065c0ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.049+0000 7f065affd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f065c0cc420 0x7f065c0c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.049+0000 7f06527fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f065c0cda70 0x7f065c0ad260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35956/0 (socket says 172.21.15.72:35956) 2023-12-13T00:01:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.049+0000 7f06527fc640 1 -- 172.21.15.72:0/3564598405 learned_addr learned my addr 172.21.15.72:0/3564598405 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.049+0000 7f065b7fe640 1 --2- 172.21.15.72:0/3564598405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f065c159b50 0x7f065c0ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:15.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.052+0000 7f06527fc640 1 -- 172.21.15.72:0/3564598405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f065c0cc420 msgr2=0x7f065c0c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:15.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.052+0000 7f06527fc640 1 --2- 172.21.15.72:0/3564598405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f065c0cc420 0x7f065c0c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:15.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.052+0000 7f06527fc640 1 -- 172.21.15.72:0/3564598405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f065c159b50 msgr2=0x7f065c0ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:15.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.052+0000 7f06527fc640 1 --2- 172.21.15.72:0/3564598405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f065c159b50 0x7f065c0ad7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:15.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.052+0000 7f06527fc640 1 -- 172.21.15.72:0/3564598405 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0654009a70 con 0x7f065c0cda70 2023-12-13T00:01:15.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.054+0000 7f06527fc640 1 --2- 172.21.15.72:0/3564598405 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f065c0cda70 0x7f065c0ad260 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f064400e980 tx=0x7f064400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.057+0000 7f0653fff640 1 -- 172.21.15.72:0/3564598405 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644009670 con 0x7f065c0cda70 2023-12-13T00:01:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.058+0000 7f0653fff640 1 -- 172.21.15.72:0/3564598405 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064400ca00 con 0x7f065c0cda70 2023-12-13T00:01:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.058+0000 7f066130c640 1 -- 172.21.15.72:0/3564598405 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065c0c44c0 con 0x7f065c0cda70 2023-12-13T00:01:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.058+0000 7f0653fff640 1 -- 172.21.15.72:0/3564598405 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064400cd90 con 0x7f065c0cda70 2023-12-13T00:01:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.058+0000 7f066130c640 1 -- 172.21.15.72:0/3564598405 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065c0b29c0 con 0x7f065c0cda70 2023-12-13T00:01:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.059+0000 7f066130c640 1 -- 172.21.15.72:0/3564598405 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065c067470 con 0x7f065c0cda70 2023-12-13T00:01:15.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.307+0000 7f0653fff640 1 -- 172.21.15.72:0/3564598405 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0644013470 con 0x7f065c0cda70 2023-12-13T00:01:15.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.307+0000 7f0653fff640 1 --2- 172.21.15.72:0/3564598405 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f063c06b1c0 0x7f063c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:15.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.308+0000 7f065affd640 1 --2- 172.21.15.72:0/3564598405 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f063c06b1c0 0x7f063c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:15.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.308+0000 7f065affd640 1 --2- 172.21.15.72:0/3564598405 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f063c06b1c0 0x7f063c06d680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f064c000f60 tx=0x7f064c007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:15.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.321+0000 7f0653fff640 1 -- 172.21.15.72:0/3564598405 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f0644058e40 con 0x7f065c0cda70 2023-12-13T00:01:15.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.321+0000 7f0653fff640 1 -- 172.21.15.72:0/3564598405 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0644055180 con 0x7f065c0cda70 2023-12-13T00:01:15.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.502+0000 7f066130c640 1 -- 172.21.15.72:0/3564598405 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f065c0b4c20 con 0x7f065c0cda70 2023-12-13T00:01:15.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.542+0000 7f0653fff640 1 -- 172.21.15.72:0/3564598405 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18563 (secure 0 0 0) 0x7f0644017090 con 0x7f065c0cda70 2023-12-13T00:01:15.542 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:01:15.542 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:01:00.435991+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T00:00:27.701252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T00:00:29.324356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T00:00:33.363089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.3","mappings":[{"from":7,"to":5}]},{"pgid":"4.10","mappings":[{"from":7,"to":0}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:01:15.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.544+0000 7f066130c640 1 -- 172.21.15.72:0/3564598405 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f063c06b1c0 msgr2=0x7f063c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:15.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.544+0000 7f066130c640 1 --2- 172.21.15.72:0/3564598405 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f063c06b1c0 0x7f063c06d680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f064c000f60 tx=0x7f064c007d50 comp rx=0 tx=0).stop 2023-12-13T00:01:15.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.544+0000 7f066130c640 1 -- 172.21.15.72:0/3564598405 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f065c0cda70 msgr2=0x7f065c0ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:15.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.544+0000 7f066130c640 1 --2- 172.21.15.72:0/3564598405 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f065c0cda70 0x7f065c0ad260 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f064400e980 tx=0x7f064400ee40 comp rx=0 tx=0).stop 2023-12-13T00:01:15.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.544+0000 7f066130c640 1 -- 172.21.15.72:0/3564598405 shutdown_connections 2023-12-13T00:01:15.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.544+0000 7f066130c640 1 --2- 172.21.15.72:0/3564598405 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f063c06b1c0 0x7f063c06d680 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:15.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.544+0000 7f066130c640 1 --2- 172.21.15.72:0/3564598405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f065c159b50 0x7f065c0ad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:15.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.544+0000 7f066130c640 1 --2- 172.21.15.72:0/3564598405 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f065c0cda70 0x7f065c0ad260 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:15.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.544+0000 7f066130c640 1 --2- 172.21.15.72:0/3564598405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f065c0cc420 0x7f065c0c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:15.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.544+0000 7f066130c640 1 -- 172.21.15.72:0/3564598405 >> 172.21.15.72:0/3564598405 conn(0x7f065c0b07b0 msgr2=0x7f065c0af810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:15.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.544+0000 7f066130c640 1 -- 172.21.15.72:0/3564598405 shutdown_connections 2023-12-13T00:01:15.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.544+0000 7f066130c640 1 -- 172.21.15.72:0/3564598405 wait complete. 2023-12-13T00:01:15.555 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-13T00:00:06.839153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-13T00:00:27.701252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-13T00:00:29.324356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-13T00:00:33.363089+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-13T00:01:15.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-13T00:01:15.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.658+0000 7fd0cd409640 1 Processor -- start 2023-12-13T00:01:15.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.658+0000 7fd0cd409640 1 -- start start 2023-12-13T00:01:15.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.659+0000 7fd0cd409640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd0c814ff80 0x7fd0c80c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:15.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.659+0000 7fd0cd409640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c80c1ba0 con 0x7fd0c814fba0 2023-12-13T00:01:15.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.659+0000 7fd0cd409640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c80c3c20 con 0x7fd0c806e480 2023-12-13T00:01:15.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.659+0000 7fd0cd409640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c80c3f00 con 0x7fd0c814ff80 2023-12-13T00:01:15.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.659+0000 7fd0c6ffd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd0c814fba0 0x7fd0c80c1f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48102/0 (socket says 172.21.15.72:48102) 2023-12-13T00:01:15.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.659+0000 7fd0c6ffd640 1 -- 172.21.15.72:0/3095249220 learned_addr learned my addr 172.21.15.72:0/3095249220 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:15.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.659+0000 7fd0c67fc640 1 --2- 172.21.15.72:0/3095249220 >> v2:172.21.15.176:3300/0 conn(0x7fd0c814ff80 0x7fd0c80c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:15.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.662+0000 7fd0c5ffb640 1 -- 172.21.15.72:0/3095249220 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742360492 0 0) 0x7fd0c80c1ba0 con 0x7fd0c814fba0 2023-12-13T00:01:15.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.662+0000 7fd0c5ffb640 1 -- 172.21.15.72:0/3095249220 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0b0003520 con 0x7fd0c814fba0 2023-12-13T00:01:15.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.663+0000 7fd0c67fc640 1 -- 172.21.15.72:0/3095249220 >> v1:172.21.15.176:6789/0 conn(0x7fd0c806e480 legacy=0x7fd0c8155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:15.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.663+0000 7fd0c67fc640 1 -- 172.21.15.72:0/3095249220 >> v1:172.21.15.72:6789/0 conn(0x7fd0c814fba0 legacy=0x7fd0c80c1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:15.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.663+0000 7fd0c67fc640 1 -- 172.21.15.72:0/3095249220 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c80c41e0 con 0x7fd0c814ff80 2023-12-13T00:01:15.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.667+0000 7fd0c67fc640 1 --2- 172.21.15.72:0/3095249220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0c814ff80 0x7fd0c80c12f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00a940 tx=0x7fd0bc02cec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e57e02015176d4d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:15.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.670+0000 7fd0c5ffb640 1 -- 172.21.15.72:0/3095249220 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc02dc70 con 0x7fd0c814ff80 2023-12-13T00:01:15.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.670+0000 7fd0c5ffb640 1 -- 172.21.15.72:0/3095249220 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0bc02ddd0 con 0x7fd0c814ff80 2023-12-13T00:01:15.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.670+0000 7fd0c5ffb640 1 -- 172.21.15.72:0/3095249220 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc035660 con 0x7fd0c814ff80 2023-12-13T00:01:15.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.671+0000 7fd0cd409640 1 -- 172.21.15.72:0/3095249220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0c814ff80 msgr2=0x7fd0c80c12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:15.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.671+0000 7fd0cd409640 1 --2- 172.21.15.72:0/3095249220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0c814ff80 0x7fd0c80c12f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00a940 tx=0x7fd0bc02cec0 comp rx=0 tx=0).stop 2023-12-13T00:01:15.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.671+0000 7fd0cd409640 1 -- 172.21.15.72:0/3095249220 shutdown_connections 2023-12-13T00:01:15.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.671+0000 7fd0cd409640 1 --2- 172.21.15.72:0/3095249220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0c814ff80 0x7fd0c80c12f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:15.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.671+0000 7fd0cd409640 1 -- 172.21.15.72:0/3095249220 >> 172.21.15.72:0/3095249220 conn(0x7fd0c806c5f0 msgr2=0x7fd0c806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:15.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.671+0000 7fd0cd409640 1 -- 172.21.15.72:0/3095249220 shutdown_connections 2023-12-13T00:01:15.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.671+0000 7fd0cd409640 1 -- 172.21.15.72:0/3095249220 wait complete. 2023-12-13T00:01:15.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.672+0000 7fd0cd409640 1 Processor -- start 2023-12-13T00:01:15.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.672+0000 7fd0cd409640 1 -- start start 2023-12-13T00:01:15.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.673+0000 7fd0cd409640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0c806e480 0x7fd0c813a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:15.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.673+0000 7fd0cd409640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0c814fba0 0x7fd0c81438e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:15.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.673+0000 7fd0cd409640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0c8070f20 0x7fd0c81ee5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:15.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.673+0000 7fd0cd409640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c8154720 con 0x7fd0c8070f20 2023-12-13T00:01:15.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.673+0000 7fd0cd409640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c8070a90 con 0x7fd0c806e480 2023-12-13T00:01:15.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.673+0000 7fd0cd409640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c813a6c0 con 0x7fd0c814fba0 2023-12-13T00:01:15.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.674+0000 7fd0c77fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0c8070f20 0x7fd0c81ee5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:15.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.674+0000 7fd0c6ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0c806e480 0x7fd0c813a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:15.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.674+0000 7fd0c67fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0c814fba0 0x7fd0c81438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:15.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.674+0000 7fd0c77fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0c8070f20 0x7fd0c81ee5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35964/0 (socket says 172.21.15.72:35964) 2023-12-13T00:01:15.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.674+0000 7fd0c77fe640 1 -- 172.21.15.72:0/3427323909 learned_addr learned my addr 172.21.15.72:0/3427323909 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:15.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.677+0000 7fd0c77fe640 1 -- 172.21.15.72:0/3427323909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0c814fba0 msgr2=0x7fd0c81438e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:15.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.677+0000 7fd0c77fe640 1 --2- 172.21.15.72:0/3427323909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0c814fba0 0x7fd0c81438e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:15.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.677+0000 7fd0c77fe640 1 -- 172.21.15.72:0/3427323909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0c806e480 msgr2=0x7fd0c813a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:15.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.677+0000 7fd0c77fe640 1 --2- 172.21.15.72:0/3427323909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0c806e480 0x7fd0c813a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:15.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.677+0000 7fd0c77fe640 1 -- 172.21.15.72:0/3427323909 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc00a5a0 con 0x7fd0c8070f20 2023-12-13T00:01:15.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.679+0000 7fd0c77fe640 1 --2- 172.21.15.72:0/3427323909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0c8070f20 0x7fd0c81ee5b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd0c000c7a0 tx=0x7fd0c000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:15.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.683+0000 7fd0af7fe640 1 -- 172.21.15.72:0/3427323909 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0003b70 con 0x7fd0c8070f20 2023-12-13T00:01:15.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.683+0000 7fd0af7fe640 1 -- 172.21.15.72:0/3427323909 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c0003cf0 con 0x7fd0c8070f20 2023-12-13T00:01:15.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.683+0000 7fd0af7fe640 1 -- 172.21.15.72:0/3427323909 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0003ea0 con 0x7fd0c8070f20 2023-12-13T00:01:15.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.683+0000 7fd0cd409640 1 -- 172.21.15.72:0/3427323909 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c8139990 con 0x7fd0c8070f20 2023-12-13T00:01:15.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.683+0000 7fd0cd409640 1 -- 172.21.15.72:0/3427323909 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c8072930 con 0x7fd0c8070f20 2023-12-13T00:01:15.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.684+0000 7fd0cd409640 1 -- 172.21.15.72:0/3427323909 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c8067470 con 0x7fd0c8070f20 2023-12-13T00:01:15.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.703+0000 7fd0af7fe640 1 -- 172.21.15.72:0/3427323909 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd0c000aa90 con 0x7fd0c8070f20 2023-12-13T00:01:15.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.703+0000 7fd0af7fe640 1 --2- 172.21.15.72:0/3427323909 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd0b406b240 0x7fd0b406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:15.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.703+0000 7fd0c6ffd640 1 --2- 172.21.15.72:0/3427323909 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd0b406b240 0x7fd0b406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:15.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.704+0000 7fd0c6ffd640 1 --2- 172.21.15.72:0/3427323909 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd0b406b240 0x7fd0b406d700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80011e0 tx=0x7fd0b8007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:15.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.940+0000 7fd0af7fe640 1 -- 172.21.15.72:0/3427323909 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fd0c0058cb0 con 0x7fd0c8070f20 2023-12-13T00:01:15.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:15.940+0000 7fd0af7fe640 1 -- 172.21.15.72:0/3427323909 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd0c0054ff0 con 0x7fd0c8070f20 2023-12-13T00:01:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.110+0000 7fd0cd409640 1 -- 172.21.15.72:0/3427323909 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0c8070bd0 con 0x7fd0c8070f20 2023-12-13T00:01:16.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.116+0000 7fd0af7fe640 1 -- 172.21.15.72:0/3427323909 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0c0058610 con 0x7fd0c8070f20 2023-12-13T00:01:16.115 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-12-13T00:01:16.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.118+0000 7fd0cd409640 1 -- 172.21.15.72:0/3427323909 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd0b406b240 msgr2=0x7fd0b406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:16.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.118+0000 7fd0cd409640 1 --2- 172.21.15.72:0/3427323909 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd0b406b240 0x7fd0b406d700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80011e0 tx=0x7fd0b8007d30 comp rx=0 tx=0).stop 2023-12-13T00:01:16.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.118+0000 7fd0cd409640 1 -- 172.21.15.72:0/3427323909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0c8070f20 msgr2=0x7fd0c81ee5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:16.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.118+0000 7fd0cd409640 1 --2- 172.21.15.72:0/3427323909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0c8070f20 0x7fd0c81ee5b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd0c000c7a0 tx=0x7fd0c000cc60 comp rx=0 tx=0).stop 2023-12-13T00:01:16.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.118+0000 7fd0cd409640 1 -- 172.21.15.72:0/3427323909 shutdown_connections 2023-12-13T00:01:16.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.118+0000 7fd0cd409640 1 --2- 172.21.15.72:0/3427323909 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd0b406b240 0x7fd0b406d700 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.118+0000 7fd0cd409640 1 --2- 172.21.15.72:0/3427323909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0c8070f20 0x7fd0c81ee5b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.118+0000 7fd0cd409640 1 --2- 172.21.15.72:0/3427323909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0c814fba0 0x7fd0c81438e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.118+0000 7fd0cd409640 1 --2- 172.21.15.72:0/3427323909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0c806e480 0x7fd0c813a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.118+0000 7fd0cd409640 1 -- 172.21.15.72:0/3427323909 >> 172.21.15.72:0/3427323909 conn(0x7fd0c806c5f0 msgr2=0x7fd0c8073530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:16.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.118+0000 7fd0cd409640 1 -- 172.21.15.72:0/3427323909 shutdown_connections 2023-12-13T00:01:16.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.118+0000 7fd0cd409640 1 -- 172.21.15.72:0/3427323909 wait complete. 2023-12-13T00:01:16.129 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-13T00:01:16.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.231+0000 7f97b75a9640 1 Processor -- start 2023-12-13T00:01:16.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.231+0000 7f97b75a9640 1 -- start start 2023-12-13T00:01:16.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.232+0000 7f97b75a9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f97b006a4b0 0x7f97b006a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:16.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.232+0000 7f97b75a9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97b015c9c0 0x7f97b015ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.232+0000 7f97b75a9640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b0159f80 con 0x7f97b00c59e0 2023-12-13T00:01:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.232+0000 7f97b75a9640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b015d350 con 0x7f97b006a4b0 2023-12-13T00:01:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.232+0000 7f97b75a9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b01593d0 con 0x7f97b015c9c0 2023-12-13T00:01:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.233+0000 7f97b5345640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f97b00c59e0 0x7f97b006d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48116/0 (socket says 172.21.15.72:48116) 2023-12-13T00:01:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.233+0000 7f97b5345640 1 -- 172.21.15.72:0/1442542979 learned_addr learned my addr 172.21.15.72:0/1442542979 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.233+0000 7f97b4b44640 1 --2- 172.21.15.72:0/1442542979 >> v2:172.21.15.176:3300/0 conn(0x7f97b006a4b0 0x7f97b006a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.233+0000 7f97b5b46640 1 --2- 172.21.15.72:0/1442542979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97b015c9c0 0x7f97b015ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.235+0000 7f97a7fff640 1 -- 172.21.15.72:0/1442542979 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617244460 0 0) 0x7f97b0159f80 con 0x7f97b00c59e0 2023-12-13T00:01:16.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.235+0000 7f97a7fff640 1 -- 172.21.15.72:0/1442542979 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f979c003520 con 0x7f97b00c59e0 2023-12-13T00:01:16.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.236+0000 7f97b4b44640 1 -- 172.21.15.72:0/1442542979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97b015c9c0 msgr2=0x7f97b015ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:16.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.236+0000 7f97b4b44640 1 --2- 172.21.15.72:0/1442542979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97b015c9c0 0x7f97b015ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.236+0000 7f97b4b44640 1 -- 172.21.15.72:0/1442542979 >> v1:172.21.15.72:6789/0 conn(0x7f97b00c59e0 legacy=0x7f97b006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:16.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.236+0000 7f97b4b44640 1 -- 172.21.15.72:0/1442542979 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b0072650 con 0x7f97b006a4b0 2023-12-13T00:01:16.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.238+0000 7f97b4b44640 1 --2- 172.21.15.72:0/1442542979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97b006a4b0 0x7f97b006a8e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f97a00097a0 tx=0x7f97a002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de4382b4cb69dbcc server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:16.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.241+0000 7f97a7fff640 1 -- 172.21.15.72:0/1442542979 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0030610 con 0x7f97b006a4b0 2023-12-13T00:01:16.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.241+0000 7f97a7fff640 1 -- 172.21.15.72:0/1442542979 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a0030770 con 0x7f97b006a4b0 2023-12-13T00:01:16.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.241+0000 7f97a7fff640 1 -- 172.21.15.72:0/1442542979 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0030b00 con 0x7f97b006a4b0 2023-12-13T00:01:16.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.242+0000 7f97b75a9640 1 -- 172.21.15.72:0/1442542979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97b006a4b0 msgr2=0x7f97b006a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:16.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.242+0000 7f97b75a9640 1 --2- 172.21.15.72:0/1442542979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97b006a4b0 0x7f97b006a8e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f97a00097a0 tx=0x7f97a002b960 comp rx=0 tx=0).stop 2023-12-13T00:01:16.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.242+0000 7f97b75a9640 1 -- 172.21.15.72:0/1442542979 shutdown_connections 2023-12-13T00:01:16.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.242+0000 7f97b75a9640 1 --2- 172.21.15.72:0/1442542979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97b015c9c0 0x7f97b015ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.242+0000 7f97b75a9640 1 --2- 172.21.15.72:0/1442542979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97b006a4b0 0x7f97b006a8e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.242+0000 7f97b75a9640 1 -- 172.21.15.72:0/1442542979 >> 172.21.15.72:0/1442542979 conn(0x7f97b006f6d0 msgr2=0x7f97b006fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:16.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.242+0000 7f97b75a9640 1 -- 172.21.15.72:0/1442542979 shutdown_connections 2023-12-13T00:01:16.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.242+0000 7f97b75a9640 1 -- 172.21.15.72:0/1442542979 wait complete. 2023-12-13T00:01:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.243+0000 7f97b75a9640 1 Processor -- start 2023-12-13T00:01:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.243+0000 7f97b75a9640 1 -- start start 2023-12-13T00:01:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.244+0000 7f97b75a9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97b006a4b0 0x7f97b01e2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.244+0000 7f97b75a9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97b00c59e0 0x7f97b01f00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.244+0000 7f97b75a9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b015c9c0 0x7f97b01f3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.244+0000 7f97b75a9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b01efc20 con 0x7f97b015c9c0 2023-12-13T00:01:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.244+0000 7f97b75a9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b01f3a80 con 0x7f97b006a4b0 2023-12-13T00:01:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.244+0000 7f97b75a9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b01ef5f0 con 0x7f97b00c59e0 2023-12-13T00:01:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.245+0000 7f97b5b46640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b015c9c0 0x7f97b01f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.245+0000 7f97b4b44640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97b00c59e0 0x7f97b01f00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.245+0000 7f97b5b46640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b015c9c0 0x7f97b01f3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35976/0 (socket says 172.21.15.72:35976) 2023-12-13T00:01:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.245+0000 7f97b5b46640 1 -- 172.21.15.72:0/2375792625 learned_addr learned my addr 172.21.15.72:0/2375792625 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.245+0000 7f97b5345640 1 --2- 172.21.15.72:0/2375792625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97b006a4b0 0x7f97b01e2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.248+0000 7f97b5b46640 1 -- 172.21.15.72:0/2375792625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97b00c59e0 msgr2=0x7f97b01f00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.248+0000 7f97b5b46640 1 --2- 172.21.15.72:0/2375792625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97b00c59e0 0x7f97b01f00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.248+0000 7f97b5b46640 1 -- 172.21.15.72:0/2375792625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97b006a4b0 msgr2=0x7f97b01e2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.248+0000 7f97b5b46640 1 --2- 172.21.15.72:0/2375792625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97b006a4b0 0x7f97b01e2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.248+0000 7f97b5b46640 1 -- 172.21.15.72:0/2375792625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a0009400 con 0x7f97b015c9c0 2023-12-13T00:01:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.250+0000 7f97b5b46640 1 --2- 172.21.15.72:0/2375792625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b015c9c0 0x7f97b01f3540 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f97a800e820 tx=0x7f97a800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.254+0000 7f97a5ffb640 1 -- 172.21.15.72:0/2375792625 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a8009510 con 0x7f97b015c9c0 2023-12-13T00:01:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.254+0000 7f97a5ffb640 1 -- 172.21.15.72:0/2375792625 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a800ee70 con 0x7f97b015c9c0 2023-12-13T00:01:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.254+0000 7f97b75a9640 1 -- 172.21.15.72:0/2375792625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b015b240 con 0x7f97b015c9c0 2023-12-13T00:01:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.254+0000 7f97a5ffb640 1 -- 172.21.15.72:0/2375792625 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a800cb80 con 0x7f97b015c9c0 2023-12-13T00:01:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.254+0000 7f97b75a9640 1 -- 172.21.15.72:0/2375792625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b015bae0 con 0x7f97b015c9c0 2023-12-13T00:01:16.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.255+0000 7f97b75a9640 1 -- 172.21.15.72:0/2375792625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b00c7fb0 con 0x7f97b015c9c0 2023-12-13T00:01:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.496+0000 7f97a5ffb640 1 -- 172.21.15.72:0/2375792625 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f97a800cce0 con 0x7f97b015c9c0 2023-12-13T00:01:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.497+0000 7f97a5ffb640 1 --2- 172.21.15.72:0/2375792625 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f979406b1f0 0x7f979406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.497+0000 7f97b5345640 1 --2- 172.21.15.72:0/2375792625 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f979406b1f0 0x7f979406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.497+0000 7f97b5345640 1 --2- 172.21.15.72:0/2375792625 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f979406b1f0 0x7f979406d6b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f97ac001560 tx=0x7f97ac0019f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.511+0000 7f97a5ffb640 1 -- 172.21.15.72:0/2375792625 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f97a8058cd0 con 0x7f97b015c9c0 2023-12-13T00:01:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.511+0000 7f97a5ffb640 1 -- 172.21.15.72:0/2375792625 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f97a8055010 con 0x7f97b015c9c0 2023-12-13T00:01:16.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.709+0000 7f97b75a9640 1 -- 172.21.15.72:0/2375792625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97b01598e0 con 0x7f97b015c9c0 2023-12-13T00:01:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.715+0000 7f97a5ffb640 1 -- 172.21.15.72:0/2375792625 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f97a80210a0 con 0x7f97b015c9c0 2023-12-13T00:01:16.715 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-12-13T00:01:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.717+0000 7f97b75a9640 1 -- 172.21.15.72:0/2375792625 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f979406b1f0 msgr2=0x7f979406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.717+0000 7f97b75a9640 1 --2- 172.21.15.72:0/2375792625 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f979406b1f0 0x7f979406d6b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f97ac001560 tx=0x7f97ac0019f0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.717+0000 7f97b75a9640 1 -- 172.21.15.72:0/2375792625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b015c9c0 msgr2=0x7f97b01f3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.717+0000 7f97b75a9640 1 --2- 172.21.15.72:0/2375792625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b015c9c0 0x7f97b01f3540 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f97a800e820 tx=0x7f97a800ec20 comp rx=0 tx=0).stop 2023-12-13T00:01:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.717+0000 7f97b75a9640 1 -- 172.21.15.72:0/2375792625 shutdown_connections 2023-12-13T00:01:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.717+0000 7f97b75a9640 1 --2- 172.21.15.72:0/2375792625 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f979406b1f0 0x7f979406d6b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.717+0000 7f97b75a9640 1 --2- 172.21.15.72:0/2375792625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b015c9c0 0x7f97b01f3540 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.717+0000 7f97b75a9640 1 --2- 172.21.15.72:0/2375792625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97b00c59e0 0x7f97b01f00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.717+0000 7f97b75a9640 1 --2- 172.21.15.72:0/2375792625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97b006a4b0 0x7f97b01e2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.717+0000 7f97b75a9640 1 -- 172.21.15.72:0/2375792625 >> 172.21.15.72:0/2375792625 conn(0x7f97b006f6d0 msgr2=0x7f97b00c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:16.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.717+0000 7f97b75a9640 1 -- 172.21.15.72:0/2375792625 shutdown_connections 2023-12-13T00:01:16.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.717+0000 7f97b75a9640 1 -- 172.21.15.72:0/2375792625 wait complete. 2023-12-13T00:01:16.727 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-13T00:01:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.830+0000 7f4238578640 1 Processor -- start 2023-12-13T00:01:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.830+0000 7f4238578640 1 -- start start 2023-12-13T00:01:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.831+0000 7f4238578640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42300cb520 0x7f4230159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.831+0000 7f4238578640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423015d430 con 0x7f42300c8270 2023-12-13T00:01:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.831+0000 7f4238578640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423015d710 con 0x7f42300cb900 2023-12-13T00:01:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.831+0000 7f4238578640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42300c6e40 con 0x7f42300cb520 2023-12-13T00:01:16.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.831+0000 7f4236b15640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f42300c8270 0x7f4230153140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39342/0 (socket says 172.21.15.72:39342) 2023-12-13T00:01:16.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.831+0000 7f4236b15640 1 -- 172.21.15.72:0/2254579492 learned_addr learned my addr 172.21.15.72:0/2254579492 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:16.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.831+0000 7f4236314640 1 --2- 172.21.15.72:0/2254579492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42300cb520 0x7f4230159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:16.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.834+0000 7f4235312640 1 -- 172.21.15.72:0/2254579492 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839302625 0 0) 0x7f423015d430 con 0x7f42300c8270 2023-12-13T00:01:16.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.834+0000 7f4235312640 1 -- 172.21.15.72:0/2254579492 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f421c003520 con 0x7f42300c8270 2023-12-13T00:01:16.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.834+0000 7f4235312640 1 -- 172.21.15.72:0/2254579492 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424349605 0 0) 0x7f423015d710 con 0x7f42300cb900 2023-12-13T00:01:16.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.834+0000 7f4235312640 1 -- 172.21.15.72:0/2254579492 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f423015d430 con 0x7f42300cb900 2023-12-13T00:01:16.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.834+0000 7f4236314640 1 -- 172.21.15.72:0/2254579492 >> v1:172.21.15.176:6789/0 conn(0x7f42300cb900 legacy=0x7f423015cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:16.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.835+0000 7f4236314640 1 -- 172.21.15.72:0/2254579492 >> v1:172.21.15.72:6789/0 conn(0x7f42300c8270 legacy=0x7f4230153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:16.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.835+0000 7f4236314640 1 -- 172.21.15.72:0/2254579492 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423015d9f0 con 0x7f42300cb520 2023-12-13T00:01:16.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.837+0000 7f4236314640 1 --2- 172.21.15.72:0/2254579492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42300cb520 0x7f4230159620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f422c0097d0 tx=0x7f422c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84d51744f0835cbe server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:16.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.840+0000 7f4235312640 1 -- 172.21.15.72:0/2254579492 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c031800 con 0x7f42300cb520 2023-12-13T00:01:16.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.840+0000 7f4235312640 1 -- 172.21.15.72:0/2254579492 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c031960 con 0x7f42300cb520 2023-12-13T00:01:16.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.840+0000 7f4235312640 1 -- 172.21.15.72:0/2254579492 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c031cf0 con 0x7f42300cb520 2023-12-13T00:01:16.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.841+0000 7f4238578640 1 -- 172.21.15.72:0/2254579492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42300cb520 msgr2=0x7f4230159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.841+0000 7f4238578640 1 --2- 172.21.15.72:0/2254579492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42300cb520 0x7f4230159620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f422c0097d0 tx=0x7f422c02b8a0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.841+0000 7f4238578640 1 -- 172.21.15.72:0/2254579492 shutdown_connections 2023-12-13T00:01:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.841+0000 7f4238578640 1 --2- 172.21.15.72:0/2254579492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42300cb520 0x7f4230159620 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.841+0000 7f4238578640 1 -- 172.21.15.72:0/2254579492 >> 172.21.15.72:0/2254579492 conn(0x7f423006d170 msgr2=0x7f423006d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.841+0000 7f4238578640 1 -- 172.21.15.72:0/2254579492 shutdown_connections 2023-12-13T00:01:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.841+0000 7f4238578640 1 -- 172.21.15.72:0/2254579492 wait complete. 2023-12-13T00:01:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.842+0000 7f4238578640 1 Processor -- start 2023-12-13T00:01:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.842+0000 7f4238578640 1 -- start start 2023-12-13T00:01:16.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.843+0000 7f4238578640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42300c8270 0x7f42301eff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:16.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.843+0000 7f4238578640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42300cb520 0x7f423014bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:16.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.843+0000 7f4238578640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42300cb900 0x7f423014c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:16.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.843+0000 7f4238578640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423015a590 con 0x7f42300cb900 2023-12-13T00:01:16.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.843+0000 7f4238578640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42301589b0 con 0x7f42300cb520 2023-12-13T00:01:16.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.843+0000 7f4238578640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423015a080 con 0x7f42300c8270 2023-12-13T00:01:16.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.843+0000 7f4236b15640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42300cb900 0x7f423014c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:16.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.844+0000 7f4235b13640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42300cb520 0x7f423014bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:16.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.844+0000 7f4236314640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42300c8270 0x7f42301eff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:16.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.844+0000 7f4236b15640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42300cb900 0x7f423014c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48292/0 (socket says 172.21.15.72:48292) 2023-12-13T00:01:16.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.844+0000 7f4236b15640 1 -- 172.21.15.72:0/2577320489 learned_addr learned my addr 172.21.15.72:0/2577320489 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:16.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.847+0000 7f4236b15640 1 -- 172.21.15.72:0/2577320489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42300c8270 msgr2=0x7f42301eff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:16.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.847+0000 7f4236b15640 1 --2- 172.21.15.72:0/2577320489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42300c8270 0x7f42301eff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.847+0000 7f4236b15640 1 -- 172.21.15.72:0/2577320489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42300cb520 msgr2=0x7f423014bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:16.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.847+0000 7f4236b15640 1 --2- 172.21.15.72:0/2577320489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42300cb520 0x7f423014bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:16.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.847+0000 7f4236b15640 1 -- 172.21.15.72:0/2577320489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c009400 con 0x7f42300cb900 2023-12-13T00:01:16.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.849+0000 7f4236b15640 1 --2- 172.21.15.72:0/2577320489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42300cb900 0x7f423014c1c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f422800cb40 tx=0x7f422800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.853+0000 7f4226ffd640 1 -- 172.21.15.72:0/2577320489 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422800aca0 con 0x7f42300cb900 2023-12-13T00:01:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.853+0000 7f4226ffd640 1 -- 172.21.15.72:0/2577320489 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422800ae20 con 0x7f42300cb900 2023-12-13T00:01:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.853+0000 7f4226ffd640 1 -- 172.21.15.72:0/2577320489 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228012640 con 0x7f42300cb900 2023-12-13T00:01:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.853+0000 7f4238578640 1 -- 172.21.15.72:0/2577320489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4230159960 con 0x7f42300cb900 2023-12-13T00:01:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.853+0000 7f4238578640 1 -- 172.21.15.72:0/2577320489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4230158ba0 con 0x7f42300cb900 2023-12-13T00:01:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.854+0000 7f4238578640 1 -- 172.21.15.72:0/2577320489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4230067470 con 0x7f42300cb900 2023-12-13T00:01:16.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.872+0000 7f4226ffd640 1 -- 172.21.15.72:0/2577320489 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4228007070 con 0x7f42300cb900 2023-12-13T00:01:16.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.873+0000 7f4226ffd640 1 --2- 172.21.15.72:0/2577320489 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f421406b1c0 0x7f421406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:16.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.873+0000 7f4236314640 1 --2- 172.21.15.72:0/2577320489 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f421406b1c0 0x7f421406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:16.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:16.873+0000 7f4236314640 1 --2- 172.21.15.72:0/2577320489 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f421406b1c0 0x7f421406d680 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f422c036000 tx=0x7f422c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:17.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.106+0000 7f4226ffd640 1 -- 172.21.15.72:0/2577320489 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f42280588b0 con 0x7f42300cb900 2023-12-13T00:01:17.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.106+0000 7f4226ffd640 1 -- 172.21.15.72:0/2577320489 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4228054bf0 con 0x7f42300cb900 2023-12-13T00:01:17.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.275+0000 7f4238578640 1 -- 172.21.15.72:0/2577320489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f423006bb30 con 0x7f42300cb900 2023-12-13T00:01:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.280+0000 7f4226ffd640 1 -- 172.21.15.72:0/2577320489 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4228017030 con 0x7f42300cb900 2023-12-13T00:01:17.280 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-12-13T00:01:17.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.282+0000 7f4238578640 1 -- 172.21.15.72:0/2577320489 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f421406b1c0 msgr2=0x7f421406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:17.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.282+0000 7f4238578640 1 --2- 172.21.15.72:0/2577320489 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f421406b1c0 0x7f421406d680 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f422c036000 tx=0x7f422c03c040 comp rx=0 tx=0).stop 2023-12-13T00:01:17.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.282+0000 7f4238578640 1 -- 172.21.15.72:0/2577320489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42300cb900 msgr2=0x7f423014c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.282+0000 7f4238578640 1 --2- 172.21.15.72:0/2577320489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42300cb900 0x7f423014c1c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f422800cb40 tx=0x7f422800a060 comp rx=0 tx=0).stop 2023-12-13T00:01:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.282+0000 7f4238578640 1 -- 172.21.15.72:0/2577320489 shutdown_connections 2023-12-13T00:01:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.282+0000 7f4238578640 1 --2- 172.21.15.72:0/2577320489 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f421406b1c0 0x7f421406d680 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.282+0000 7f4238578640 1 --2- 172.21.15.72:0/2577320489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42300cb900 0x7f423014c1c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.282+0000 7f4238578640 1 --2- 172.21.15.72:0/2577320489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42300cb520 0x7f423014bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.282+0000 7f4238578640 1 --2- 172.21.15.72:0/2577320489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42300c8270 0x7f42301eff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.282+0000 7f4238578640 1 -- 172.21.15.72:0/2577320489 >> 172.21.15.72:0/2577320489 conn(0x7f423006d170 msgr2=0x7f4230152f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.282+0000 7f4238578640 1 -- 172.21.15.72:0/2577320489 shutdown_connections 2023-12-13T00:01:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.282+0000 7f4238578640 1 -- 172.21.15.72:0/2577320489 wait complete. 2023-12-13T00:01:17.293 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-13T00:01:17.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.396+0000 7fdc5d66b640 1 Processor -- start 2023-12-13T00:01:17.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.396+0000 7fdc5d66b640 1 -- start start 2023-12-13T00:01:17.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.397+0000 7fdc5d66b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc580c9c70 0x7fdc581594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:17.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.397+0000 7fdc5d66b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdc580cd430 0x7fdc580cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:17.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.397+0000 7fdc5d66b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc580cba70 con 0x7fdc580cbf00 2023-12-13T00:01:17.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.397+0000 7fdc5d66b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc58153c60 con 0x7fdc580c9c70 2023-12-13T00:01:17.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.397+0000 7fdc5d66b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc580cb490 con 0x7fdc580cd430 2023-12-13T00:01:17.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.398+0000 7fdc56ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc580c9c70 0x7fdc581594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:17.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.398+0000 7fdc56ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc580c9c70 0x7fdc581594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48294/0 (socket says 172.21.15.72:48294) 2023-12-13T00:01:17.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.398+0000 7fdc56ffd640 1 -- 172.21.15.72:0/578976274 learned_addr learned my addr 172.21.15.72:0/578976274 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:17.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.398+0000 7fdc577fe640 1 --2- 172.21.15.72:0/578976274 >> v2:172.21.15.176:3300/0 conn(0x7fdc580cd430 0x7fdc580cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:17.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.400+0000 7fdc56ffd640 1 -- 172.21.15.72:0/578976274 >> v2:172.21.15.176:3300/0 conn(0x7fdc580cd430 msgr2=0x7fdc580cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:17.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.400+0000 7fdc56ffd640 1 --2- 172.21.15.72:0/578976274 >> v2:172.21.15.176:3300/0 conn(0x7fdc580cd430 0x7fdc580cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.400+0000 7fdc56ffd640 1 -- 172.21.15.72:0/578976274 >> v1:172.21.15.176:6789/0 conn(0x7fdc580cbf00 legacy=0x7fdc580ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:17.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.400+0000 7fdc56ffd640 1 -- 172.21.15.72:0/578976274 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc580ce2f0 con 0x7fdc580c9c70 2023-12-13T00:01:17.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.402+0000 7fdc56ffd640 1 --2- 172.21.15.72:0/578976274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc580c9c70 0x7fdc581594c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc5808ce20 tx=0x7fdc4802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f0583654a0cf31 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:17.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.404+0000 7fdc55ffb640 1 -- 172.21.15.72:0/578976274 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4802cb20 con 0x7fdc580c9c70 2023-12-13T00:01:17.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.405+0000 7fdc55ffb640 1 -- 172.21.15.72:0/578976274 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4802cc80 con 0x7fdc580c9c70 2023-12-13T00:01:17.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.405+0000 7fdc55ffb640 1 -- 172.21.15.72:0/578976274 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc480343f0 con 0x7fdc580c9c70 2023-12-13T00:01:17.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.406+0000 7fdc5d66b640 1 -- 172.21.15.72:0/578976274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc580c9c70 msgr2=0x7fdc581594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:17.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.406+0000 7fdc5d66b640 1 --2- 172.21.15.72:0/578976274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc580c9c70 0x7fdc581594c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc5808ce20 tx=0x7fdc4802bf80 comp rx=0 tx=0).stop 2023-12-13T00:01:17.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.406+0000 7fdc5d66b640 1 -- 172.21.15.72:0/578976274 shutdown_connections 2023-12-13T00:01:17.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.406+0000 7fdc5d66b640 1 --2- 172.21.15.72:0/578976274 >> v2:172.21.15.176:3300/0 conn(0x7fdc580cd430 0x7fdc580cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.406+0000 7fdc5d66b640 1 --2- 172.21.15.72:0/578976274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc580c9c70 0x7fdc581594c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.406+0000 7fdc5d66b640 1 -- 172.21.15.72:0/578976274 >> 172.21.15.72:0/578976274 conn(0x7fdc580b07d0 msgr2=0x7fdc580b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:17.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.406+0000 7fdc5d66b640 1 -- 172.21.15.72:0/578976274 shutdown_connections 2023-12-13T00:01:17.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.406+0000 7fdc5d66b640 1 -- 172.21.15.72:0/578976274 wait complete. 2023-12-13T00:01:17.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.408+0000 7fdc5d66b640 1 Processor -- start 2023-12-13T00:01:17.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.408+0000 7fdc5d66b640 1 -- start start 2023-12-13T00:01:17.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.408+0000 7fdc5d66b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc580c9c70 0x7fdc581508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.408+0000 7fdc5d66b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc580cbf00 0x7fdc581f0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.408+0000 7fdc5d66b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc580cd430 0x7fdc5814ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.408+0000 7fdc5d66b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc58150e10 con 0x7fdc580c9c70 2023-12-13T00:01:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.408+0000 7fdc5d66b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc581ee690 con 0x7fdc580cd430 2023-12-13T00:01:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.408+0000 7fdc5d66b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc581ed7a0 con 0x7fdc580cbf00 2023-12-13T00:01:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.409+0000 7fdc56ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc580c9c70 0x7fdc581508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.409+0000 7fdc577fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc580cd430 0x7fdc5814ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.409+0000 7fdc567fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc580cbf00 0x7fdc581f0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.409+0000 7fdc56ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc580c9c70 0x7fdc581508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48306/0 (socket says 172.21.15.72:48306) 2023-12-13T00:01:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.409+0000 7fdc56ffd640 1 -- 172.21.15.72:0/1781483104 learned_addr learned my addr 172.21.15.72:0/1781483104 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:17.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.412+0000 7fdc577fe640 1 -- 172.21.15.72:0/1781483104 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc580cbf00 msgr2=0x7fdc581f0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:17.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.412+0000 7fdc577fe640 1 --2- 172.21.15.72:0/1781483104 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc580cbf00 0x7fdc581f0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.412+0000 7fdc577fe640 1 -- 172.21.15.72:0/1781483104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc580c9c70 msgr2=0x7fdc581508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:17.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.412+0000 7fdc577fe640 1 --2- 172.21.15.72:0/1781483104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc580c9c70 0x7fdc581508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.412+0000 7fdc577fe640 1 -- 172.21.15.72:0/1781483104 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc48009b30 con 0x7fdc580cd430 2023-12-13T00:01:17.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.414+0000 7fdc577fe640 1 --2- 172.21.15.72:0/1781483104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc580cd430 0x7fdc5814ca60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000e7f0 tx=0x7fdc5000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:17.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.418+0000 7fdc3f7fe640 1 -- 172.21.15.72:0/1781483104 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50009590 con 0x7fdc580cd430 2023-12-13T00:01:17.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.418+0000 7fdc3f7fe640 1 -- 172.21.15.72:0/1781483104 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5000c940 con 0x7fdc580cd430 2023-12-13T00:01:17.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.418+0000 7fdc3f7fe640 1 -- 172.21.15.72:0/1781483104 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5000ccd0 con 0x7fdc580cd430 2023-12-13T00:01:17.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.418+0000 7fdc5d66b640 1 -- 172.21.15.72:0/1781483104 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc581eda80 con 0x7fdc580cd430 2023-12-13T00:01:17.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.418+0000 7fdc5d66b640 1 -- 172.21.15.72:0/1781483104 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc581ee040 con 0x7fdc580cd430 2023-12-13T00:01:17.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.419+0000 7fdc5d66b640 1 -- 172.21.15.72:0/1781483104 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc58073dc0 con 0x7fdc580cd430 2023-12-13T00:01:17.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.661+0000 7fdc3f7fe640 1 -- 172.21.15.72:0/1781483104 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdc50004020 con 0x7fdc580cd430 2023-12-13T00:01:17.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.662+0000 7fdc3f7fe640 1 --2- 172.21.15.72:0/1781483104 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fdc4406b1c0 0x7fdc4406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:17.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.662+0000 7fdc56ffd640 1 --2- 172.21.15.72:0/1781483104 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fdc4406b1c0 0x7fdc4406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:17.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.662+0000 7fdc56ffd640 1 --2- 172.21.15.72:0/1781483104 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fdc4406b1c0 0x7fdc4406d680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdc4802bfc0 tx=0x7fdc48030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:17.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.665+0000 7fdc3f7fe640 1 -- 172.21.15.72:0/1781483104 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fdc5000ce30 con 0x7fdc580cd430 2023-12-13T00:01:17.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.675+0000 7fdc3f7fe640 1 -- 172.21.15.72:0/1781483104 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdc50054920 con 0x7fdc580cd430 2023-12-13T00:01:17.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.848+0000 7fdc5d66b640 1 -- 172.21.15.72:0/1781483104 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdc581ee7d0 con 0x7fdc580cd430 2023-12-13T00:01:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.853+0000 7fdc3f7fe640 1 -- 172.21.15.72:0/1781483104 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdc500210a0 con 0x7fdc580cd430 2023-12-13T00:01:17.853 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-12-13T00:01:17.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.855+0000 7fdc5d66b640 1 -- 172.21.15.72:0/1781483104 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fdc4406b1c0 msgr2=0x7fdc4406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:17.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.855+0000 7fdc5d66b640 1 --2- 172.21.15.72:0/1781483104 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fdc4406b1c0 0x7fdc4406d680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdc4802bfc0 tx=0x7fdc48030000 comp rx=0 tx=0).stop 2023-12-13T00:01:17.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.855+0000 7fdc5d66b640 1 -- 172.21.15.72:0/1781483104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc580cd430 msgr2=0x7fdc5814ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:17.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.855+0000 7fdc5d66b640 1 --2- 172.21.15.72:0/1781483104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc580cd430 0x7fdc5814ca60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000e7f0 tx=0x7fdc5000ecb0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.855+0000 7fdc5d66b640 1 -- 172.21.15.72:0/1781483104 shutdown_connections 2023-12-13T00:01:17.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.855+0000 7fdc5d66b640 1 --2- 172.21.15.72:0/1781483104 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fdc4406b1c0 0x7fdc4406d680 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.855+0000 7fdc5d66b640 1 --2- 172.21.15.72:0/1781483104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc580cd430 0x7fdc5814ca60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.855+0000 7fdc5d66b640 1 --2- 172.21.15.72:0/1781483104 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc580cbf00 0x7fdc581f0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.855+0000 7fdc5d66b640 1 --2- 172.21.15.72:0/1781483104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc580c9c70 0x7fdc581508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.855+0000 7fdc5d66b640 1 -- 172.21.15.72:0/1781483104 >> 172.21.15.72:0/1781483104 conn(0x7fdc580b07d0 msgr2=0x7fdc580c5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:17.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.856+0000 7fdc5d66b640 1 -- 172.21.15.72:0/1781483104 shutdown_connections 2023-12-13T00:01:17.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.856+0000 7fdc5d66b640 1 -- 172.21.15.72:0/1781483104 wait complete. 2023-12-13T00:01:17.866 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T00:01:17.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.966+0000 7f31c65a9640 1 Processor -- start 2023-12-13T00:01:17.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.967+0000 7f31c65a9640 1 -- start start 2023-12-13T00:01:17.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.967+0000 7f31c65a9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31c0153730 0x7f31c006eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:17.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.967+0000 7f31c65a9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f31c015a0c0 0x7f31c00ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:17.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.967+0000 7f31c65a9640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c006f090 con 0x7f31c00c91d0 2023-12-13T00:01:17.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.967+0000 7f31c65a9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c00c38f0 con 0x7f31c0153730 2023-12-13T00:01:17.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.967+0000 7f31c65a9640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c01593d0 con 0x7f31c015a0c0 2023-12-13T00:01:17.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.968+0000 7f31bffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31c0153730 0x7f31c006eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:17.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.968+0000 7f31bffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31c0153730 0x7f31c006eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48314/0 (socket says 172.21.15.72:48314) 2023-12-13T00:01:17.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.968+0000 7f31bffff640 1 -- 172.21.15.72:0/986671739 learned_addr learned my addr 172.21.15.72:0/986671739 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:17.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.968+0000 7f31c4b46640 1 --2- 172.21.15.72:0/986671739 >> v2:172.21.15.176:3300/0 conn(0x7f31c015a0c0 0x7f31c00ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:17.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.970+0000 7f31bffff640 1 -- 172.21.15.72:0/986671739 >> v2:172.21.15.176:3300/0 conn(0x7f31c015a0c0 msgr2=0x7f31c00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:17.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.970+0000 7f31bffff640 1 --2- 172.21.15.72:0/986671739 >> v2:172.21.15.176:3300/0 conn(0x7f31c015a0c0 0x7f31c00ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.970+0000 7f31bffff640 1 -- 172.21.15.72:0/986671739 >> v1:172.21.15.176:6789/0 conn(0x7f31c00c91d0 legacy=0x7f31c00c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:17.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.970+0000 7f31bffff640 1 -- 172.21.15.72:0/986671739 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c0153b10 con 0x7f31c0153730 2023-12-13T00:01:17.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.972+0000 7f31bffff640 1 --2- 172.21.15.72:0/986671739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31c0153730 0x7f31c006eb50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f31c006e350 tx=0x7f31b002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18f85f7250dd7e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:17.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.976+0000 7f31beffd640 1 -- 172.21.15.72:0/986671739 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b002f850 con 0x7f31c0153730 2023-12-13T00:01:17.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.976+0000 7f31beffd640 1 -- 172.21.15.72:0/986671739 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b002f9b0 con 0x7f31c0153730 2023-12-13T00:01:17.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.976+0000 7f31beffd640 1 -- 172.21.15.72:0/986671739 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b002fd40 con 0x7f31c0153730 2023-12-13T00:01:17.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.976+0000 7f31c65a9640 1 -- 172.21.15.72:0/986671739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31c0153730 msgr2=0x7f31c006eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:17.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.976+0000 7f31c65a9640 1 --2- 172.21.15.72:0/986671739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31c0153730 0x7f31c006eb50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f31c006e350 tx=0x7f31b002ba30 comp rx=0 tx=0).stop 2023-12-13T00:01:17.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.976+0000 7f31c65a9640 1 -- 172.21.15.72:0/986671739 shutdown_connections 2023-12-13T00:01:17.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.976+0000 7f31c65a9640 1 --2- 172.21.15.72:0/986671739 >> v2:172.21.15.176:3300/0 conn(0x7f31c015a0c0 0x7f31c00ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.976+0000 7f31c65a9640 1 --2- 172.21.15.72:0/986671739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31c0153730 0x7f31c006eb50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.976+0000 7f31c65a9640 1 -- 172.21.15.72:0/986671739 >> 172.21.15.72:0/986671739 conn(0x7f31c00707f0 msgr2=0x7f31c0070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:17.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.976+0000 7f31c65a9640 1 -- 172.21.15.72:0/986671739 shutdown_connections 2023-12-13T00:01:17.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.976+0000 7f31c65a9640 1 -- 172.21.15.72:0/986671739 wait complete. 2023-12-13T00:01:17.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.977+0000 7f31c65a9640 1 Processor -- start 2023-12-13T00:01:17.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.978+0000 7f31c65a9640 1 -- start start 2023-12-13T00:01:17.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.978+0000 7f31c65a9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31c00c91d0 0x7f31c014b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:17.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.978+0000 7f31c65a9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31c0153730 0x7f31c01e5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:17.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.978+0000 7f31c65a9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31c015a0c0 0x7f31c0146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:17.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.978+0000 7f31c65a9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00c4740 con 0x7f31c015a0c0 2023-12-13T00:01:17.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.978+0000 7f31c65a9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c014abb0 con 0x7f31c0153730 2023-12-13T00:01:17.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.978+0000 7f31c65a9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00c58e0 con 0x7f31c00c91d0 2023-12-13T00:01:17.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.979+0000 7f31c4b46640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31c015a0c0 0x7f31c0146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:17.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.979+0000 7f31c4b46640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31c015a0c0 0x7f31c0146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48326/0 (socket says 172.21.15.72:48326) 2023-12-13T00:01:17.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.979+0000 7f31c4b46640 1 -- 172.21.15.72:0/960743034 learned_addr learned my addr 172.21.15.72:0/960743034 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:17.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.979+0000 7f31bf7fe640 1 --2- 172.21.15.72:0/960743034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31c0153730 0x7f31c01e5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:17.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.979+0000 7f31bffff640 1 --2- 172.21.15.72:0/960743034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31c00c91d0 0x7f31c014b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:17.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.982+0000 7f31c4b46640 1 -- 172.21.15.72:0/960743034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31c00c91d0 msgr2=0x7f31c014b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:17.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.982+0000 7f31c4b46640 1 --2- 172.21.15.72:0/960743034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31c00c91d0 0x7f31c014b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.982+0000 7f31c4b46640 1 -- 172.21.15.72:0/960743034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31c0153730 msgr2=0x7f31c01e5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:17.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.982+0000 7f31c4b46640 1 --2- 172.21.15.72:0/960743034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31c0153730 0x7f31c01e5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:17.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.982+0000 7f31c4b46640 1 -- 172.21.15.72:0/960743034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b00094d0 con 0x7f31c015a0c0 2023-12-13T00:01:17.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.985+0000 7f31c4b46640 1 --2- 172.21.15.72:0/960743034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31c015a0c0 0x7f31c0146820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009d30 tx=0x7f31b800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:17.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.988+0000 7f31bcff9640 1 -- 172.21.15.72:0/960743034 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8009ba0 con 0x7f31c015a0c0 2023-12-13T00:01:17.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.988+0000 7f31bcff9640 1 -- 172.21.15.72:0/960743034 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b800f040 con 0x7f31c015a0c0 2023-12-13T00:01:17.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.988+0000 7f31bcff9640 1 -- 172.21.15.72:0/960743034 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b80146c0 con 0x7f31c015a0c0 2023-12-13T00:01:17.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.988+0000 7f31c65a9640 1 -- 172.21.15.72:0/960743034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c00c3f30 con 0x7f31c015a0c0 2023-12-13T00:01:17.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.988+0000 7f31c65a9640 1 -- 172.21.15.72:0/960743034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c00c4180 con 0x7f31c015a0c0 2023-12-13T00:01:17.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:17.989+0000 7f31c65a9640 1 -- 172.21.15.72:0/960743034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c0073dc0 con 0x7f31c015a0c0 2023-12-13T00:01:18.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.234+0000 7f31bcff9640 1 -- 172.21.15.72:0/960743034 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f31b8014820 con 0x7f31c015a0c0 2023-12-13T00:01:18.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.235+0000 7f31bcff9640 1 --2- 172.21.15.72:0/960743034 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f31ac06b1f0 0x7f31ac06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:18.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.235+0000 7f31bffff640 1 --2- 172.21.15.72:0/960743034 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f31ac06b1f0 0x7f31ac06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:18.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.235+0000 7f31bffff640 1 --2- 172.21.15.72:0/960743034 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f31ac06b1f0 0x7f31ac06d6b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f31b0036000 tx=0x7f31b0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:18.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.247+0000 7f31bcff9640 1 -- 172.21.15.72:0/960743034 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f31b8059640 con 0x7f31c015a0c0 2023-12-13T00:01:18.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.248+0000 7f31bcff9640 1 -- 172.21.15.72:0/960743034 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f31b8055980 con 0x7f31c015a0c0 2023-12-13T00:01:18.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.449+0000 7f31c65a9640 1 -- 172.21.15.72:0/960743034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31c00c8400 con 0x7f31c015a0c0 2023-12-13T00:01:18.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.462+0000 7f31bcff9640 1 -- 172.21.15.72:0/960743034 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+6530 (secure 0 0 0) 0x7f31b8018070 con 0x7f31c015a0c0 2023-12-13T00:01:18.462 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:01:18.462 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/541435124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":541435124},{"type":"v1","addr":"172.21.15.72:6837","nonce":541435124}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4190692049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4190692049},{"type":"v1","addr":"172.21.15.176:6835","nonce":4190692049}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1780646034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1780646034},{"type":"v1","addr":"172.21.15.176:6833","nonce":1780646034}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-13T00:00:30.722325+0000","modified":"2023-12-13T00:01:06.584709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4266,"mds_1":4264,"mds_2":4259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":13,"addr":"172.21.15.72:6839/3632161953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":3632161953},{"type":"v1","addr":"172.21.15.72:6839","nonce":3632161953}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4264":{"gid":4264,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6835/3954648997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3954648997},{"type":"v1","addr":"172.21.15.72:6835","nonce":3954648997}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4266":{"gid":4266,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6837/3968747607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":3968747607},{"type":"v1","addr":"172.21.15.176:6837","nonce":3968747607}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-13T00:01:18.462 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2023-12-13T00:01:18.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.464+0000 7f31c65a9640 1 -- 172.21.15.72:0/960743034 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f31ac06b1f0 msgr2=0x7f31ac06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:18.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.464+0000 7f31c65a9640 1 --2- 172.21.15.72:0/960743034 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f31ac06b1f0 0x7f31ac06d6b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f31b0036000 tx=0x7f31b0008030 comp rx=0 tx=0).stop 2023-12-13T00:01:18.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.464+0000 7f31c65a9640 1 -- 172.21.15.72:0/960743034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31c015a0c0 msgr2=0x7f31c0146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:18.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.464+0000 7f31c65a9640 1 --2- 172.21.15.72:0/960743034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31c015a0c0 0x7f31c0146820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009d30 tx=0x7f31b800c490 comp rx=0 tx=0).stop 2023-12-13T00:01:18.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.464+0000 7f31c65a9640 1 -- 172.21.15.72:0/960743034 shutdown_connections 2023-12-13T00:01:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.464+0000 7f31c65a9640 1 --2- 172.21.15.72:0/960743034 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f31ac06b1f0 0x7f31ac06d6b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.464+0000 7f31c65a9640 1 --2- 172.21.15.72:0/960743034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31c015a0c0 0x7f31c0146820 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.464+0000 7f31c65a9640 1 --2- 172.21.15.72:0/960743034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31c0153730 0x7f31c01e5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.464+0000 7f31c65a9640 1 --2- 172.21.15.72:0/960743034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31c00c91d0 0x7f31c014b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.464+0000 7f31c65a9640 1 -- 172.21.15.72:0/960743034 >> 172.21.15.72:0/960743034 conn(0x7f31c00707f0 msgr2=0x7f31c006cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.464+0000 7f31c65a9640 1 -- 172.21.15.72:0/960743034 shutdown_connections 2023-12-13T00:01:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.464+0000 7f31c65a9640 1 -- 172.21.15.72:0/960743034 wait complete. 2023-12-13T00:01:18.475 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:01:18.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.588+0000 7fe34191d640 1 Processor -- start 2023-12-13T00:01:18.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.588+0000 7fe34191d640 1 -- start start 2023-12-13T00:01:18.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.589+0000 7fe34191d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe33c153620 0x7fe33c0723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:18.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.589+0000 7fe34191d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe33c06f1d0 0x7fe33c159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:18.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.589+0000 7fe34191d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33c06fe60 con 0x7fe33c0c8370 2023-12-13T00:01:18.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.589+0000 7fe34191d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33c0c2e00 con 0x7fe33c153620 2023-12-13T00:01:18.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.589+0000 7fe34191d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33c1597d0 con 0x7fe33c06f1d0 2023-12-13T00:01:18.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.589+0000 7fe33affd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe33c153620 0x7fe33c0723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:18.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.590+0000 7fe33affd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe33c153620 0x7fe33c0723f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48332/0 (socket says 172.21.15.72:48332) 2023-12-13T00:01:18.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.590+0000 7fe33affd640 1 -- 172.21.15.72:0/2393309254 learned_addr learned my addr 172.21.15.72:0/2393309254 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:18.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.590+0000 7fe33a7fc640 1 --2- 172.21.15.72:0/2393309254 >> v2:172.21.15.176:3300/0 conn(0x7fe33c06f1d0 0x7fe33c159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:18.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.592+0000 7fe33affd640 1 -- 172.21.15.72:0/2393309254 >> v2:172.21.15.176:3300/0 conn(0x7fe33c06f1d0 msgr2=0x7fe33c159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:18.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.592+0000 7fe33affd640 1 --2- 172.21.15.72:0/2393309254 >> v2:172.21.15.176:3300/0 conn(0x7fe33c06f1d0 0x7fe33c159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:18.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.592+0000 7fe33affd640 1 -- 172.21.15.72:0/2393309254 >> v1:172.21.15.176:6789/0 conn(0x7fe33c0c8370 legacy=0x7fe33c06a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:18.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.592+0000 7fe33affd640 1 -- 172.21.15.72:0/2393309254 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c0c6a00 con 0x7fe33c153620 2023-12-13T00:01:18.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.594+0000 7fe33affd640 1 --2- 172.21.15.72:0/2393309254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c153620 0x7fe33c0723f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe33c06b570 tx=0x7fe32c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b160b87dc47b3d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:18.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.597+0000 7fe339ffb640 1 -- 172.21.15.72:0/2393309254 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c02ca80 con 0x7fe33c153620 2023-12-13T00:01:18.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.597+0000 7fe339ffb640 1 -- 172.21.15.72:0/2393309254 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32c02cbe0 con 0x7fe33c153620 2023-12-13T00:01:18.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.597+0000 7fe339ffb640 1 -- 172.21.15.72:0/2393309254 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c0343f0 con 0x7fe33c153620 2023-12-13T00:01:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.598+0000 7fe34191d640 1 -- 172.21.15.72:0/2393309254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c153620 msgr2=0x7fe33c0723f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.598+0000 7fe34191d640 1 --2- 172.21.15.72:0/2393309254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c153620 0x7fe33c0723f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe33c06b570 tx=0x7fe32c02bee0 comp rx=0 tx=0).stop 2023-12-13T00:01:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.598+0000 7fe34191d640 1 -- 172.21.15.72:0/2393309254 shutdown_connections 2023-12-13T00:01:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.598+0000 7fe34191d640 1 --2- 172.21.15.72:0/2393309254 >> v2:172.21.15.176:3300/0 conn(0x7fe33c06f1d0 0x7fe33c159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.598+0000 7fe34191d640 1 --2- 172.21.15.72:0/2393309254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c153620 0x7fe33c0723f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.598+0000 7fe34191d640 1 -- 172.21.15.72:0/2393309254 >> 172.21.15.72:0/2393309254 conn(0x7fe33c06b5c0 msgr2=0x7fe33c06b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.598+0000 7fe34191d640 1 -- 172.21.15.72:0/2393309254 shutdown_connections 2023-12-13T00:01:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.598+0000 7fe34191d640 1 -- 172.21.15.72:0/2393309254 wait complete. 2023-12-13T00:01:18.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.599+0000 7fe34191d640 1 Processor -- start 2023-12-13T00:01:18.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.600+0000 7fe34191d640 1 -- start start 2023-12-13T00:01:18.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.600+0000 7fe34191d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c06f1d0 0x7fe33c149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:18.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.600+0000 7fe34191d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c0c8370 0x7fe33c14a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:18.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.600+0000 7fe34191d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c153620 0x7fe33c14ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:18.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.600+0000 7fe34191d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c0cc4b0 con 0x7fe33c153620 2023-12-13T00:01:18.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.600+0000 7fe34191d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c1efc50 con 0x7fe33c0c8370 2023-12-13T00:01:18.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.600+0000 7fe34191d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c0cc6a0 con 0x7fe33c06f1d0 2023-12-13T00:01:18.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.601+0000 7fe33b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c153620 0x7fe33c14ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:18.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.601+0000 7fe33b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c153620 0x7fe33c14ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48338/0 (socket says 172.21.15.72:48338) 2023-12-13T00:01:18.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.601+0000 7fe33a7fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c0c8370 0x7fe33c14a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:18.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.601+0000 7fe33b7fe640 1 -- 172.21.15.72:0/3681235052 learned_addr learned my addr 172.21.15.72:0/3681235052 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:18.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.601+0000 7fe33affd640 1 --2- 172.21.15.72:0/3681235052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c06f1d0 0x7fe33c149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.604+0000 7fe33b7fe640 1 -- 172.21.15.72:0/3681235052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c06f1d0 msgr2=0x7fe33c149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.604+0000 7fe33b7fe640 1 --2- 172.21.15.72:0/3681235052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c06f1d0 0x7fe33c149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.604+0000 7fe33b7fe640 1 -- 172.21.15.72:0/3681235052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c0c8370 msgr2=0x7fe33c14a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.604+0000 7fe33b7fe640 1 --2- 172.21.15.72:0/3681235052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c0c8370 0x7fe33c14a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.604+0000 7fe33b7fe640 1 -- 172.21.15.72:0/3681235052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c009b30 con 0x7fe33c153620 2023-12-13T00:01:18.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.609+0000 7fe33b7fe640 1 --2- 172.21.15.72:0/3681235052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c153620 0x7fe33c14ab30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe334001eb0 tx=0x7fe33400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:18.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.612+0000 7fe323fff640 1 -- 172.21.15.72:0/3681235052 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3340052d0 con 0x7fe33c153620 2023-12-13T00:01:18.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.612+0000 7fe323fff640 1 -- 172.21.15.72:0/3681235052 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe334005430 con 0x7fe33c153620 2023-12-13T00:01:18.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.612+0000 7fe323fff640 1 -- 172.21.15.72:0/3681235052 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334003810 con 0x7fe33c153620 2023-12-13T00:01:18.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.612+0000 7fe34191d640 1 -- 172.21.15.72:0/3681235052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33c1ef320 con 0x7fe33c153620 2023-12-13T00:01:18.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.612+0000 7fe34191d640 1 -- 172.21.15.72:0/3681235052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33c1ef8e0 con 0x7fe33c153620 2023-12-13T00:01:18.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.613+0000 7fe34191d640 1 -- 172.21.15.72:0/3681235052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33c1efaa0 con 0x7fe33c153620 2023-12-13T00:01:18.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.854+0000 7fe323fff640 1 -- 172.21.15.72:0/3681235052 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe334003970 con 0x7fe33c153620 2023-12-13T00:01:18.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.854+0000 7fe323fff640 1 --2- 172.21.15.72:0/3681235052 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe32806b210 0x7fe32806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:18.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.854+0000 7fe33affd640 1 --2- 172.21.15.72:0/3681235052 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe32806b210 0x7fe32806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:18.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.855+0000 7fe33affd640 1 --2- 172.21.15.72:0/3681235052 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe32806b210 0x7fe32806d6d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe32c035000 tx=0x7fe32c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.869+0000 7fe323fff640 1 -- 172.21.15.72:0/3681235052 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fe334013e50 con 0x7fe33c153620 2023-12-13T00:01:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:18.869+0000 7fe323fff640 1 -- 172.21.15.72:0/3681235052 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe3340541c0 con 0x7fe33c153620 2023-12-13T00:01:19.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.050+0000 7fe34191d640 1 -- 172.21.15.72:0/3681235052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe33c073dc0 con 0x7fe33c153620 2023-12-13T00:01:19.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.089+0000 7fe323fff640 1 -- 172.21.15.72:0/3681235052 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18563 (secure 0 0 0) 0x7fe3340577e0 con 0x7fe33c153620 2023-12-13T00:01:19.089 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:01:19.089 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:01:00.435991+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T00:00:27.701252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T00:00:29.324356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T00:00:33.363089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.3","mappings":[{"from":7,"to":5}]},{"pgid":"4.10","mappings":[{"from":7,"to":0}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:01:19.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.091+0000 7fe34191d640 1 -- 172.21.15.72:0/3681235052 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe32806b210 msgr2=0x7fe32806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:19.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.091+0000 7fe34191d640 1 --2- 172.21.15.72:0/3681235052 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe32806b210 0x7fe32806d6d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe32c035000 tx=0x7fe32c030000 comp rx=0 tx=0).stop 2023-12-13T00:01:19.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.091+0000 7fe34191d640 1 -- 172.21.15.72:0/3681235052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c153620 msgr2=0x7fe33c14ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:19.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.091+0000 7fe34191d640 1 --2- 172.21.15.72:0/3681235052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c153620 0x7fe33c14ab30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe334001eb0 tx=0x7fe33400c890 comp rx=0 tx=0).stop 2023-12-13T00:01:19.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.091+0000 7fe34191d640 1 -- 172.21.15.72:0/3681235052 shutdown_connections 2023-12-13T00:01:19.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.091+0000 7fe34191d640 1 --2- 172.21.15.72:0/3681235052 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe32806b210 0x7fe32806d6d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.091+0000 7fe34191d640 1 --2- 172.21.15.72:0/3681235052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c153620 0x7fe33c14ab30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.091+0000 7fe34191d640 1 --2- 172.21.15.72:0/3681235052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c0c8370 0x7fe33c14a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.091+0000 7fe34191d640 1 --2- 172.21.15.72:0/3681235052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c06f1d0 0x7fe33c149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.091+0000 7fe34191d640 1 -- 172.21.15.72:0/3681235052 >> 172.21.15.72:0/3681235052 conn(0x7fe33c06b5c0 msgr2=0x7fe33c0c2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:19.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.091+0000 7fe34191d640 1 -- 172.21.15.72:0/3681235052 shutdown_connections 2023-12-13T00:01:19.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.091+0000 7fe34191d640 1 -- 172.21.15.72:0/3681235052 wait complete. 2023-12-13T00:01:19.102 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-13T00:00:06.839153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-13T00:00:27.701252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-13T00:00:29.324356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-13T00:00:33.363089+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-13T00:01:19.102 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-13T00:01:19.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.207+0000 7ff194d73640 1 Processor -- start 2023-12-13T00:01:19.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.207+0000 7ff194d73640 1 -- start start 2023-12-13T00:01:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.207+0000 7ff194d73640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff1900cc420 0x7ff190159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.207+0000 7ff194d73640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff190159b50 0x7ff1900c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.207+0000 7ff194d73640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1900cbda0 con 0x7ff1900cda70 2023-12-13T00:01:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.207+0000 7ff194d73640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1900cc230 con 0x7ff1900cc420 2023-12-13T00:01:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.207+0000 7ff194d73640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1900cea60 con 0x7ff190159b50 2023-12-13T00:01:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.208+0000 7ff18e59c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff1900cda70 0x7ff1900ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39352/0 (socket says 172.21.15.72:39352) 2023-12-13T00:01:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.208+0000 7ff18e59c640 1 -- 172.21.15.72:0/3364333671 learned_addr learned my addr 172.21.15.72:0/3364333671 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.208+0000 7ff187fff640 1 --2- 172.21.15.72:0/3364333671 >> v2:172.21.15.176:3300/0 conn(0x7ff1900cc420 0x7ff190159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.208+0000 7ff18ed9d640 1 --2- 172.21.15.72:0/3364333671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff190159b50 0x7ff1900c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.210+0000 7ff18dd9b640 1 -- 172.21.15.72:0/3364333671 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712330927 0 0) 0x7ff1900cbda0 con 0x7ff1900cda70 2023-12-13T00:01:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.210+0000 7ff18dd9b640 1 -- 172.21.15.72:0/3364333671 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff17c003520 con 0x7ff1900cda70 2023-12-13T00:01:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.211+0000 7ff187fff640 1 -- 172.21.15.72:0/3364333671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff190159b50 msgr2=0x7ff1900c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.211+0000 7ff187fff640 1 --2- 172.21.15.72:0/3364333671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff190159b50 0x7ff1900c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.211+0000 7ff187fff640 1 -- 172.21.15.72:0/3364333671 >> v1:172.21.15.72:6789/0 conn(0x7ff1900cda70 legacy=0x7ff1900ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.211+0000 7ff187fff640 1 -- 172.21.15.72:0/3364333671 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1900cb4e0 con 0x7ff1900cc420 2023-12-13T00:01:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.213+0000 7ff187fff640 1 --2- 172.21.15.72:0/3364333671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1900cc420 0x7ff190159610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff1780097a0 tx=0x7ff17802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3158f31f48201b86 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.217+0000 7ff18dd9b640 1 -- 172.21.15.72:0/3364333671 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178030610 con 0x7ff1900cc420 2023-12-13T00:01:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.217+0000 7ff18dd9b640 1 -- 172.21.15.72:0/3364333671 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff178030770 con 0x7ff1900cc420 2023-12-13T00:01:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.217+0000 7ff18dd9b640 1 -- 172.21.15.72:0/3364333671 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178030b00 con 0x7ff1900cc420 2023-12-13T00:01:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.217+0000 7ff194d73640 1 -- 172.21.15.72:0/3364333671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1900cc420 msgr2=0x7ff190159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.217+0000 7ff194d73640 1 --2- 172.21.15.72:0/3364333671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1900cc420 0x7ff190159610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff1780097a0 tx=0x7ff17802b960 comp rx=0 tx=0).stop 2023-12-13T00:01:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.217+0000 7ff194d73640 1 -- 172.21.15.72:0/3364333671 shutdown_connections 2023-12-13T00:01:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.217+0000 7ff194d73640 1 --2- 172.21.15.72:0/3364333671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff190159b50 0x7ff1900c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.217+0000 7ff194d73640 1 --2- 172.21.15.72:0/3364333671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1900cc420 0x7ff190159610 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.217+0000 7ff194d73640 1 -- 172.21.15.72:0/3364333671 >> 172.21.15.72:0/3364333671 conn(0x7ff1900b07b0 msgr2=0x7ff1900b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:19.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.217+0000 7ff194d73640 1 -- 172.21.15.72:0/3364333671 shutdown_connections 2023-12-13T00:01:19.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.217+0000 7ff194d73640 1 -- 172.21.15.72:0/3364333671 wait complete. 2023-12-13T00:01:19.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.219+0000 7ff194d73640 1 Processor -- start 2023-12-13T00:01:19.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.219+0000 7ff194d73640 1 -- start start 2023-12-13T00:01:19.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.219+0000 7ff194d73640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1900cc420 0x7ff1901f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:19.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.219+0000 7ff194d73640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1900cda70 0x7ff190152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.219+0000 7ff194d73640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff190159b50 0x7ff190152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.219+0000 7ff194d73640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1901f2f50 con 0x7ff1900cda70 2023-12-13T00:01:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.219+0000 7ff194d73640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1901f02d0 con 0x7ff190159b50 2023-12-13T00:01:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.219+0000 7ff194d73640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff190158720 con 0x7ff1900cc420 2023-12-13T00:01:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.220+0000 7ff187fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1900cda70 0x7ff190152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.220+0000 7ff187fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1900cda70 0x7ff190152760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48340/0 (socket says 172.21.15.72:48340) 2023-12-13T00:01:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.220+0000 7ff187fff640 1 -- 172.21.15.72:0/339982453 learned_addr learned my addr 172.21.15.72:0/339982453 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.220+0000 7ff18ed9d640 1 --2- 172.21.15.72:0/339982453 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff190159b50 0x7ff190152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.220+0000 7ff18e59c640 1 --2- 172.21.15.72:0/339982453 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1900cc420 0x7ff1901f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.223+0000 7ff187fff640 1 -- 172.21.15.72:0/339982453 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1900cc420 msgr2=0x7ff1901f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.223+0000 7ff187fff640 1 --2- 172.21.15.72:0/339982453 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1900cc420 0x7ff1901f2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.223+0000 7ff187fff640 1 -- 172.21.15.72:0/339982453 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff190159b50 msgr2=0x7ff190152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.223+0000 7ff187fff640 1 --2- 172.21.15.72:0/339982453 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff190159b50 0x7ff190152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.223+0000 7ff187fff640 1 -- 172.21.15.72:0/339982453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff178009400 con 0x7ff1900cda70 2023-12-13T00:01:19.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.227+0000 7ff187fff640 1 --2- 172.21.15.72:0/339982453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1900cda70 0x7ff190152760 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff17802bf70 tx=0x7ff178004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.234+0000 7ff186ffd640 1 -- 172.21.15.72:0/339982453 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17803e040 con 0x7ff1900cda70 2023-12-13T00:01:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.234+0000 7ff186ffd640 1 -- 172.21.15.72:0/339982453 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1780399c0 con 0x7ff1900cda70 2023-12-13T00:01:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.234+0000 7ff186ffd640 1 -- 172.21.15.72:0/339982453 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178039d70 con 0x7ff1900cda70 2023-12-13T00:01:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.234+0000 7ff194d73640 1 -- 172.21.15.72:0/339982453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1901effa0 con 0x7ff1900cda70 2023-12-13T00:01:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.234+0000 7ff194d73640 1 -- 172.21.15.72:0/339982453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff190158ca0 con 0x7ff1900cda70 2023-12-13T00:01:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.235+0000 7ff194d73640 1 -- 172.21.15.72:0/339982453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1901f0480 con 0x7ff1900cda70 2023-12-13T00:01:19.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.482+0000 7ff186ffd640 1 -- 172.21.15.72:0/339982453 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff17804d3b0 con 0x7ff1900cda70 2023-12-13T00:01:19.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.482+0000 7ff186ffd640 1 --2- 172.21.15.72:0/339982453 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff17006b240 0x7ff17006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:19.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.482+0000 7ff18e59c640 1 --2- 172.21.15.72:0/339982453 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff17006b240 0x7ff17006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.483+0000 7ff18e59c640 1 --2- 172.21.15.72:0/339982453 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff17006b240 0x7ff17006d700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff180005880 tx=0x7ff180009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:19.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.498+0000 7ff186ffd640 1 -- 172.21.15.72:0/339982453 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7ff17807aac0 con 0x7ff1900cda70 2023-12-13T00:01:19.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.498+0000 7ff186ffd640 1 -- 172.21.15.72:0/339982453 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff178076e00 con 0x7ff1900cda70 2023-12-13T00:01:19.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.665+0000 7ff194d73640 1 -- 172.21.15.72:0/339982453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1901f0480 con 0x7ff1900cda70 2023-12-13T00:01:19.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.669+0000 7ff186ffd640 1 -- 172.21.15.72:0/339982453 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1901f0480 con 0x7ff1900cda70 2023-12-13T00:01:19.669 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-12-13T00:01:19.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.671+0000 7ff194d73640 1 -- 172.21.15.72:0/339982453 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff17006b240 msgr2=0x7ff17006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:19.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.671+0000 7ff194d73640 1 --2- 172.21.15.72:0/339982453 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff17006b240 0x7ff17006d700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff180005880 tx=0x7ff180009040 comp rx=0 tx=0).stop 2023-12-13T00:01:19.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.671+0000 7ff194d73640 1 -- 172.21.15.72:0/339982453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1900cda70 msgr2=0x7ff190152760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:19.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.671+0000 7ff194d73640 1 --2- 172.21.15.72:0/339982453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1900cda70 0x7ff190152760 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff17802bf70 tx=0x7ff178004730 comp rx=0 tx=0).stop 2023-12-13T00:01:19.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.671+0000 7ff194d73640 1 -- 172.21.15.72:0/339982453 shutdown_connections 2023-12-13T00:01:19.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.671+0000 7ff194d73640 1 --2- 172.21.15.72:0/339982453 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff17006b240 0x7ff17006d700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.671+0000 7ff194d73640 1 --2- 172.21.15.72:0/339982453 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff190159b50 0x7ff190152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.671+0000 7ff194d73640 1 --2- 172.21.15.72:0/339982453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1900cda70 0x7ff190152760 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.671+0000 7ff194d73640 1 --2- 172.21.15.72:0/339982453 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1900cc420 0x7ff1901f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.671+0000 7ff194d73640 1 -- 172.21.15.72:0/339982453 >> 172.21.15.72:0/339982453 conn(0x7ff1900b07b0 msgr2=0x7ff1900c6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:19.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.671+0000 7ff194d73640 1 -- 172.21.15.72:0/339982453 shutdown_connections 2023-12-13T00:01:19.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.671+0000 7ff194d73640 1 -- 172.21.15.72:0/339982453 wait complete. 2023-12-13T00:01:19.682 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-13T00:01:19.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.786+0000 7fe79c59e640 1 Processor -- start 2023-12-13T00:01:19.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.786+0000 7fe79c59e640 1 -- start start 2023-12-13T00:01:19.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.787+0000 7fe79c59e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe794151720 0x7fe79406e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:19.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.787+0000 7fe79c59e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe79406ed80 0x7fe794161e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:19.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.787+0000 7fe79c59e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7940c9330 con 0x7fe7940c8de0 2023-12-13T00:01:19.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.787+0000 7fe79c59e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7940cdbc0 con 0x7fe794151720 2023-12-13T00:01:19.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.787+0000 7fe79c59e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7940cd620 con 0x7fe79406ed80 2023-12-13T00:01:19.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.787+0000 7fe79ab3b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe79406ed80 0x7fe794161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:19.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.788+0000 7fe79a33a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe794151720 0x7fe79406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:19.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.788+0000 7fe799b39640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe7940c8de0 0x7fe7940c2570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39368/0 (socket says 172.21.15.72:39368) 2023-12-13T00:01:19.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.788+0000 7fe799b39640 1 -- 172.21.15.72:0/453325983 learned_addr learned my addr 172.21.15.72:0/453325983 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:19.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.790+0000 7fe79ab3b640 1 -- 172.21.15.72:0/453325983 >> v2:172.21.15.72:3300/0 conn(0x7fe794151720 msgr2=0x7fe79406e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:19.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.790+0000 7fe79ab3b640 1 --2- 172.21.15.72:0/453325983 >> v2:172.21.15.72:3300/0 conn(0x7fe794151720 0x7fe79406e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.790+0000 7fe79ab3b640 1 -- 172.21.15.72:0/453325983 >> v1:172.21.15.72:6789/0 conn(0x7fe7940c8de0 legacy=0x7fe7940c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:19.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.790+0000 7fe79ab3b640 1 -- 172.21.15.72:0/453325983 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe794158380 con 0x7fe79406ed80 2023-12-13T00:01:19.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.792+0000 7fe79ab3b640 1 --2- 172.21.15.72:0/453325983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe79406ed80 0x7fe794161e40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009d90 tx=0x7fe78c02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5ed462a01819489 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:19.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.794+0000 7fe799338640 1 -- 172.21.15.72:0/453325983 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c02cce0 con 0x7fe79406ed80 2023-12-13T00:01:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.795+0000 7fe799338640 1 -- 172.21.15.72:0/453325983 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c02ce40 con 0x7fe79406ed80 2023-12-13T00:01:19.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.796+0000 7fe799338640 1 -- 172.21.15.72:0/453325983 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c034660 con 0x7fe79406ed80 2023-12-13T00:01:19.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.796+0000 7fe79c59e640 1 -- 172.21.15.72:0/453325983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe79406ed80 msgr2=0x7fe794161e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:19.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.796+0000 7fe79c59e640 1 --2- 172.21.15.72:0/453325983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe79406ed80 0x7fe794161e40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009d90 tx=0x7fe78c02bf30 comp rx=0 tx=0).stop 2023-12-13T00:01:19.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.796+0000 7fe79c59e640 1 -- 172.21.15.72:0/453325983 shutdown_connections 2023-12-13T00:01:19.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.796+0000 7fe79c59e640 1 --2- 172.21.15.72:0/453325983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe79406ed80 0x7fe794161e40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.796+0000 7fe79c59e640 1 --2- 172.21.15.72:0/453325983 >> v2:172.21.15.72:3300/0 conn(0x7fe794151720 0x7fe79406e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.796+0000 7fe79c59e640 1 -- 172.21.15.72:0/453325983 >> 172.21.15.72:0/453325983 conn(0x7fe794060f20 msgr2=0x7fe794061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:19.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.796+0000 7fe79c59e640 1 -- 172.21.15.72:0/453325983 shutdown_connections 2023-12-13T00:01:19.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.796+0000 7fe79c59e640 1 -- 172.21.15.72:0/453325983 wait complete. 2023-12-13T00:01:19.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.797+0000 7fe79c59e640 1 Processor -- start 2023-12-13T00:01:19.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.797+0000 7fe79c59e640 1 -- start start 2023-12-13T00:01:19.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.798+0000 7fe79c59e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe79406ed80 0x7fe7940af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:19.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.798+0000 7fe79c59e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7940c8de0 0x7fe7940cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:19.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.798+0000 7fe79c59e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe794151720 0x7fe7941ed470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:19.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.798+0000 7fe79c59e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7941f15d0 con 0x7fe79406ed80 2023-12-13T00:01:19.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.798+0000 7fe79c59e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe794158910 con 0x7fe7940c8de0 2023-12-13T00:01:19.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.798+0000 7fe79c59e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7941f0770 con 0x7fe794151720 2023-12-13T00:01:19.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.798+0000 7fe79a33a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe79406ed80 0x7fe7940af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:19.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.798+0000 7fe79ab3b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe794151720 0x7fe7941ed470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:19.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.798+0000 7fe799b39640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7940c8de0 0x7fe7940cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:19.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.798+0000 7fe79a33a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe79406ed80 0x7fe7940af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48350/0 (socket says 172.21.15.72:48350) 2023-12-13T00:01:19.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.798+0000 7fe79a33a640 1 -- 172.21.15.72:0/3554228420 learned_addr learned my addr 172.21.15.72:0/3554228420 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.801+0000 7fe79a33a640 1 -- 172.21.15.72:0/3554228420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe794151720 msgr2=0x7fe7941ed470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.801+0000 7fe79a33a640 1 --2- 172.21.15.72:0/3554228420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe794151720 0x7fe7941ed470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.801+0000 7fe79a33a640 1 -- 172.21.15.72:0/3554228420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7940c8de0 msgr2=0x7fe7940cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.801+0000 7fe79a33a640 1 --2- 172.21.15.72:0/3554228420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7940c8de0 0x7fe7940cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.801+0000 7fe79a33a640 1 -- 172.21.15.72:0/3554228420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c009a70 con 0x7fe79406ed80 2023-12-13T00:01:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.803+0000 7fe79a33a640 1 --2- 172.21.15.72:0/3554228420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe79406ed80 0x7fe7940af730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe79000e9e0 tx=0x7fe79000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.807+0000 7fe78affd640 1 -- 172.21.15.72:0/3554228420 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe790009670 con 0x7fe79406ed80 2023-12-13T00:01:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.807+0000 7fe78affd640 1 -- 172.21.15.72:0/3554228420 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79000c970 con 0x7fe79406ed80 2023-12-13T00:01:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.807+0000 7fe78affd640 1 -- 172.21.15.72:0/3554228420 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79000cd20 con 0x7fe79406ed80 2023-12-13T00:01:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.807+0000 7fe79c59e640 1 -- 172.21.15.72:0/3554228420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7941f09c0 con 0x7fe79406ed80 2023-12-13T00:01:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.807+0000 7fe79c59e640 1 -- 172.21.15.72:0/3554228420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7941f0f80 con 0x7fe79406ed80 2023-12-13T00:01:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.808+0000 7fe79c59e640 1 -- 172.21.15.72:0/3554228420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79406af40 con 0x7fe79406ed80 2023-12-13T00:01:19.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.826+0000 7fe78affd640 1 -- 172.21.15.72:0/3554228420 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe790013470 con 0x7fe79406ed80 2023-12-13T00:01:19.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.826+0000 7fe78affd640 1 --2- 172.21.15.72:0/3554228420 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe77806b210 0x7fe77806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:19.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.827+0000 7fe799b39640 1 --2- 172.21.15.72:0/3554228420 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe77806b210 0x7fe77806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:19.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:19.827+0000 7fe799b39640 1 --2- 172.21.15.72:0/3554228420 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe77806b210 0x7fe77806d6d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe794071110 tx=0x7fe784007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:20.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.061+0000 7fe78affd640 1 -- 172.21.15.72:0/3554228420 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fe79000ce80 con 0x7fe79406ed80 2023-12-13T00:01:20.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.061+0000 7fe78affd640 1 -- 172.21.15.72:0/3554228420 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe7900550e0 con 0x7fe79406ed80 2023-12-13T00:01:20.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.236+0000 7fe79c59e640 1 -- 172.21.15.72:0/3554228420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe794151b00 con 0x7fe79406ed80 2023-12-13T00:01:20.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.240+0000 7fe78affd640 1 -- 172.21.15.72:0/3554228420 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe790017020 con 0x7fe79406ed80 2023-12-13T00:01:20.240 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-12-13T00:01:20.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.242+0000 7fe79c59e640 1 -- 172.21.15.72:0/3554228420 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe77806b210 msgr2=0x7fe77806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:20.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.242+0000 7fe79c59e640 1 --2- 172.21.15.72:0/3554228420 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe77806b210 0x7fe77806d6d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe794071110 tx=0x7fe784007e80 comp rx=0 tx=0).stop 2023-12-13T00:01:20.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.242+0000 7fe79c59e640 1 -- 172.21.15.72:0/3554228420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe79406ed80 msgr2=0x7fe7940af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:20.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.242+0000 7fe79c59e640 1 --2- 172.21.15.72:0/3554228420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe79406ed80 0x7fe7940af730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe79000e9e0 tx=0x7fe79000eea0 comp rx=0 tx=0).stop 2023-12-13T00:01:20.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.242+0000 7fe79c59e640 1 -- 172.21.15.72:0/3554228420 shutdown_connections 2023-12-13T00:01:20.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.242+0000 7fe79c59e640 1 --2- 172.21.15.72:0/3554228420 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe77806b210 0x7fe77806d6d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:20.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.242+0000 7fe79c59e640 1 --2- 172.21.15.72:0/3554228420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe794151720 0x7fe7941ed470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:20.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.242+0000 7fe79c59e640 1 --2- 172.21.15.72:0/3554228420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7940c8de0 0x7fe7940cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:20.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.242+0000 7fe79c59e640 1 --2- 172.21.15.72:0/3554228420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe79406ed80 0x7fe7940af730 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:20.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.242+0000 7fe79c59e640 1 -- 172.21.15.72:0/3554228420 >> 172.21.15.72:0/3554228420 conn(0x7fe794060f20 msgr2=0x7fe79414eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:20.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.242+0000 7fe79c59e640 1 -- 172.21.15.72:0/3554228420 shutdown_connections 2023-12-13T00:01:20.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.242+0000 7fe79c59e640 1 -- 172.21.15.72:0/3554228420 wait complete. 2023-12-13T00:01:20.253 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-13T00:01:20.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.356+0000 7f362c725640 1 Processor -- start 2023-12-13T00:01:20.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.356+0000 7f362c725640 1 -- start start 2023-12-13T00:01:20.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.357+0000 7f362c725640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36240cda70 0x7f36240ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:20.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.357+0000 7f362c725640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f36240cc420 0x7f3624159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:20.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.357+0000 7f362c725640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36240cbda0 con 0x7f3624159b50 2023-12-13T00:01:20.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.357+0000 7f362c725640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36240cc230 con 0x7f36240cc420 2023-12-13T00:01:20.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.357+0000 7f362c725640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36240cb4e0 con 0x7f36240cda70 2023-12-13T00:01:20.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.358+0000 7f3629cc0640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f36240cc420 0x7f3624159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:20.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.358+0000 7f362a4c1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36240cda70 0x7f36240ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:20.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.358+0000 7f3629cc0640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f36240cc420 0x7f3624159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:44236/0 (socket says 172.21.15.72:44236) 2023-12-13T00:01:20.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.358+0000 7f3629cc0640 1 -- 172.21.15.72:0/1916100013 learned_addr learned my addr 172.21.15.72:0/1916100013 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:20.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.361+0000 7f3629cc0640 1 -- 172.21.15.72:0/1916100013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36240cda70 msgr2=0x7f36240ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:20.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.361+0000 7f3629cc0640 1 --2- 172.21.15.72:0/1916100013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36240cda70 0x7f36240ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:20.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.361+0000 7f3629cc0640 1 -- 172.21.15.72:0/1916100013 >> v1:172.21.15.72:6789/0 conn(0x7f3624159b50 legacy=0x7f36240c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:20.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.361+0000 7f3629cc0640 1 -- 172.21.15.72:0/1916100013 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36240cce00 con 0x7f36240cc420 2023-12-13T00:01:20.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.363+0000 7f3629cc0640 1 --2- 172.21.15.72:0/1916100013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36240cc420 0x7f3624159610 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3620009870 tx=0x7f362002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f5a7238b89945d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.366+0000 7f36294bf640 1 -- 172.21.15.72:0/1916100013 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620030840 con 0x7f36240cc420 2023-12-13T00:01:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.366+0000 7f36294bf640 1 -- 172.21.15.72:0/1916100013 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36200309a0 con 0x7f36240cc420 2023-12-13T00:01:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.366+0000 7f36294bf640 1 -- 172.21.15.72:0/1916100013 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620030d30 con 0x7f36240cc420 2023-12-13T00:01:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.367+0000 7f362c725640 1 -- 172.21.15.72:0/1916100013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36240cc420 msgr2=0x7f3624159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.367+0000 7f362c725640 1 --2- 172.21.15.72:0/1916100013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36240cc420 0x7f3624159610 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3620009870 tx=0x7f362002b980 comp rx=0 tx=0).stop 2023-12-13T00:01:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.367+0000 7f362c725640 1 -- 172.21.15.72:0/1916100013 shutdown_connections 2023-12-13T00:01:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.367+0000 7f362c725640 1 --2- 172.21.15.72:0/1916100013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36240cc420 0x7f3624159610 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.367+0000 7f362c725640 1 --2- 172.21.15.72:0/1916100013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36240cda70 0x7f36240ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.367+0000 7f362c725640 1 -- 172.21.15.72:0/1916100013 >> 172.21.15.72:0/1916100013 conn(0x7f36240b07b0 msgr2=0x7f36240b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.367+0000 7f362c725640 1 -- 172.21.15.72:0/1916100013 shutdown_connections 2023-12-13T00:01:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.367+0000 7f362c725640 1 -- 172.21.15.72:0/1916100013 wait complete. 2023-12-13T00:01:20.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.368+0000 7f362c725640 1 Processor -- start 2023-12-13T00:01:20.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.368+0000 7f362c725640 1 -- start start 2023-12-13T00:01:20.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.369+0000 7f362c725640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36240cc420 0x7f3624158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:20.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.369+0000 7f362c725640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36240cda70 0x7f3624156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:20.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.369+0000 7f362c725640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3624159b50 0x7f36241f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:20.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.369+0000 7f362c725640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36241f26e0 con 0x7f36240cda70 2023-12-13T00:01:20.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.369+0000 7f362c725640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36240b2740 con 0x7f36240cc420 2023-12-13T00:01:20.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.369+0000 7f362c725640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36240b1bc0 con 0x7f3624159b50 2023-12-13T00:01:20.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.370+0000 7f362a4c1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36240cc420 0x7f3624158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:20.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.370+0000 7f362acc2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3624159b50 0x7f36241f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:20.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.370+0000 7f362a4c1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36240cc420 0x7f3624158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:44238/0 (socket says 172.21.15.72:44238) 2023-12-13T00:01:20.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.370+0000 7f362a4c1640 1 -- 172.21.15.72:0/2511614650 learned_addr learned my addr 172.21.15.72:0/2511614650 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:20.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.373+0000 7f362a4c1640 1 -- 172.21.15.72:0/2511614650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3624159b50 msgr2=0x7f36241f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:20.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.373+0000 7f362a4c1640 1 --2- 172.21.15.72:0/2511614650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3624159b50 0x7f36241f2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:20.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.373+0000 7f362a4c1640 1 -- 172.21.15.72:0/2511614650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36240cda70 msgr2=0x7f3624156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:20.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.373+0000 7f362a4c1640 1 --2- 172.21.15.72:0/2511614650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36240cda70 0x7f3624156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:20.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.373+0000 7f362a4c1640 1 -- 172.21.15.72:0/2511614650 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36200094d0 con 0x7f36240cc420 2023-12-13T00:01:20.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.376+0000 7f362a4c1640 1 --2- 172.21.15.72:0/2511614650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36240cc420 0x7f3624158830 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f361400e9b0 tx=0x7f361400ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:20.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.394+0000 7f361affd640 1 -- 172.21.15.72:0/2511614650 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361400c9a0 con 0x7f36240cc420 2023-12-13T00:01:20.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.394+0000 7f361affd640 1 -- 172.21.15.72:0/2511614650 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361400cb00 con 0x7f36240cc420 2023-12-13T00:01:20.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.394+0000 7f361affd640 1 -- 172.21.15.72:0/2511614650 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614013470 con 0x7f36240cc420 2023-12-13T00:01:20.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.394+0000 7f362c725640 1 -- 172.21.15.72:0/2511614650 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36240b1ea0 con 0x7f36240cc420 2023-12-13T00:01:20.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.394+0000 7f362c725640 1 -- 172.21.15.72:0/2511614650 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36240b2460 con 0x7f36240cc420 2023-12-13T00:01:20.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.395+0000 7f362c725640 1 -- 172.21.15.72:0/2511614650 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36240cad00 con 0x7f36240cc420 2023-12-13T00:01:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.690+0000 7f361affd640 1 -- 172.21.15.72:0/2511614650 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f36140135d0 con 0x7f36240cc420 2023-12-13T00:01:20.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.691+0000 7f361affd640 1 --2- 172.21.15.72:0/2511614650 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f360806b240 0x7f360806d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:20.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.691+0000 7f3629cc0640 1 --2- 172.21.15.72:0/2511614650 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f360806b240 0x7f360806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:20.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.692+0000 7f3629cc0640 1 --2- 172.21.15.72:0/2511614650 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f360806b240 0x7f360806d700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3620036000 tx=0x7f362003b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:20.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.695+0000 7f361affd640 1 -- 172.21.15.72:0/2511614650 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f3614058e10 con 0x7f36240cc420 2023-12-13T00:01:20.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.705+0000 7f361affd640 1 -- 172.21.15.72:0/2511614650 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3614055150 con 0x7f36240cc420 2023-12-13T00:01:20.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.875+0000 7f362c725640 1 -- 172.21.15.72:0/2511614650 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3624067470 con 0x7f36240cc420 2023-12-13T00:01:20.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.883+0000 7f361affd640 1 -- 172.21.15.72:0/2511614650 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3614021020 con 0x7f36240cc420 2023-12-13T00:01:20.882 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-12-13T00:01:20.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.885+0000 7f362c725640 1 -- 172.21.15.72:0/2511614650 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f360806b240 msgr2=0x7f360806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:20.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.885+0000 7f362c725640 1 --2- 172.21.15.72:0/2511614650 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f360806b240 0x7f360806d700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3620036000 tx=0x7f362003b040 comp rx=0 tx=0).stop 2023-12-13T00:01:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.885+0000 7f362c725640 1 -- 172.21.15.72:0/2511614650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36240cc420 msgr2=0x7f3624158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.885+0000 7f362c725640 1 --2- 172.21.15.72:0/2511614650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36240cc420 0x7f3624158830 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f361400e9b0 tx=0x7f361400ee70 comp rx=0 tx=0).stop 2023-12-13T00:01:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.885+0000 7f362c725640 1 -- 172.21.15.72:0/2511614650 shutdown_connections 2023-12-13T00:01:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.885+0000 7f362c725640 1 --2- 172.21.15.72:0/2511614650 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f360806b240 0x7f360806d700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.885+0000 7f362c725640 1 --2- 172.21.15.72:0/2511614650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3624159b50 0x7f36241f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.885+0000 7f362c725640 1 --2- 172.21.15.72:0/2511614650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36240cda70 0x7f3624156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.885+0000 7f362c725640 1 --2- 172.21.15.72:0/2511614650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36240cc420 0x7f3624158830 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.885+0000 7f362c725640 1 -- 172.21.15.72:0/2511614650 >> 172.21.15.72:0/2511614650 conn(0x7f36240b07b0 msgr2=0x7f36240c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.885+0000 7f362c725640 1 -- 172.21.15.72:0/2511614650 shutdown_connections 2023-12-13T00:01:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.885+0000 7f362c725640 1 -- 172.21.15.72:0/2511614650 wait complete. 2023-12-13T00:01:20.895 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-13T00:01:20.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.998+0000 7f92a1d9e640 1 Processor -- start 2023-12-13T00:01:20.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.999+0000 7f92a1d9e640 1 -- start start 2023-12-13T00:01:20.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.999+0000 7f92a1d9e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f929c153750 0x7f929c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.999+0000 7f92a1d9e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f929c0c62c0 0x7f929c0c6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.999+0000 7f92a1d9e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929c0c6c90 con 0x7f929c0cbec0 2023-12-13T00:01:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.999+0000 7f92a1d9e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929c15d700 con 0x7f929c0c62c0 2023-12-13T00:01:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:20.999+0000 7f92a1d9e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c15a3e0 con 0x7f929c153750 2023-12-13T00:01:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.000+0000 7f929bfff640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f929c0cbec0 0x7f929c0c8320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:37000/0 (socket says 172.21.15.72:37000) 2023-12-13T00:01:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.000+0000 7f929bfff640 1 -- 172.21.15.72:0/1972107558 learned_addr learned my addr 172.21.15.72:0/1972107558 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.000+0000 7f92a159d640 1 --2- 172.21.15.72:0/1972107558 >> v2:172.21.15.72:3300/0 conn(0x7f929c0c62c0 0x7f929c0c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.000+0000 7f92a0d9c640 1 --2- 172.21.15.72:0/1972107558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f929c153750 0x7f929c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:21.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.002+0000 7f92a159d640 1 -- 172.21.15.72:0/1972107558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f929c153750 msgr2=0x7f929c159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:21.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.002+0000 7f92a159d640 1 --2- 172.21.15.72:0/1972107558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f929c153750 0x7f929c159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:21.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.002+0000 7f92a159d640 1 -- 172.21.15.72:0/1972107558 >> v1:172.21.15.176:6789/0 conn(0x7f929c0cbec0 legacy=0x7f929c0c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:21.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.002+0000 7f92a159d640 1 -- 172.21.15.72:0/1972107558 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c0cc400 con 0x7f929c0c62c0 2023-12-13T00:01:21.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.004+0000 7f92a159d640 1 --2- 172.21.15.72:0/1972107558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f929c0c62c0 0x7f929c0c6750 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f928c0097a0 tx=0x7f928c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b05cd4b07f5f06 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:21.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.007+0000 7f929b7fe640 1 -- 172.21.15.72:0/1972107558 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c030610 con 0x7f929c0c62c0 2023-12-13T00:01:21.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.007+0000 7f929b7fe640 1 -- 172.21.15.72:0/1972107558 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928c030770 con 0x7f929c0c62c0 2023-12-13T00:01:21.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.007+0000 7f929b7fe640 1 -- 172.21.15.72:0/1972107558 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c030b00 con 0x7f929c0c62c0 2023-12-13T00:01:21.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.008+0000 7f92a1d9e640 1 -- 172.21.15.72:0/1972107558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f929c0c62c0 msgr2=0x7f929c0c6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:21.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.008+0000 7f92a1d9e640 1 --2- 172.21.15.72:0/1972107558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f929c0c62c0 0x7f929c0c6750 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f928c0097a0 tx=0x7f928c02b960 comp rx=0 tx=0).stop 2023-12-13T00:01:21.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.008+0000 7f92a1d9e640 1 -- 172.21.15.72:0/1972107558 shutdown_connections 2023-12-13T00:01:21.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.008+0000 7f92a1d9e640 1 --2- 172.21.15.72:0/1972107558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f929c0c62c0 0x7f929c0c6750 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:21.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.008+0000 7f92a1d9e640 1 --2- 172.21.15.72:0/1972107558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f929c153750 0x7f929c159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:21.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.008+0000 7f92a1d9e640 1 -- 172.21.15.72:0/1972107558 >> 172.21.15.72:0/1972107558 conn(0x7f929c06f570 msgr2=0x7f929c06f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:21.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.008+0000 7f92a1d9e640 1 -- 172.21.15.72:0/1972107558 shutdown_connections 2023-12-13T00:01:21.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.008+0000 7f92a1d9e640 1 -- 172.21.15.72:0/1972107558 wait complete. 2023-12-13T00:01:21.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.009+0000 7f92a1d9e640 1 Processor -- start 2023-12-13T00:01:21.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.010+0000 7f92a1d9e640 1 -- start start 2023-12-13T00:01:21.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.010+0000 7f92a1d9e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f929c0c62c0 0x7f929c0caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:21.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.010+0000 7f92a1d9e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f929c0cbec0 0x7f929c149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:21.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.010+0000 7f92a1d9e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f929c153750 0x7f929c14a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:21.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.010+0000 7f92a1d9e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c155370 con 0x7f929c0c62c0 2023-12-13T00:01:21.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.010+0000 7f92a1d9e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c1f2f40 con 0x7f929c0cbec0 2023-12-13T00:01:21.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.010+0000 7f92a1d9e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0c53e0 con 0x7f929c153750 2023-12-13T00:01:21.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.011+0000 7f92a0d9c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f929c0c62c0 0x7f929c0caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:21.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.011+0000 7f92a159d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f929c153750 0x7f929c14a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:21.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.011+0000 7f929bfff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f929c0cbec0 0x7f929c149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:21.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.011+0000 7f92a0d9c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f929c0c62c0 0x7f929c0caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48372/0 (socket says 172.21.15.72:48372) 2023-12-13T00:01:21.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.011+0000 7f92a0d9c640 1 -- 172.21.15.72:0/2646168532 learned_addr learned my addr 172.21.15.72:0/2646168532 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:21.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.014+0000 7f92a0d9c640 1 -- 172.21.15.72:0/2646168532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f929c153750 msgr2=0x7f929c14a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:21.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.014+0000 7f92a0d9c640 1 --2- 172.21.15.72:0/2646168532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f929c153750 0x7f929c14a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:21.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.014+0000 7f92a0d9c640 1 -- 172.21.15.72:0/2646168532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f929c0cbec0 msgr2=0x7f929c149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:21.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.014+0000 7f92a0d9c640 1 --2- 172.21.15.72:0/2646168532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f929c0cbec0 0x7f929c149b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:21.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.014+0000 7f92a0d9c640 1 -- 172.21.15.72:0/2646168532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c009400 con 0x7f929c0c62c0 2023-12-13T00:01:21.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.016+0000 7f92a0d9c640 1 --2- 172.21.15.72:0/2646168532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f929c0c62c0 0x7f929c0caab0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f929400efc0 tx=0x7f929400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:21.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.020+0000 7f92997fa640 1 -- 172.21.15.72:0/2646168532 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294009b80 con 0x7f929c0c62c0 2023-12-13T00:01:21.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.020+0000 7f92997fa640 1 -- 172.21.15.72:0/2646168532 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929400f040 con 0x7f929c0c62c0 2023-12-13T00:01:21.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.020+0000 7f92997fa640 1 -- 172.21.15.72:0/2646168532 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92940146a0 con 0x7f929c0c62c0 2023-12-13T00:01:21.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.020+0000 7f92a1d9e640 1 -- 172.21.15.72:0/2646168532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929c1f2330 con 0x7f929c0c62c0 2023-12-13T00:01:21.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.020+0000 7f92a1d9e640 1 -- 172.21.15.72:0/2646168532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929c1f28f0 con 0x7f929c0c62c0 2023-12-13T00:01:21.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.021+0000 7f92a1d9e640 1 -- 172.21.15.72:0/2646168532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929c04e920 con 0x7f929c0c62c0 2023-12-13T00:01:21.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.260+0000 7f92997fa640 1 -- 172.21.15.72:0/2646168532 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9294014800 con 0x7f929c0c62c0 2023-12-13T00:01:21.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.261+0000 7f92997fa640 1 --2- 172.21.15.72:0/2646168532 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f927c06b240 0x7f927c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:21.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.261+0000 7f929bfff640 1 --2- 172.21.15.72:0/2646168532 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f927c06b240 0x7f927c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:21.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.261+0000 7f929bfff640 1 --2- 172.21.15.72:0/2646168532 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f927c06b240 0x7f927c06d700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f929c15c8d0 tx=0x7f9284009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:21.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.275+0000 7f92997fa640 1 -- 172.21.15.72:0/2646168532 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f9294059750 con 0x7f929c0c62c0 2023-12-13T00:01:21.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.275+0000 7f92997fa640 1 -- 172.21.15.72:0/2646168532 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9294055a90 con 0x7f929c0c62c0 2023-12-13T00:01:21.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.479+0000 7f92a1d9e640 1 -- 172.21.15.72:0/2646168532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f929c071a50 con 0x7f929c0c62c0 2023-12-13T00:01:21.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.484+0000 7f92997fa640 1 -- 172.21.15.72:0/2646168532 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f92940590b0 con 0x7f929c0c62c0 2023-12-13T00:01:21.484 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-12-13T00:01:21.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.486+0000 7f92a1d9e640 1 -- 172.21.15.72:0/2646168532 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f927c06b240 msgr2=0x7f927c06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:21.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.486+0000 7f92a1d9e640 1 --2- 172.21.15.72:0/2646168532 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f927c06b240 0x7f927c06d700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f929c15c8d0 tx=0x7f9284009040 comp rx=0 tx=0).stop 2023-12-13T00:01:21.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.486+0000 7f92a1d9e640 1 -- 172.21.15.72:0/2646168532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f929c0c62c0 msgr2=0x7f929c0caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:21.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.486+0000 7f92a1d9e640 1 --2- 172.21.15.72:0/2646168532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f929c0c62c0 0x7f929c0caab0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f929400efc0 tx=0x7f929400c490 comp rx=0 tx=0).stop 2023-12-13T00:01:21.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.487+0000 7f92a1d9e640 1 -- 172.21.15.72:0/2646168532 shutdown_connections 2023-12-13T00:01:21.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.487+0000 7f92a1d9e640 1 --2- 172.21.15.72:0/2646168532 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f927c06b240 0x7f927c06d700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:21.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.487+0000 7f92a1d9e640 1 --2- 172.21.15.72:0/2646168532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f929c153750 0x7f929c14a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:21.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.487+0000 7f92a1d9e640 1 --2- 172.21.15.72:0/2646168532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f929c0cbec0 0x7f929c149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:21.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.487+0000 7f92a1d9e640 1 --2- 172.21.15.72:0/2646168532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f929c0c62c0 0x7f929c0caab0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:21.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.487+0000 7f92a1d9e640 1 -- 172.21.15.72:0/2646168532 >> 172.21.15.72:0/2646168532 conn(0x7f929c06f570 msgr2=0x7f929c06aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:21.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.487+0000 7f92a1d9e640 1 -- 172.21.15.72:0/2646168532 shutdown_connections 2023-12-13T00:01:21.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.487+0000 7f92a1d9e640 1 -- 172.21.15.72:0/2646168532 wait complete. 2023-12-13T00:01:21.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T00:01:21.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.597+0000 7f4e95b48640 1 Processor -- start 2023-12-13T00:01:21.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.597+0000 7f4e95b48640 1 -- start start 2023-12-13T00:01:21.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.598+0000 7f4e95b48640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e900c4aa0 0x7f4e9014fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:21.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.598+0000 7f4e95b48640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e900c76f0 con 0x7f4e900c46c0 2023-12-13T00:01:21.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.598+0000 7f4e95b48640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e900c2bc0 con 0x7f4e90150290 2023-12-13T00:01:21.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.598+0000 7f4e95b48640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900c6dc0 con 0x7f4e900c4aa0 2023-12-13T00:01:21.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.598+0000 7f4e8f7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4e900c46c0 0x7f4e900c53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39388/0 (socket says 172.21.15.72:39388) 2023-12-13T00:01:21.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.598+0000 7f4e8f7fe640 1 -- 172.21.15.72:0/55411524 learned_addr learned my addr 172.21.15.72:0/55411524 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:21.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.599+0000 7f4e8effd640 1 --2- 172.21.15.72:0/55411524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e900c4aa0 0x7f4e9014fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:21.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.601+0000 7f4e8e7fc640 1 -- 172.21.15.72:0/55411524 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271827455 0 0) 0x7f4e900c76f0 con 0x7f4e900c46c0 2023-12-13T00:01:21.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.601+0000 7f4e8e7fc640 1 -- 172.21.15.72:0/55411524 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e78003520 con 0x7f4e900c46c0 2023-12-13T00:01:21.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.601+0000 7f4e8e7fc640 1 -- 172.21.15.72:0/55411524 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143440367 0 0) 0x7f4e900c2bc0 con 0x7f4e90150290 2023-12-13T00:01:21.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.601+0000 7f4e8e7fc640 1 -- 172.21.15.72:0/55411524 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e900c76f0 con 0x7f4e90150290 2023-12-13T00:01:21.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.602+0000 7f4e8effd640 1 -- 172.21.15.72:0/55411524 >> v1:172.21.15.176:6789/0 conn(0x7f4e90150290 legacy=0x7f4e900c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:21.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.602+0000 7f4e8effd640 1 -- 172.21.15.72:0/55411524 >> v1:172.21.15.72:6789/0 conn(0x7f4e900c46c0 legacy=0x7f4e900c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:21.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.602+0000 7f4e8effd640 1 -- 172.21.15.72:0/55411524 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e900c70a0 con 0x7f4e900c4aa0 2023-12-13T00:01:21.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.604+0000 7f4e8effd640 1 --2- 172.21.15.72:0/55411524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e900c4aa0 0x7f4e9014fd50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e840097d0 tx=0x7f4e8402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2562240d86d1fe0c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:21.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.606+0000 7f4e8e7fc640 1 -- 172.21.15.72:0/55411524 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84031890 con 0x7f4e900c4aa0 2023-12-13T00:01:21.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.608+0000 7f4e8e7fc640 1 -- 172.21.15.72:0/55411524 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e840319f0 con 0x7f4e900c4aa0 2023-12-13T00:01:21.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.608+0000 7f4e8e7fc640 1 -- 172.21.15.72:0/55411524 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84031d60 con 0x7f4e900c4aa0 2023-12-13T00:01:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.608+0000 7f4e95b48640 1 -- 172.21.15.72:0/55411524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e900c4aa0 msgr2=0x7f4e9014fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.608+0000 7f4e95b48640 1 --2- 172.21.15.72:0/55411524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e900c4aa0 0x7f4e9014fd50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e840097d0 tx=0x7f4e8402b930 comp rx=0 tx=0).stop 2023-12-13T00:01:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.608+0000 7f4e95b48640 1 -- 172.21.15.72:0/55411524 shutdown_connections 2023-12-13T00:01:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.608+0000 7f4e95b48640 1 --2- 172.21.15.72:0/55411524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e900c4aa0 0x7f4e9014fd50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.608+0000 7f4e95b48640 1 -- 172.21.15.72:0/55411524 >> 172.21.15.72:0/55411524 conn(0x7f4e9006c5f0 msgr2=0x7f4e9006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.608+0000 7f4e95b48640 1 -- 172.21.15.72:0/55411524 shutdown_connections 2023-12-13T00:01:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.608+0000 7f4e95b48640 1 -- 172.21.15.72:0/55411524 wait complete. 2023-12-13T00:01:21.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.609+0000 7f4e95b48640 1 Processor -- start 2023-12-13T00:01:21.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.610+0000 7f4e95b48640 1 -- start start 2023-12-13T00:01:21.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.610+0000 7f4e95b48640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e900c46c0 0x7f4e90147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:21.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.610+0000 7f4e95b48640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e900c4aa0 0x7f4e90146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:21.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.610+0000 7f4e95b48640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e90150290 0x7f4e90151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:21.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.610+0000 7f4e95b48640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e90148840 con 0x7f4e900c46c0 2023-12-13T00:01:21.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.610+0000 7f4e95b48640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e90148460 con 0x7f4e90150290 2023-12-13T00:01:21.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.610+0000 7f4e95b48640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e901519f0 con 0x7f4e900c4aa0 2023-12-13T00:01:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.611+0000 7f4e8f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e900c46c0 0x7f4e90147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.611+0000 7f4e8ffff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e90150290 0x7f4e90151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.611+0000 7f4e8effd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e900c4aa0 0x7f4e90146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.611+0000 7f4e8f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e900c46c0 0x7f4e90147f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48380/0 (socket says 172.21.15.72:48380) 2023-12-13T00:01:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.611+0000 7f4e8f7fe640 1 -- 172.21.15.72:0/4076872997 learned_addr learned my addr 172.21.15.72:0/4076872997 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:21.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.614+0000 7f4e8f7fe640 1 -- 172.21.15.72:0/4076872997 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e900c4aa0 msgr2=0x7f4e90146d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:21.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.614+0000 7f4e8f7fe640 1 --2- 172.21.15.72:0/4076872997 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e900c4aa0 0x7f4e90146d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:21.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.614+0000 7f4e8f7fe640 1 -- 172.21.15.72:0/4076872997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e90150290 msgr2=0x7f4e90151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:21.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.614+0000 7f4e8f7fe640 1 --2- 172.21.15.72:0/4076872997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e90150290 0x7f4e90151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:21.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.614+0000 7f4e8f7fe640 1 -- 172.21.15.72:0/4076872997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e84009400 con 0x7f4e900c46c0 2023-12-13T00:01:21.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.617+0000 7f4e8f7fe640 1 --2- 172.21.15.72:0/4076872997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e900c46c0 0x7f4e90147f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000c410 tx=0x7f4e8000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:21.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.620+0000 7f4e77fff640 1 -- 172.21.15.72:0/4076872997 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e80005ce0 con 0x7f4e900c46c0 2023-12-13T00:01:21.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.620+0000 7f4e77fff640 1 -- 172.21.15.72:0/4076872997 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e80005e40 con 0x7f4e900c46c0 2023-12-13T00:01:21.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.620+0000 7f4e95b48640 1 -- 172.21.15.72:0/4076872997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e900ca8c0 con 0x7f4e900c46c0 2023-12-13T00:01:21.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.620+0000 7f4e77fff640 1 -- 172.21.15.72:0/4076872997 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e80007310 con 0x7f4e900c46c0 2023-12-13T00:01:21.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.620+0000 7f4e95b48640 1 -- 172.21.15.72:0/4076872997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e900cae40 con 0x7f4e900c46c0 2023-12-13T00:01:21.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.621+0000 7f4e95b48640 1 -- 172.21.15.72:0/4076872997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e900c6760 con 0x7f4e900c46c0 2023-12-13T00:01:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.860+0000 7f4e77fff640 1 -- 172.21.15.72:0/4076872997 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4e80007530 con 0x7f4e900c46c0 2023-12-13T00:01:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.861+0000 7f4e77fff640 1 --2- 172.21.15.72:0/4076872997 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f4e7c06b210 0x7f4e7c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.861+0000 7f4e8effd640 1 --2- 172.21.15.72:0/4076872997 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f4e7c06b210 0x7f4e7c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:21.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.861+0000 7f4e8effd640 1 --2- 172.21.15.72:0/4076872997 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f4e7c06b210 0x7f4e7c06d6d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4e84036000 tx=0x7f4e84008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:21.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.874+0000 7f4e77fff640 1 -- 172.21.15.72:0/4076872997 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f4e80057fa0 con 0x7f4e900c46c0 2023-12-13T00:01:21.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:21.874+0000 7f4e77fff640 1 -- 172.21.15.72:0/4076872997 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4e800542e0 con 0x7f4e900c46c0 2023-12-13T00:01:22.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.075+0000 7f4e95b48640 1 -- 172.21.15.72:0/4076872997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e90067470 con 0x7f4e900c46c0 2023-12-13T00:01:22.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.090+0000 7f4e77fff640 1 -- 172.21.15.72:0/4076872997 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+6530 (secure 0 0 0) 0x7f4e80057900 con 0x7f4e900c46c0 2023-12-13T00:01:22.090 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:01:22.090 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/541435124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":541435124},{"type":"v1","addr":"172.21.15.72:6837","nonce":541435124}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4190692049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4190692049},{"type":"v1","addr":"172.21.15.176:6835","nonce":4190692049}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1780646034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1780646034},{"type":"v1","addr":"172.21.15.176:6833","nonce":1780646034}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-13T00:00:30.722325+0000","modified":"2023-12-13T00:01:06.584709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4266,"mds_1":4264,"mds_2":4259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":13,"addr":"172.21.15.72:6839/3632161953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":3632161953},{"type":"v1","addr":"172.21.15.72:6839","nonce":3632161953}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4264":{"gid":4264,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6835/3954648997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3954648997},{"type":"v1","addr":"172.21.15.72:6835","nonce":3954648997}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4266":{"gid":4266,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6837/3968747607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":3968747607},{"type":"v1","addr":"172.21.15.176:6837","nonce":3968747607}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-13T00:01:22.090 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2023-12-13T00:01:22.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.092+0000 7f4e95b48640 1 -- 172.21.15.72:0/4076872997 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f4e7c06b210 msgr2=0x7f4e7c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.092+0000 7f4e95b48640 1 --2- 172.21.15.72:0/4076872997 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f4e7c06b210 0x7f4e7c06d6d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4e84036000 tx=0x7f4e84008030 comp rx=0 tx=0).stop 2023-12-13T00:01:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.092+0000 7f4e95b48640 1 -- 172.21.15.72:0/4076872997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e900c46c0 msgr2=0x7f4e90147f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.092+0000 7f4e95b48640 1 --2- 172.21.15.72:0/4076872997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e900c46c0 0x7f4e90147f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000c410 tx=0x7f4e8000c8d0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.092+0000 7f4e95b48640 1 -- 172.21.15.72:0/4076872997 shutdown_connections 2023-12-13T00:01:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.092+0000 7f4e95b48640 1 --2- 172.21.15.72:0/4076872997 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f4e7c06b210 0x7f4e7c06d6d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.092+0000 7f4e95b48640 1 --2- 172.21.15.72:0/4076872997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e90150290 0x7f4e90151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.092+0000 7f4e95b48640 1 --2- 172.21.15.72:0/4076872997 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e900c4aa0 0x7f4e90146d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.092+0000 7f4e95b48640 1 --2- 172.21.15.72:0/4076872997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e900c46c0 0x7f4e90147f20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.092+0000 7f4e95b48640 1 -- 172.21.15.72:0/4076872997 >> 172.21.15.72:0/4076872997 conn(0x7f4e9006c5f0 msgr2=0x7f4e90073530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.092+0000 7f4e95b48640 1 -- 172.21.15.72:0/4076872997 shutdown_connections 2023-12-13T00:01:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.092+0000 7f4e95b48640 1 -- 172.21.15.72:0/4076872997 wait complete. 2023-12-13T00:01:22.102 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:01:22.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.202+0000 7f490be9b640 1 Processor -- start 2023-12-13T00:01:22.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.202+0000 7f490be9b640 1 -- start start 2023-12-13T00:01:22.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.203+0000 7f490be9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49040c44d0 0x7f49040c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:22.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.203+0000 7f490be9b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f49041596e0 0x7f4904159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:22.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.203+0000 7f490be9b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4904150910 con 0x7f4904150530 2023-12-13T00:01:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.203+0000 7f490be9b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49040c1ec0 con 0x7f49041596e0 2023-12-13T00:01:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.203+0000 7f490be9b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490415a4e0 con 0x7f49040c44d0 2023-12-13T00:01:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.204+0000 7f4909c37640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4904150530 0x7f49040c6c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39400/0 (socket says 172.21.15.72:39400) 2023-12-13T00:01:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.204+0000 7f4909c37640 1 -- 172.21.15.72:0/428268517 learned_addr learned my addr 172.21.15.72:0/428268517 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.204+0000 7f490a438640 1 --2- 172.21.15.72:0/428268517 >> v2:172.21.15.176:3300/0 conn(0x7f49041596e0 0x7f4904159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.204+0000 7f4909436640 1 --2- 172.21.15.72:0/428268517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49040c44d0 0x7f49040c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:22.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.206+0000 7f4908c35640 1 -- 172.21.15.72:0/428268517 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414569439 0 0) 0x7f4904150910 con 0x7f4904150530 2023-12-13T00:01:22.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.206+0000 7f4908c35640 1 -- 172.21.15.72:0/428268517 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48f0003520 con 0x7f4904150530 2023-12-13T00:01:22.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.207+0000 7f490a438640 1 -- 172.21.15.72:0/428268517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49040c44d0 msgr2=0x7f49040c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:22.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.207+0000 7f490a438640 1 --2- 172.21.15.72:0/428268517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49040c44d0 0x7f49040c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.207+0000 7f490a438640 1 -- 172.21.15.72:0/428268517 >> v1:172.21.15.72:6789/0 conn(0x7f4904150530 legacy=0x7f49040c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:22.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.207+0000 7f490a438640 1 -- 172.21.15.72:0/428268517 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49040c2110 con 0x7f49041596e0 2023-12-13T00:01:22.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.210+0000 7f490a438640 1 --2- 172.21.15.72:0/428268517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49041596e0 0x7f4904159b70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0097a0 tx=0x7f48fc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=832a6cb61fe6e0b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:22.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.214+0000 7f4908c35640 1 -- 172.21.15.72:0/428268517 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc030610 con 0x7f49041596e0 2023-12-13T00:01:22.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.214+0000 7f4908c35640 1 -- 172.21.15.72:0/428268517 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc030770 con 0x7f49041596e0 2023-12-13T00:01:22.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.214+0000 7f4908c35640 1 -- 172.21.15.72:0/428268517 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc030b00 con 0x7f49041596e0 2023-12-13T00:01:22.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.215+0000 7f490be9b640 1 -- 172.21.15.72:0/428268517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49041596e0 msgr2=0x7f4904159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:22.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.215+0000 7f490be9b640 1 --2- 172.21.15.72:0/428268517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49041596e0 0x7f4904159b70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0097a0 tx=0x7f48fc02b960 comp rx=0 tx=0).stop 2023-12-13T00:01:22.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.215+0000 7f490be9b640 1 -- 172.21.15.72:0/428268517 shutdown_connections 2023-12-13T00:01:22.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.215+0000 7f490be9b640 1 --2- 172.21.15.72:0/428268517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49041596e0 0x7f4904159b70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.215+0000 7f490be9b640 1 --2- 172.21.15.72:0/428268517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49040c44d0 0x7f49040c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.215+0000 7f490be9b640 1 -- 172.21.15.72:0/428268517 >> 172.21.15.72:0/428268517 conn(0x7f490406c5f0 msgr2=0x7f490406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:22.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.215+0000 7f490be9b640 1 -- 172.21.15.72:0/428268517 shutdown_connections 2023-12-13T00:01:22.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.215+0000 7f490be9b640 1 -- 172.21.15.72:0/428268517 wait complete. 2023-12-13T00:01:22.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.216+0000 7f490be9b640 1 Processor -- start 2023-12-13T00:01:22.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.216+0000 7f490be9b640 1 -- start start 2023-12-13T00:01:22.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.217+0000 7f490be9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49040c44d0 0x7f490414be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:22.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.217+0000 7f490be9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4904150530 0x7f490414c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:22.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.217+0000 7f490be9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49041596e0 0x7f49041549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:22.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.217+0000 7f490be9b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490414cbc0 con 0x7f49040c44d0 2023-12-13T00:01:22.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.217+0000 7f490be9b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49041ed330 con 0x7f4904150530 2023-12-13T00:01:22.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.217+0000 7f490be9b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49040c8db0 con 0x7f49041596e0 2023-12-13T00:01:22.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.218+0000 7f4909c37640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49040c44d0 0x7f490414be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:22.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.218+0000 7f4909436640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4904150530 0x7f490414c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:22.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.218+0000 7f490a438640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49041596e0 0x7f49041549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:22.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.218+0000 7f4909c37640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49040c44d0 0x7f490414be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48386/0 (socket says 172.21.15.72:48386) 2023-12-13T00:01:22.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.218+0000 7f4909c37640 1 -- 172.21.15.72:0/2663184950 learned_addr learned my addr 172.21.15.72:0/2663184950 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:22.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.221+0000 7f4909c37640 1 -- 172.21.15.72:0/2663184950 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49041596e0 msgr2=0x7f49041549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:22.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.221+0000 7f4909c37640 1 --2- 172.21.15.72:0/2663184950 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49041596e0 0x7f49041549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.221+0000 7f4909c37640 1 -- 172.21.15.72:0/2663184950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4904150530 msgr2=0x7f490414c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:22.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.221+0000 7f4909c37640 1 --2- 172.21.15.72:0/2663184950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4904150530 0x7f490414c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.221+0000 7f4909c37640 1 -- 172.21.15.72:0/2663184950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc009400 con 0x7f49040c44d0 2023-12-13T00:01:22.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.224+0000 7f4909c37640 1 --2- 172.21.15.72:0/2663184950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49040c44d0 0x7f490414be80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f490000cb40 tx=0x7f490000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:22.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.227+0000 7f48fa7fc640 1 -- 172.21.15.72:0/2663184950 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490000ac20 con 0x7f49040c44d0 2023-12-13T00:01:22.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.227+0000 7f48fa7fc640 1 -- 172.21.15.72:0/2663184950 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490000ad80 con 0x7f49040c44d0 2023-12-13T00:01:22.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.227+0000 7f48fa7fc640 1 -- 172.21.15.72:0/2663184950 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900012620 con 0x7f49040c44d0 2023-12-13T00:01:22.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.227+0000 7f490be9b640 1 -- 172.21.15.72:0/2663184950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49040c3170 con 0x7f49040c44d0 2023-12-13T00:01:22.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.227+0000 7f490be9b640 1 -- 172.21.15.72:0/2663184950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490414b3a0 con 0x7f49040c44d0 2023-12-13T00:01:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.228+0000 7f490be9b640 1 -- 172.21.15.72:0/2663184950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490414b200 con 0x7f49040c44d0 2023-12-13T00:01:22.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.247+0000 7f48fa7fc640 1 -- 172.21.15.72:0/2663184950 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4900007070 con 0x7f49040c44d0 2023-12-13T00:01:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.247+0000 7f48fa7fc640 1 --2- 172.21.15.72:0/2663184950 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f48e806b1c0 0x7f48e806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.247+0000 7f4909436640 1 --2- 172.21.15.72:0/2663184950 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f48e806b1c0 0x7f48e806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.248+0000 7f4909436640 1 --2- 172.21.15.72:0/2663184950 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f48e806b1c0 0x7f48e806d680 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f49040736b0 tx=0x7f48f4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:22.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.496+0000 7f48fa7fc640 1 -- 172.21.15.72:0/2663184950 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f49000586e0 con 0x7f49040c44d0 2023-12-13T00:01:22.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.496+0000 7f48fa7fc640 1 -- 172.21.15.72:0/2663184950 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4900054a20 con 0x7f49040c44d0 2023-12-13T00:01:22.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.697+0000 7f490be9b640 1 -- 172.21.15.72:0/2663184950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f490414b200 con 0x7f49040c44d0 2023-12-13T00:01:22.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.736+0000 7f48fa7fc640 1 -- 172.21.15.72:0/2663184950 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18563 (secure 0 0 0) 0x7f490414b200 con 0x7f49040c44d0 2023-12-13T00:01:22.737 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:01:22.737 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:01:00.435991+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T00:00:27.701252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T00:00:29.324356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T00:00:33.363089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.3","mappings":[{"from":7,"to":5}]},{"pgid":"4.10","mappings":[{"from":7,"to":0}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:01:22.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.738+0000 7f490be9b640 1 -- 172.21.15.72:0/2663184950 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f48e806b1c0 msgr2=0x7f48e806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:22.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.738+0000 7f490be9b640 1 --2- 172.21.15.72:0/2663184950 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f48e806b1c0 0x7f48e806d680 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f49040736b0 tx=0x7f48f4009190 comp rx=0 tx=0).stop 2023-12-13T00:01:22.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.738+0000 7f490be9b640 1 -- 172.21.15.72:0/2663184950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49040c44d0 msgr2=0x7f490414be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:22.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.738+0000 7f490be9b640 1 --2- 172.21.15.72:0/2663184950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49040c44d0 0x7f490414be80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f490000cb40 tx=0x7f490000a060 comp rx=0 tx=0).stop 2023-12-13T00:01:22.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.738+0000 7f490be9b640 1 -- 172.21.15.72:0/2663184950 shutdown_connections 2023-12-13T00:01:22.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.738+0000 7f490be9b640 1 --2- 172.21.15.72:0/2663184950 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f48e806b1c0 0x7f48e806d680 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.738+0000 7f490be9b640 1 --2- 172.21.15.72:0/2663184950 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49041596e0 0x7f49041549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.738+0000 7f490be9b640 1 --2- 172.21.15.72:0/2663184950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4904150530 0x7f490414c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.738+0000 7f490be9b640 1 --2- 172.21.15.72:0/2663184950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49040c44d0 0x7f490414be80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.738+0000 7f490be9b640 1 -- 172.21.15.72:0/2663184950 >> 172.21.15.72:0/2663184950 conn(0x7f490406c5f0 msgr2=0x7f4904156450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:22.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.738+0000 7f490be9b640 1 -- 172.21.15.72:0/2663184950 shutdown_connections 2023-12-13T00:01:22.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.738+0000 7f490be9b640 1 -- 172.21.15.72:0/2663184950 wait complete. 2023-12-13T00:01:22.749 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T00:01:22.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.850+0000 7f5dc29c9640 1 Processor -- start 2023-12-13T00:01:22.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.851+0000 7f5dc29c9640 1 -- start start 2023-12-13T00:01:22.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.851+0000 7f5dc29c9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5dbc151680 0x7f5dbc1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:22.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.851+0000 7f5dc29c9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5dbc06f3f0 0x7f5dbc0c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:22.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.851+0000 7f5dc29c9640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dbc157880 con 0x7f5dbc06f810 2023-12-13T00:01:22.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.851+0000 7f5dc29c9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dbc157b60 con 0x7f5dbc06f3f0 2023-12-13T00:01:22.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.851+0000 7f5dc29c9640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dbc157e40 con 0x7f5dbc151680 2023-12-13T00:01:22.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.852+0000 7f5dbb7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5dbc06f3f0 0x7f5dbc0c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:22.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.852+0000 7f5dbbfff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5dbc151680 0x7f5dbc1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:22.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.852+0000 7f5dc0f66640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5dbc06f810 0x7f5dbc0ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39414/0 (socket says 172.21.15.72:39414) 2023-12-13T00:01:22.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.852+0000 7f5dc0f66640 1 -- 172.21.15.72:0/4194570587 learned_addr learned my addr 172.21.15.72:0/4194570587 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:22.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.854+0000 7f5dbbfff640 1 -- 172.21.15.72:0/4194570587 >> v2:172.21.15.72:3300/0 conn(0x7f5dbc06f3f0 msgr2=0x7f5dbc0c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:22.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.854+0000 7f5dbbfff640 1 --2- 172.21.15.72:0/4194570587 >> v2:172.21.15.72:3300/0 conn(0x7f5dbc06f3f0 0x7f5dbc0c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.854+0000 7f5dbbfff640 1 -- 172.21.15.72:0/4194570587 >> v1:172.21.15.72:6789/0 conn(0x7f5dbc06f810 legacy=0x7f5dbc0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:22.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.854+0000 7f5dbbfff640 1 -- 172.21.15.72:0/4194570587 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc158120 con 0x7f5dbc151680 2023-12-13T00:01:22.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.856+0000 7f5dbbfff640 1 --2- 172.21.15.72:0/4194570587 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dbc151680 0x7f5dbc1571d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc0cd680 tx=0x7f5da402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b13be9c0e40a32c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.860+0000 7f5dbaffd640 1 -- 172.21.15.72:0/4194570587 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da4030610 con 0x7f5dbc151680 2023-12-13T00:01:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.860+0000 7f5dbaffd640 1 -- 172.21.15.72:0/4194570587 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da4030770 con 0x7f5dbc151680 2023-12-13T00:01:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.860+0000 7f5dbaffd640 1 -- 172.21.15.72:0/4194570587 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da4030b00 con 0x7f5dbc151680 2023-12-13T00:01:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.860+0000 7f5dc29c9640 1 -- 172.21.15.72:0/4194570587 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dbc151680 msgr2=0x7f5dbc1571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.860+0000 7f5dc29c9640 1 --2- 172.21.15.72:0/4194570587 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dbc151680 0x7f5dbc1571d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc0cd680 tx=0x7f5da402b960 comp rx=0 tx=0).stop 2023-12-13T00:01:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.860+0000 7f5dc29c9640 1 -- 172.21.15.72:0/4194570587 shutdown_connections 2023-12-13T00:01:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.860+0000 7f5dc29c9640 1 --2- 172.21.15.72:0/4194570587 >> v2:172.21.15.72:3300/0 conn(0x7f5dbc06f3f0 0x7f5dbc0c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.860+0000 7f5dc29c9640 1 --2- 172.21.15.72:0/4194570587 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dbc151680 0x7f5dbc1571d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.860+0000 7f5dc29c9640 1 -- 172.21.15.72:0/4194570587 >> 172.21.15.72:0/4194570587 conn(0x7f5dbc0707f0 msgr2=0x7f5dbc070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.860+0000 7f5dc29c9640 1 -- 172.21.15.72:0/4194570587 shutdown_connections 2023-12-13T00:01:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.860+0000 7f5dc29c9640 1 -- 172.21.15.72:0/4194570587 wait complete. 2023-12-13T00:01:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.862+0000 7f5dc29c9640 1 Processor -- start 2023-12-13T00:01:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.862+0000 7f5dc29c9640 1 -- start start 2023-12-13T00:01:22.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.862+0000 7f5dc29c9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dbc06f3f0 0x7f5dbc0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:22.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.862+0000 7f5dc29c9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dbc06f810 0x7f5dbc0cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:22.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.862+0000 7f5dc29c9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dbc151680 0x7f5dbc1ef270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:22.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.862+0000 7f5dc29c9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc0ae370 con 0x7f5dbc06f3f0 2023-12-13T00:01:22.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.862+0000 7f5dc29c9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc1eeb40 con 0x7f5dbc151680 2023-12-13T00:01:22.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.862+0000 7f5dc29c9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc06c610 con 0x7f5dbc06f810 2023-12-13T00:01:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.863+0000 7f5dc0f66640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dbc151680 0x7f5dbc1ef270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.863+0000 7f5dbbfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dbc06f3f0 0x7f5dbc0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.863+0000 7f5dbb7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dbc06f810 0x7f5dbc0cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.863+0000 7f5dc0f66640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dbc151680 0x7f5dbc1ef270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:44286/0 (socket says 172.21.15.72:44286) 2023-12-13T00:01:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.863+0000 7f5dc0f66640 1 -- 172.21.15.72:0/1129286114 learned_addr learned my addr 172.21.15.72:0/1129286114 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:22.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.866+0000 7f5dc0f66640 1 -- 172.21.15.72:0/1129286114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dbc06f810 msgr2=0x7f5dbc0cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:22.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.866+0000 7f5dc0f66640 1 --2- 172.21.15.72:0/1129286114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dbc06f810 0x7f5dbc0cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.866+0000 7f5dc0f66640 1 -- 172.21.15.72:0/1129286114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dbc06f3f0 msgr2=0x7f5dbc0ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:22.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.866+0000 7f5dc0f66640 1 --2- 172.21.15.72:0/1129286114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dbc06f3f0 0x7f5dbc0ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:22.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.866+0000 7f5dc0f66640 1 -- 172.21.15.72:0/1129286114 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da4009400 con 0x7f5dbc151680 2023-12-13T00:01:22.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.869+0000 7f5dc0f66640 1 --2- 172.21.15.72:0/1129286114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dbc151680 0x7f5dbc1ef270 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5db400cbc0 tx=0x7f5db400a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:22.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.872+0000 7f5db8ff9640 1 -- 172.21.15.72:0/1129286114 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db400ad40 con 0x7f5dbc151680 2023-12-13T00:01:22.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.872+0000 7f5db8ff9640 1 -- 172.21.15.72:0/1129286114 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db4012400 con 0x7f5dbc151680 2023-12-13T00:01:22.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.872+0000 7f5db8ff9640 1 -- 172.21.15.72:0/1129286114 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db400aea0 con 0x7f5dbc151680 2023-12-13T00:01:22.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.872+0000 7f5dc29c9640 1 -- 172.21.15.72:0/1129286114 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dbc0ace00 con 0x7f5dbc151680 2023-12-13T00:01:22.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.872+0000 7f5dc29c9640 1 -- 172.21.15.72:0/1129286114 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dbc06bd70 con 0x7f5dbc151680 2023-12-13T00:01:22.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:22.873+0000 7f5dc29c9640 1 -- 172.21.15.72:0/1129286114 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dbc073dc0 con 0x7f5dbc151680 2023-12-13T00:01:23.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.109+0000 7f5db8ff9640 1 -- 172.21.15.72:0/1129286114 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5db4007070 con 0x7f5dbc151680 2023-12-13T00:01:23.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.109+0000 7f5db8ff9640 1 --2- 172.21.15.72:0/1129286114 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5d9c06b1c0 0x7f5d9c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:23.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.109+0000 7f5dbbfff640 1 --2- 172.21.15.72:0/1129286114 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5d9c06b1c0 0x7f5d9c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:23.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.110+0000 7f5dbbfff640 1 --2- 172.21.15.72:0/1129286114 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5d9c06b1c0 0x7f5d9c06d680 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5da4036000 tx=0x7f5da403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.113+0000 7f5db8ff9640 1 -- 172.21.15.72:0/1129286114 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f5db4058820 con 0x7f5dbc151680 2023-12-13T00:01:23.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.123+0000 7f5db8ff9640 1 -- 172.21.15.72:0/1129286114 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5db4054b60 con 0x7f5dbc151680 2023-12-13T00:01:23.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.324+0000 7f5dc29c9640 1 -- 172.21.15.72:0/1129286114 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5dbc0c8400 con 0x7f5dbc151680 2023-12-13T00:01:23.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.345+0000 7f5db8ff9640 1 -- 172.21.15.72:0/1129286114 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+6530 (secure 0 0 0) 0x7f5db4021090 con 0x7f5dbc151680 2023-12-13T00:01:23.344 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:01:23.345 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/541435124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":541435124},{"type":"v1","addr":"172.21.15.72:6837","nonce":541435124}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4190692049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4190692049},{"type":"v1","addr":"172.21.15.176:6835","nonce":4190692049}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1780646034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1780646034},{"type":"v1","addr":"172.21.15.176:6833","nonce":1780646034}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-13T00:00:30.722325+0000","modified":"2023-12-13T00:01:06.584709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4266,"mds_1":4264,"mds_2":4259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":13,"addr":"172.21.15.72:6839/3632161953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":3632161953},{"type":"v1","addr":"172.21.15.72:6839","nonce":3632161953}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4264":{"gid":4264,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6835/3954648997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3954648997},{"type":"v1","addr":"172.21.15.72:6835","nonce":3954648997}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4266":{"gid":4266,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6837/3968747607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":3968747607},{"type":"v1","addr":"172.21.15.176:6837","nonce":3968747607}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-13T00:01:23.345 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2023-12-13T00:01:23.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.347+0000 7f5dc29c9640 1 -- 172.21.15.72:0/1129286114 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5d9c06b1c0 msgr2=0x7f5d9c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:23.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.347+0000 7f5dc29c9640 1 --2- 172.21.15.72:0/1129286114 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5d9c06b1c0 0x7f5d9c06d680 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5da4036000 tx=0x7f5da403b040 comp rx=0 tx=0).stop 2023-12-13T00:01:23.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.347+0000 7f5dc29c9640 1 -- 172.21.15.72:0/1129286114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dbc151680 msgr2=0x7f5dbc1ef270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:23.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.347+0000 7f5dc29c9640 1 --2- 172.21.15.72:0/1129286114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dbc151680 0x7f5dbc1ef270 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5db400cbc0 tx=0x7f5db400a430 comp rx=0 tx=0).stop 2023-12-13T00:01:23.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.347+0000 7f5dc29c9640 1 -- 172.21.15.72:0/1129286114 shutdown_connections 2023-12-13T00:01:23.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.347+0000 7f5dc29c9640 1 --2- 172.21.15.72:0/1129286114 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f5d9c06b1c0 0x7f5d9c06d680 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:23.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.347+0000 7f5dc29c9640 1 --2- 172.21.15.72:0/1129286114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dbc151680 0x7f5dbc1ef270 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:23.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.347+0000 7f5dc29c9640 1 --2- 172.21.15.72:0/1129286114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5dbc06f810 0x7f5dbc0cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:23.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.347+0000 7f5dc29c9640 1 --2- 172.21.15.72:0/1129286114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dbc06f3f0 0x7f5dbc0ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:23.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.347+0000 7f5dc29c9640 1 -- 172.21.15.72:0/1129286114 >> 172.21.15.72:0/1129286114 conn(0x7f5dbc0707f0 msgr2=0x7f5dbc1566c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:23.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.347+0000 7f5dc29c9640 1 -- 172.21.15.72:0/1129286114 shutdown_connections 2023-12-13T00:01:23.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:23.347+0000 7f5dc29c9640 1 -- 172.21.15.72:0/1129286114 wait complete. 2023-12-13T00:01:23.961 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-13T00:00:30.722325+0000', 'modified': '2023-12-13T00:01:06.584709+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4266, 'mds_1': 4264, 'mds_2': 4259}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4259': {'gid': 4259, 'name': 'c', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.72:6839/3632161953', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6838', 'nonce': 3632161953}, {'type': 'v1', 'addr': '172.21.15.72:6839', 'nonce': 3632161953}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4264': {'gid': 4264, 'name': 'a', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.72:6835/3954648997', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6834', 'nonce': 3954648997}, {'type': 'v1', 'addr': '172.21.15.72:6835', 'nonce': 3954648997}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4266': {'gid': 4266, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.176:6837/3968747607', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6836', 'nonce': 3968747607}, {'type': 'v1', 'addr': '172.21.15.176:6837', 'nonce': 3968747607}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-13T00:01:23.962 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-12-13T00:01:23.962 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-13T00:01:24.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.062+0000 7f39047a9640 1 Processor -- start 2023-12-13T00:01:24.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.062+0000 7f39047a9640 1 -- start start 2023-12-13T00:01:24.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.063+0000 7f39047a9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f38fc150530 0x7f38fc0c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.063+0000 7f39047a9640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38fc150910 con 0x7f38fc0c7180 2023-12-13T00:01:24.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.063+0000 7f39047a9640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38fc0c1ec0 con 0x7f38fc1596e0 2023-12-13T00:01:24.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.063+0000 7f39047a9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38fc15a280 con 0x7f38fc150530 2023-12-13T00:01:24.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.064+0000 7f3901d44640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f38fc0c7180 0x7f38fc0c44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39422/0 (socket says 172.21.15.72:39422) 2023-12-13T00:01:24.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.064+0000 7f3901d44640 1 -- 172.21.15.72:0/2440012391 learned_addr learned my addr 172.21.15.72:0/2440012391 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:24.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.064+0000 7f3902545640 1 --2- 172.21.15.72:0/2440012391 >> v2:172.21.15.72:3300/0 conn(0x7f38fc150530 0x7f38fc0c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.067+0000 7f3902545640 1 -- 172.21.15.72:0/2440012391 >> v1:172.21.15.176:6789/0 conn(0x7f38fc1596e0 legacy=0x7f38fc159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.067+0000 7f3902545640 1 -- 172.21.15.72:0/2440012391 >> v1:172.21.15.72:6789/0 conn(0x7f38fc0c7180 legacy=0x7f38fc0c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.067+0000 7f3902545640 1 -- 172.21.15.72:0/2440012391 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc15a4e0 con 0x7f38fc150530 2023-12-13T00:01:24.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.071+0000 7f3902545640 1 --2- 172.21.15.72:0/2440012391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38fc150530 0x7f38fc0c6c40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f38f80097a0 tx=0x7f38f802dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b4ea133a16bdc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.075+0000 7f3901543640 1 -- 172.21.15.72:0/2440012391 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f802e9b0 con 0x7f38fc150530 2023-12-13T00:01:24.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.075+0000 7f3901543640 1 -- 172.21.15.72:0/2440012391 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f802eb10 con 0x7f38fc150530 2023-12-13T00:01:24.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.075+0000 7f3901543640 1 -- 172.21.15.72:0/2440012391 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f802eea0 con 0x7f38fc150530 2023-12-13T00:01:24.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.076+0000 7f39047a9640 1 -- 172.21.15.72:0/2440012391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38fc150530 msgr2=0x7f38fc0c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.076+0000 7f39047a9640 1 --2- 172.21.15.72:0/2440012391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38fc150530 0x7f38fc0c6c40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f38f80097a0 tx=0x7f38f802dc00 comp rx=0 tx=0).stop 2023-12-13T00:01:24.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.076+0000 7f39047a9640 1 -- 172.21.15.72:0/2440012391 shutdown_connections 2023-12-13T00:01:24.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.076+0000 7f39047a9640 1 --2- 172.21.15.72:0/2440012391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38fc150530 0x7f38fc0c6c40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.076+0000 7f39047a9640 1 -- 172.21.15.72:0/2440012391 >> 172.21.15.72:0/2440012391 conn(0x7f38fc06c5f0 msgr2=0x7f38fc06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:24.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.076+0000 7f39047a9640 1 -- 172.21.15.72:0/2440012391 shutdown_connections 2023-12-13T00:01:24.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.076+0000 7f39047a9640 1 -- 172.21.15.72:0/2440012391 wait complete. 2023-12-13T00:01:24.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.077+0000 7f39047a9640 1 Processor -- start 2023-12-13T00:01:24.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.077+0000 7f39047a9640 1 -- start start 2023-12-13T00:01:24.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.078+0000 7f39047a9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38fc0c7180 0x7f38fc158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.078+0000 7f39047a9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38fc150530 0x7f38fc14a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.078+0000 7f39047a9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38fc1596e0 0x7f38fc06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.078+0000 7f39047a9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc154ed0 con 0x7f38fc150530 2023-12-13T00:01:24.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.078+0000 7f39047a9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc158b70 con 0x7f38fc1596e0 2023-12-13T00:01:24.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.078+0000 7f39047a9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc0c8f80 con 0x7f38fc0c7180 2023-12-13T00:01:24.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.078+0000 7f3901d44640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38fc150530 0x7f38fc14a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.079+0000 7f3902d46640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38fc1596e0 0x7f38fc06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.079+0000 7f3901d44640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38fc150530 0x7f38fc14a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48426/0 (socket says 172.21.15.72:48426) 2023-12-13T00:01:24.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.079+0000 7f3901d44640 1 -- 172.21.15.72:0/3328105410 learned_addr learned my addr 172.21.15.72:0/3328105410 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:24.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.079+0000 7f3902545640 1 --2- 172.21.15.72:0/3328105410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38fc0c7180 0x7f38fc158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.082+0000 7f3901d44640 1 -- 172.21.15.72:0/3328105410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38fc0c7180 msgr2=0x7f38fc158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.082+0000 7f3901d44640 1 --2- 172.21.15.72:0/3328105410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38fc0c7180 0x7f38fc158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.082+0000 7f3901d44640 1 -- 172.21.15.72:0/3328105410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38fc1596e0 msgr2=0x7f38fc06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.082+0000 7f3901d44640 1 --2- 172.21.15.72:0/3328105410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38fc1596e0 0x7f38fc06e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.082+0000 7f3901d44640 1 -- 172.21.15.72:0/3328105410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f8009400 con 0x7f38fc150530 2023-12-13T00:01:24.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.084+0000 7f3901d44640 1 --2- 172.21.15.72:0/3328105410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38fc150530 0x7f38fc14a700 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00c3f0 tx=0x7f38ec00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.088+0000 7f38f2ffd640 1 -- 172.21.15.72:0/3328105410 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec005ce0 con 0x7f38fc150530 2023-12-13T00:01:24.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.088+0000 7f38f2ffd640 1 -- 172.21.15.72:0/3328105410 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec005e40 con 0x7f38fc150530 2023-12-13T00:01:24.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.088+0000 7f38f2ffd640 1 -- 172.21.15.72:0/3328105410 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec0072d0 con 0x7f38fc150530 2023-12-13T00:01:24.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.088+0000 7f39047a9640 1 -- 172.21.15.72:0/3328105410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38fc14cb70 con 0x7f38fc150530 2023-12-13T00:01:24.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.088+0000 7f39047a9640 1 -- 172.21.15.72:0/3328105410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38fc1550e0 con 0x7f38fc150530 2023-12-13T00:01:24.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.092+0000 7f3907419740 1 Processor -- start 2023-12-13T00:01:24.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.092+0000 7f3907419740 1 -- start start 2023-12-13T00:01:24.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.093+0000 7f3907419740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac45ac70 0x5628ac4af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.093+0000 7f3907419740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac486a30 0x5628ac45d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.093+0000 7f3907419740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac45b050 0x5628ac45d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.093+0000 7f3907419740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ac3cb020 con 0x5628ac45ac70 2023-12-13T00:01:24.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.093+0000 7f3907419740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ac3c8710 con 0x5628ac486a30 2023-12-13T00:01:24.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.093+0000 7f3907419740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628ac3c4000 con 0x5628ac45b050 2023-12-13T00:01:24.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.094+0000 7f3901d44640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac45b050 0x5628ac45d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.094+0000 7f3902545640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac486a30 0x5628ac45d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.094+0000 7f3902545640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac486a30 0x5628ac45d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:44304/0 (socket says 172.21.15.72:44304) 2023-12-13T00:01:24.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.094+0000 7f3902545640 1 -- 172.21.15.72:0/1635809624 learned_addr learned my addr 172.21.15.72:0/1635809624 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:24.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.097+0000 7f3902545640 1 -- 172.21.15.72:0/1635809624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac45b050 msgr2=0x5628ac45d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.097+0000 7f3902545640 1 --2- 172.21.15.72:0/1635809624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac45b050 0x5628ac45d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.097+0000 7f3902545640 1 -- 172.21.15.72:0/1635809624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac45ac70 msgr2=0x5628ac4af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.097+0000 7f3902545640 1 --2- 172.21.15.72:0/1635809624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac45ac70 0x5628ac4af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.097+0000 7f3902545640 1 -- 172.21.15.72:0/1635809624 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628ac386c90 con 0x5628ac486a30 2023-12-13T00:01:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.099+0000 7f3902545640 1 --2- 172.21.15.72:0/1635809624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac486a30 0x5628ac45d0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f38f80098c0 tx=0x7f38f8030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68d80544d94284 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.103+0000 7f38dffff640 1 -- 172.21.15.72:0/1635809624 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f8036640 con 0x5628ac486a30 2023-12-13T00:01:24.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.103+0000 7f38dffff640 1 -- 172.21.15.72:0/1635809624 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f80367c0 con 0x5628ac486a30 2023-12-13T00:01:24.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.103+0000 7f38dffff640 1 -- 172.21.15.72:0/1635809624 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f8036b70 con 0x5628ac486a30 2023-12-13T00:01:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.104+0000 7f3907419740 1 -- 172.21.15.72:0/1635809624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac486a30 msgr2=0x5628ac45d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.104+0000 7f3907419740 1 --2- 172.21.15.72:0/1635809624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac486a30 0x5628ac45d0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f38f80098c0 tx=0x7f38f8030000 comp rx=0 tx=0).stop 2023-12-13T00:01:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.104+0000 7f3907419740 1 -- 172.21.15.72:0/1635809624 shutdown_connections 2023-12-13T00:01:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.104+0000 7f3907419740 1 --2- 172.21.15.72:0/1635809624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac45b050 0x5628ac45d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.104+0000 7f3907419740 1 --2- 172.21.15.72:0/1635809624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac486a30 0x5628ac45d0a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.104+0000 7f3907419740 1 --2- 172.21.15.72:0/1635809624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac45ac70 0x5628ac4af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.104+0000 7f3907419740 1 -- 172.21.15.72:0/1635809624 >> 172.21.15.72:0/1635809624 conn(0x5628ac459c90 msgr2=0x5628ac45c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.104+0000 7f3907419740 1 -- 172.21.15.72:0/1635809624 shutdown_connections 2023-12-13T00:01:24.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.104+0000 7f3907419740 1 -- 172.21.15.72:0/1635809624 wait complete. 2023-12-13T00:01:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.105+0000 7f3907419740 1 -- start start 2023-12-13T00:01:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.105+0000 7f3907419740 1 Processor -- start 2023-12-13T00:01:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.106+0000 7f3907419740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac45b050 0x5628ac49b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.106+0000 7f3907419740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac486a30 0x5628ac4afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.106+0000 7f3907419740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac484b90 0x5628ac4b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.106+0000 7f3907419740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ac37de00 con 0x5628ac486a30 2023-12-13T00:01:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.106+0000 7f3907419740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ac37daa0 con 0x5628ac45b050 2023-12-13T00:01:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.106+0000 7f3907419740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628ac343270 con 0x5628ac484b90 2023-12-13T00:01:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.106+0000 7f3907419740 10 client.0 _ll_register_callbacks cb 0x5628ac0d5ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-13T00:01:24.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.106+0000 7f3902d46640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac45b050 0x5628ac49b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.106+0000 7f3901d44640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac484b90 0x5628ac4b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.106+0000 7f3902d46640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac45b050 0x5628ac49b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:44312/0 (socket says 172.21.15.72:44312) 2023-12-13T00:01:24.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.106+0000 7f3902d46640 1 -- 172.21.15.72:0/3084222330 learned_addr learned my addr 172.21.15.72:0/3084222330 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:24.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.111+0000 7f3902d46640 1 -- 172.21.15.72:0/3084222330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac484b90 msgr2=0x5628ac4b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.111+0000 7f3902d46640 1 --2- 172.21.15.72:0/3084222330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac484b90 0x5628ac4b00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.111+0000 7f38f2ffd640 1 -- 172.21.15.72:0/3328105410 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f38ec007610 con 0x7f38fc150530 2023-12-13T00:01:24.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.111+0000 7f3902d46640 1 -- 172.21.15.72:0/3084222330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac486a30 msgr2=0x5628ac4afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.111+0000 7f3902d46640 1 --2- 172.21.15.72:0/3084222330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac486a30 0x5628ac4afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.111+0000 7f3902d46640 1 -- 172.21.15.72:0/3084222330 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f800e040 con 0x5628ac45b050 2023-12-13T00:01:24.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.111+0000 7f38f2ffd640 1 --2- 172.21.15.72:0/3328105410 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f38e006b180 0x7f38e006d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.111+0000 7f3902545640 1 --2- 172.21.15.72:0/3328105410 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f38e006b180 0x7f38e006d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.111+0000 7f3902545640 1 --2- 172.21.15.72:0/3328105410 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f38e006b180 0x7f38e006d640 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f38f8044000 tx=0x7f38f8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.113+0000 7f3902d46640 1 --2- 172.21.15.72:0/3084222330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac45b050 0x5628ac49b390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f38f4007b90 tx=0x7f38f400f9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=673f0aaf1ab255bc server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.113+0000 7f38dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2023-12-13T00:01:24.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.114+0000 7f38f2ffd640 1 -- 172.21.15.72:0/3328105410 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f38ec05e9c0 con 0x7f38fc150530 2023-12-13T00:01:24.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.117+0000 7f38dd7fa640 1 -- 172.21.15.72:0/3084222330 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4003b80 con 0x5628ac45b050 2023-12-13T00:01:24.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.117+0000 7f38dd7fa640 1 -- 172.21.15.72:0/3084222330 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f38f4003ce0 con 0x5628ac45b050 2023-12-13T00:01:24.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.117+0000 7f3907419740 1 -- 172.21.15.72:0/3084222330 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628ac3bce90 con 0x5628ac45b050 2023-12-13T00:01:24.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.118+0000 7f38dd7fa640 1 -- 172.21.15.72:0/3084222330 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38f4003ea0 con 0x5628ac45b050 2023-12-13T00:01:24.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.118+0000 7f3907419740 10 client.4744 fetch_fsmap learned FSMap version 14 2023-12-13T00:01:24.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.118+0000 7f3907419740 1 -- 172.21.15.72:0/3084222330 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x5628ac3c2680 con 0x5628ac45b050 2023-12-13T00:01:24.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.123+0000 7f38dd7fa640 1 -- 172.21.15.72:0/3084222330 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5628ac3bce90 con 0x5628ac45b050 2023-12-13T00:01:24.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.123+0000 7f38dd7fa640 1 -- 172.21.15.72:0/3084222330 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f38f4012070 con 0x5628ac45b050 2023-12-13T00:01:24.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.123+0000 7f3907419740 10 client.4744 fetch_fsmap finished waiting for FSMap version 14 2023-12-13T00:01:24.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.123+0000 7f3907419740 10 client.4744 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-13T00:01:24.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.123+0000 7f3907419740 20 client.4744 populate_metadata read hostname 'smithi072' 2023-12-13T00:01:24.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.123+0000 7f3907419740 1 --2- 172.21.15.72:0/3084222330 >> [v2:172.21.15.72:6838/3632161953,v1:172.21.15.72:6839/3632161953] conn(0x5628ac4b9d80 0x5628ac4a1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.123+0000 7f3907419740 4 client.4744 mds_command: new command op to 4259 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-13T00:01:24.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.123+0000 7f3907419740 1 -- 172.21.15.72:0/3084222330 --> [v2:172.21.15.72:6838/3632161953,v1:172.21.15.72:6839/3632161953] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628ac3bcbb0 con 0x5628ac4b9d80 2023-12-13T00:01:24.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.124+0000 7f3901d44640 1 --2- 172.21.15.72:0/3084222330 >> [v2:172.21.15.72:6838/3632161953,v1:172.21.15.72:6839/3632161953] conn(0x5628ac4b9d80 0x5628ac4a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.163+0000 7f38dd7fa640 10 client.4744 ms_handle_connect on v2:172.21.15.72:6838/3632161953 2023-12-13T00:01:24.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.163+0000 7f3901d44640 1 --2- 172.21.15.72:0/3084222330 >> [v2:172.21.15.72:6838/3632161953,v1:172.21.15.72:6839/3632161953] conn(0x5628ac4b9d80 0x5628ac4a1530 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=127fd610c37ee88b server_cookie=91d4ce8e8d3901d2 in_seq=0 out_seq=0 2023-12-13T00:01:24.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.262+0000 7f38dd7fa640 1 -- 172.21.15.72:0/3084222330 <== mds.2 v2:172.21.15.72:6838/3632161953 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5628ac3bcbb0 con 0x5628ac4b9d80 2023-12-13T00:01:24.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.262+0000 7f38dd7fa640 10 client.4744 handle_command_reply: tid=0 2023-12-13T00:01:24.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.262+0000 7f3907419740 1 client.4744 shutdown 2023-12-13T00:01:24.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.263+0000 7f3907419740 1 -- 172.21.15.72:0/3084222330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac45b050 msgr2=0x5628ac49b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.263+0000 7f3907419740 1 --2- 172.21.15.72:0/3084222330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac45b050 0x5628ac49b390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f38f4007b90 tx=0x7f38f400f9d0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.263+0000 7f3907419740 1 -- 172.21.15.72:0/3084222330 shutdown_connections 2023-12-13T00:01:24.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.263+0000 7f3907419740 1 --2- 172.21.15.72:0/3084222330 >> [v2:172.21.15.72:6838/3632161953,v1:172.21.15.72:6839/3632161953] conn(0x5628ac4b9d80 0x5628ac4a1530 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.263+0000 7f3907419740 1 --2- 172.21.15.72:0/3084222330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac484b90 0x5628ac4b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.263+0000 7f38dd7fa640 0 client.4744 ms_handle_reset on v2:172.21.15.72:6838/3632161953 2023-12-13T00:01:24.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.263+0000 7f3907419740 1 --2- 172.21.15.72:0/3084222330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac486a30 0x5628ac4afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.263+0000 7f3907419740 1 --2- 172.21.15.72:0/3084222330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac45b050 0x5628ac49b390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.263+0000 7f3907419740 1 -- 172.21.15.72:0/3084222330 >> 172.21.15.72:0/3084222330 conn(0x5628ac45ac70 msgr2=0x5628ac49e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:24.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.263+0000 7f3907419740 1 -- 172.21.15.72:0/3084222330 shutdown_connections 2023-12-13T00:01:24.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.263+0000 7f3907419740 1 -- 172.21.15.72:0/3084222330 wait complete. 2023-12-13T00:01:24.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.263+0000 7f3907419740 20 client.4744 trim_cache size 0 max 16384 2023-12-13T00:01:24.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.279+0000 7f3907419740 1 Processor -- start 2023-12-13T00:01:24.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.280+0000 7f3907419740 1 -- start start 2023-12-13T00:01:24.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.280+0000 7f3907419740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac45b050 0x5628ac4b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.280+0000 7f3907419740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac484b90 0x5628ac4af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.280+0000 7f3907419740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac486a30 0x5628ac4afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.280+0000 7f3907419740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ac4aa090 con 0x5628ac484b90 2023-12-13T00:01:24.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.280+0000 7f3907419740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ac484a10 con 0x5628ac45b050 2023-12-13T00:01:24.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.280+0000 7f3907419740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628ac4b04c0 con 0x5628ac486a30 2023-12-13T00:01:24.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.281+0000 7f3902545640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac45b050 0x5628ac4b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.281+0000 7f3902d46640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac486a30 0x5628ac4afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.281+0000 7f3901d44640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac484b90 0x5628ac4af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.281+0000 7f3902545640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac45b050 0x5628ac4b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:44318/0 (socket says 172.21.15.72:44318) 2023-12-13T00:01:24.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.281+0000 7f3902545640 1 -- 172.21.15.72:0/2295890988 learned_addr learned my addr 172.21.15.72:0/2295890988 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:24.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.283+0000 7f3901d44640 1 -- 172.21.15.72:0/2295890988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac486a30 msgr2=0x5628ac4afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.283+0000 7f3901d44640 1 --2- 172.21.15.72:0/2295890988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac486a30 0x5628ac4afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.283+0000 7f3901d44640 1 -- 172.21.15.72:0/2295890988 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac45b050 msgr2=0x5628ac4b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.283+0000 7f3901d44640 1 --2- 172.21.15.72:0/2295890988 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac45b050 0x5628ac4b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.283+0000 7f3901d44640 1 -- 172.21.15.72:0/2295890988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628ac35fd00 con 0x5628ac484b90 2023-12-13T00:01:24.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.285+0000 7f3901d44640 1 --2- 172.21.15.72:0/2295890988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac484b90 0x5628ac4af990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f38ec08e530 tx=0x7f38ec01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a019162f20da7c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.289+0000 7f38f0ff9640 1 -- 172.21.15.72:0/2295890988 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec062a60 con 0x5628ac484b90 2023-12-13T00:01:24.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.289+0000 7f38f0ff9640 1 -- 172.21.15.72:0/2295890988 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec066ca0 con 0x5628ac484b90 2023-12-13T00:01:24.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.289+0000 7f38f0ff9640 1 -- 172.21.15.72:0/2295890988 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec05b040 con 0x5628ac484b90 2023-12-13T00:01:24.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.289+0000 7f3907419740 1 -- 172.21.15.72:0/2295890988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac484b90 msgr2=0x5628ac4af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.289+0000 7f3907419740 1 --2- 172.21.15.72:0/2295890988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac484b90 0x5628ac4af990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f38ec08e530 tx=0x7f38ec01a000 comp rx=0 tx=0).stop 2023-12-13T00:01:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.289+0000 7f3907419740 1 -- 172.21.15.72:0/2295890988 shutdown_connections 2023-12-13T00:01:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.289+0000 7f3907419740 1 --2- 172.21.15.72:0/2295890988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac486a30 0x5628ac4afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.289+0000 7f3907419740 1 --2- 172.21.15.72:0/2295890988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac484b90 0x5628ac4af990 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.289+0000 7f3907419740 1 --2- 172.21.15.72:0/2295890988 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac45b050 0x5628ac4b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.289+0000 7f3907419740 1 -- 172.21.15.72:0/2295890988 >> 172.21.15.72:0/2295890988 conn(0x5628ac45ac70 msgr2=0x5628ac4c89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.290+0000 7f3907419740 1 -- 172.21.15.72:0/2295890988 shutdown_connections 2023-12-13T00:01:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.290+0000 7f3907419740 1 -- 172.21.15.72:0/2295890988 wait complete. 2023-12-13T00:01:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.290+0000 7f3907419740 1 -- start start 2023-12-13T00:01:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.290+0000 7f3907419740 1 Processor -- start 2023-12-13T00:01:24.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.291+0000 7f3907419740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac45b050 0x5628ac510fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.291+0000 7f3907419740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac484b90 0x5628ac45b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.291+0000 7f3907419740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac486a30 0x5628ac50ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.291+0000 7f3907419740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ac511520 con 0x5628ac45b050 2023-12-13T00:01:24.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.291+0000 7f3907419740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ac45bd70 con 0x5628ac484b90 2023-12-13T00:01:24.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.291+0000 7f3907419740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628ac49ec00 con 0x5628ac486a30 2023-12-13T00:01:24.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.291+0000 7f3907419740 10 client.0 _ll_register_callbacks cb 0x7f38f8009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-13T00:01:24.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.292+0000 7f3902545640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac45b050 0x5628ac510fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.292+0000 7f3901d44640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac484b90 0x5628ac45b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.292+0000 7f3902545640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac45b050 0x5628ac510fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48464/0 (socket says 172.21.15.72:48464) 2023-12-13T00:01:24.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.292+0000 7f3902545640 1 -- 172.21.15.72:0/908763360 learned_addr learned my addr 172.21.15.72:0/908763360 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:24.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.292+0000 7f3902d46640 1 --2- 172.21.15.72:0/908763360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac486a30 0x5628ac50ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.295+0000 7f3902545640 1 -- 172.21.15.72:0/908763360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac486a30 msgr2=0x5628ac50ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.295+0000 7f3902545640 1 --2- 172.21.15.72:0/908763360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac486a30 0x5628ac50ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.295+0000 7f3902545640 1 -- 172.21.15.72:0/908763360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac484b90 msgr2=0x5628ac45b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.295+0000 7f3902545640 1 --2- 172.21.15.72:0/908763360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac484b90 0x5628ac45b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.295+0000 7f3902545640 1 -- 172.21.15.72:0/908763360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38fc1550e0 con 0x5628ac45b050 2023-12-13T00:01:24.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.297+0000 7f3902545640 1 --2- 172.21.15.72:0/908763360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac45b050 0x5628ac510fe0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f38f8006f30 tx=0x7f38f8030070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19dd2521a3ed7e03 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.297+0000 7f38dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-12-13T00:01:24.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.300+0000 7f38dd7fa640 1 -- 172.21.15.72:0/908763360 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f8036e00 con 0x5628ac45b050 2023-12-13T00:01:24.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.300+0000 7f38dd7fa640 1 -- 172.21.15.72:0/908763360 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f38f8003610 con 0x5628ac45b050 2023-12-13T00:01:24.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.300+0000 7f3907419740 1 -- 172.21.15.72:0/908763360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628ac45ab00 con 0x5628ac45b050 2023-12-13T00:01:24.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.302+0000 7f38dd7fa640 1 -- 172.21.15.72:0/908763360 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38f80037d0 con 0x5628ac45b050 2023-12-13T00:01:24.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.302+0000 7f3907419740 10 client.4704 fetch_fsmap learned FSMap version 14 2023-12-13T00:01:24.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.302+0000 7f3907419740 1 -- 172.21.15.72:0/908763360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x5628ac3854f0 con 0x5628ac45b050 2023-12-13T00:01:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.308+0000 7f38dd7fa640 1 -- 172.21.15.72:0/908763360 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5628ac45ab00 con 0x5628ac45b050 2023-12-13T00:01:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.308+0000 7f38dd7fa640 1 -- 172.21.15.72:0/908763360 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f38f8003930 con 0x5628ac45b050 2023-12-13T00:01:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.308+0000 7f3907419740 10 client.4704 fetch_fsmap finished waiting for FSMap version 14 2023-12-13T00:01:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.308+0000 7f3907419740 10 client.4704 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-13T00:01:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.308+0000 7f3907419740 20 client.4704 populate_metadata read hostname 'smithi072' 2023-12-13T00:01:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.308+0000 7f3907419740 1 --2- 172.21.15.72:0/908763360 >> [v2:172.21.15.72:6838/3632161953,v1:172.21.15.72:6839/3632161953] conn(0x5628ac4851f0 0x5628ac4855d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.308+0000 7f3907419740 4 client.4704 mds_command: new command op to 4259 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-13T00:01:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.308+0000 7f3907419740 1 -- 172.21.15.72:0/908763360 --> [v2:172.21.15.72:6838/3632161953,v1:172.21.15.72:6839/3632161953] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f38f80367c0 con 0x5628ac4851f0 2023-12-13T00:01:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.309+0000 7f3901d44640 1 --2- 172.21.15.72:0/908763360 >> [v2:172.21.15.72:6838/3632161953,v1:172.21.15.72:6839/3632161953] conn(0x5628ac4851f0 0x5628ac4855d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.311+0000 7f3901d44640 1 --2- 172.21.15.72:0/908763360 >> [v2:172.21.15.72:6838/3632161953,v1:172.21.15.72:6839/3632161953] conn(0x5628ac4851f0 0x5628ac4855d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d7b40cb97c9207de server_cookie=b0bc0fd7527a9d45 in_seq=0 out_seq=0 2023-12-13T00:01:24.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.311+0000 7f38dd7fa640 10 client.4704 ms_handle_connect on v2:172.21.15.72:6838/3632161953 2023-12-13T00:01:24.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.328+0000 7f38dd7fa640 1 -- 172.21.15.72:0/908763360 <== mds.2 v2:172.21.15.72:6838/3632161953 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7f38f80367c0 con 0x5628ac4851f0 2023-12-13T00:01:24.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.328+0000 7f38dd7fa640 10 client.4704 handle_command_reply: tid=0 2023-12-13T00:01:24.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.329+0000 7f3907419740 1 client.4704 shutdown 2023-12-13T00:01:24.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.329+0000 7f3907419740 1 -- 172.21.15.72:0/908763360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac45b050 msgr2=0x5628ac510fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.329+0000 7f3907419740 1 --2- 172.21.15.72:0/908763360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac45b050 0x5628ac510fe0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f38f8006f30 tx=0x7f38f8030070 comp rx=0 tx=0).stop 2023-12-13T00:01:24.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.329+0000 7f3907419740 1 -- 172.21.15.72:0/908763360 shutdown_connections 2023-12-13T00:01:24.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.329+0000 7f3907419740 1 --2- 172.21.15.72:0/908763360 >> [v2:172.21.15.72:6838/3632161953,v1:172.21.15.72:6839/3632161953] conn(0x5628ac4851f0 0x5628ac4855d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.329+0000 7f3907419740 1 --2- 172.21.15.72:0/908763360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628ac486a30 0x5628ac50ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.329+0000 7f3907419740 1 --2- 172.21.15.72:0/908763360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628ac484b90 0x5628ac45b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.329+0000 7f3907419740 1 --2- 172.21.15.72:0/908763360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5628ac45b050 0x5628ac510fe0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.329+0000 7f38dd7fa640 0 client.4704 ms_handle_reset on v2:172.21.15.72:6838/3632161953 2023-12-13T00:01:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.329+0000 7f3907419740 1 -- 172.21.15.72:0/908763360 >> 172.21.15.72:0/908763360 conn(0x5628ac45ac70 msgr2=0x5628ac49b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.329+0000 7f3907419740 1 -- 172.21.15.72:0/908763360 shutdown_connections 2023-12-13T00:01:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.329+0000 7f3907419740 1 -- 172.21.15.72:0/908763360 wait complete. 2023-12-13T00:01:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.329+0000 7f3907419740 20 client.4704 trim_cache size 0 max 16384 2023-12-13T00:01:24.331 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-12-13T00:01:24.332 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d", 2023-12-13T00:01:24.332 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 2, 2023-12-13T00:01:24.332 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4259, 2023-12-13T00:01:24.332 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-12-13T00:01:24.332 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-12-13T00:01:24.332 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-12-13T00:01:24.332 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 18.771802247, 2023-12-13T00:01:24.332 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 14, 2023-12-13T00:01:24.332 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 27, 2023-12-13T00:01:24.332 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 27, 2023-12-13T00:01:24.332 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 63.009697342999999 2023-12-13T00:01:24.332 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-12-13T00:01:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.329+0000 7f39047a9640 1 -- 172.21.15.72:0/3328105410 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f38e006b180 msgr2=0x7f38e006d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.329+0000 7f39047a9640 1 --2- 172.21.15.72:0/3328105410 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f38e006b180 0x7f38e006d640 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f38f8044000 tx=0x7f38f8008030 comp rx=0 tx=0).stop 2023-12-13T00:01:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.329+0000 7f39047a9640 1 -- 172.21.15.72:0/3328105410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38fc150530 msgr2=0x7f38fc14a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.329+0000 7f39047a9640 1 --2- 172.21.15.72:0/3328105410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38fc150530 0x7f38fc14a700 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00c3f0 tx=0x7f38ec00c8b0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.330+0000 7f39047a9640 1 -- 172.21.15.72:0/3328105410 shutdown_connections 2023-12-13T00:01:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.330+0000 7f39047a9640 1 --2- 172.21.15.72:0/3328105410 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f38e006b180 0x7f38e006d640 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.330+0000 7f39047a9640 1 --2- 172.21.15.72:0/3328105410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38fc1596e0 0x7f38fc06e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.330+0000 7f39047a9640 1 --2- 172.21.15.72:0/3328105410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38fc150530 0x7f38fc14a700 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.330+0000 7f39047a9640 1 --2- 172.21.15.72:0/3328105410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38fc0c7180 0x7f38fc158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.330+0000 7f39047a9640 1 -- 172.21.15.72:0/3328105410 >> 172.21.15.72:0/3328105410 conn(0x7f38fc06c5f0 msgr2=0x7f38fc070c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.330+0000 7f39047a9640 1 -- 172.21.15.72:0/3328105410 shutdown_connections 2023-12-13T00:01:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.330+0000 7f39047a9640 1 -- 172.21.15.72:0/3328105410 wait complete. 2023-12-13T00:01:24.341 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-13T00:01:24.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.443+0000 7fd8de448640 1 Processor -- start 2023-12-13T00:01:24.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.443+0000 7fd8de448640 1 -- start start 2023-12-13T00:01:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.444+0000 7fd8de448640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd8d80c44d0 0x7fd8d80c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.444+0000 7fd8de448640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd8d81596e0 0x7fd8d8159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.444+0000 7fd8de448640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d8150910 con 0x7fd8d8150530 2023-12-13T00:01:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.444+0000 7fd8de448640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d80c1ec0 con 0x7fd8d80c44d0 2023-12-13T00:01:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.444+0000 7fd8de448640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d815a4e0 con 0x7fd8d81596e0 2023-12-13T00:01:24.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.445+0000 7fd8d77fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd8d80c44d0 0x7fd8d80c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.445+0000 7fd8d77fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd8d80c44d0 0x7fd8d80c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48480/0 (socket says 172.21.15.72:48480) 2023-12-13T00:01:24.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.445+0000 7fd8d77fe640 1 -- 172.21.15.72:0/1494397939 learned_addr learned my addr 172.21.15.72:0/1494397939 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:24.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.445+0000 7fd8dc9e5640 1 --2- 172.21.15.72:0/1494397939 >> v2:172.21.15.176:3300/0 conn(0x7fd8d81596e0 0x7fd8d8159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.447+0000 7fd8d77fe640 1 -- 172.21.15.72:0/1494397939 >> v2:172.21.15.176:3300/0 conn(0x7fd8d81596e0 msgr2=0x7fd8d8159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.447+0000 7fd8d77fe640 1 --2- 172.21.15.72:0/1494397939 >> v2:172.21.15.176:3300/0 conn(0x7fd8d81596e0 0x7fd8d8159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.447+0000 7fd8d77fe640 1 -- 172.21.15.72:0/1494397939 >> v1:172.21.15.176:6789/0 conn(0x7fd8d8150530 legacy=0x7fd8d80c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.447+0000 7fd8d77fe640 1 -- 172.21.15.72:0/1494397939 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d80c2110 con 0x7fd8d80c44d0 2023-12-13T00:01:24.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.449+0000 7fd8d77fe640 1 --2- 172.21.15.72:0/1494397939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d80c44d0 0x7fd8d80c4910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd8d806dfe0 tx=0x7fd8c802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769a676ecb9174fd server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.453+0000 7fd8d6ffd640 1 -- 172.21.15.72:0/1494397939 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c802f850 con 0x7fd8d80c44d0 2023-12-13T00:01:24.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.453+0000 7fd8d6ffd640 1 -- 172.21.15.72:0/1494397939 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c802f9b0 con 0x7fd8d80c44d0 2023-12-13T00:01:24.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.453+0000 7fd8d6ffd640 1 -- 172.21.15.72:0/1494397939 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c802fd40 con 0x7fd8d80c44d0 2023-12-13T00:01:24.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.453+0000 7fd8de448640 1 -- 172.21.15.72:0/1494397939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d80c44d0 msgr2=0x7fd8d80c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.453+0000 7fd8de448640 1 --2- 172.21.15.72:0/1494397939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d80c44d0 0x7fd8d80c4910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd8d806dfe0 tx=0x7fd8c802ba30 comp rx=0 tx=0).stop 2023-12-13T00:01:24.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.453+0000 7fd8de448640 1 -- 172.21.15.72:0/1494397939 shutdown_connections 2023-12-13T00:01:24.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.453+0000 7fd8de448640 1 --2- 172.21.15.72:0/1494397939 >> v2:172.21.15.176:3300/0 conn(0x7fd8d81596e0 0x7fd8d8159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.453+0000 7fd8de448640 1 --2- 172.21.15.72:0/1494397939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d80c44d0 0x7fd8d80c4910 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.453+0000 7fd8de448640 1 -- 172.21.15.72:0/1494397939 >> 172.21.15.72:0/1494397939 conn(0x7fd8d806c5f0 msgr2=0x7fd8d806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:24.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.453+0000 7fd8de448640 1 -- 172.21.15.72:0/1494397939 shutdown_connections 2023-12-13T00:01:24.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.453+0000 7fd8de448640 1 -- 172.21.15.72:0/1494397939 wait complete. 2023-12-13T00:01:24.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.455+0000 7fd8de448640 1 Processor -- start 2023-12-13T00:01:24.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.455+0000 7fd8de448640 1 -- start start 2023-12-13T00:01:24.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.456+0000 7fd8de448640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d80c44d0 0x7fd8d8146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.456+0000 7fd8de448640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8d8150530 0x7fd8d814c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.456+0000 7fd8de448640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8d81596e0 0x7fd8d81f0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.456+0000 7fd8de448640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d8147a10 con 0x7fd8d80c44d0 2023-12-13T00:01:24.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.456+0000 7fd8de448640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d81f07f0 con 0x7fd8d8150530 2023-12-13T00:01:24.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.456+0000 7fd8de448640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d81f0ad0 con 0x7fd8d81596e0 2023-12-13T00:01:24.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.456+0000 7fd8d7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d80c44d0 0x7fd8d8146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.456+0000 7fd8d77fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8d8150530 0x7fd8d814c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.456+0000 7fd8dc9e5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8d81596e0 0x7fd8d81f0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.456+0000 7fd8d7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d80c44d0 0x7fd8d8146d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48488/0 (socket says 172.21.15.72:48488) 2023-12-13T00:01:24.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.456+0000 7fd8d7fff640 1 -- 172.21.15.72:0/4072598277 learned_addr learned my addr 172.21.15.72:0/4072598277 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:24.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.460+0000 7fd8d7fff640 1 -- 172.21.15.72:0/4072598277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8d81596e0 msgr2=0x7fd8d81f0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.460+0000 7fd8d7fff640 1 --2- 172.21.15.72:0/4072598277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8d81596e0 0x7fd8d81f0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.460+0000 7fd8d7fff640 1 -- 172.21.15.72:0/4072598277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8d8150530 msgr2=0x7fd8d814c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.460+0000 7fd8d7fff640 1 --2- 172.21.15.72:0/4072598277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8d8150530 0x7fd8d814c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.460+0000 7fd8d7fff640 1 -- 172.21.15.72:0/4072598277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c80094d0 con 0x7fd8d80c44d0 2023-12-13T00:01:24.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.464+0000 7fd8d7fff640 1 --2- 172.21.15.72:0/4072598277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d80c44d0 0x7fd8d8146d10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00c460 tx=0x7fd8cc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.468+0000 7fd8d4ff9640 1 -- 172.21.15.72:0/4072598277 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc0052d0 con 0x7fd8d80c44d0 2023-12-13T00:01:24.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.468+0000 7fd8d4ff9640 1 -- 172.21.15.72:0/4072598277 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc005450 con 0x7fd8d80c44d0 2023-12-13T00:01:24.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.468+0000 7fd8d4ff9640 1 -- 172.21.15.72:0/4072598277 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc007260 con 0x7fd8d80c44d0 2023-12-13T00:01:24.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.468+0000 7fd8de448640 1 -- 172.21.15.72:0/4072598277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d81540c0 con 0x7fd8d80c44d0 2023-12-13T00:01:24.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.468+0000 7fd8de448640 1 -- 172.21.15.72:0/4072598277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d8154680 con 0x7fd8d80c44d0 2023-12-13T00:01:24.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.471+0000 7fd8e0fda740 1 Processor -- start 2023-12-13T00:01:24.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.471+0000 7fd8e0fda740 1 -- start start 2023-12-13T00:01:24.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.471+0000 7fd8e0fda740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab18df290 0x55cab18df670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.471+0000 7fd8e0fda740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab1929110 0x55cab18dfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.471+0000 7fd8e0fda740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cab18ddcf0 0x55cab191eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.471+0000 7fd8e0fda740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab184d020 con 0x55cab18ddcf0 2023-12-13T00:01:24.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.471+0000 7fd8e0fda740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab184a710 con 0x55cab1929110 2023-12-13T00:01:24.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.471+0000 7fd8e0fda740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cab1846000 con 0x55cab18df290 2023-12-13T00:01:24.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.472+0000 7fd8dc9e5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab18df290 0x55cab18df670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.473+0000 7fd8dc9e5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab18df290 0x55cab18df670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:39924/0 (socket says 172.21.15.72:39924) 2023-12-13T00:01:24.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.473+0000 7fd8dc9e5640 1 -- 172.21.15.72:0/2270224508 learned_addr learned my addr 172.21.15.72:0/2270224508 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:24.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.473+0000 7fd8d7fff640 1 --2- 172.21.15.72:0/2270224508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab1929110 0x55cab18dfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.475+0000 7fd8dc9e5640 1 -- 172.21.15.72:0/2270224508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab1929110 msgr2=0x55cab18dfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.475+0000 7fd8dc9e5640 1 --2- 172.21.15.72:0/2270224508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab1929110 0x55cab18dfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.475+0000 7fd8dc9e5640 1 -- 172.21.15.72:0/2270224508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cab18ddcf0 msgr2=0x55cab191eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.475+0000 7fd8dc9e5640 1 --2- 172.21.15.72:0/2270224508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cab18ddcf0 0x55cab191eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.475+0000 7fd8dc9e5640 1 -- 172.21.15.72:0/2270224508 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cab1808c90 con 0x55cab18df290 2023-12-13T00:01:24.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.477+0000 7fd8dc9e5640 1 --2- 172.21.15.72:0/2270224508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab18df290 0x55cab18df670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0011550 tx=0x7fd8d0009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3929d430edad2719 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.482+0000 7fd8bdffb640 1 -- 172.21.15.72:0/2270224508 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d000e040 con 0x55cab18df290 2023-12-13T00:01:24.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.482+0000 7fd8bdffb640 1 -- 172.21.15.72:0/2270224508 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d000f040 con 0x55cab18df290 2023-12-13T00:01:24.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.482+0000 7fd8bdffb640 1 -- 172.21.15.72:0/2270224508 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0015a40 con 0x55cab18df290 2023-12-13T00:01:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.483+0000 7fd8e0fda740 1 -- 172.21.15.72:0/2270224508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab18df290 msgr2=0x55cab18df670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.483+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/2270224508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab18df290 0x55cab18df670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0011550 tx=0x7fd8d0009750 comp rx=0 tx=0).stop 2023-12-13T00:01:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.483+0000 7fd8e0fda740 1 -- 172.21.15.72:0/2270224508 shutdown_connections 2023-12-13T00:01:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.483+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/2270224508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cab18ddcf0 0x55cab191eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.483+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/2270224508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab1929110 0x55cab18dfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.483+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/2270224508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab18df290 0x55cab18df670 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.483+0000 7fd8e0fda740 1 -- 172.21.15.72:0/2270224508 >> 172.21.15.72:0/2270224508 conn(0x55cab18dbc90 msgr2=0x55cab18de340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:24.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.483+0000 7fd8e0fda740 1 -- 172.21.15.72:0/2270224508 shutdown_connections 2023-12-13T00:01:24.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.483+0000 7fd8e0fda740 1 -- 172.21.15.72:0/2270224508 wait complete. 2023-12-13T00:01:24.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.484+0000 7fd8e0fda740 1 -- start start 2023-12-13T00:01:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.484+0000 7fd8e0fda740 1 Processor -- start 2023-12-13T00:01:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.485+0000 7fd8e0fda740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab18df290 0x55cab1927990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.485+0000 7fd8e0fda740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cab1929110 0x55cab192f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.485+0000 7fd8e0fda740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab19226c0 0x55cab1923950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.485+0000 7fd8e0fda740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab17ffe00 con 0x55cab1929110 2023-12-13T00:01:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.485+0000 7fd8e0fda740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab17ffaa0 con 0x55cab19226c0 2023-12-13T00:01:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.485+0000 7fd8e0fda740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cab17c5270 con 0x55cab18df290 2023-12-13T00:01:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.485+0000 7fd8e0fda740 10 client.0 _ll_register_callbacks cb 0x55cab1557ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-13T00:01:24.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.485+0000 7fd8d77fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab19226c0 0x55cab1923950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.485+0000 7fd8dc9e5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab18df290 0x55cab1927990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.486+0000 7fd8d77fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab19226c0 0x55cab1923950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:44352/0 (socket says 172.21.15.72:44352) 2023-12-13T00:01:24.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.486+0000 7fd8d77fe640 1 -- 172.21.15.72:0/2134408361 learned_addr learned my addr 172.21.15.72:0/2134408361 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:24.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.489+0000 7fd8d4ff9640 1 -- 172.21.15.72:0/4072598277 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd8cc007400 con 0x7fd8d80c44d0 2023-12-13T00:01:24.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.489+0000 7fd8d4ff9640 1 --2- 172.21.15.72:0/4072598277 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd8c406b180 0x7fd8c406d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.489+0000 7fd8dc9e5640 1 --2- 172.21.15.72:0/4072598277 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd8c406b180 0x7fd8c406d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.490+0000 7fd8dc9e5640 1 --2- 172.21.15.72:0/4072598277 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd8c406b180 0x7fd8c406d640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0012010 tx=0x7fd8d0014000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.490+0000 7fd8d77fe640 1 -- 172.21.15.72:0/2134408361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab18df290 msgr2=0x55cab1927990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.490+0000 7fd8d77fe640 1 --2- 172.21.15.72:0/2134408361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab18df290 0x55cab1927990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.490+0000 7fd8d77fe640 1 -- 172.21.15.72:0/2134408361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cab1929110 msgr2=0x55cab192f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.490+0000 7fd8d77fe640 1 --2- 172.21.15.72:0/2134408361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cab1929110 0x55cab192f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.490+0000 7fd8d77fe640 1 -- 172.21.15.72:0/2134408361 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d0011230 con 0x55cab19226c0 2023-12-13T00:01:24.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.492+0000 7fd8d4ff9640 1 -- 172.21.15.72:0/4072598277 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fd8cc05adf0 con 0x7fd8d80c44d0 2023-12-13T00:01:24.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.493+0000 7fd8d77fe640 1 --2- 172.21.15.72:0/2134408361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab19226c0 0x55cab1923950 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8009930 tx=0x7fd8c80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45b47b9e016ee3c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.493+0000 7fd8b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2023-12-13T00:01:24.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.496+0000 7fd8b6ffd640 1 -- 172.21.15.72:0/2134408361 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c803b040 con 0x55cab19226c0 2023-12-13T00:01:24.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.496+0000 7fd8b6ffd640 1 -- 172.21.15.72:0/2134408361 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fd8c8040810 con 0x55cab19226c0 2023-12-13T00:01:24.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.496+0000 7fd8e0fda740 1 -- 172.21.15.72:0/2134408361 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cab183ee90 con 0x55cab19226c0 2023-12-13T00:01:24.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.498+0000 7fd8b6ffd640 1 -- 172.21.15.72:0/2134408361 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8c80409d0 con 0x55cab19226c0 2023-12-13T00:01:24.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.498+0000 7fd8e0fda740 10 client.4765 fetch_fsmap learned FSMap version 14 2023-12-13T00:01:24.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.498+0000 7fd8e0fda740 1 -- 172.21.15.72:0/2134408361 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55cab1844680 con 0x55cab19226c0 2023-12-13T00:01:24.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.504+0000 7fd8b6ffd640 1 -- 172.21.15.72:0/2134408361 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cab183ee90 con 0x55cab19226c0 2023-12-13T00:01:24.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.504+0000 7fd8b6ffd640 1 -- 172.21.15.72:0/2134408361 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7fd8c8035020 con 0x55cab19226c0 2023-12-13T00:01:24.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.504+0000 7fd8e0fda740 10 client.4765 fetch_fsmap finished waiting for FSMap version 14 2023-12-13T00:01:24.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.504+0000 7fd8e0fda740 10 client.4765 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-13T00:01:24.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.504+0000 7fd8e0fda740 20 client.4765 populate_metadata read hostname 'smithi072' 2023-12-13T00:01:24.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.504+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/2134408361 >> [v2:172.21.15.72:6834/3954648997,v1:172.21.15.72:6835/3954648997] conn(0x55cab19335e0 0x55cab1907be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.504+0000 7fd8e0fda740 4 client.4765 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-13T00:01:24.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.504+0000 7fd8e0fda740 1 -- 172.21.15.72:0/2134408361 --> [v2:172.21.15.72:6834/3954648997,v1:172.21.15.72:6835/3954648997] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cab183ebb0 con 0x55cab19335e0 2023-12-13T00:01:24.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.504+0000 7fd8d7fff640 1 --2- 172.21.15.72:0/2134408361 >> [v2:172.21.15.72:6834/3954648997,v1:172.21.15.72:6835/3954648997] conn(0x55cab19335e0 0x55cab1907be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.544+0000 7fd8d7fff640 1 --2- 172.21.15.72:0/2134408361 >> [v2:172.21.15.72:6834/3954648997,v1:172.21.15.72:6835/3954648997] conn(0x55cab19335e0 0x55cab1907be0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=95a54fdd59a9d392 server_cookie=dc4e19002561ee1d in_seq=0 out_seq=0 2023-12-13T00:01:24.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.544+0000 7fd8b6ffd640 10 client.4765 ms_handle_connect on v2:172.21.15.72:6834/3954648997 2023-12-13T00:01:24.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.648+0000 7fd8b6ffd640 1 -- 172.21.15.72:0/2134408361 <== mds.1 v2:172.21.15.72:6834/3954648997 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cab183ebb0 con 0x55cab19335e0 2023-12-13T00:01:24.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.648+0000 7fd8b6ffd640 10 client.4765 handle_command_reply: tid=0 2023-12-13T00:01:24.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.648+0000 7fd8e0fda740 1 client.4765 shutdown 2023-12-13T00:01:24.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.648+0000 7fd8e0fda740 1 -- 172.21.15.72:0/2134408361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab19226c0 msgr2=0x55cab1923950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.648+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/2134408361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab19226c0 0x55cab1923950 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8009930 tx=0x7fd8c80046c0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.648+0000 7fd8e0fda740 1 -- 172.21.15.72:0/2134408361 shutdown_connections 2023-12-13T00:01:24.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.648+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/2134408361 >> [v2:172.21.15.72:6834/3954648997,v1:172.21.15.72:6835/3954648997] conn(0x55cab19335e0 0x55cab1907be0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.648+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/2134408361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab19226c0 0x55cab1923950 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.648+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/2134408361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cab1929110 0x55cab192f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.648+0000 7fd8b6ffd640 0 client.4765 ms_handle_reset on v2:172.21.15.72:6834/3954648997 2023-12-13T00:01:24.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.648+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/2134408361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab18df290 0x55cab1927990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.648+0000 7fd8e0fda740 1 -- 172.21.15.72:0/2134408361 >> 172.21.15.72:0/2134408361 conn(0x55cab18ddcf0 msgr2=0x55cab18df670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:24.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.648+0000 7fd8e0fda740 1 -- 172.21.15.72:0/2134408361 shutdown_connections 2023-12-13T00:01:24.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.648+0000 7fd8e0fda740 1 -- 172.21.15.72:0/2134408361 wait complete. 2023-12-13T00:01:24.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.648+0000 7fd8e0fda740 20 client.4765 trim_cache size 0 max 16384 2023-12-13T00:01:24.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.664+0000 7fd8e0fda740 1 Processor -- start 2023-12-13T00:01:24.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.664+0000 7fd8e0fda740 1 -- start start 2023-12-13T00:01:24.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.664+0000 7fd8e0fda740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab18df290 0x55cab18d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.664+0000 7fd8e0fda740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab19226c0 0x55cab18d56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.664+0000 7fd8e0fda740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cab1929110 0x55cab18d8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.664+0000 7fd8e0fda740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab19224f0 con 0x55cab1929110 2023-12-13T00:01:24.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.664+0000 7fd8e0fda740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab192fd30 con 0x55cab18df290 2023-12-13T00:01:24.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.664+0000 7fd8e0fda740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cab1928250 con 0x55cab19226c0 2023-12-13T00:01:24.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.665+0000 7fd8d7fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab18df290 0x55cab18d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.665+0000 7fd8d7fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab18df290 0x55cab18d5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:44362/0 (socket says 172.21.15.72:44362) 2023-12-13T00:01:24.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.665+0000 7fd8d7fff640 1 -- 172.21.15.72:0/1713621408 learned_addr learned my addr 172.21.15.72:0/1713621408 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:24.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.667+0000 7fd8d7fff640 1 -- 172.21.15.72:0/1713621408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab19226c0 msgr2=0x55cab18d56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.667+0000 7fd8d7fff640 1 --2- 172.21.15.72:0/1713621408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab19226c0 0x55cab18d56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.667+0000 7fd8d7fff640 1 -- 172.21.15.72:0/1713621408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cab1929110 msgr2=0x55cab18d8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.667+0000 7fd8d7fff640 1 --2- 172.21.15.72:0/1713621408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cab1929110 0x55cab18d8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.667+0000 7fd8d7fff640 1 -- 172.21.15.72:0/1713621408 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cab17e1d00 con 0x55cab18df290 2023-12-13T00:01:24.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.669+0000 7fd8d7fff640 1 --2- 172.21.15.72:0/1713621408 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab18df290 0x55cab18d5160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc05a3f0 tx=0x7fd8cc001220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79b00155bd9129ed server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.673+0000 7fd8be7fc640 1 -- 172.21.15.72:0/1713621408 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc0588f0 con 0x55cab18df290 2023-12-13T00:01:24.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.673+0000 7fd8be7fc640 1 -- 172.21.15.72:0/1713621408 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc056e00 con 0x55cab18df290 2023-12-13T00:01:24.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.673+0000 7fd8be7fc640 1 -- 172.21.15.72:0/1713621408 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc059e00 con 0x55cab18df290 2023-12-13T00:01:24.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.673+0000 7fd8e0fda740 1 -- 172.21.15.72:0/1713621408 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab18df290 msgr2=0x55cab18d5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.673+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/1713621408 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab18df290 0x55cab18d5160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc05a3f0 tx=0x7fd8cc001220 comp rx=0 tx=0).stop 2023-12-13T00:01:24.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.673+0000 7fd8e0fda740 1 -- 172.21.15.72:0/1713621408 shutdown_connections 2023-12-13T00:01:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.673+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/1713621408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cab1929110 0x55cab18d8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.673+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/1713621408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab19226c0 0x55cab18d56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.673+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/1713621408 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab18df290 0x55cab18d5160 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.673+0000 7fd8e0fda740 1 -- 172.21.15.72:0/1713621408 >> 172.21.15.72:0/1713621408 conn(0x55cab18ddcf0 msgr2=0x55cab1942310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.673+0000 7fd8e0fda740 1 -- 172.21.15.72:0/1713621408 shutdown_connections 2023-12-13T00:01:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.673+0000 7fd8e0fda740 1 -- 172.21.15.72:0/1713621408 wait complete. 2023-12-13T00:01:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.674+0000 7fd8e0fda740 1 -- start start 2023-12-13T00:01:24.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.674+0000 7fd8e0fda740 1 Processor -- start 2023-12-13T00:01:24.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.675+0000 7fd8e0fda740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab18df290 0x55cab18d8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.675+0000 7fd8e0fda740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab19226c0 0x55cab1983fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.675+0000 7fd8e0fda740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cab1929110 0x55cab1984510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.675+0000 7fd8e0fda740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab18da1f0 con 0x55cab1929110 2023-12-13T00:01:24.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.675+0000 7fd8e0fda740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab18d9380 con 0x55cab18df290 2023-12-13T00:01:24.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.675+0000 7fd8e0fda740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cab18fd230 con 0x55cab19226c0 2023-12-13T00:01:24.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.675+0000 7fd8e0fda740 10 client.0 _ll_register_callbacks cb 0x7fd8d0009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-13T00:01:24.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.675+0000 7fd8d7fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab18df290 0x55cab18d8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.676+0000 7fd8d7fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab18df290 0x55cab18d8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:44374/0 (socket says 172.21.15.72:44374) 2023-12-13T00:01:24.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.676+0000 7fd8d7fff640 1 -- 172.21.15.72:0/1242350560 learned_addr learned my addr 172.21.15.72:0/1242350560 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:24.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.678+0000 7fd8d7fff640 1 -- 172.21.15.72:0/1242350560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab19226c0 msgr2=0x55cab1983fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.678+0000 7fd8d7fff640 1 --2- 172.21.15.72:0/1242350560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab19226c0 0x55cab1983fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.678+0000 7fd8d7fff640 1 -- 172.21.15.72:0/1242350560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cab1929110 msgr2=0x55cab1984510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.678+0000 7fd8d7fff640 1 --2- 172.21.15.72:0/1242350560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cab1929110 0x55cab1984510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.678+0000 7fd8d7fff640 1 -- 172.21.15.72:0/1242350560 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d8154680 con 0x55cab18df290 2023-12-13T00:01:24.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.682+0000 7fd8d7fff640 1 --2- 172.21.15.72:0/1242350560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab18df290 0x55cab18d8e40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc000fb0 tx=0x7fd8cc000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=835e6ea94beeca25 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.682+0000 7fd8b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2023-12-13T00:01:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.733+0000 7fd8b6ffd640 1 -- 172.21.15.72:0/1242350560 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc0588f0 con 0x55cab18df290 2023-12-13T00:01:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.733+0000 7fd8b6ffd640 1 -- 172.21.15.72:0/1242350560 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fd8cc056f70 con 0x55cab18df290 2023-12-13T00:01:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.733+0000 7fd8e0fda740 1 -- 172.21.15.72:0/1242350560 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd8d000f040 con 0x55cab18df290 2023-12-13T00:01:24.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.737+0000 7fd8b6ffd640 1 -- 172.21.15.72:0/1242350560 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8cc062560 con 0x55cab18df290 2023-12-13T00:01:24.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.737+0000 7fd8e0fda740 10 client.4771 fetch_fsmap learned FSMap version 14 2023-12-13T00:01:24.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.737+0000 7fd8e0fda740 1 -- 172.21.15.72:0/1242350560 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55cab18074f0 con 0x55cab18df290 2023-12-13T00:01:24.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.741+0000 7fd8b6ffd640 1 -- 172.21.15.72:0/1242350560 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d000f040 con 0x55cab18df290 2023-12-13T00:01:24.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.741+0000 7fd8b6ffd640 1 -- 172.21.15.72:0/1242350560 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7fd8cc074070 con 0x55cab18df290 2023-12-13T00:01:24.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.742+0000 7fd8e0fda740 10 client.4771 fetch_fsmap finished waiting for FSMap version 14 2023-12-13T00:01:24.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.742+0000 7fd8e0fda740 10 client.4771 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-13T00:01:24.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.742+0000 7fd8e0fda740 20 client.4771 populate_metadata read hostname 'smithi072' 2023-12-13T00:01:24.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.742+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/1242350560 >> [v2:172.21.15.72:6834/3954648997,v1:172.21.15.72:6835/3954648997] conn(0x55cab198d930 0x55cab198dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.742+0000 7fd8e0fda740 4 client.4771 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-13T00:01:24.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.742+0000 7fd8e0fda740 1 -- 172.21.15.72:0/1242350560 --> [v2:172.21.15.72:6834/3954648997,v1:172.21.15.72:6835/3954648997] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cab15466c0 con 0x55cab198d930 2023-12-13T00:01:24.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.742+0000 7fd8d77fe640 1 --2- 172.21.15.72:0/1242350560 >> [v2:172.21.15.72:6834/3954648997,v1:172.21.15.72:6835/3954648997] conn(0x55cab198d930 0x55cab198dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.745+0000 7fd8d77fe640 1 --2- 172.21.15.72:0/1242350560 >> [v2:172.21.15.72:6834/3954648997,v1:172.21.15.72:6835/3954648997] conn(0x55cab198d930 0x55cab198dd10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ad17ad7ca6a19a3a server_cookie=a8f8324ed97f70b3 in_seq=0 out_seq=0 2023-12-13T00:01:24.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.745+0000 7fd8b6ffd640 10 client.4771 ms_handle_connect on v2:172.21.15.72:6834/3954648997 2023-12-13T00:01:24.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.763+0000 7fd8b6ffd640 1 -- 172.21.15.72:0/1242350560 <== mds.1 v2:172.21.15.72:6834/3954648997 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55cab15466c0 con 0x55cab198d930 2023-12-13T00:01:24.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.763+0000 7fd8b6ffd640 10 client.4771 handle_command_reply: tid=0 2023-12-13T00:01:24.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.763+0000 7fd8e0fda740 1 client.4771 shutdown 2023-12-13T00:01:24.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.763+0000 7fd8e0fda740 1 -- 172.21.15.72:0/1242350560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab18df290 msgr2=0x55cab18d8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.763+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/1242350560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab18df290 0x55cab18d8e40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc000fb0 tx=0x7fd8cc000bc0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.763+0000 7fd8e0fda740 1 -- 172.21.15.72:0/1242350560 shutdown_connections 2023-12-13T00:01:24.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.763+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/1242350560 >> [v2:172.21.15.72:6834/3954648997,v1:172.21.15.72:6835/3954648997] conn(0x55cab198d930 0x55cab198dd10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.763+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/1242350560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cab1929110 0x55cab1984510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.763+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/1242350560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cab19226c0 0x55cab1983fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.763+0000 7fd8e0fda740 1 --2- 172.21.15.72:0/1242350560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cab18df290 0x55cab18d8e40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.763+0000 7fd8b6ffd640 0 client.4771 ms_handle_reset on v2:172.21.15.72:6834/3954648997 2023-12-13T00:01:24.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.763+0000 7fd8e0fda740 1 -- 172.21.15.72:0/1242350560 >> 172.21.15.72:0/1242350560 conn(0x55cab18ddcf0 msgr2=0x55cab18fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:24.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.763+0000 7fd8e0fda740 1 -- 172.21.15.72:0/1242350560 shutdown_connections 2023-12-13T00:01:24.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.763+0000 7fd8e0fda740 1 -- 172.21.15.72:0/1242350560 wait complete. 2023-12-13T00:01:24.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.763+0000 7fd8e0fda740 20 client.4771 trim_cache size 0 max 16384 2023-12-13T00:01:24.766 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-12-13T00:01:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d", 2023-12-13T00:01:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 1, 2023-12-13T00:01:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4264, 2023-12-13T00:01:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-12-13T00:01:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-12-13T00:01:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-12-13T00:01:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 21.698254513999998, 2023-12-13T00:01:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 14, 2023-12-13T00:01:24.767 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 27, 2023-12-13T00:01:24.767 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 27, 2023-12-13T00:01:24.767 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 63.555690562999999 2023-12-13T00:01:24.767 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-12-13T00:01:24.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.764+0000 7fd8de448640 1 -- 172.21.15.72:0/4072598277 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd8c406b180 msgr2=0x7fd8c406d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.764+0000 7fd8de448640 1 --2- 172.21.15.72:0/4072598277 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd8c406b180 0x7fd8c406d640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0012010 tx=0x7fd8d0014000 comp rx=0 tx=0).stop 2023-12-13T00:01:24.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.764+0000 7fd8de448640 1 -- 172.21.15.72:0/4072598277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d80c44d0 msgr2=0x7fd8d8146d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.764+0000 7fd8de448640 1 --2- 172.21.15.72:0/4072598277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d80c44d0 0x7fd8d8146d10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00c460 tx=0x7fd8cc00c920 comp rx=0 tx=0).stop 2023-12-13T00:01:24.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.764+0000 7fd8de448640 1 -- 172.21.15.72:0/4072598277 shutdown_connections 2023-12-13T00:01:24.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.764+0000 7fd8de448640 1 --2- 172.21.15.72:0/4072598277 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd8c406b180 0x7fd8c406d640 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.764+0000 7fd8de448640 1 --2- 172.21.15.72:0/4072598277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8d81596e0 0x7fd8d81f0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.764+0000 7fd8de448640 1 --2- 172.21.15.72:0/4072598277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8d8150530 0x7fd8d814c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.764+0000 7fd8de448640 1 --2- 172.21.15.72:0/4072598277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d80c44d0 0x7fd8d8146d10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.764+0000 7fd8de448640 1 -- 172.21.15.72:0/4072598277 >> 172.21.15.72:0/4072598277 conn(0x7fd8d806c5f0 msgr2=0x7fd8d8073530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:24.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.764+0000 7fd8de448640 1 -- 172.21.15.72:0/4072598277 shutdown_connections 2023-12-13T00:01:24.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.764+0000 7fd8de448640 1 -- 172.21.15.72:0/4072598277 wait complete. 2023-12-13T00:01:24.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-12-13T00:01:24.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.875+0000 7faabd7bb640 1 Processor -- start 2023-12-13T00:01:24.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.875+0000 7faabd7bb640 1 -- start start 2023-12-13T00:01:24.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.876+0000 7faabd7bb640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faab80cda70 0x7faab80ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.876+0000 7faabd7bb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faab80cc420 0x7faab8159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.876+0000 7faabd7bb640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab80cbda0 con 0x7faab8159b50 2023-12-13T00:01:24.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.876+0000 7faabd7bb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab80cc230 con 0x7faab80cc420 2023-12-13T00:01:24.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.876+0000 7faabd7bb640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab80cb4e0 con 0x7faab80cda70 2023-12-13T00:01:24.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.876+0000 7faab67fc640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faab80cc420 0x7faab8159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.877+0000 7faab67fc640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faab80cc420 0x7faab8159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48532/0 (socket says 172.21.15.72:48532) 2023-12-13T00:01:24.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.877+0000 7faab67fc640 1 -- 172.21.15.72:0/4037413143 learned_addr learned my addr 172.21.15.72:0/4037413143 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:24.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.877+0000 7faab6ffd640 1 --2- 172.21.15.72:0/4037413143 >> v2:172.21.15.176:3300/0 conn(0x7faab80cda70 0x7faab80ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.879+0000 7faab67fc640 1 -- 172.21.15.72:0/4037413143 >> v2:172.21.15.176:3300/0 conn(0x7faab80cda70 msgr2=0x7faab80ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.879+0000 7faab67fc640 1 --2- 172.21.15.72:0/4037413143 >> v2:172.21.15.176:3300/0 conn(0x7faab80cda70 0x7faab80ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.879+0000 7faab67fc640 1 -- 172.21.15.72:0/4037413143 >> v1:172.21.15.176:6789/0 conn(0x7faab8159b50 legacy=0x7faab80c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.879+0000 7faab67fc640 1 -- 172.21.15.72:0/4037413143 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab80cce00 con 0x7faab80cc420 2023-12-13T00:01:24.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.880+0000 7faab67fc640 1 --2- 172.21.15.72:0/4037413143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faab80cc420 0x7faab8159610 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faab8072a20 tx=0x7faaac02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b42fc21a862a572 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.884+0000 7faab5ffb640 1 -- 172.21.15.72:0/4037413143 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac02f850 con 0x7faab80cc420 2023-12-13T00:01:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.884+0000 7faab5ffb640 1 -- 172.21.15.72:0/4037413143 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaac02f9b0 con 0x7faab80cc420 2023-12-13T00:01:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.884+0000 7faab5ffb640 1 -- 172.21.15.72:0/4037413143 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac02fd40 con 0x7faab80cc420 2023-12-13T00:01:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.885+0000 7faabd7bb640 1 -- 172.21.15.72:0/4037413143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faab80cc420 msgr2=0x7faab8159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.885+0000 7faabd7bb640 1 --2- 172.21.15.72:0/4037413143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faab80cc420 0x7faab8159610 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faab8072a20 tx=0x7faaac02ba30 comp rx=0 tx=0).stop 2023-12-13T00:01:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.885+0000 7faabd7bb640 1 -- 172.21.15.72:0/4037413143 shutdown_connections 2023-12-13T00:01:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.885+0000 7faabd7bb640 1 --2- 172.21.15.72:0/4037413143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faab80cc420 0x7faab8159610 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.885+0000 7faabd7bb640 1 --2- 172.21.15.72:0/4037413143 >> v2:172.21.15.176:3300/0 conn(0x7faab80cda70 0x7faab80ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.885+0000 7faabd7bb640 1 -- 172.21.15.72:0/4037413143 >> 172.21.15.72:0/4037413143 conn(0x7faab80b07b0 msgr2=0x7faab80b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:24.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.885+0000 7faabd7bb640 1 -- 172.21.15.72:0/4037413143 shutdown_connections 2023-12-13T00:01:24.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.885+0000 7faabd7bb640 1 -- 172.21.15.72:0/4037413143 wait complete. 2023-12-13T00:01:24.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.886+0000 7faabd7bb640 1 Processor -- start 2023-12-13T00:01:24.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.886+0000 7faabd7bb640 1 -- start start 2023-12-13T00:01:24.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.887+0000 7faabd7bb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faab80cc420 0x7faab80b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.887+0000 7faabd7bb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faab80cda70 0x7faab81f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.887+0000 7faabd7bb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faab8159b50 0x7faab8156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.887+0000 7faabd7bb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab80b3ec0 con 0x7faab80cc420 2023-12-13T00:01:24.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.887+0000 7faabd7bb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab80b2600 con 0x7faab80cda70 2023-12-13T00:01:24.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.887+0000 7faabd7bb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab80b28e0 con 0x7faab8159b50 2023-12-13T00:01:24.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.888+0000 7faab6ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faab80cc420 0x7faab80b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.888+0000 7faab67fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faab80cda70 0x7faab81f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.888+0000 7faab6ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faab80cc420 0x7faab80b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48538/0 (socket says 172.21.15.72:48538) 2023-12-13T00:01:24.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.888+0000 7faab6ffd640 1 -- 172.21.15.72:0/3615745915 learned_addr learned my addr 172.21.15.72:0/3615745915 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:24.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.888+0000 7faab77fe640 1 --2- 172.21.15.72:0/3615745915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faab8159b50 0x7faab8156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.891+0000 7faab6ffd640 1 -- 172.21.15.72:0/3615745915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faab8159b50 msgr2=0x7faab8156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.891+0000 7faab6ffd640 1 --2- 172.21.15.72:0/3615745915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faab8159b50 0x7faab8156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.891+0000 7faab6ffd640 1 -- 172.21.15.72:0/3615745915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faab80cda70 msgr2=0x7faab81f2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.891+0000 7faab6ffd640 1 --2- 172.21.15.72:0/3615745915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faab80cda70 0x7faab81f2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.891+0000 7faab6ffd640 1 -- 172.21.15.72:0/3615745915 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0094d0 con 0x7faab80cc420 2023-12-13T00:01:24.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.893+0000 7faab6ffd640 1 --2- 172.21.15.72:0/3615745915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faab80cc420 0x7faab80b3980 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faaa800e9b0 tx=0x7faaa800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.897+0000 7faa9f7fe640 1 -- 172.21.15.72:0/3615745915 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa8009670 con 0x7faab80cc420 2023-12-13T00:01:24.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.897+0000 7faa9f7fe640 1 -- 172.21.15.72:0/3615745915 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa800c9a0 con 0x7faab80cc420 2023-12-13T00:01:24.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.897+0000 7faa9f7fe640 1 -- 172.21.15.72:0/3615745915 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa800cd50 con 0x7faab80cc420 2023-12-13T00:01:24.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.897+0000 7faabd7bb640 1 -- 172.21.15.72:0/3615745915 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab80b2bc0 con 0x7faab80cc420 2023-12-13T00:01:24.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.897+0000 7faabd7bb640 1 -- 172.21.15.72:0/3615745915 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab80b3180 con 0x7faab80cc420 2023-12-13T00:01:24.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.900+0000 7faac042a740 1 Processor -- start 2023-12-13T00:01:24.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.900+0000 7faac042a740 1 -- start start 2023-12-13T00:01:24.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.901+0000 7faac042a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d378290 0x55e20d378670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.901+0000 7faac042a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d3c2110 0x55e20d378bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.901+0000 7faac042a740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d376cf0 0x55e20d3b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.901+0000 7faac042a740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e20d2e6020 con 0x55e20d376cf0 2023-12-13T00:01:24.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.901+0000 7faac042a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e20d2e3710 con 0x55e20d3c2110 2023-12-13T00:01:24.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.901+0000 7faac042a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e20d2df000 con 0x55e20d378290 2023-12-13T00:01:24.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.901+0000 7faab77fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d378290 0x55e20d378670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.901+0000 7faab6ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d3c2110 0x55e20d378bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.901+0000 7faab6ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d3c2110 0x55e20d378bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:44396/0 (socket says 172.21.15.72:44396) 2023-12-13T00:01:24.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.901+0000 7faab6ffd640 1 -- 172.21.15.72:0/4153516176 learned_addr learned my addr 172.21.15.72:0/4153516176 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:24.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.903+0000 7faab6ffd640 1 -- 172.21.15.72:0/4153516176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d378290 msgr2=0x55e20d378670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.903+0000 7faab6ffd640 1 --2- 172.21.15.72:0/4153516176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d378290 0x55e20d378670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.903+0000 7faab6ffd640 1 -- 172.21.15.72:0/4153516176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d376cf0 msgr2=0x55e20d3b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.903+0000 7faab6ffd640 1 --2- 172.21.15.72:0/4153516176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d376cf0 0x55e20d3b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.904+0000 7faab6ffd640 1 -- 172.21.15.72:0/4153516176 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e20d2a1c90 con 0x55e20d3c2110 2023-12-13T00:01:24.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.905+0000 7faab6ffd640 1 --2- 172.21.15.72:0/4153516176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d3c2110 0x55e20d378bb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faaa8000c00 tx=0x7faaa8013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0359ddb3f4963d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.909+0000 7faa9cff9640 1 -- 172.21.15.72:0/4153516176 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa8013670 con 0x55e20d3c2110 2023-12-13T00:01:24.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.909+0000 7faa9cff9640 1 -- 172.21.15.72:0/4153516176 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa80137d0 con 0x55e20d3c2110 2023-12-13T00:01:24.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.909+0000 7faa9cff9640 1 -- 172.21.15.72:0/4153516176 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa8013b80 con 0x55e20d3c2110 2023-12-13T00:01:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.910+0000 7faac042a740 1 -- 172.21.15.72:0/4153516176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d3c2110 msgr2=0x55e20d378bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.910+0000 7faac042a740 1 --2- 172.21.15.72:0/4153516176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d3c2110 0x55e20d378bb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faaa8000c00 tx=0x7faaa8013000 comp rx=0 tx=0).stop 2023-12-13T00:01:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.910+0000 7faac042a740 1 -- 172.21.15.72:0/4153516176 shutdown_connections 2023-12-13T00:01:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.910+0000 7faac042a740 1 --2- 172.21.15.72:0/4153516176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d376cf0 0x55e20d3b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.910+0000 7faac042a740 1 --2- 172.21.15.72:0/4153516176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d3c2110 0x55e20d378bb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.910+0000 7faac042a740 1 --2- 172.21.15.72:0/4153516176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d378290 0x55e20d378670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.910+0000 7faac042a740 1 -- 172.21.15.72:0/4153516176 >> 172.21.15.72:0/4153516176 conn(0x55e20d374c90 msgr2=0x55e20d377340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.910+0000 7faac042a740 1 -- 172.21.15.72:0/4153516176 shutdown_connections 2023-12-13T00:01:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.910+0000 7faac042a740 1 -- 172.21.15.72:0/4153516176 wait complete. 2023-12-13T00:01:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.910+0000 7faac042a740 1 -- start start 2023-12-13T00:01:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.910+0000 7faac042a740 1 Processor -- start 2023-12-13T00:01:24.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.911+0000 7faac042a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d378290 0x55e20d3947b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.911+0000 7faac042a740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d3c2110 0x55e20d3ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.911+0000 7faac042a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d396680 0x55e20d39cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.911+0000 7faac042a740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e20d298e00 con 0x55e20d3c2110 2023-12-13T00:01:24.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.911+0000 7faac042a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e20d298aa0 con 0x55e20d378290 2023-12-13T00:01:24.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.911+0000 7faac042a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e20d25e270 con 0x55e20d396680 2023-12-13T00:01:24.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.911+0000 7faac042a740 10 client.0 _ll_register_callbacks cb 0x55e20cff0ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-13T00:01:24.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.912+0000 7faab77fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d378290 0x55e20d3947b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.912+0000 7faab67fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d396680 0x55e20d39cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.912+0000 7faab77fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d378290 0x55e20d3947b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:44402/0 (socket says 172.21.15.72:44402) 2023-12-13T00:01:24.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.912+0000 7faab77fe640 1 -- 172.21.15.72:0/1943272086 learned_addr learned my addr 172.21.15.72:0/1943272086 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:24.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.915+0000 7faab77fe640 1 -- 172.21.15.72:0/1943272086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d396680 msgr2=0x55e20d39cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.915+0000 7faab77fe640 1 --2- 172.21.15.72:0/1943272086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d396680 0x55e20d39cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.915+0000 7faab77fe640 1 -- 172.21.15.72:0/1943272086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d3c2110 msgr2=0x55e20d3ba4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.915+0000 7faab77fe640 1 --2- 172.21.15.72:0/1943272086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d3c2110 0x55e20d3ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.915+0000 7faab77fe640 1 -- 172.21.15.72:0/1943272086 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab80b3180 con 0x55e20d378290 2023-12-13T00:01:24.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.917+0000 7faab77fe640 1 --2- 172.21.15.72:0/1943272086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d378290 0x55e20d3947b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faab0012740 tx=0x7faab0012c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bef3e23aff46671d server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.917+0000 7faa95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2023-12-13T00:01:24.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.918+0000 7faa9f7fe640 1 -- 172.21.15.72:0/3615745915 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7faaa8013470 con 0x7faab80cc420 2023-12-13T00:01:24.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.918+0000 7faa9f7fe640 1 --2- 172.21.15.72:0/3615745915 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faaa406b180 0x7faaa406d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.918+0000 7faab6ffd640 1 --2- 172.21.15.72:0/3615745915 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faaa406b180 0x7faaa406d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.919+0000 7faab6ffd640 1 --2- 172.21.15.72:0/3615745915 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faaa406b180 0x7faaa406d640 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faaa805aef0 tx=0x7faaa8006c30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.920+0000 7faa95ffb640 1 -- 172.21.15.72:0/1943272086 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0003970 con 0x55e20d378290 2023-12-13T00:01:24.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.920+0000 7faa95ffb640 1 -- 172.21.15.72:0/1943272086 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7faab0003ad0 con 0x55e20d378290 2023-12-13T00:01:24.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.920+0000 7faac042a740 1 -- 172.21.15.72:0/1943272086 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e20d2d7e90 con 0x55e20d378290 2023-12-13T00:01:24.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.922+0000 7faa95ffb640 1 -- 172.21.15.72:0/1943272086 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7faab0003c90 con 0x55e20d378290 2023-12-13T00:01:24.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.922+0000 7faac042a740 10 client.4786 fetch_fsmap learned FSMap version 14 2023-12-13T00:01:24.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.922+0000 7faac042a740 1 -- 172.21.15.72:0/1943272086 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55e20d2dd680 con 0x55e20d378290 2023-12-13T00:01:24.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.922+0000 7faa9f7fe640 1 -- 172.21.15.72:0/3615745915 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7faaa8006860 con 0x7faab80cc420 2023-12-13T00:01:24.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.926+0000 7faa95ffb640 1 -- 172.21.15.72:0/1943272086 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e20d2d7e90 con 0x55e20d378290 2023-12-13T00:01:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.926+0000 7faa95ffb640 1 -- 172.21.15.72:0/1943272086 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7faab0010820 con 0x55e20d378290 2023-12-13T00:01:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.926+0000 7faac042a740 10 client.4786 fetch_fsmap finished waiting for FSMap version 14 2023-12-13T00:01:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.926+0000 7faac042a740 10 client.4786 resolve_mds: resolved name 'f' to daemon mds.f 2023-12-13T00:01:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.926+0000 7faac042a740 20 client.4786 populate_metadata read hostname 'smithi072' 2023-12-13T00:01:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.926+0000 7faac042a740 1 --2- 172.21.15.72:0/1943272086 >> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] conn(0x55e20d3940f0 0x55e20d396b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.926+0000 7faac042a740 4 client.4786 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-13T00:01:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.926+0000 7faac042a740 1 -- 172.21.15.72:0/1943272086 --> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e20d2d7bb0 con 0x55e20d3940f0 2023-12-13T00:01:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.927+0000 7faab67fc640 1 --2- 172.21.15.72:0/1943272086 >> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] conn(0x55e20d3940f0 0x55e20d396b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.930+0000 7faab67fc640 1 --2- 172.21.15.72:0/1943272086 >> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] conn(0x55e20d3940f0 0x55e20d396b00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c565a4fe12d30664 server_cookie=75e78fcf938b958 in_seq=0 out_seq=0 2023-12-13T00:01:24.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.930+0000 7faa95ffb640 10 client.4786 ms_handle_connect on v2:172.21.15.176:6836/3968747607 2023-12-13T00:01:24.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.948+0000 7faa95ffb640 1 -- 172.21.15.72:0/1943272086 <== mds.0 v2:172.21.15.176:6836/3968747607 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e20d2d7bb0 con 0x55e20d3940f0 2023-12-13T00:01:24.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.948+0000 7faa95ffb640 10 client.4786 handle_command_reply: tid=0 2023-12-13T00:01:24.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.948+0000 7faac042a740 1 client.4786 shutdown 2023-12-13T00:01:24.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.948+0000 7faac042a740 1 -- 172.21.15.72:0/1943272086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d378290 msgr2=0x55e20d3947b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.948+0000 7faac042a740 1 --2- 172.21.15.72:0/1943272086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d378290 0x55e20d3947b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faab0012740 tx=0x7faab0012c00 comp rx=0 tx=0).stop 2023-12-13T00:01:24.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.948+0000 7faac042a740 1 -- 172.21.15.72:0/1943272086 shutdown_connections 2023-12-13T00:01:24.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.948+0000 7faac042a740 1 --2- 172.21.15.72:0/1943272086 >> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] conn(0x55e20d3940f0 0x55e20d396b00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.948+0000 7faac042a740 1 --2- 172.21.15.72:0/1943272086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d396680 0x55e20d39cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.948+0000 7faa95ffb640 0 client.4786 ms_handle_reset on v2:172.21.15.176:6836/3968747607 2023-12-13T00:01:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.948+0000 7faac042a740 1 --2- 172.21.15.72:0/1943272086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d3c2110 0x55e20d3ba4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.948+0000 7faac042a740 1 --2- 172.21.15.72:0/1943272086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d378290 0x55e20d3947b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.948+0000 7faac042a740 1 -- 172.21.15.72:0/1943272086 >> 172.21.15.72:0/1943272086 conn(0x55e20d376cf0 msgr2=0x55e20d371a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.948+0000 7faac042a740 1 -- 172.21.15.72:0/1943272086 shutdown_connections 2023-12-13T00:01:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.948+0000 7faac042a740 1 -- 172.21.15.72:0/1943272086 wait complete. 2023-12-13T00:01:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.948+0000 7faac042a740 20 client.4786 trim_cache size 0 max 16384 2023-12-13T00:01:24.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.963+0000 7faac042a740 1 Processor -- start 2023-12-13T00:01:24.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.964+0000 7faac042a740 1 -- start start 2023-12-13T00:01:24.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.964+0000 7faac042a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d378290 0x55e20d377530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.964+0000 7faac042a740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d396680 0x55e20d3bbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.964+0000 7faac042a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d3c2110 0x55e20d3bc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.964+0000 7faac042a740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e20d371e10 con 0x55e20d396680 2023-12-13T00:01:24.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.964+0000 7faac042a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e20d378010 con 0x55e20d378290 2023-12-13T00:01:24.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.964+0000 7faac042a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e20d293e70 con 0x55e20d3c2110 2023-12-13T00:01:24.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.965+0000 7faab67fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d396680 0x55e20d3bbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.965+0000 7faab77fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d378290 0x55e20d377530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.965+0000 7faab77fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d3c2110 0x55e20d3bc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.965+0000 7faab67fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d396680 0x55e20d3bbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48550/0 (socket says 172.21.15.72:48550) 2023-12-13T00:01:24.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.965+0000 7faab67fc640 1 -- 172.21.15.72:0/2311057078 learned_addr learned my addr 172.21.15.72:0/2311057078 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.967+0000 7faab67fc640 1 -- 172.21.15.72:0/2311057078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d3c2110 msgr2=0x55e20d3bc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.967+0000 7faab67fc640 1 --2- 172.21.15.72:0/2311057078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d3c2110 0x55e20d3bc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.967+0000 7faab67fc640 1 -- 172.21.15.72:0/2311057078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d378290 msgr2=0x55e20d377530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.967+0000 7faab67fc640 1 --2- 172.21.15.72:0/2311057078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d378290 0x55e20d377530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.967+0000 7faab67fc640 1 -- 172.21.15.72:0/2311057078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e20d27ad00 con 0x55e20d396680 2023-12-13T00:01:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.967+0000 7faab77fe640 1 --2- 172.21.15.72:0/2311057078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d378290 0x55e20d377530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T00:01:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.969+0000 7faab67fc640 1 --2- 172.21.15.72:0/2311057078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d396680 0x55e20d3bbeb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7faaac02ba70 tx=0x7faaac02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3384692fa655ab3 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.972+0000 7faa9d7fa640 1 -- 172.21.15.72:0/2311057078 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac03b040 con 0x55e20d396680 2023-12-13T00:01:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.973+0000 7faa9d7fa640 1 -- 172.21.15.72:0/2311057078 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaac02fe00 con 0x55e20d396680 2023-12-13T00:01:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.973+0000 7faa9d7fa640 1 -- 172.21.15.72:0/2311057078 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac004280 con 0x55e20d396680 2023-12-13T00:01:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.973+0000 7faac042a740 1 -- 172.21.15.72:0/2311057078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d396680 msgr2=0x55e20d3bbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.973+0000 7faac042a740 1 --2- 172.21.15.72:0/2311057078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d396680 0x55e20d3bbeb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7faaac02ba70 tx=0x7faaac02e000 comp rx=0 tx=0).stop 2023-12-13T00:01:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.973+0000 7faac042a740 1 -- 172.21.15.72:0/2311057078 shutdown_connections 2023-12-13T00:01:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.973+0000 7faac042a740 1 --2- 172.21.15.72:0/2311057078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d3c2110 0x55e20d3bc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.973+0000 7faac042a740 1 --2- 172.21.15.72:0/2311057078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d396680 0x55e20d3bbeb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.973+0000 7faac042a740 1 --2- 172.21.15.72:0/2311057078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d378290 0x55e20d377530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.973+0000 7faac042a740 1 -- 172.21.15.72:0/2311057078 >> 172.21.15.72:0/2311057078 conn(0x55e20d376cf0 msgr2=0x55e20d3d26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:24.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.973+0000 7faac042a740 1 -- 172.21.15.72:0/2311057078 shutdown_connections 2023-12-13T00:01:24.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.973+0000 7faac042a740 1 -- 172.21.15.72:0/2311057078 wait complete. 2023-12-13T00:01:24.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.974+0000 7faac042a740 1 -- start start 2023-12-13T00:01:24.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.974+0000 7faac042a740 1 Processor -- start 2023-12-13T00:01:24.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.975+0000 7faac042a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d378290 0x55e20d390830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.975+0000 7faac042a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d396680 0x55e20d3be630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.975+0000 7faac042a740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d3c2110 0x55e20d3b7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.975+0000 7faac042a740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e20d390d70 con 0x55e20d3c2110 2023-12-13T00:01:24.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.975+0000 7faac042a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e20d3beb70 con 0x55e20d396680 2023-12-13T00:01:24.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.975+0000 7faac042a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e20d3b8270 con 0x55e20d378290 2023-12-13T00:01:24.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.975+0000 7faac042a740 10 client.0 _ll_register_callbacks cb 0x7faaa801f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-13T00:01:24.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.976+0000 7faab77fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d3c2110 0x55e20d3b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.976+0000 7faab67fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d396680 0x55e20d3be630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.976+0000 7faab77fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d378290 0x55e20d390830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.976+0000 7faab77fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d3c2110 0x55e20d3b7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48554/0 (socket says 172.21.15.72:48554) 2023-12-13T00:01:24.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.976+0000 7faab77fe640 1 -- 172.21.15.72:0/1501568257 learned_addr learned my addr 172.21.15.72:0/1501568257 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:24.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.979+0000 7faab67fc640 1 -- 172.21.15.72:0/1501568257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d378290 msgr2=0x55e20d390830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.979+0000 7faab67fc640 1 --2- 172.21.15.72:0/1501568257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d378290 0x55e20d390830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.979+0000 7faab67fc640 1 -- 172.21.15.72:0/1501568257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d3c2110 msgr2=0x55e20d3b7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:24.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.979+0000 7faab67fc640 1 --2- 172.21.15.72:0/1501568257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d3c2110 0x55e20d3b7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:24.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.979+0000 7faab67fc640 1 -- 172.21.15.72:0/1501568257 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab0031040 con 0x55e20d396680 2023-12-13T00:01:24.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.981+0000 7faab67fc640 1 --2- 172.21.15.72:0/1501568257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d396680 0x55e20d3be630 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faaac007000 tx=0x7faaac004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7687e927cfc572b server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:24.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.981+0000 7faa95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2023-12-13T00:01:24.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.984+0000 7faa95ffb640 1 -- 172.21.15.72:0/1501568257 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac03b040 con 0x55e20d396680 2023-12-13T00:01:24.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.985+0000 7faa95ffb640 1 -- 172.21.15.72:0/1501568257 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7faaac052e30 con 0x55e20d396680 2023-12-13T00:01:24.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.985+0000 7faac042a740 1 -- 172.21.15.72:0/1501568257 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faaa80137d0 con 0x55e20d396680 2023-12-13T00:01:24.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.986+0000 7faa95ffb640 1 -- 172.21.15.72:0/1501568257 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7faaac004240 con 0x55e20d396680 2023-12-13T00:01:24.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.986+0000 7faac042a740 10 client.4792 fetch_fsmap learned FSMap version 14 2023-12-13T00:01:24.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.986+0000 7faac042a740 1 -- 172.21.15.72:0/1501568257 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x7faab80cce00 con 0x55e20d396680 2023-12-13T00:01:24.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.990+0000 7faa95ffb640 1 -- 172.21.15.72:0/1501568257 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa80137d0 con 0x55e20d396680 2023-12-13T00:01:24.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.990+0000 7faa95ffb640 1 -- 172.21.15.72:0/1501568257 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7faaac04f020 con 0x55e20d396680 2023-12-13T00:01:24.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.991+0000 7faac042a740 10 client.4792 fetch_fsmap finished waiting for FSMap version 14 2023-12-13T00:01:24.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.991+0000 7faac042a740 10 client.4792 resolve_mds: resolved name 'f' to daemon mds.f 2023-12-13T00:01:24.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.991+0000 7faac042a740 20 client.4792 populate_metadata read hostname 'smithi072' 2023-12-13T00:01:24.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.991+0000 7faac042a740 1 --2- 172.21.15.72:0/1501568257 >> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] conn(0x55e20d4269b0 0x55e20d426d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:24.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.991+0000 7faac042a740 4 client.4792 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-13T00:01:24.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.991+0000 7faac042a740 1 -- 172.21.15.72:0/1501568257 --> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e20cfdf6c0 con 0x55e20d4269b0 2023-12-13T00:01:24.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.991+0000 7faab77fe640 1 --2- 172.21.15.72:0/1501568257 >> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] conn(0x55e20d4269b0 0x55e20d426d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:24.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.994+0000 7faab77fe640 1 --2- 172.21.15.72:0/1501568257 >> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] conn(0x55e20d4269b0 0x55e20d426d90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49082b004a5ebf82 server_cookie=4b26cea194f5b2de in_seq=0 out_seq=0 2023-12-13T00:01:24.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.994+0000 7faa95ffb640 10 client.4792 ms_handle_connect on v2:172.21.15.176:6836/3968747607 2023-12-13T00:01:24.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.997+0000 7faa95ffb640 1 -- 172.21.15.72:0/1501568257 <== mds.0 v2:172.21.15.176:6836/3968747607 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55e20cfdf6c0 con 0x55e20d4269b0 2023-12-13T00:01:25.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.997+0000 7faa95ffb640 10 client.4792 handle_command_reply: tid=0 2023-12-13T00:01:25.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.997+0000 7faac042a740 1 client.4792 shutdown 2023-12-13T00:01:25.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faac042a740 1 -- 172.21.15.72:0/1501568257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d396680 msgr2=0x55e20d3be630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:25.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faac042a740 1 --2- 172.21.15.72:0/1501568257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d396680 0x55e20d3be630 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faaac007000 tx=0x7faaac004730 comp rx=0 tx=0).stop 2023-12-13T00:01:25.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faac042a740 1 -- 172.21.15.72:0/1501568257 shutdown_connections 2023-12-13T00:01:25.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faac042a740 1 --2- 172.21.15.72:0/1501568257 >> [v2:172.21.15.176:6836/3968747607,v1:172.21.15.176:6837/3968747607] conn(0x55e20d4269b0 0x55e20d426d90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:25.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faac042a740 1 --2- 172.21.15.72:0/1501568257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e20d3c2110 0x55e20d3b7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:25.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faa95ffb640 0 client.4792 ms_handle_reset on v2:172.21.15.176:6836/3968747607 2023-12-13T00:01:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faac042a740 1 --2- 172.21.15.72:0/1501568257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e20d396680 0x55e20d3be630 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faac042a740 1 --2- 172.21.15.72:0/1501568257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e20d378290 0x55e20d390830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faac042a740 1 -- 172.21.15.72:0/1501568257 >> 172.21.15.72:0/1501568257 conn(0x55e20d376cf0 msgr2=0x55e20d375b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faac042a740 1 -- 172.21.15.72:0/1501568257 shutdown_connections 2023-12-13T00:01:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faac042a740 1 -- 172.21.15.72:0/1501568257 wait complete. 2023-12-13T00:01:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faac042a740 20 client.4792 trim_cache size 0 max 16384 2023-12-13T00:01:25.001 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-12-13T00:01:25.001 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d", 2023-12-13T00:01:25.001 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-12-13T00:01:25.001 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4266, 2023-12-13T00:01:25.002 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-12-13T00:01:25.002 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-12-13T00:01:25.002 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-12-13T00:01:25.002 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 53.74084233, 2023-12-13T00:01:25.002 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 14, 2023-12-13T00:01:25.002 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 27, 2023-12-13T00:01:25.002 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 27, 2023-12-13T00:01:25.002 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 63.665383415000001 2023-12-13T00:01:25.002 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-12-13T00:01:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faabd7bb640 1 -- 172.21.15.72:0/3615745915 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faaa406b180 msgr2=0x7faaa406d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faabd7bb640 1 --2- 172.21.15.72:0/3615745915 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faaa406b180 0x7faaa406d640 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faaa805aef0 tx=0x7faaa8006c30 comp rx=0 tx=0).stop 2023-12-13T00:01:25.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faabd7bb640 1 -- 172.21.15.72:0/3615745915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faab80cc420 msgr2=0x7faab80b3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:25.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faabd7bb640 1 --2- 172.21.15.72:0/3615745915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faab80cc420 0x7faab80b3980 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faaa800e9b0 tx=0x7faaa800ee70 comp rx=0 tx=0).stop 2023-12-13T00:01:25.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faabd7bb640 1 -- 172.21.15.72:0/3615745915 shutdown_connections 2023-12-13T00:01:25.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faabd7bb640 1 --2- 172.21.15.72:0/3615745915 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faaa406b180 0x7faaa406d640 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:25.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faabd7bb640 1 --2- 172.21.15.72:0/3615745915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faab8159b50 0x7faab8156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:25.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faabd7bb640 1 --2- 172.21.15.72:0/3615745915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faab80cda70 0x7faab81f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:25.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faabd7bb640 1 --2- 172.21.15.72:0/3615745915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faab80cc420 0x7faab80b3980 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:25.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faabd7bb640 1 -- 172.21.15.72:0/3615745915 >> 172.21.15.72:0/3615745915 conn(0x7faab80b07b0 msgr2=0x7faab80c6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:25.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faabd7bb640 1 -- 172.21.15.72:0/3615745915 shutdown_connections 2023-12-13T00:01:25.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:24.998+0000 7faabd7bb640 1 -- 172.21.15.72:0/3615745915 wait complete. 2023-12-13T00:01:25.010 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-13T00:01:25.095 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-13T00:01:25.095 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-12-13T00:01:25.095 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-12-13T00:01:25.095 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-13T00:01:25.095 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-13T00:01:25.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:25.096 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-12-13T00:01:25.111 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-13T00:01:25.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:25.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-13T00:01:25.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:25.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-12-13T00:01:25.285 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-13T00:01:25.285 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-13T00:01:25.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.388+0000 7f69d6f3c640 1 Processor -- start 2023-12-13T00:01:25.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.388+0000 7f69d6f3c640 1 -- start start 2023-12-13T00:01:25.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.389+0000 7f69d6f3c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f69d00c4340 0x7f69d006ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:25.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.389+0000 7f69d6f3c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69d00c4720 0x7f69d0070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:25.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.389+0000 7f69d6f3c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d00c68c0 con 0x7f69d0151040 2023-12-13T00:01:25.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.389+0000 7f69d6f3c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d00c1090 con 0x7f69d00c4340 2023-12-13T00:01:25.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.389+0000 7f69d6f3c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d0157360 con 0x7f69d00c4720 2023-12-13T00:01:25.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.390+0000 7f69d54d9640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f69d0151040 0x7f69d015a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:37040/0 (socket says 172.21.15.72:37040) 2023-12-13T00:01:25.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.390+0000 7f69d54d9640 1 -- 172.21.15.72:0/244306195 learned_addr learned my addr 172.21.15.72:0/244306195 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:01:25.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.390+0000 7f69cffff640 1 --2- 172.21.15.72:0/244306195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69d00c4720 0x7f69d0070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:25.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.392+0000 7f69cffff640 1 -- 172.21.15.72:0/244306195 >> v2:172.21.15.72:3300/0 conn(0x7f69d00c4340 msgr2=0x7f69d006ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:01:25.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.392+0000 7f69cffff640 1 --2- 172.21.15.72:0/244306195 >> v2:172.21.15.72:3300/0 conn(0x7f69d00c4340 0x7f69d006ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:25.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.392+0000 7f69cffff640 1 -- 172.21.15.72:0/244306195 >> v1:172.21.15.176:6789/0 conn(0x7f69d0151040 legacy=0x7f69d015a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:25.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.392+0000 7f69cffff640 1 -- 172.21.15.72:0/244306195 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d0157600 con 0x7f69d00c4720 2023-12-13T00:01:25.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.394+0000 7f69cffff640 1 --2- 172.21.15.72:0/244306195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69d00c4720 0x7f69d0070a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0097a0 tx=0x7f69bc02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96b365b15ce79fef server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:25.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.398+0000 7f69cf7fe640 1 -- 172.21.15.72:0/244306195 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc030610 con 0x7f69d00c4720 2023-12-13T00:01:25.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.398+0000 7f69cf7fe640 1 -- 172.21.15.72:0/244306195 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69bc030770 con 0x7f69d00c4720 2023-12-13T00:01:25.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.398+0000 7f69cf7fe640 1 -- 172.21.15.72:0/244306195 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc030b00 con 0x7f69d00c4720 2023-12-13T00:01:25.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.398+0000 7f69d6f3c640 1 -- 172.21.15.72:0/244306195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69d00c4720 msgr2=0x7f69d0070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:25.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.398+0000 7f69d6f3c640 1 --2- 172.21.15.72:0/244306195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69d00c4720 0x7f69d0070a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0097a0 tx=0x7f69bc02b960 comp rx=0 tx=0).stop 2023-12-13T00:01:25.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.398+0000 7f69d6f3c640 1 -- 172.21.15.72:0/244306195 shutdown_connections 2023-12-13T00:01:25.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.398+0000 7f69d6f3c640 1 --2- 172.21.15.72:0/244306195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69d00c4720 0x7f69d0070a00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:25.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.398+0000 7f69d6f3c640 1 --2- 172.21.15.72:0/244306195 >> v2:172.21.15.72:3300/0 conn(0x7f69d00c4340 0x7f69d006ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:25.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.398+0000 7f69d6f3c640 1 -- 172.21.15.72:0/244306195 >> 172.21.15.72:0/244306195 conn(0x7f69d006c5f0 msgr2=0x7f69d006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:25.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.399+0000 7f69d6f3c640 1 -- 172.21.15.72:0/244306195 shutdown_connections 2023-12-13T00:01:25.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.399+0000 7f69d6f3c640 1 -- 172.21.15.72:0/244306195 wait complete. 2023-12-13T00:01:25.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.400+0000 7f69d6f3c640 1 Processor -- start 2023-12-13T00:01:25.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.400+0000 7f69d6f3c640 1 -- start start 2023-12-13T00:01:25.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.401+0000 7f69d6f3c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69d00c4340 0x7f69d0155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:25.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.401+0000 7f69d6f3c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69d00c4720 0x7f69d01f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:25.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.401+0000 7f69d6f3c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69d0151040 0x7f69d014c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:25.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.401+0000 7f69d6f3c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d0156770 con 0x7f69d00c4340 2023-12-13T00:01:25.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.401+0000 7f69d6f3c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d00c2b50 con 0x7f69d00c4720 2023-12-13T00:01:25.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.401+0000 7f69d6f3c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d01eff90 con 0x7f69d0151040 2023-12-13T00:01:25.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.401+0000 7f69d4cd8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69d00c4340 0x7f69d0155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:25.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.402+0000 7f69d4cd8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69d00c4340 0x7f69d0155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48570/0 (socket says 172.21.15.72:48570) 2023-12-13T00:01:25.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.402+0000 7f69d4cd8640 1 -- 172.21.15.72:0/1355415216 learned_addr learned my addr 172.21.15.72:0/1355415216 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:01:25.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.403+0000 7f69d54d9640 1 --2- 172.21.15.72:0/1355415216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69d0151040 0x7f69d014c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:25.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.406+0000 7f69d4cd8640 1 -- 172.21.15.72:0/1355415216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69d0151040 msgr2=0x7f69d014c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:25.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.406+0000 7f69d4cd8640 1 --2- 172.21.15.72:0/1355415216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69d0151040 0x7f69d014c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:25.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.406+0000 7f69d4cd8640 1 -- 172.21.15.72:0/1355415216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69d00c4720 msgr2=0x7f69d01f2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:25.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.406+0000 7f69d4cd8640 1 --2- 172.21.15.72:0/1355415216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69d00c4720 0x7f69d01f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:25.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.406+0000 7f69d4cd8640 1 -- 172.21.15.72:0/1355415216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc009400 con 0x7f69d00c4340 2023-12-13T00:01:25.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.408+0000 7f69d4cd8640 1 --2- 172.21.15.72:0/1355415216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69d00c4340 0x7f69d0155b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f69c400b4a0 tx=0x7f69c400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:25.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.412+0000 7f69cd7fa640 1 -- 172.21.15.72:0/1355415216 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c4010610 con 0x7f69d00c4340 2023-12-13T00:01:25.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.412+0000 7f69cd7fa640 1 -- 172.21.15.72:0/1355415216 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c4010770 con 0x7f69d00c4340 2023-12-13T00:01:25.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.412+0000 7f69d6f3c640 1 -- 172.21.15.72:0/1355415216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d01f29c0 con 0x7f69d00c4340 2023-12-13T00:01:25.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.412+0000 7f69cd7fa640 1 -- 172.21.15.72:0/1355415216 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c4010b20 con 0x7f69d00c4340 2023-12-13T00:01:25.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.412+0000 7f69d6f3c640 1 -- 172.21.15.72:0/1355415216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d00c3000 con 0x7f69d00c4340 2023-12-13T00:01:25.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.413+0000 7f69d6f3c640 1 -- 172.21.15.72:0/1355415216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d0067470 con 0x7f69d00c4340 2023-12-13T00:01:25.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.433+0000 7f69cd7fa640 1 -- 172.21.15.72:0/1355415216 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f69c4010c80 con 0x7f69d00c4340 2023-12-13T00:01:25.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.433+0000 7f69cd7fa640 1 --2- 172.21.15.72:0/1355415216 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f69b406b240 0x7f69b406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:01:25.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.433+0000 7f69cffff640 1 --2- 172.21.15.72:0/1355415216 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f69b406b240 0x7f69b406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:01:25.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.434+0000 7f69cffff640 1 --2- 172.21.15.72:0/1355415216 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f69b406b240 0x7f69b406d700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f69bc036000 tx=0x7f69bc03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:01:25.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.436+0000 7f69cd7fa640 1 -- 172.21.15.72:0/1355415216 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f69c4058b10 con 0x7f69d00c4340 2023-12-13T00:01:25.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.670+0000 7f69cd7fa640 1 -- 172.21.15.72:0/1355415216 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f69c4054750 con 0x7f69d00c4340 2023-12-13T00:01:25.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.882+0000 7f69d6f3c640 1 -- 172.21.15.72:0/1355415216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f69d0156b10 con 0x7f69d00c4340 2023-12-13T00:01:25.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.887+0000 7f69cd7fa640 1 -- 172.21.15.72:0/1355415216 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+88 (secure 0 0 0) 0x7f69c401e070 con 0x7f69d00c4340 2023-12-13T00:01:25.888 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-13T00:01:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.889+0000 7f69d6f3c640 1 -- 172.21.15.72:0/1355415216 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f69b406b240 msgr2=0x7f69b406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:25.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.889+0000 7f69d6f3c640 1 --2- 172.21.15.72:0/1355415216 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f69b406b240 0x7f69b406d700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f69bc036000 tx=0x7f69bc03b040 comp rx=0 tx=0).stop 2023-12-13T00:01:25.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.889+0000 7f69d6f3c640 1 -- 172.21.15.72:0/1355415216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69d00c4340 msgr2=0x7f69d0155b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:01:25.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.889+0000 7f69d6f3c640 1 --2- 172.21.15.72:0/1355415216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69d00c4340 0x7f69d0155b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f69c400b4a0 tx=0x7f69c400b960 comp rx=0 tx=0).stop 2023-12-13T00:01:25.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.890+0000 7f69d6f3c640 1 -- 172.21.15.72:0/1355415216 shutdown_connections 2023-12-13T00:01:25.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.890+0000 7f69d6f3c640 1 --2- 172.21.15.72:0/1355415216 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f69b406b240 0x7f69b406d700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:25.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.890+0000 7f69d6f3c640 1 --2- 172.21.15.72:0/1355415216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69d0151040 0x7f69d014c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:25.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.890+0000 7f69d6f3c640 1 --2- 172.21.15.72:0/1355415216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69d00c4720 0x7f69d01f2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:25.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.890+0000 7f69d6f3c640 1 --2- 172.21.15.72:0/1355415216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69d00c4340 0x7f69d0155b30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:01:25.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.890+0000 7f69d6f3c640 1 -- 172.21.15.72:0/1355415216 >> 172.21.15.72:0/1355415216 conn(0x7f69d006c5f0 msgr2=0x7f69d014f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:01:25.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.890+0000 7f69d6f3c640 1 -- 172.21.15.72:0/1355415216 shutdown_connections 2023-12-13T00:01:25.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:25.890+0000 7f69d6f3c640 1 -- 172.21.15.72:0/1355415216 wait complete. 2023-12-13T00:01:25.901 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-13T00:01:25.901 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-13T00:01:25.901 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-12-13T00:01:25.901 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-13T00:01:25.901 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-13T00:01:25.902 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-13T00:01:25.902 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-13T00:01:25.902 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-13T00:01:25.902 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-13T00:01:25.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:25.902 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-12-13T00:01:25.917 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-13T00:01:25.917 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-13T00:01:25.917 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-12-13T00:01:25.917 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-12-13T00:01:25.917 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-12-13T00:01:25.917 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-12-13T00:01:25.917 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-13T00:01:25.917 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-12-13T00:01:25.917 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-12-13T00:01:25.918 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-13T00:01:25.918 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-12-13T00:01:25.918 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-12-13T00:01:25.918 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-13T00:01:25.918 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-12-13T00:01:25.918 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-13T00:01:25.918 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-12-13T00:01:25.918 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-13T00:01:25.918 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42218sec preferred_lft 42218sec 2023-12-13T00:01:25.918 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-12-13T00:01:25.918 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-12-13T00:01:25.919 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-13T00:01:25.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:25.919 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-12-13T00:01:25.919 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-12-13T00:01:25.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2023-12-13T00:01:25.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2023-12-13T00:01:25.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2023-12-13T00:01:25.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-13T00:01:25.919 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-12-13T00:01:26.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:26.025 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-13T00:01:26.049 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-12-13T00:01:26.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:26.051 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-12-13T00:01:26.107 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-12-13T00:01:26.107 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-13T00:01:26.107 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-13T00:01:26.107 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-13T00:01:26.107 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-13T00:01:26.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:26.108 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-12-13T00:01:26.108 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-12-13T00:01:26.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-13T00:01:26.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-13T00:01:26.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-13T00:01:26.108 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-12-13T00:01:26.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:26.203 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-12-13T00:01:26.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:26.218 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-12-13T00:01:26.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:26.273 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-12-13T00:01:26.273 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-12-13T00:01:26.273 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:01:26.273 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-13T00:01:26.273 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-12-13T00:01:26.355 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-13T00:01:26.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:26.356 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-12-13T00:01:26.356 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-12-13T00:01:26.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-13T00:01:26.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-13T00:01:26.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-13T00:01:26.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-13T00:01:26.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-13T00:01:26.356 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-12-13T00:01:26.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:26.481 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-12-13T00:01:26.481 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-12-13T00:01:26.481 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-12-13T00:01:26.481 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2023-12-13T00:01:26.481 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-12-13T00:01:26.522 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-12-13T00:01:26.523 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-13T00:01:26.523 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-13T00:01:26.577 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-13T00:01:26.577 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-13T00:01:26.578 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-13T00:01:26.632 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-13T00:01:26.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-12-13T00:01:26.700 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T00:01:26.756 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2023-12-13T00:01:26.756 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2023-12-13T00:01:26.757 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2023-12-13T00:01:26.757 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2023-12-13T00:01:26.757 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2023-12-13T00:01:26.757 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2023-12-13T00:01:26.757 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2023-12-13T00:01:26.757 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2023-12-13T00:01:26.757 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2023-12-13T00:01:26.757 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2023-12-13T00:01:26.757 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2023-12-13T00:01:26.757 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2023-12-13T00:01:26.758 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T00:01:26.758 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2023-12-13T00:01:26.758 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2023-12-13T00:01:26.758 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2023-12-13T00:01:26.758 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2023-12-13T00:01:26.758 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2023-12-13T00:01:26.758 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2023-12-13T00:01:26.758 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-13T00:01:26.758 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2023-12-13T00:01:26.758 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-13T00:01:26.758 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2023-12-13T00:01:26.758 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2023-12-13T00:01:26.758 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2023-12-13T00:01:26.759 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T00:01:26.759 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T00:01:26.759 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T00:01:26.759 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T00:01:26.759 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2023-12-13T00:01:26.759 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:01:26.759 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:01:26.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:26.759 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-12-13T00:01:26.811 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-13T00:01:26.812 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-13T00:01:26.854 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-12-13T00:01:26.880 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T00:01:26.936 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2023-12-13T00:01:26.936 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2023-12-13T00:01:26.936 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2023-12-13T00:01:26.936 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2023-12-13T00:01:26.936 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2023-12-13T00:01:26.936 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2023-12-13T00:01:26.937 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2023-12-13T00:01:26.937 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2023-12-13T00:01:26.937 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2023-12-13T00:01:26.937 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2023-12-13T00:01:26.937 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2023-12-13T00:01:26.937 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2023-12-13T00:01:26.937 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T00:01:26.937 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2023-12-13T00:01:26.937 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2023-12-13T00:01:26.937 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2023-12-13T00:01:26.937 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2023-12-13T00:01:26.937 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2023-12-13T00:01:26.938 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2023-12-13T00:01:26.938 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-13T00:01:26.938 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2023-12-13T00:01:26.938 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-13T00:01:26.938 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2023-12-13T00:01:26.938 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2023-12-13T00:01:26.938 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2023-12-13T00:01:26.938 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T00:01:26.938 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T00:01:26.938 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T00:01:26.938 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T00:01:26.938 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2023-12-13T00:01:26.939 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:01:26.939 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:01:26.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:26.940 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-12-13T00:01:28.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-12-13T00:01:28.122 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T00:01:28.178 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2023-12-13T00:01:28.178 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2023-12-13T00:01:28.179 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2023-12-13T00:01:28.179 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2023-12-13T00:01:28.179 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2023-12-13T00:01:28.179 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2023-12-13T00:01:28.179 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2023-12-13T00:01:28.179 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2023-12-13T00:01:28.179 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2023-12-13T00:01:28.179 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2023-12-13T00:01:28.179 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2023-12-13T00:01:28.179 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2023-12-13T00:01:28.179 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T00:01:28.179 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2023-12-13T00:01:28.179 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2023-12-13T00:01:28.180 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2023-12-13T00:01:28.180 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2023-12-13T00:01:28.180 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2023-12-13T00:01:28.180 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2023-12-13T00:01:28.180 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-13T00:01:28.180 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2023-12-13T00:01:28.180 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-13T00:01:28.180 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2023-12-13T00:01:28.180 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2023-12-13T00:01:28.180 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2023-12-13T00:01:28.180 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T00:01:28.180 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T00:01:28.180 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T00:01:28.180 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T00:01:28.181 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2023-12-13T00:01:28.181 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:01:28.181 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:01:28.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:28.181 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-12-13T00:01:29.335 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-12-13T00:01:29.362 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T00:01:29.418 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2023-12-13T00:01:29.418 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2023-12-13T00:01:29.418 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2023-12-13T00:01:29.418 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2023-12-13T00:01:29.418 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2023-12-13T00:01:29.418 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2023-12-13T00:01:29.418 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2023-12-13T00:01:29.418 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2023-12-13T00:01:29.418 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2023-12-13T00:01:29.419 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2023-12-13T00:01:29.419 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2023-12-13T00:01:29.419 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2023-12-13T00:01:29.419 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T00:01:29.419 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2023-12-13T00:01:29.419 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2023-12-13T00:01:29.419 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2023-12-13T00:01:29.419 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2023-12-13T00:01:29.419 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2023-12-13T00:01:29.419 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2023-12-13T00:01:29.419 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-13T00:01:29.419 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2023-12-13T00:01:29.419 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-13T00:01:29.420 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2023-12-13T00:01:29.420 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2023-12-13T00:01:29.420 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2023-12-13T00:01:29.420 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T00:01:29.420 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T00:01:29.420 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T00:01:29.420 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T00:01:29.420 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2023-12-13T00:01:29.420 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:01:29.420 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:01:29.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:29.421 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-12-13T00:01:29.857 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:01:29.860 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:01:30.574 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-12-13T00:01:30.602 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T00:01:30.658 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2023-12-13T00:01:30.658 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2023-12-13T00:01:30.658 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2023-12-13T00:01:30.658 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2023-12-13T00:01:30.659 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2023-12-13T00:01:30.659 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2023-12-13T00:01:30.659 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2023-12-13T00:01:30.659 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2023-12-13T00:01:30.659 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2023-12-13T00:01:30.659 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2023-12-13T00:01:30.659 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2023-12-13T00:01:30.659 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2023-12-13T00:01:30.659 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T00:01:30.659 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2023-12-13T00:01:30.660 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2023-12-13T00:01:30.660 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2023-12-13T00:01:30.660 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2023-12-13T00:01:30.660 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2023-12-13T00:01:30.660 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2023-12-13T00:01:30.660 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-13T00:01:30.660 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2023-12-13T00:01:30.661 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-13T00:01:30.661 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2023-12-13T00:01:30.661 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2023-12-13T00:01:30.661 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2023-12-13T00:01:30.661 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T00:01:30.661 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T00:01:30.661 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T00:01:30.662 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T00:01:30.662 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2023-12-13T00:01:30.662 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:01:30.662 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:01:30.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:30.663 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-12-13T00:01:31.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-12-13T00:01:31.842 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T00:01:31.898 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2023-12-13T00:01:31.898 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2023-12-13T00:01:31.898 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2023-12-13T00:01:31.898 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2023-12-13T00:01:31.898 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2023-12-13T00:01:31.898 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2023-12-13T00:01:31.898 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2023-12-13T00:01:31.898 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2023-12-13T00:01:31.898 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2023-12-13T00:01:31.898 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2023-12-13T00:01:31.899 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2023-12-13T00:01:31.899 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2023-12-13T00:01:31.899 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T00:01:31.899 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2023-12-13T00:01:31.899 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2023-12-13T00:01:31.899 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2023-12-13T00:01:31.899 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2023-12-13T00:01:31.899 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2023-12-13T00:01:31.899 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2023-12-13T00:01:31.899 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-13T00:01:31.899 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2023-12-13T00:01:31.899 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-13T00:01:31.899 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2023-12-13T00:01:31.900 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2023-12-13T00:01:31.900 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2023-12-13T00:01:31.900 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T00:01:31.900 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T00:01:31.900 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T00:01:31.900 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T00:01:31.900 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2023-12-13T00:01:31.900 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:01:31.900 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:01:31.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:31.900 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-12-13T00:01:32.501 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[99551]: starting ceph client 2023-12-13T00:01:32.584 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:2023-12-13T00:01:32.379+0000 64d6100 -1 init, newargv = 0x81d4a20 newargc=15 2023-12-13T00:01:33.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-12-13T00:01:33.083 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T00:01:33.139 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2023-12-13T00:01:33.139 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2023-12-13T00:01:33.139 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2023-12-13T00:01:33.139 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2023-12-13T00:01:33.139 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2023-12-13T00:01:33.139 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2023-12-13T00:01:33.140 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2023-12-13T00:01:33.140 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2023-12-13T00:01:33.140 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2023-12-13T00:01:33.140 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2023-12-13T00:01:33.140 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2023-12-13T00:01:33.140 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2023-12-13T00:01:33.140 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T00:01:33.140 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2023-12-13T00:01:33.140 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2023-12-13T00:01:33.140 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2023-12-13T00:01:33.140 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2023-12-13T00:01:33.140 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2023-12-13T00:01:33.141 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2023-12-13T00:01:33.141 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-13T00:01:33.141 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2023-12-13T00:01:33.141 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-13T00:01:33.141 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2023-12-13T00:01:33.141 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2023-12-13T00:01:33.141 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2023-12-13T00:01:33.141 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T00:01:33.141 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T00:01:33.141 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T00:01:33.141 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T00:01:33.141 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2023-12-13T00:01:33.141 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:01:33.142 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:01:33.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:33.142 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-12-13T00:01:33.337 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[99551]: starting fuse 2023-12-13T00:01:34.295 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-12-13T00:01:34.325 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T00:01:34.381 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2023-12-13T00:01:34.381 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2023-12-13T00:01:34.381 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2023-12-13T00:01:34.381 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2023-12-13T00:01:34.382 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2023-12-13T00:01:34.382 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2023-12-13T00:01:34.382 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2023-12-13T00:01:34.382 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2023-12-13T00:01:34.382 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2023-12-13T00:01:34.382 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2023-12-13T00:01:34.382 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2023-12-13T00:01:34.382 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2023-12-13T00:01:34.382 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T00:01:34.382 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2023-12-13T00:01:34.382 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2023-12-13T00:01:34.382 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2023-12-13T00:01:34.382 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2023-12-13T00:01:34.383 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2023-12-13T00:01:34.383 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2023-12-13T00:01:34.383 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-13T00:01:34.383 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2023-12-13T00:01:34.383 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-13T00:01:34.383 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2023-12-13T00:01:34.383 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2023-12-13T00:01:34.383 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2023-12-13T00:01:34.383 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T00:01:34.383 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T00:01:34.383 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T00:01:34.383 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T00:01:34.383 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2023-12-13T00:01:34.384 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:01:34.384 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:01:34.384 INFO:teuthology.orchestra.run.smithi072.stdout:/home/ubuntu/cephtest/mnt.0 2023-12-13T00:01:34.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:34.385 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-12-13T00:01:34.440 INFO:teuthology.orchestra.run.smithi072.stdout:41 2023-12-13T00:01:34.440 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-13T00:01:34.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo stdin-killer -- python3 -c ' 2023-12-13T00:01:34.440 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2023-12-13T00:01:34.440 DEBUG:teuthology.orchestra.run.smithi072:> import re 2023-12-13T00:01:34.441 DEBUG:teuthology.orchestra.run.smithi072:> import os 2023-12-13T00:01:34.441 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2023-12-13T00:01:34.441 DEBUG:teuthology.orchestra.run.smithi072:> 2023-12-13T00:01:34.441 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2023-12-13T00:01:34.441 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-13T00:01:34.441 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2023-12-13T00:01:34.441 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-13T00:01:34.441 DEBUG:teuthology.orchestra.run.smithi072:> 2023-12-13T00:01:34.441 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2023-12-13T00:01:34.441 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2023-12-13T00:01:34.441 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2023-12-13T00:01:34.441 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2023-12-13T00:01:34.441 DEBUG:teuthology.orchestra.run.smithi072:> 2023-12-13T00:01:34.441 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2023-12-13T00:01:34.441 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-13T00:01:34.441 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-13T00:01:34.442 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-13T00:01:34.442 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2023-12-13T00:01:34.442 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2023-12-13T00:01:34.442 DEBUG:teuthology.orchestra.run.smithi072:> return f 2023-12-13T00:01:34.442 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-13T00:01:34.442 DEBUG:teuthology.orchestra.run.smithi072:> 2023-12-13T00:01:34.442 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.0")) 2023-12-13T00:01:34.442 DEBUG:teuthology.orchestra.run.smithi072:> ' 2023-12-13T00:01:34.561 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.0.99551.asok 2023-12-13T00:01:34.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:01:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-13T00:01:34.571 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.99551.asok 2023-12-13T00:01:34.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:34.571 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.99551.asok status 2023-12-13T00:01:34.806 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-12-13T00:01:34.806 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2023-12-13T00:01:34.806 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "021ac1670a21c19759080c6da90baaeb42e7d175", 2023-12-13T00:01:34.807 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 19.0.0-157-g021ac167 (021ac1670a21c19759080c6da90baaeb42e7d175) squid (dev)", 2023-12-13T00:01:34.807 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "0", 2023-12-13T00:01:34.807 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2023-12-13T00:01:34.807 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-13T00:01:34.807 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "99551", 2023-12-13T00:01:34.807 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2023-12-13T00:01:34.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-12-13T00:01:34.807 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2023-12-13T00:01:34.807 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2023-12-13T00:01:34.807 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4734, 2023-12-13T00:01:34.807 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2023-12-13T00:01:34.807 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2023-12-13T00:01:34.807 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2023-12-13T00:01:34.808 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 4734 2023-12-13T00:01:34.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-12-13T00:01:34.808 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-12-13T00:01:34.808 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-12-13T00:01:34.808 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:0", 2023-12-13T00:01:34.808 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 1304387874 2023-12-13T00:01:34.808 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-12-13T00:01:34.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-12-13T00:01:34.808 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-12-13T00:01:34.808 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-12-13T00:01:34.808 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:0", 2023-12-13T00:01:34.808 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 1304387874 2023-12-13T00:01:34.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-12-13T00:01:34.808 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.4734 172.21.15.72:0/1304387874", 2023-12-13T00:01:34.809 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "172.21.15.72:0/1304387874", 2023-12-13T00:01:34.809 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2023-12-13T00:01:34.809 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 14, 2023-12-13T00:01:34.809 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 27, 2023-12-13T00:01:34.809 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2023-12-13T00:01:34.809 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2023-12-13T00:01:34.809 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2023-12-13T00:01:34.809 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-12-13T00:01:34.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:34.816 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2023-12-13T00:01:34.816 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-13T00:01:34.859 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2023-12-13T00:01:34.859 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-13T00:01:34.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:01:34.860 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-13T00:01:34.950 INFO:teuthology.run_tasks:Running task workunit... 2023-12-13T00:01:35.037 INFO:tasks.workunit:Pulling workunits from ref 021ac1670a21c19759080c6da90baaeb42e7d175 2023-12-13T00:01:35.037 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-13T00:01:35.037 INFO:tasks.workunit:timeout=3h 2023-12-13T00:01:35.037 INFO:tasks.workunit:cleanup=True 2023-12-13T00:01:35.038 DEBUG:teuthology.orchestra.run.smithi072:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-13T00:01:35.054 INFO:teuthology.orchestra.run.smithi072.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-13T00:01:35.054 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-12-13T00:01:35.054 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 29h/41d Inode: 1 Links: 2 2023-12-13T00:01:35.054 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-13T00:01:35.054 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:fusefs_t:s0 2023-12-13T00:01:35.054 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-13T00:01:35.054 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-12-13 00:00:31.565097471 +0000 2023-12-13T00:01:35.054 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-12-13 00:00:44.850977416 +0000 2023-12-13T00:01:35.055 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-12-13T00:01:35.055 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-13T00:01:35.055 DEBUG:teuthology.orchestra.run.smithi072:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-13T00:01:35.724 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 021ac1670a21c19759080c6da90baaeb42e7d175 2023-12-13T00:01:35.739 INFO:tasks.workunit.client.0.smithi072.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-13T00:01:59.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:01:59.924 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:02:21.739 INFO:tasks.workunit.client.0.smithi072.stderr:Note: switching to '021ac1670a21c19759080c6da90baaeb42e7d175'. 2023-12-13T00:02:21.739 INFO:tasks.workunit.client.0.smithi072.stderr: 2023-12-13T00:02:21.740 INFO:tasks.workunit.client.0.smithi072.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-13T00:02:21.740 INFO:tasks.workunit.client.0.smithi072.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-13T00:02:21.740 INFO:tasks.workunit.client.0.smithi072.stderr:state without impacting any branches by switching back to a branch. 2023-12-13T00:02:21.740 INFO:tasks.workunit.client.0.smithi072.stderr: 2023-12-13T00:02:21.740 INFO:tasks.workunit.client.0.smithi072.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-13T00:02:21.740 INFO:tasks.workunit.client.0.smithi072.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-13T00:02:21.740 INFO:tasks.workunit.client.0.smithi072.stderr: 2023-12-13T00:02:21.740 INFO:tasks.workunit.client.0.smithi072.stderr: git switch -c 2023-12-13T00:02:21.740 INFO:tasks.workunit.client.0.smithi072.stderr: 2023-12-13T00:02:21.740 INFO:tasks.workunit.client.0.smithi072.stderr:Or undo this operation with: 2023-12-13T00:02:21.740 INFO:tasks.workunit.client.0.smithi072.stderr: 2023-12-13T00:02:21.740 INFO:tasks.workunit.client.0.smithi072.stderr: git switch - 2023-12-13T00:02:21.740 INFO:tasks.workunit.client.0.smithi072.stderr: 2023-12-13T00:02:21.741 INFO:tasks.workunit.client.0.smithi072.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-13T00:02:21.741 INFO:tasks.workunit.client.0.smithi072.stderr: 2023-12-13T00:02:21.741 INFO:tasks.workunit.client.0.smithi072.stderr:HEAD is now at 021ac1670a2 Merge branch 'wip-63713' of https://github.com/vshankar/ceph into wip-yuri10-testing-2023-12-12-1229 2023-12-13T00:02:21.743 DEBUG:teuthology.orchestra.run.smithi072:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-13T00:02:21.774 INFO:tasks.workunit.client.0.smithi072.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-13T00:02:21.776 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-13T00:02:21.776 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-13T00:02:22.771 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-13T00:02:22.860 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-13T00:02:22.899 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-13T00:02:22.901 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-13T00:02:22.901 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-13T00:02:22.939 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-13T00:02:22.943 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-13T00:02:22.943 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-13T00:02:22.999 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2023-12-13T00:02:23.000 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2023-12-13T00:02:23.001 DEBUG:teuthology.orchestra.run.smithi072:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=021ac1670a21c19759080c6da90baaeb42e7d175 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2023-12-13T00:02:23.442 INFO:tasks.workunit.client.0.smithi072.stderr:+ dbench 1 2023-12-13T00:02:23.448 INFO:tasks.workunit.client.0.smithi072.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-12-13T00:02:23.448 INFO:tasks.workunit.client.0.smithi072.stdout: 2023-12-13T00:02:23.448 INFO:tasks.workunit.client.0.smithi072.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-12-13T00:02:23.454 INFO:tasks.workunit.client.0.smithi072.stdout:0 of 1 processes prepared for launch 0 sec 2023-12-13T00:02:23.554 INFO:tasks.workunit.client.0.smithi072.stdout:1 of 1 processes prepared for launch 0 sec 2023-12-13T00:02:23.555 INFO:tasks.workunit.client.0.smithi072.stdout:releasing clients 2023-12-13T00:02:24.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 31 1.05 MB/sec warmup 1 sec latency 82.118 ms 2023-12-13T00:02:25.554 INFO:tasks.workunit.client.0.smithi072.stdout: 1 113 2.62 MB/sec warmup 2 sec latency 204.816 ms 2023-12-13T00:02:26.554 INFO:tasks.workunit.client.0.smithi072.stdout: 1 155 2.18 MB/sec warmup 3 sec latency 169.914 ms 2023-12-13T00:02:27.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 199 1.96 MB/sec warmup 4 sec latency 184.685 ms 2023-12-13T00:02:28.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 247 1.88 MB/sec warmup 5 sec latency 175.481 ms 2023-12-13T00:02:29.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 289 1.78 MB/sec warmup 6 sec latency 182.278 ms 2023-12-13T00:02:30.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 331 1.72 MB/sec warmup 7 sec latency 218.016 ms 2023-12-13T00:02:30.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:02:30.777 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:02:31.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 365 1.63 MB/sec warmup 8 sec latency 252.595 ms 2023-12-13T00:02:32.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 397 1.57 MB/sec warmup 9 sec latency 461.870 ms 2023-12-13T00:02:33.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 429 1.51 MB/sec warmup 10 sec latency 293.014 ms 2023-12-13T00:02:34.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 461 1.47 MB/sec warmup 11 sec latency 290.066 ms 2023-12-13T00:02:35.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 493 1.43 MB/sec warmup 12 sec latency 379.431 ms 2023-12-13T00:02:36.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 538 1.45 MB/sec warmup 13 sec latency 253.906 ms 2023-12-13T00:02:37.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 609 1.50 MB/sec warmup 14 sec latency 339.624 ms 2023-12-13T00:02:38.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 616 1.40 MB/sec warmup 15 sec latency 634.455 ms 2023-12-13T00:02:39.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 645 1.32 MB/sec warmup 16 sec latency 442.455 ms 2023-12-13T00:02:40.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 654 1.24 MB/sec warmup 17 sec latency 332.796 ms 2023-12-13T00:02:41.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 682 1.18 MB/sec warmup 18 sec latency 369.534 ms 2023-12-13T00:02:42.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 710 1.12 MB/sec warmup 19 sec latency 356.473 ms 2023-12-13T00:02:43.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 743 1.07 MB/sec warmup 20 sec latency 376.952 ms 2023-12-13T00:02:44.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 769 1.02 MB/sec warmup 21 sec latency 331.029 ms 2023-12-13T00:02:45.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 800 0.98 MB/sec warmup 22 sec latency 234.587 ms 2023-12-13T00:02:46.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 815 0.93 MB/sec warmup 23 sec latency 311.592 ms 2023-12-13T00:02:47.555 INFO:tasks.workunit.client.0.smithi072.stdout: 1 823 0.90 MB/sec warmup 24 sec latency 476.936 ms 2023-12-13T00:02:48.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 856 0.86 MB/sec warmup 25 sec latency 328.946 ms 2023-12-13T00:02:49.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 863 0.83 MB/sec warmup 26 sec latency 306.968 ms 2023-12-13T00:02:50.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 892 0.80 MB/sec warmup 27 sec latency 297.015 ms 2023-12-13T00:02:51.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 904 0.77 MB/sec warmup 28 sec latency 238.798 ms 2023-12-13T00:02:52.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 928 0.75 MB/sec warmup 29 sec latency 405.359 ms 2023-12-13T00:02:53.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 933 0.73 MB/sec warmup 30 sec latency 321.723 ms 2023-12-13T00:02:54.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 961 0.70 MB/sec warmup 31 sec latency 312.503 ms 2023-12-13T00:02:55.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 980 0.68 MB/sec warmup 32 sec latency 205.526 ms 2023-12-13T00:02:56.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1007 0.67 MB/sec warmup 33 sec latency 306.965 ms 2023-12-13T00:02:57.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1033 0.67 MB/sec warmup 34 sec latency 315.782 ms 2023-12-13T00:02:58.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1047 0.65 MB/sec warmup 35 sec latency 309.207 ms 2023-12-13T00:02:59.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1060 0.64 MB/sec warmup 36 sec latency 327.347 ms 2023-12-13T00:03:00.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1088 0.62 MB/sec warmup 37 sec latency 180.315 ms 2023-12-13T00:03:00.840 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:03:00.843 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:03:01.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1100 0.60 MB/sec warmup 38 sec latency 339.185 ms 2023-12-13T00:03:02.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1128 0.59 MB/sec warmup 39 sec latency 391.231 ms 2023-12-13T00:03:03.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1157 0.58 MB/sec warmup 40 sec latency 191.767 ms 2023-12-13T00:03:04.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1169 0.56 MB/sec warmup 41 sec latency 326.722 ms 2023-12-13T00:03:05.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1176 0.55 MB/sec warmup 42 sec latency 328.080 ms 2023-12-13T00:03:06.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1202 0.54 MB/sec warmup 43 sec latency 192.164 ms 2023-12-13T00:03:07.556 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1224 0.52 MB/sec warmup 44 sec latency 340.907 ms 2023-12-13T00:03:08.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1248 0.51 MB/sec warmup 45 sec latency 211.085 ms 2023-12-13T00:03:09.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1274 0.50 MB/sec warmup 46 sec latency 288.121 ms 2023-12-13T00:03:10.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1281 0.49 MB/sec warmup 47 sec latency 314.629 ms 2023-12-13T00:03:11.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1377 0.54 MB/sec warmup 48 sec latency 309.011 ms 2023-12-13T00:03:12.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1385 0.53 MB/sec warmup 49 sec latency 355.323 ms 2023-12-13T00:03:13.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1397 0.52 MB/sec warmup 50 sec latency 339.951 ms 2023-12-13T00:03:14.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1418 0.51 MB/sec warmup 51 sec latency 333.100 ms 2023-12-13T00:03:15.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1446 0.50 MB/sec warmup 52 sec latency 133.952 ms 2023-12-13T00:03:16.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1466 0.49 MB/sec warmup 53 sec latency 313.789 ms 2023-12-13T00:03:17.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1487 0.48 MB/sec warmup 54 sec latency 369.581 ms 2023-12-13T00:03:18.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1502 0.47 MB/sec warmup 55 sec latency 311.758 ms 2023-12-13T00:03:19.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1526 0.47 MB/sec warmup 56 sec latency 258.205 ms 2023-12-13T00:03:20.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1554 0.46 MB/sec warmup 57 sec latency 342.719 ms 2023-12-13T00:03:21.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1584 0.45 MB/sec warmup 58 sec latency 314.273 ms 2023-12-13T00:03:22.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1603 0.44 MB/sec warmup 59 sec latency 417.857 ms 2023-12-13T00:03:23.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1614 0.44 MB/sec warmup 60 sec latency 355.376 ms 2023-12-13T00:03:24.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1641 0.43 MB/sec warmup 61 sec latency 301.088 ms 2023-12-13T00:03:25.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1655 0.42 MB/sec warmup 62 sec latency 307.027 ms 2023-12-13T00:03:26.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1689 0.42 MB/sec warmup 63 sec latency 257.271 ms 2023-12-13T00:03:27.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1707 0.41 MB/sec warmup 64 sec latency 314.640 ms 2023-12-13T00:03:28.557 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1769 0.40 MB/sec warmup 65 sec latency 295.721 ms 2023-12-13T00:03:29.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1803 0.40 MB/sec warmup 66 sec latency 298.570 ms 2023-12-13T00:03:30.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1822 0.39 MB/sec warmup 67 sec latency 294.442 ms 2023-12-13T00:03:30.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:03:30.906 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:03:31.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1841 0.39 MB/sec warmup 68 sec latency 309.589 ms 2023-12-13T00:03:32.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1859 0.38 MB/sec warmup 69 sec latency 357.752 ms 2023-12-13T00:03:33.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1869 0.38 MB/sec warmup 70 sec latency 323.622 ms 2023-12-13T00:03:34.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1903 0.37 MB/sec warmup 71 sec latency 344.461 ms 2023-12-13T00:03:35.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1920 0.37 MB/sec warmup 72 sec latency 323.249 ms 2023-12-13T00:03:36.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1973 0.36 MB/sec warmup 73 sec latency 327.739 ms 2023-12-13T00:03:37.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 1997 0.36 MB/sec warmup 74 sec latency 289.958 ms 2023-12-13T00:03:38.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2043 0.35 MB/sec warmup 75 sec latency 336.778 ms 2023-12-13T00:03:39.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2053 0.35 MB/sec warmup 76 sec latency 321.782 ms 2023-12-13T00:03:40.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2079 0.35 MB/sec warmup 77 sec latency 323.181 ms 2023-12-13T00:03:41.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2093 0.34 MB/sec warmup 78 sec latency 344.975 ms 2023-12-13T00:03:42.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2137 0.34 MB/sec warmup 79 sec latency 406.701 ms 2023-12-13T00:03:43.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2146 0.33 MB/sec warmup 80 sec latency 310.892 ms 2023-12-13T00:03:44.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2177 0.33 MB/sec warmup 81 sec latency 321.845 ms 2023-12-13T00:03:45.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2199 0.33 MB/sec warmup 82 sec latency 295.605 ms 2023-12-13T00:03:46.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2247 0.32 MB/sec warmup 83 sec latency 341.912 ms 2023-12-13T00:03:47.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2292 0.33 MB/sec warmup 84 sec latency 286.798 ms 2023-12-13T00:03:48.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2306 0.33 MB/sec warmup 85 sec latency 335.547 ms 2023-12-13T00:03:49.558 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2324 0.32 MB/sec warmup 86 sec latency 315.019 ms 2023-12-13T00:03:50.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2337 0.32 MB/sec warmup 87 sec latency 352.246 ms 2023-12-13T00:03:51.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2359 0.32 MB/sec warmup 88 sec latency 354.945 ms 2023-12-13T00:03:52.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2362 0.31 MB/sec warmup 89 sec latency 452.670 ms 2023-12-13T00:03:53.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2371 0.31 MB/sec warmup 90 sec latency 340.245 ms 2023-12-13T00:03:54.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2389 0.31 MB/sec warmup 91 sec latency 316.287 ms 2023-12-13T00:03:55.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2401 0.30 MB/sec warmup 92 sec latency 299.360 ms 2023-12-13T00:03:56.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2423 0.30 MB/sec warmup 93 sec latency 312.766 ms 2023-12-13T00:03:57.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2432 0.30 MB/sec warmup 94 sec latency 323.253 ms 2023-12-13T00:03:58.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2441 0.30 MB/sec warmup 95 sec latency 316.470 ms 2023-12-13T00:03:59.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2466 0.30 MB/sec warmup 96 sec latency 191.927 ms 2023-12-13T00:04:00.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2489 0.30 MB/sec warmup 97 sec latency 331.262 ms 2023-12-13T00:04:01.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:04:01.036 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:04:01.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2497 0.29 MB/sec warmup 98 sec latency 318.894 ms 2023-12-13T00:04:02.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2549 0.29 MB/sec warmup 99 sec latency 428.849 ms 2023-12-13T00:04:03.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2559 0.29 MB/sec warmup 100 sec latency 340.553 ms 2023-12-13T00:04:04.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2577 0.29 MB/sec warmup 101 sec latency 313.594 ms 2023-12-13T00:04:05.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2583 0.28 MB/sec warmup 102 sec latency 332.986 ms 2023-12-13T00:04:06.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2600 0.28 MB/sec warmup 103 sec latency 263.965 ms 2023-12-13T00:04:07.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2615 0.28 MB/sec warmup 104 sec latency 298.213 ms 2023-12-13T00:04:08.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2621 0.28 MB/sec warmup 105 sec latency 330.522 ms 2023-12-13T00:04:09.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2745 0.30 MB/sec warmup 106 sec latency 319.000 ms 2023-12-13T00:04:10.559 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2760 0.30 MB/sec warmup 107 sec latency 344.835 ms 2023-12-13T00:04:11.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2779 0.30 MB/sec warmup 108 sec latency 336.089 ms 2023-12-13T00:04:12.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2874 0.30 MB/sec warmup 109 sec latency 335.589 ms 2023-12-13T00:04:13.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2898 0.30 MB/sec warmup 110 sec latency 174.021 ms 2023-12-13T00:04:14.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2925 0.30 MB/sec warmup 111 sec latency 205.001 ms 2023-12-13T00:04:15.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2938 0.30 MB/sec warmup 112 sec latency 196.062 ms 2023-12-13T00:04:16.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2973 0.30 MB/sec warmup 113 sec latency 313.121 ms 2023-12-13T00:04:17.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 2986 0.29 MB/sec warmup 114 sec latency 405.589 ms 2023-12-13T00:04:18.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3002 0.29 MB/sec warmup 115 sec latency 298.071 ms 2023-12-13T00:04:19.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3021 0.29 MB/sec warmup 116 sec latency 180.082 ms 2023-12-13T00:04:20.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3167 0.29 MB/sec warmup 117 sec latency 312.671 ms 2023-12-13T00:04:21.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3188 0.29 MB/sec warmup 118 sec latency 318.529 ms 2023-12-13T00:04:22.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3205 0.29 MB/sec warmup 119 sec latency 319.946 ms 2023-12-13T00:04:24.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3280 0.02 MB/sec execute 1 sec latency 298.571 ms 2023-12-13T00:04:25.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3283 0.01 MB/sec execute 2 sec latency 314.928 ms 2023-12-13T00:04:26.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3287 0.01 MB/sec execute 3 sec latency 331.603 ms 2023-12-13T00:04:27.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3292 0.00 MB/sec execute 4 sec latency 348.359 ms 2023-12-13T00:04:28.560 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3298 0.00 MB/sec execute 5 sec latency 318.827 ms 2023-12-13T00:04:29.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3303 0.00 MB/sec execute 6 sec latency 337.865 ms 2023-12-13T00:04:30.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3309 0.01 MB/sec execute 7 sec latency 346.929 ms 2023-12-13T00:04:31.154 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:04:31.157 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:04:31.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3312 0.00 MB/sec execute 8 sec latency 331.475 ms 2023-12-13T00:04:32.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3314 0.00 MB/sec execute 9 sec latency 405.745 ms 2023-12-13T00:04:33.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3318 0.00 MB/sec execute 10 sec latency 350.809 ms 2023-12-13T00:04:34.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3322 0.00 MB/sec execute 11 sec latency 374.633 ms 2023-12-13T00:04:35.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3326 0.00 MB/sec execute 12 sec latency 328.113 ms 2023-12-13T00:04:36.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3330 0.00 MB/sec execute 13 sec latency 344.212 ms 2023-12-13T00:04:37.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3333 0.00 MB/sec execute 14 sec latency 386.669 ms 2023-12-13T00:04:38.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3337 0.00 MB/sec execute 15 sec latency 321.853 ms 2023-12-13T00:04:39.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3353 0.00 MB/sec execute 16 sec latency 345.832 ms 2023-12-13T00:04:40.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3372 0.01 MB/sec execute 17 sec latency 185.712 ms 2023-12-13T00:04:41.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3391 0.01 MB/sec execute 18 sec latency 169.410 ms 2023-12-13T00:04:42.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3395 0.01 MB/sec execute 19 sec latency 380.455 ms 2023-12-13T00:04:43.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3503 0.15 MB/sec execute 20 sec latency 307.584 ms 2023-12-13T00:04:44.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3530 0.14 MB/sec execute 21 sec latency 114.758 ms 2023-12-13T00:04:45.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3548 0.14 MB/sec execute 22 sec latency 322.165 ms 2023-12-13T00:04:46.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3560 0.13 MB/sec execute 23 sec latency 321.388 ms 2023-12-13T00:04:47.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3581 0.13 MB/sec execute 24 sec latency 349.886 ms 2023-12-13T00:04:48.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3627 0.13 MB/sec execute 25 sec latency 315.299 ms 2023-12-13T00:04:49.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3642 0.13 MB/sec execute 26 sec latency 247.542 ms 2023-12-13T00:04:50.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3666 0.13 MB/sec execute 27 sec latency 305.676 ms 2023-12-13T00:04:51.561 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3682 0.12 MB/sec execute 28 sec latency 315.493 ms 2023-12-13T00:04:52.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3696 0.12 MB/sec execute 29 sec latency 374.352 ms 2023-12-13T00:04:53.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3716 0.12 MB/sec execute 30 sec latency 219.920 ms 2023-12-13T00:04:54.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3758 0.14 MB/sec execute 31 sec latency 202.442 ms 2023-12-13T00:04:55.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3773 0.14 MB/sec execute 32 sec latency 328.982 ms 2023-12-13T00:04:56.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3784 0.13 MB/sec execute 33 sec latency 192.275 ms 2023-12-13T00:04:57.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3792 0.13 MB/sec execute 34 sec latency 239.717 ms 2023-12-13T00:04:58.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3801 0.13 MB/sec execute 35 sec latency 241.670 ms 2023-12-13T00:04:59.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3812 0.12 MB/sec execute 36 sec latency 220.569 ms 2023-12-13T00:05:00.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3824 0.12 MB/sec execute 37 sec latency 202.124 ms 2023-12-13T00:05:01.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:05:01.257 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:05:01.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3836 0.12 MB/sec execute 38 sec latency 223.801 ms 2023-12-13T00:05:02.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3847 0.11 MB/sec execute 39 sec latency 196.674 ms 2023-12-13T00:05:03.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3860 0.11 MB/sec execute 40 sec latency 179.210 ms 2023-12-13T00:05:04.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3870 0.11 MB/sec execute 41 sec latency 184.893 ms 2023-12-13T00:05:05.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3879 0.11 MB/sec execute 42 sec latency 311.229 ms 2023-12-13T00:05:06.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3897 0.11 MB/sec execute 43 sec latency 315.072 ms 2023-12-13T00:05:07.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3914 0.11 MB/sec execute 44 sec latency 377.477 ms 2023-12-13T00:05:08.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3925 0.11 MB/sec execute 45 sec latency 333.238 ms 2023-12-13T00:05:09.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3935 0.10 MB/sec execute 46 sec latency 222.274 ms 2023-12-13T00:05:10.562 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3942 0.10 MB/sec execute 47 sec latency 269.864 ms 2023-12-13T00:05:11.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3951 0.10 MB/sec execute 48 sec latency 256.305 ms 2023-12-13T00:05:12.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3961 0.10 MB/sec execute 49 sec latency 208.409 ms 2023-12-13T00:05:13.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3974 0.09 MB/sec execute 50 sec latency 196.284 ms 2023-12-13T00:05:14.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3987 0.09 MB/sec execute 51 sec latency 181.760 ms 2023-12-13T00:05:15.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 3999 0.09 MB/sec execute 52 sec latency 210.372 ms 2023-12-13T00:05:16.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4010 0.09 MB/sec execute 53 sec latency 182.916 ms 2023-12-13T00:05:17.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4022 0.09 MB/sec execute 54 sec latency 183.495 ms 2023-12-13T00:05:18.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4028 0.09 MB/sec execute 55 sec latency 345.222 ms 2023-12-13T00:05:19.567 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4035 0.08 MB/sec execute 56 sec latency 320.824 ms 2023-12-13T00:05:20.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4058 0.08 MB/sec execute 57 sec latency 333.673 ms 2023-12-13T00:05:21.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4071 0.08 MB/sec execute 58 sec latency 319.934 ms 2023-12-13T00:05:22.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4091 0.08 MB/sec execute 59 sec latency 371.502 ms 2023-12-13T00:05:23.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4104 0.08 MB/sec execute 60 sec latency 159.563 ms 2023-12-13T00:05:24.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4117 0.08 MB/sec execute 61 sec latency 144.038 ms 2023-12-13T00:05:25.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4133 0.08 MB/sec execute 62 sec latency 151.725 ms 2023-12-13T00:05:26.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4145 0.08 MB/sec execute 63 sec latency 178.545 ms 2023-12-13T00:05:27.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4158 0.07 MB/sec execute 64 sec latency 283.808 ms 2023-12-13T00:05:28.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4169 0.07 MB/sec execute 65 sec latency 149.213 ms 2023-12-13T00:05:29.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4179 0.07 MB/sec execute 66 sec latency 319.847 ms 2023-12-13T00:05:30.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4216 0.07 MB/sec execute 67 sec latency 313.689 ms 2023-12-13T00:05:31.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:05:31.375 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:05:31.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4225 0.07 MB/sec execute 68 sec latency 304.767 ms 2023-12-13T00:05:32.563 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4250 0.07 MB/sec execute 69 sec latency 529.449 ms 2023-12-13T00:05:33.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4272 0.07 MB/sec execute 70 sec latency 334.764 ms 2023-12-13T00:05:34.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4297 0.07 MB/sec execute 71 sec latency 214.789 ms 2023-12-13T00:05:35.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4318 0.07 MB/sec execute 72 sec latency 331.813 ms 2023-12-13T00:05:36.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4350 0.07 MB/sec execute 73 sec latency 199.711 ms 2023-12-13T00:05:37.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4383 0.07 MB/sec execute 74 sec latency 312.497 ms 2023-12-13T00:05:38.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4388 0.07 MB/sec execute 75 sec latency 327.213 ms 2023-12-13T00:05:39.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4424 0.07 MB/sec execute 76 sec latency 345.127 ms 2023-12-13T00:05:40.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4432 0.07 MB/sec execute 77 sec latency 335.372 ms 2023-12-13T00:05:41.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4462 0.07 MB/sec execute 78 sec latency 334.591 ms 2023-12-13T00:05:42.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4480 0.07 MB/sec execute 79 sec latency 200.502 ms 2023-12-13T00:05:43.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4498 0.07 MB/sec execute 80 sec latency 326.419 ms 2023-12-13T00:05:44.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4506 0.07 MB/sec execute 81 sec latency 308.585 ms 2023-12-13T00:05:45.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4530 0.07 MB/sec execute 82 sec latency 316.322 ms 2023-12-13T00:05:46.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4559 0.07 MB/sec execute 83 sec latency 199.974 ms 2023-12-13T00:05:47.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4596 0.08 MB/sec execute 84 sec latency 321.262 ms 2023-12-13T00:05:48.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4614 0.08 MB/sec execute 85 sec latency 325.766 ms 2023-12-13T00:05:49.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4621 0.08 MB/sec execute 86 sec latency 317.996 ms 2023-12-13T00:05:50.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4653 0.08 MB/sec execute 87 sec latency 168.496 ms 2023-12-13T00:05:51.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4668 0.08 MB/sec execute 88 sec latency 306.150 ms 2023-12-13T00:05:52.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4695 0.08 MB/sec execute 89 sec latency 336.877 ms 2023-12-13T00:05:53.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4724 0.08 MB/sec execute 90 sec latency 189.964 ms 2023-12-13T00:05:54.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4735 0.07 MB/sec execute 91 sec latency 323.945 ms 2023-12-13T00:05:55.564 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4742 0.07 MB/sec execute 92 sec latency 343.835 ms 2023-12-13T00:05:56.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4767 0.07 MB/sec execute 93 sec latency 190.375 ms 2023-12-13T00:05:57.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4786 0.07 MB/sec execute 94 sec latency 312.287 ms 2023-12-13T00:05:58.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4811 0.07 MB/sec execute 95 sec latency 217.651 ms 2023-12-13T00:05:59.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4834 0.07 MB/sec execute 96 sec latency 313.502 ms 2023-12-13T00:06:00.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4847 0.07 MB/sec execute 97 sec latency 327.932 ms 2023-12-13T00:06:01.470 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:06:01.474 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:06:01.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4942 0.10 MB/sec execute 98 sec latency 344.656 ms 2023-12-13T00:06:02.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4948 0.10 MB/sec execute 99 sec latency 392.373 ms 2023-12-13T00:06:03.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4963 0.10 MB/sec execute 100 sec latency 293.304 ms 2023-12-13T00:06:04.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 4984 0.10 MB/sec execute 101 sec latency 342.280 ms 2023-12-13T00:06:05.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5012 0.10 MB/sec execute 102 sec latency 173.509 ms 2023-12-13T00:06:06.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5032 0.10 MB/sec execute 103 sec latency 306.360 ms 2023-12-13T00:06:07.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5052 0.09 MB/sec execute 104 sec latency 413.997 ms 2023-12-13T00:06:08.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5068 0.09 MB/sec execute 105 sec latency 315.032 ms 2023-12-13T00:06:09.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5092 0.09 MB/sec execute 106 sec latency 181.846 ms 2023-12-13T00:06:10.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5118 0.09 MB/sec execute 107 sec latency 335.517 ms 2023-12-13T00:06:11.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5145 0.09 MB/sec execute 108 sec latency 299.883 ms 2023-12-13T00:06:12.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5168 0.09 MB/sec execute 109 sec latency 326.789 ms 2023-12-13T00:06:13.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5180 0.09 MB/sec execute 110 sec latency 320.843 ms 2023-12-13T00:06:14.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5206 0.09 MB/sec execute 111 sec latency 335.371 ms 2023-12-13T00:06:15.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5218 0.09 MB/sec execute 112 sec latency 342.328 ms 2023-12-13T00:06:16.565 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5252 0.09 MB/sec execute 113 sec latency 255.603 ms 2023-12-13T00:06:17.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5266 0.09 MB/sec execute 114 sec latency 310.021 ms 2023-12-13T00:06:18.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5327 0.09 MB/sec execute 115 sec latency 321.020 ms 2023-12-13T00:06:19.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5362 0.09 MB/sec execute 116 sec latency 305.454 ms 2023-12-13T00:06:20.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5386 0.09 MB/sec execute 117 sec latency 299.919 ms 2023-12-13T00:06:21.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5402 0.09 MB/sec execute 118 sec latency 313.364 ms 2023-12-13T00:06:22.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5423 0.09 MB/sec execute 119 sec latency 324.082 ms 2023-12-13T00:06:23.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5434 0.08 MB/sec execute 120 sec latency 306.844 ms 2023-12-13T00:06:24.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5468 0.08 MB/sec execute 121 sec latency 320.109 ms 2023-12-13T00:06:25.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5485 0.08 MB/sec execute 122 sec latency 330.615 ms 2023-12-13T00:06:26.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5536 0.08 MB/sec execute 123 sec latency 294.595 ms 2023-12-13T00:06:27.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5554 0.08 MB/sec execute 124 sec latency 391.799 ms 2023-12-13T00:06:28.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5597 0.08 MB/sec execute 125 sec latency 339.418 ms 2023-12-13T00:06:29.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5613 0.08 MB/sec execute 126 sec latency 322.804 ms 2023-12-13T00:06:30.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5623 0.08 MB/sec execute 127 sec latency 337.021 ms 2023-12-13T00:06:31.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5643 0.08 MB/sec execute 128 sec latency 328.215 ms 2023-12-13T00:06:31.583 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:06:31.585 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:06:32.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5660 0.08 MB/sec execute 129 sec latency 346.279 ms 2023-12-13T00:06:33.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5707 0.08 MB/sec execute 130 sec latency 321.251 ms 2023-12-13T00:06:34.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5737 0.08 MB/sec execute 131 sec latency 331.948 ms 2023-12-13T00:06:35.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5746 0.08 MB/sec execute 132 sec latency 335.814 ms 2023-12-13T00:06:36.567 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5782 0.08 MB/sec execute 133 sec latency 170.504 ms 2023-12-13T00:06:37.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5853 0.09 MB/sec execute 134 sec latency 316.549 ms 2023-12-13T00:06:38.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5866 0.09 MB/sec execute 135 sec latency 304.426 ms 2023-12-13T00:06:39.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5884 0.09 MB/sec execute 136 sec latency 364.019 ms 2023-12-13T00:06:40.566 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5895 0.08 MB/sec execute 137 sec latency 339.466 ms 2023-12-13T00:06:41.567 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5918 0.08 MB/sec execute 138 sec latency 328.790 ms 2023-12-13T00:06:42.567 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5924 0.08 MB/sec execute 139 sec latency 315.512 ms 2023-12-13T00:06:43.567 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5931 0.08 MB/sec execute 140 sec latency 333.714 ms 2023-12-13T00:06:44.567 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5951 0.08 MB/sec execute 141 sec latency 302.354 ms 2023-12-13T00:06:45.567 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5966 0.08 MB/sec execute 142 sec latency 325.494 ms 2023-12-13T00:06:46.567 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5988 0.08 MB/sec execute 143 sec latency 303.696 ms 2023-12-13T00:06:47.567 INFO:tasks.workunit.client.0.smithi072.stdout: 1 5992 0.08 MB/sec execute 144 sec latency 407.318 ms 2023-12-13T00:06:48.567 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6007 0.08 MB/sec execute 145 sec latency 317.833 ms 2023-12-13T00:06:49.567 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6028 0.08 MB/sec execute 146 sec latency 201.874 ms 2023-12-13T00:06:50.567 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6050 0.09 MB/sec execute 147 sec latency 318.693 ms 2023-12-13T00:06:51.567 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6059 0.08 MB/sec execute 148 sec latency 339.940 ms 2023-12-13T00:06:52.567 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6109 0.09 MB/sec execute 149 sec latency 321.451 ms 2023-12-13T00:06:53.567 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6118 0.08 MB/sec execute 150 sec latency 329.238 ms 2023-12-13T00:06:54.567 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6138 0.08 MB/sec execute 151 sec latency 337.274 ms 2023-12-13T00:06:55.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6150 0.08 MB/sec execute 152 sec latency 319.539 ms 2023-12-13T00:06:56.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6164 0.08 MB/sec execute 153 sec latency 291.292 ms 2023-12-13T00:06:57.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6175 0.08 MB/sec execute 154 sec latency 414.011 ms 2023-12-13T00:06:58.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6274 0.10 MB/sec execute 155 sec latency 318.786 ms 2023-12-13T00:06:59.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6308 0.10 MB/sec execute 156 sec latency 324.366 ms 2023-12-13T00:07:00.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6324 0.10 MB/sec execute 157 sec latency 296.960 ms 2023-12-13T00:07:01.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6337 0.10 MB/sec execute 158 sec latency 335.989 ms 2023-12-13T00:07:01.705 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:07:01.708 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:07:02.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6435 0.10 MB/sec execute 159 sec latency 330.766 ms 2023-12-13T00:07:03.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6458 0.10 MB/sec execute 160 sec latency 198.777 ms 2023-12-13T00:07:04.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6487 0.11 MB/sec execute 161 sec latency 189.698 ms 2023-12-13T00:07:05.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6522 0.11 MB/sec execute 162 sec latency 297.478 ms 2023-12-13T00:07:06.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6533 0.11 MB/sec execute 163 sec latency 309.289 ms 2023-12-13T00:07:07.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6549 0.11 MB/sec execute 164 sec latency 253.384 ms 2023-12-13T00:07:08.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6567 0.10 MB/sec execute 165 sec latency 341.881 ms 2023-12-13T00:07:09.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6580 0.10 MB/sec execute 166 sec latency 196.641 ms 2023-12-13T00:07:10.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6726 0.11 MB/sec execute 167 sec latency 319.871 ms 2023-12-13T00:07:11.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6744 0.11 MB/sec execute 168 sec latency 333.731 ms 2023-12-13T00:07:12.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6767 0.11 MB/sec execute 169 sec latency 214.822 ms 2023-12-13T00:07:13.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6827 0.11 MB/sec execute 170 sec latency 324.857 ms 2023-12-13T00:07:14.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6836 0.11 MB/sec execute 171 sec latency 322.574 ms 2023-12-13T00:07:15.568 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6840 0.11 MB/sec execute 172 sec latency 314.658 ms 2023-12-13T00:07:16.569 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6845 0.11 MB/sec execute 173 sec latency 317.625 ms 2023-12-13T00:07:17.569 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6848 0.11 MB/sec execute 174 sec latency 431.402 ms 2023-12-13T00:07:18.569 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6854 0.11 MB/sec execute 175 sec latency 327.067 ms 2023-12-13T00:07:19.569 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6862 0.11 MB/sec execute 176 sec latency 361.318 ms 2023-12-13T00:07:20.569 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6865 0.11 MB/sec execute 177 sec latency 323.497 ms 2023-12-13T00:07:21.570 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6868 0.11 MB/sec execute 178 sec latency 317.771 ms 2023-12-13T00:07:22.569 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6872 0.11 MB/sec execute 179 sec latency 413.714 ms 2023-12-13T00:07:23.569 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6875 0.11 MB/sec execute 180 sec latency 328.987 ms 2023-12-13T00:07:24.569 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6879 0.11 MB/sec execute 181 sec latency 325.336 ms 2023-12-13T00:07:25.569 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6882 0.11 MB/sec execute 182 sec latency 313.331 ms 2023-12-13T00:07:26.569 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6887 0.10 MB/sec execute 183 sec latency 338.479 ms 2023-12-13T00:07:27.569 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6890 0.10 MB/sec execute 184 sec latency 406.661 ms 2023-12-13T00:07:28.569 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6897 0.10 MB/sec execute 185 sec latency 360.463 ms 2023-12-13T00:07:29.569 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6918 0.10 MB/sec execute 186 sec latency 164.970 ms 2023-12-13T00:07:30.570 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6933 0.10 MB/sec execute 187 sec latency 195.634 ms 2023-12-13T00:07:31.569 INFO:tasks.workunit.client.0.smithi072.stdout: 1 6948 0.10 MB/sec execute 188 sec latency 321.361 ms 2023-12-13T00:07:31.784 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:07:31.786 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:07:32.570 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7046 0.12 MB/sec execute 189 sec latency 342.549 ms 2023-12-13T00:07:33.570 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7071 0.12 MB/sec execute 190 sec latency 124.328 ms 2023-12-13T00:07:34.570 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7087 0.12 MB/sec execute 191 sec latency 299.578 ms 2023-12-13T00:07:35.570 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7108 0.12 MB/sec execute 192 sec latency 172.023 ms 2023-12-13T00:07:36.570 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7123 0.12 MB/sec execute 193 sec latency 321.730 ms 2023-12-13T00:07:37.570 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7162 0.12 MB/sec execute 194 sec latency 360.953 ms 2023-12-13T00:07:38.570 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7185 0.11 MB/sec execute 195 sec latency 218.701 ms 2023-12-13T00:07:39.570 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7197 0.11 MB/sec execute 196 sec latency 352.029 ms 2023-12-13T00:07:40.570 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7218 0.11 MB/sec execute 197 sec latency 298.754 ms 2023-12-13T00:07:41.570 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7231 0.11 MB/sec execute 198 sec latency 306.864 ms 2023-12-13T00:07:42.570 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7250 0.11 MB/sec execute 199 sec latency 369.690 ms 2023-12-13T00:07:43.570 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7266 0.11 MB/sec execute 200 sec latency 182.464 ms 2023-12-13T00:07:44.570 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7312 0.12 MB/sec execute 201 sec latency 325.174 ms 2023-12-13T00:07:45.570 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7324 0.12 MB/sec execute 202 sec latency 232.019 ms 2023-12-13T00:07:46.570 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7334 0.12 MB/sec execute 203 sec latency 233.572 ms 2023-12-13T00:07:47.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7340 0.12 MB/sec execute 204 sec latency 217.072 ms 2023-12-13T00:07:48.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7349 0.11 MB/sec execute 205 sec latency 242.803 ms 2023-12-13T00:07:49.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7362 0.11 MB/sec execute 206 sec latency 185.512 ms 2023-12-13T00:07:50.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7373 0.11 MB/sec execute 207 sec latency 203.777 ms 2023-12-13T00:07:51.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7386 0.11 MB/sec execute 208 sec latency 181.458 ms 2023-12-13T00:07:52.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7397 0.11 MB/sec execute 209 sec latency 183.864 ms 2023-12-13T00:07:53.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7411 0.11 MB/sec execute 210 sec latency 182.937 ms 2023-12-13T00:07:54.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7420 0.11 MB/sec execute 211 sec latency 317.107 ms 2023-12-13T00:07:55.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7429 0.11 MB/sec execute 212 sec latency 303.540 ms 2023-12-13T00:07:56.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7443 0.11 MB/sec execute 213 sec latency 347.454 ms 2023-12-13T00:07:57.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7463 0.11 MB/sec execute 214 sec latency 403.881 ms 2023-12-13T00:07:58.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7474 0.11 MB/sec execute 215 sec latency 193.602 ms 2023-12-13T00:07:59.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7482 0.11 MB/sec execute 216 sec latency 258.815 ms 2023-12-13T00:08:00.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7490 0.11 MB/sec execute 217 sec latency 240.810 ms 2023-12-13T00:08:01.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7499 0.11 MB/sec execute 218 sec latency 270.198 ms 2023-12-13T00:08:01.924 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:08:01.926 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:08:02.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7511 0.11 MB/sec execute 219 sec latency 200.347 ms 2023-12-13T00:08:03.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7523 0.11 MB/sec execute 220 sec latency 191.158 ms 2023-12-13T00:08:04.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7535 0.11 MB/sec execute 221 sec latency 195.175 ms 2023-12-13T00:08:05.571 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7548 0.11 MB/sec execute 222 sec latency 188.196 ms 2023-12-13T00:08:06.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7558 0.11 MB/sec execute 223 sec latency 189.896 ms 2023-12-13T00:08:07.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7570 0.11 MB/sec execute 224 sec latency 255.307 ms 2023-12-13T00:08:08.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7576 0.11 MB/sec execute 225 sec latency 300.951 ms 2023-12-13T00:08:09.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7587 0.11 MB/sec execute 226 sec latency 312.655 ms 2023-12-13T00:08:10.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7605 0.11 MB/sec execute 227 sec latency 324.518 ms 2023-12-13T00:08:11.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7626 0.10 MB/sec execute 228 sec latency 347.681 ms 2023-12-13T00:08:12.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7640 0.10 MB/sec execute 229 sec latency 369.700 ms 2023-12-13T00:08:13.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7653 0.10 MB/sec execute 230 sec latency 147.605 ms 2023-12-13T00:08:14.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7666 0.10 MB/sec execute 231 sec latency 152.702 ms 2023-12-13T00:08:15.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7679 0.10 MB/sec execute 232 sec latency 160.352 ms 2023-12-13T00:08:16.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7695 0.10 MB/sec execute 233 sec latency 137.196 ms 2023-12-13T00:08:17.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7704 0.10 MB/sec execute 234 sec latency 186.881 ms 2023-12-13T00:08:18.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7715 0.10 MB/sec execute 235 sec latency 302.473 ms 2023-12-13T00:08:19.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7728 0.10 MB/sec execute 236 sec latency 332.185 ms 2023-12-13T00:08:20.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7762 0.10 MB/sec execute 237 sec latency 346.760 ms 2023-12-13T00:08:21.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7769 0.10 MB/sec execute 238 sec latency 313.520 ms 2023-12-13T00:08:22.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7796 0.10 MB/sec execute 239 sec latency 369.764 ms 2023-12-13T00:08:23.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7823 0.10 MB/sec execute 240 sec latency 296.919 ms 2023-12-13T00:08:24.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7857 0.10 MB/sec execute 241 sec latency 192.223 ms 2023-12-13T00:08:25.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7882 0.10 MB/sec execute 242 sec latency 339.642 ms 2023-12-13T00:08:26.572 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7899 0.10 MB/sec execute 243 sec latency 194.090 ms 2023-12-13T00:08:27.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7926 0.10 MB/sec execute 244 sec latency 423.262 ms 2023-12-13T00:08:28.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7935 0.10 MB/sec execute 245 sec latency 348.802 ms 2023-12-13T00:08:29.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7971 0.10 MB/sec execute 246 sec latency 327.722 ms 2023-12-13T00:08:30.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 7986 0.10 MB/sec execute 247 sec latency 314.924 ms 2023-12-13T00:08:31.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8014 0.10 MB/sec execute 248 sec latency 307.326 ms 2023-12-13T00:08:32.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:08:32.073 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:08:32.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8039 0.10 MB/sec execute 249 sec latency 203.138 ms 2023-12-13T00:08:33.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8043 0.10 MB/sec execute 250 sec latency 343.123 ms 2023-12-13T00:08:34.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8053 0.10 MB/sec execute 251 sec latency 319.612 ms 2023-12-13T00:08:35.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8081 0.10 MB/sec execute 252 sec latency 298.846 ms 2023-12-13T00:08:36.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8106 0.10 MB/sec execute 253 sec latency 311.480 ms 2023-12-13T00:08:36.589 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:09:01.130 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:08:36.633 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:09:01.167 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:08:36.656 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:09:01.197 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:08:36.704 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:09:01.238 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:08:36.719 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:09:01.253 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:08:36.776 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:09:01.310 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:08:37.069 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:09:01.610 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:08:37.113 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:09:01.647 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:08:37.182 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:09:01.716 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:08:37.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8142 0.10 MB/sec execute 254 sec latency 511.365 ms 2023-12-13T00:08:38.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8157 0.10 MB/sec execute 255 sec latency 344.211 ms 2023-12-13T00:08:39.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8169 0.10 MB/sec execute 256 sec latency 311.591 ms 2023-12-13T00:08:40.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8195 0.10 MB/sec execute 257 sec latency 160.851 ms 2023-12-13T00:08:41.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8210 0.10 MB/sec execute 258 sec latency 293.245 ms 2023-12-13T00:08:42.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8237 0.10 MB/sec execute 259 sec latency 424.111 ms 2023-12-13T00:08:43.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8266 0.10 MB/sec execute 260 sec latency 209.870 ms 2023-12-13T00:08:44.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8277 0.10 MB/sec execute 261 sec latency 322.367 ms 2023-12-13T00:08:45.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8284 0.10 MB/sec execute 262 sec latency 322.519 ms 2023-12-13T00:08:46.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8310 0.10 MB/sec execute 263 sec latency 165.103 ms 2023-12-13T00:08:47.573 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8329 0.10 MB/sec execute 264 sec latency 337.477 ms 2023-12-13T00:08:48.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8356 0.10 MB/sec execute 265 sec latency 209.133 ms 2023-12-13T00:08:49.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8381 0.10 MB/sec execute 266 sec latency 329.779 ms 2023-12-13T00:08:50.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8390 0.10 MB/sec execute 267 sec latency 318.488 ms 2023-12-13T00:08:51.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8485 0.11 MB/sec execute 268 sec latency 319.567 ms 2023-12-13T00:08:52.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8494 0.11 MB/sec execute 269 sec latency 395.169 ms 2023-12-13T00:08:53.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8508 0.11 MB/sec execute 270 sec latency 311.777 ms 2023-12-13T00:08:54.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8530 0.11 MB/sec execute 271 sec latency 301.659 ms 2023-12-13T00:08:55.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8557 0.11 MB/sec execute 272 sec latency 221.278 ms 2023-12-13T00:08:56.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8575 0.11 MB/sec execute 273 sec latency 318.655 ms 2023-12-13T00:08:57.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8597 0.11 MB/sec execute 274 sec latency 404.839 ms 2023-12-13T00:08:58.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8613 0.11 MB/sec execute 275 sec latency 299.060 ms 2023-12-13T00:08:59.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8636 0.11 MB/sec execute 276 sec latency 297.193 ms 2023-12-13T00:09:00.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8663 0.10 MB/sec execute 277 sec latency 326.850 ms 2023-12-13T00:09:01.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8694 0.10 MB/sec execute 278 sec latency 321.324 ms 2023-12-13T00:09:02.166 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:09:02.169 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:09:02.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8714 0.10 MB/sec execute 279 sec latency 307.685 ms 2023-12-13T00:09:03.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8725 0.10 MB/sec execute 280 sec latency 309.153 ms 2023-12-13T00:09:04.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8751 0.10 MB/sec execute 281 sec latency 332.514 ms 2023-12-13T00:09:05.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8770 0.10 MB/sec execute 282 sec latency 309.665 ms 2023-12-13T00:09:06.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8799 0.10 MB/sec execute 283 sec latency 244.394 ms 2023-12-13T00:09:07.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8815 0.10 MB/sec execute 284 sec latency 310.050 ms 2023-12-13T00:09:08.574 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8878 0.10 MB/sec execute 285 sec latency 308.985 ms 2023-12-13T00:09:09.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8913 0.10 MB/sec execute 286 sec latency 331.071 ms 2023-12-13T00:09:10.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8930 0.10 MB/sec execute 287 sec latency 336.402 ms 2023-12-13T00:09:11.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8949 0.10 MB/sec execute 288 sec latency 333.414 ms 2023-12-13T00:09:12.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8968 0.10 MB/sec execute 289 sec latency 394.743 ms 2023-12-13T00:09:12.893 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:09:37.434 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:09:12.896 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:09:37.436 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:09:12.904 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:09:37.438 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:09:12.905 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:09:37.440 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:09:12.907 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:09:37.441 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:09:12.908 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:09:37.442 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:09:12.942 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:09:37.483 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:09:12.953 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:09:37.487 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:09:12.954 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:09:37.488 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:09:13.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 8978 0.10 MB/sec execute 290 sec latency 338.640 ms 2023-12-13T00:09:14.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9012 0.10 MB/sec execute 291 sec latency 315.912 ms 2023-12-13T00:09:15.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9029 0.10 MB/sec execute 292 sec latency 342.603 ms 2023-12-13T00:09:16.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9082 0.10 MB/sec execute 293 sec latency 324.448 ms 2023-12-13T00:09:17.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9106 0.10 MB/sec execute 294 sec latency 286.278 ms 2023-12-13T00:09:18.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9142 0.10 MB/sec execute 295 sec latency 316.395 ms 2023-12-13T00:09:19.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9159 0.10 MB/sec execute 296 sec latency 332.194 ms 2023-12-13T00:09:20.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9175 0.10 MB/sec execute 297 sec latency 326.261 ms 2023-12-13T00:09:21.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9199 0.10 MB/sec execute 298 sec latency 340.940 ms 2023-12-13T00:09:22.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9233 0.10 MB/sec execute 299 sec latency 389.828 ms 2023-12-13T00:09:23.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9252 0.10 MB/sec execute 300 sec latency 309.531 ms 2023-12-13T00:09:24.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9281 0.10 MB/sec execute 301 sec latency 325.504 ms 2023-12-13T00:09:25.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9303 0.10 MB/sec execute 302 sec latency 321.579 ms 2023-12-13T00:09:26.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9346 0.10 MB/sec execute 303 sec latency 313.006 ms 2023-12-13T00:09:27.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9399 0.10 MB/sec execute 304 sec latency 312.692 ms 2023-12-13T00:09:28.575 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9410 0.10 MB/sec execute 305 sec latency 321.292 ms 2023-12-13T00:09:29.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9428 0.10 MB/sec execute 306 sec latency 336.075 ms 2023-12-13T00:09:30.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9441 0.10 MB/sec execute 307 sec latency 325.682 ms 2023-12-13T00:09:31.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9463 0.10 MB/sec execute 308 sec latency 319.383 ms 2023-12-13T00:09:32.280 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:09:32.283 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:09:32.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9468 0.10 MB/sec execute 309 sec latency 372.879 ms 2023-12-13T00:09:33.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9477 0.10 MB/sec execute 310 sec latency 325.614 ms 2023-12-13T00:09:34.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9495 0.10 MB/sec execute 311 sec latency 190.352 ms 2023-12-13T00:09:35.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9510 0.10 MB/sec execute 312 sec latency 300.542 ms 2023-12-13T00:09:36.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9532 0.10 MB/sec execute 313 sec latency 327.250 ms 2023-12-13T00:09:37.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9536 0.10 MB/sec execute 314 sec latency 316.689 ms 2023-12-13T00:09:38.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9552 0.10 MB/sec execute 315 sec latency 324.876 ms 2023-12-13T00:09:39.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9574 0.10 MB/sec execute 316 sec latency 206.197 ms 2023-12-13T00:09:40.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9594 0.10 MB/sec execute 317 sec latency 305.517 ms 2023-12-13T00:09:41.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9606 0.10 MB/sec execute 318 sec latency 324.369 ms 2023-12-13T00:09:42.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9653 0.10 MB/sec execute 319 sec latency 404.672 ms 2023-12-13T00:09:43.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9663 0.10 MB/sec execute 320 sec latency 337.031 ms 2023-12-13T00:09:44.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9682 0.10 MB/sec execute 321 sec latency 265.604 ms 2023-12-13T00:09:45.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9698 0.10 MB/sec execute 322 sec latency 324.168 ms 2023-12-13T00:09:46.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9709 0.10 MB/sec execute 323 sec latency 290.611 ms 2023-12-13T00:09:47.576 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9719 0.10 MB/sec execute 324 sec latency 335.693 ms 2023-12-13T00:09:48.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9819 0.11 MB/sec execute 325 sec latency 321.939 ms 2023-12-13T00:09:49.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9854 0.11 MB/sec execute 326 sec latency 311.174 ms 2023-12-13T00:09:50.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9870 0.11 MB/sec execute 327 sec latency 342.394 ms 2023-12-13T00:09:51.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9971 0.11 MB/sec execute 328 sec latency 309.687 ms 2023-12-13T00:09:52.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 9980 0.11 MB/sec execute 329 sec latency 363.340 ms 2023-12-13T00:09:53.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10016 0.11 MB/sec execute 330 sec latency 198.826 ms 2023-12-13T00:09:54.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10031 0.11 MB/sec execute 331 sec latency 189.774 ms 2023-12-13T00:09:55.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10067 0.11 MB/sec execute 332 sec latency 332.647 ms 2023-12-13T00:09:56.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10077 0.11 MB/sec execute 333 sec latency 302.258 ms 2023-12-13T00:09:57.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10093 0.11 MB/sec execute 334 sec latency 223.389 ms 2023-12-13T00:09:58.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10112 0.11 MB/sec execute 335 sec latency 345.188 ms 2023-12-13T00:09:59.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10124 0.11 MB/sec execute 336 sec latency 180.556 ms 2023-12-13T00:10:00.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10270 0.11 MB/sec execute 337 sec latency 325.606 ms 2023-12-13T00:10:01.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10288 0.11 MB/sec execute 338 sec latency 305.287 ms 2023-12-13T00:10:02.377 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:10:02.379 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:10:02.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10311 0.11 MB/sec execute 339 sec latency 222.643 ms 2023-12-13T00:10:03.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10370 0.11 MB/sec execute 340 sec latency 332.671 ms 2023-12-13T00:10:04.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10380 0.11 MB/sec execute 341 sec latency 335.066 ms 2023-12-13T00:10:05.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10385 0.11 MB/sec execute 342 sec latency 310.435 ms 2023-12-13T00:10:06.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10390 0.11 MB/sec execute 343 sec latency 341.324 ms 2023-12-13T00:10:07.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10393 0.11 MB/sec execute 344 sec latency 394.634 ms 2023-12-13T00:10:08.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10398 0.11 MB/sec execute 345 sec latency 326.652 ms 2023-12-13T00:10:09.577 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10406 0.11 MB/sec execute 346 sec latency 346.937 ms 2023-12-13T00:10:10.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10409 0.11 MB/sec execute 347 sec latency 323.184 ms 2023-12-13T00:10:11.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10412 0.11 MB/sec execute 348 sec latency 335.845 ms 2023-12-13T00:10:12.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10416 0.11 MB/sec execute 349 sec latency 398.312 ms 2023-12-13T00:10:13.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10419 0.11 MB/sec execute 350 sec latency 344.268 ms 2023-12-13T00:10:14.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10423 0.11 MB/sec execute 351 sec latency 341.664 ms 2023-12-13T00:10:15.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10426 0.11 MB/sec execute 352 sec latency 342.687 ms 2023-12-13T00:10:16.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10431 0.11 MB/sec execute 353 sec latency 323.610 ms 2023-12-13T00:10:17.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10434 0.11 MB/sec execute 354 sec latency 396.161 ms 2023-12-13T00:10:18.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10441 0.11 MB/sec execute 355 sec latency 313.149 ms 2023-12-13T00:10:19.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10462 0.11 MB/sec execute 356 sec latency 157.938 ms 2023-12-13T00:10:20.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10477 0.11 MB/sec execute 357 sec latency 199.870 ms 2023-12-13T00:10:21.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10492 0.11 MB/sec execute 358 sec latency 332.335 ms 2023-12-13T00:10:22.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10591 0.11 MB/sec execute 359 sec latency 362.335 ms 2023-12-13T00:10:23.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10616 0.11 MB/sec execute 360 sec latency 116.372 ms 2023-12-13T00:10:24.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10632 0.11 MB/sec execute 361 sec latency 333.828 ms 2023-12-13T00:10:25.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10653 0.11 MB/sec execute 362 sec latency 136.432 ms 2023-12-13T00:10:26.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10668 0.11 MB/sec execute 363 sec latency 327.074 ms 2023-12-13T00:10:27.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10682 0.11 MB/sec execute 364 sec latency 376.370 ms 2023-12-13T00:10:28.578 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10730 0.11 MB/sec execute 365 sec latency 206.390 ms 2023-12-13T00:10:29.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10741 0.11 MB/sec execute 366 sec latency 298.817 ms 2023-12-13T00:10:30.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10764 0.11 MB/sec execute 367 sec latency 301.940 ms 2023-12-13T00:10:31.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10776 0.11 MB/sec execute 368 sec latency 333.384 ms 2023-12-13T00:10:32.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:10:32.535 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:10:32.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10797 0.11 MB/sec execute 369 sec latency 354.722 ms 2023-12-13T00:10:33.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10819 0.11 MB/sec execute 370 sec latency 171.807 ms 2023-12-13T00:10:34.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10858 0.12 MB/sec execute 371 sec latency 325.300 ms 2023-12-13T00:10:35.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10871 0.11 MB/sec execute 372 sec latency 216.233 ms 2023-12-13T00:10:36.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10880 0.11 MB/sec execute 373 sec latency 262.166 ms 2023-12-13T00:10:37.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10887 0.11 MB/sec execute 374 sec latency 238.899 ms 2023-12-13T00:10:38.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10897 0.11 MB/sec execute 375 sec latency 228.646 ms 2023-12-13T00:10:39.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10910 0.11 MB/sec execute 376 sec latency 177.207 ms 2023-12-13T00:10:40.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10922 0.11 MB/sec execute 377 sec latency 179.912 ms 2023-12-13T00:10:41.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10934 0.11 MB/sec execute 378 sec latency 171.023 ms 2023-12-13T00:10:42.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10948 0.11 MB/sec execute 379 sec latency 193.971 ms 2023-12-13T00:10:43.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10959 0.11 MB/sec execute 380 sec latency 194.203 ms 2023-12-13T00:10:44.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10967 0.11 MB/sec execute 381 sec latency 331.743 ms 2023-12-13T00:10:45.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 10986 0.11 MB/sec execute 382 sec latency 182.397 ms 2023-12-13T00:10:46.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11004 0.11 MB/sec execute 383 sec latency 324.613 ms 2023-12-13T00:10:47.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11012 0.11 MB/sec execute 384 sec latency 375.382 ms 2023-12-13T00:10:48.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11022 0.11 MB/sec execute 385 sec latency 194.874 ms 2023-12-13T00:10:49.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11031 0.11 MB/sec execute 386 sec latency 268.770 ms 2023-12-13T00:10:50.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11038 0.11 MB/sec execute 387 sec latency 257.500 ms 2023-12-13T00:10:51.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11050 0.11 MB/sec execute 388 sec latency 272.707 ms 2023-12-13T00:10:52.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11063 0.11 MB/sec execute 389 sec latency 182.697 ms 2023-12-13T00:10:53.579 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11076 0.11 MB/sec execute 390 sec latency 177.868 ms 2023-12-13T00:10:54.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11088 0.11 MB/sec execute 391 sec latency 201.387 ms 2023-12-13T00:10:55.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11100 0.11 MB/sec execute 392 sec latency 184.461 ms 2023-12-13T00:10:56.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11112 0.11 MB/sec execute 393 sec latency 205.052 ms 2023-12-13T00:10:57.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11118 0.11 MB/sec execute 394 sec latency 406.610 ms 2023-12-13T00:10:58.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11125 0.11 MB/sec execute 395 sec latency 331.245 ms 2023-12-13T00:10:59.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11145 0.11 MB/sec execute 396 sec latency 317.001 ms 2023-12-13T00:11:00.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11161 0.11 MB/sec execute 397 sec latency 313.441 ms 2023-12-13T00:11:01.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11181 0.11 MB/sec execute 398 sec latency 319.476 ms 2023-12-13T00:11:02.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11195 0.11 MB/sec execute 399 sec latency 148.416 ms 2023-12-13T00:11:02.588 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:11:02.590 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:11:03.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11207 0.11 MB/sec execute 400 sec latency 148.533 ms 2023-12-13T00:11:04.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11223 0.11 MB/sec execute 401 sec latency 170.657 ms 2023-12-13T00:11:05.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11235 0.11 MB/sec execute 402 sec latency 142.376 ms 2023-12-13T00:11:06.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11247 0.11 MB/sec execute 403 sec latency 182.277 ms 2023-12-13T00:11:07.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11258 0.11 MB/sec execute 404 sec latency 158.413 ms 2023-12-13T00:11:08.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11269 0.11 MB/sec execute 405 sec latency 325.872 ms 2023-12-13T00:11:09.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11305 0.11 MB/sec execute 406 sec latency 324.195 ms 2023-12-13T00:11:10.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11314 0.11 MB/sec execute 407 sec latency 319.827 ms 2023-12-13T00:11:11.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11341 0.11 MB/sec execute 408 sec latency 313.123 ms 2023-12-13T00:11:12.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11361 0.11 MB/sec execute 409 sec latency 529.527 ms 2023-12-13T00:11:13.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11388 0.11 MB/sec execute 410 sec latency 198.071 ms 2023-12-13T00:11:14.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11407 0.11 MB/sec execute 411 sec latency 318.107 ms 2023-12-13T00:11:15.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11439 0.11 MB/sec execute 412 sec latency 191.968 ms 2023-12-13T00:11:16.580 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11472 0.11 MB/sec execute 413 sec latency 233.716 ms 2023-12-13T00:11:17.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11477 0.11 MB/sec execute 414 sec latency 404.923 ms 2023-12-13T00:11:18.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11513 0.11 MB/sec execute 415 sec latency 370.319 ms 2023-12-13T00:11:19.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11522 0.10 MB/sec execute 416 sec latency 329.514 ms 2023-12-13T00:11:20.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11553 0.10 MB/sec execute 417 sec latency 324.032 ms 2023-12-13T00:11:21.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11577 0.10 MB/sec execute 418 sec latency 185.928 ms 2023-12-13T00:11:22.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11588 0.10 MB/sec execute 419 sec latency 341.298 ms 2023-12-13T00:11:23.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11595 0.10 MB/sec execute 420 sec latency 345.334 ms 2023-12-13T00:11:24.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11623 0.10 MB/sec execute 421 sec latency 333.429 ms 2023-12-13T00:11:25.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11652 0.10 MB/sec execute 422 sec latency 189.350 ms 2023-12-13T00:11:26.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11689 0.11 MB/sec execute 423 sec latency 324.797 ms 2023-12-13T00:11:27.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11704 0.11 MB/sec execute 424 sec latency 366.959 ms 2023-12-13T00:11:28.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11716 0.11 MB/sec execute 425 sec latency 300.919 ms 2023-12-13T00:11:29.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11745 0.11 MB/sec execute 426 sec latency 158.900 ms 2023-12-13T00:11:30.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11757 0.11 MB/sec execute 427 sec latency 338.866 ms 2023-12-13T00:11:31.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11790 0.11 MB/sec execute 428 sec latency 332.549 ms 2023-12-13T00:11:32.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11814 0.10 MB/sec execute 429 sec latency 199.466 ms 2023-12-13T00:11:32.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:11:32.796 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:11:33.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11825 0.10 MB/sec execute 430 sec latency 330.613 ms 2023-12-13T00:11:34.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11833 0.10 MB/sec execute 431 sec latency 320.957 ms 2023-12-13T00:11:35.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11860 0.10 MB/sec execute 432 sec latency 166.774 ms 2023-12-13T00:11:36.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11887 0.10 MB/sec execute 433 sec latency 327.007 ms 2023-12-13T00:11:37.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11904 0.10 MB/sec execute 434 sec latency 266.910 ms 2023-12-13T00:11:38.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11933 0.10 MB/sec execute 435 sec latency 343.199 ms 2023-12-13T00:11:39.581 INFO:tasks.workunit.client.0.smithi072.stdout: 1 11937 0.10 MB/sec execute 436 sec latency 340.375 ms 2023-12-13T00:11:40.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12033 0.11 MB/sec execute 437 sec latency 336.823 ms 2023-12-13T00:11:41.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12041 0.11 MB/sec execute 438 sec latency 336.888 ms 2023-12-13T00:11:42.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12059 0.11 MB/sec execute 439 sec latency 373.616 ms 2023-12-13T00:11:43.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12077 0.11 MB/sec execute 440 sec latency 317.602 ms 2023-12-13T00:11:44.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12104 0.11 MB/sec execute 441 sec latency 215.435 ms 2023-12-13T00:11:45.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12124 0.11 MB/sec execute 442 sec latency 298.133 ms 2023-12-13T00:11:46.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12146 0.11 MB/sec execute 443 sec latency 308.228 ms 2023-12-13T00:11:47.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12166 0.11 MB/sec execute 444 sec latency 415.382 ms 2023-12-13T00:11:48.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12183 0.11 MB/sec execute 445 sec latency 341.526 ms 2023-12-13T00:11:49.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12210 0.11 MB/sec execute 446 sec latency 331.084 ms 2023-12-13T00:11:50.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12242 0.11 MB/sec execute 447 sec latency 301.019 ms 2023-12-13T00:11:51.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12261 0.11 MB/sec execute 448 sec latency 332.318 ms 2023-12-13T00:11:52.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12272 0.11 MB/sec execute 449 sec latency 336.805 ms 2023-12-13T00:11:53.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12298 0.11 MB/sec execute 450 sec latency 335.616 ms 2023-12-13T00:11:54.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12317 0.11 MB/sec execute 451 sec latency 294.265 ms 2023-12-13T00:11:55.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12346 0.11 MB/sec execute 452 sec latency 238.948 ms 2023-12-13T00:11:56.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12362 0.11 MB/sec execute 453 sec latency 342.309 ms 2023-12-13T00:11:57.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12425 0.11 MB/sec execute 454 sec latency 309.849 ms 2023-12-13T00:11:58.582 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12461 0.11 MB/sec execute 455 sec latency 310.590 ms 2023-12-13T00:11:59.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12478 0.11 MB/sec execute 456 sec latency 324.243 ms 2023-12-13T00:12:00.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12497 0.11 MB/sec execute 457 sec latency 313.323 ms 2023-12-13T00:12:01.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12518 0.11 MB/sec execute 458 sec latency 308.196 ms 2023-12-13T00:12:02.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12527 0.11 MB/sec execute 459 sec latency 343.984 ms 2023-12-13T00:12:02.930 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:12:02.933 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:12:03.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12561 0.11 MB/sec execute 460 sec latency 351.459 ms 2023-12-13T00:12:04.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12578 0.11 MB/sec execute 461 sec latency 351.002 ms 2023-12-13T00:12:05.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12631 0.10 MB/sec execute 462 sec latency 314.008 ms 2023-12-13T00:12:06.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12655 0.10 MB/sec execute 463 sec latency 300.195 ms 2023-12-13T00:12:07.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12691 0.10 MB/sec execute 464 sec latency 394.904 ms 2023-12-13T00:12:08.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12708 0.10 MB/sec execute 465 sec latency 316.387 ms 2023-12-13T00:12:09.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12728 0.10 MB/sec execute 466 sec latency 338.452 ms 2023-12-13T00:12:10.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12748 0.10 MB/sec execute 467 sec latency 323.728 ms 2023-12-13T00:12:11.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12793 0.10 MB/sec execute 468 sec latency 310.428 ms 2023-12-13T00:12:12.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12805 0.10 MB/sec execute 469 sec latency 336.136 ms 2023-12-13T00:12:13.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12833 0.10 MB/sec execute 470 sec latency 299.524 ms 2023-12-13T00:12:14.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12854 0.10 MB/sec execute 471 sec latency 317.809 ms 2023-12-13T00:12:15.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12902 0.10 MB/sec execute 472 sec latency 366.436 ms 2023-12-13T00:12:16.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12950 0.11 MB/sec execute 473 sec latency 314.980 ms 2023-12-13T00:12:17.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12960 0.11 MB/sec execute 474 sec latency 375.608 ms 2023-12-13T00:12:18.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12981 0.10 MB/sec execute 475 sec latency 376.542 ms 2023-12-13T00:12:19.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 12991 0.10 MB/sec execute 476 sec latency 322.210 ms 2023-12-13T00:12:20.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13015 0.10 MB/sec execute 477 sec latency 283.724 ms 2023-12-13T00:12:21.583 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13020 0.10 MB/sec execute 478 sec latency 337.577 ms 2023-12-13T00:12:22.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13027 0.10 MB/sec execute 479 sec latency 416.647 ms 2023-12-13T00:12:23.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13045 0.10 MB/sec execute 480 sec latency 318.637 ms 2023-12-13T00:12:24.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13061 0.10 MB/sec execute 481 sec latency 323.167 ms 2023-12-13T00:12:25.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13082 0.10 MB/sec execute 482 sec latency 337.118 ms 2023-12-13T00:12:26.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13090 0.10 MB/sec execute 483 sec latency 338.145 ms 2023-12-13T00:12:27.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13103 0.10 MB/sec execute 484 sec latency 185.434 ms 2023-12-13T00:12:28.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13124 0.10 MB/sec execute 485 sec latency 192.718 ms 2023-12-13T00:12:29.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13146 0.10 MB/sec execute 486 sec latency 338.963 ms 2023-12-13T00:12:30.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13156 0.10 MB/sec execute 487 sec latency 329.495 ms 2023-12-13T00:12:31.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13203 0.10 MB/sec execute 488 sec latency 339.542 ms 2023-12-13T00:12:32.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13212 0.10 MB/sec execute 489 sec latency 415.220 ms 2023-12-13T00:12:33.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:12:33.004 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:12:33.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13232 0.10 MB/sec execute 490 sec latency 424.561 ms 2023-12-13T00:12:34.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13248 0.10 MB/sec execute 491 sec latency 332.265 ms 2023-12-13T00:12:35.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13258 0.10 MB/sec execute 492 sec latency 335.137 ms 2023-12-13T00:12:36.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13269 0.10 MB/sec execute 493 sec latency 308.122 ms 2023-12-13T00:12:37.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13369 0.11 MB/sec execute 494 sec latency 367.888 ms 2023-12-13T00:12:38.584 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13403 0.11 MB/sec execute 495 sec latency 323.302 ms 2023-12-13T00:12:39.585 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13421 0.11 MB/sec execute 496 sec latency 314.475 ms 2023-12-13T00:12:40.538 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:13:05.078 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:12:40.541 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:13:05.082 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:12:40.585 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13433 0.11 MB/sec execute 497 sec latency 332.704 ms 2023-12-13T00:12:40.603 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:13:05.137 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:12:40.604 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:13:05.139 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:12:40.611 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:13:05.145 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:12:40.613 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:13:05.147 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:12:40.641 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:13:05.181 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:12:40.682 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:13:05.216 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:12:40.693 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:13:05.227 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:12:41.585 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13530 0.11 MB/sec execute 498 sec latency 344.721 ms 2023-12-13T00:12:42.585 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13553 0.11 MB/sec execute 499 sec latency 233.267 ms 2023-12-13T00:12:43.585 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13582 0.11 MB/sec execute 500 sec latency 188.576 ms 2023-12-13T00:12:44.585 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13616 0.11 MB/sec execute 501 sec latency 323.255 ms 2023-12-13T00:12:45.585 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13626 0.11 MB/sec execute 502 sec latency 321.106 ms 2023-12-13T00:12:46.585 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13644 0.11 MB/sec execute 503 sec latency 177.412 ms 2023-12-13T00:12:47.585 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13662 0.11 MB/sec execute 504 sec latency 399.982 ms 2023-12-13T00:12:48.585 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13681 0.11 MB/sec execute 505 sec latency 198.818 ms 2023-12-13T00:12:49.585 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13821 0.11 MB/sec execute 506 sec latency 336.146 ms 2023-12-13T00:12:50.585 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13839 0.11 MB/sec execute 507 sec latency 330.732 ms 2023-12-13T00:12:51.585 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13862 0.11 MB/sec execute 508 sec latency 217.058 ms 2023-12-13T00:12:52.585 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13920 0.11 MB/sec execute 509 sec latency 404.078 ms 2023-12-13T00:12:53.585 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13931 0.11 MB/sec execute 510 sec latency 314.159 ms 2023-12-13T00:12:54.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13935 0.11 MB/sec execute 511 sec latency 314.978 ms 2023-12-13T00:12:55.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13940 0.11 MB/sec execute 512 sec latency 321.255 ms 2023-12-13T00:12:56.585 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13943 0.11 MB/sec execute 513 sec latency 334.090 ms 2023-12-13T00:12:57.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13948 0.11 MB/sec execute 514 sec latency 380.796 ms 2023-12-13T00:12:58.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13956 0.11 MB/sec execute 515 sec latency 320.344 ms 2023-12-13T00:12:59.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13959 0.11 MB/sec execute 516 sec latency 326.335 ms 2023-12-13T00:13:00.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13962 0.11 MB/sec execute 517 sec latency 308.214 ms 2023-12-13T00:13:01.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13967 0.11 MB/sec execute 518 sec latency 333.627 ms 2023-12-13T00:13:02.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13969 0.11 MB/sec execute 519 sec latency 394.836 ms 2023-12-13T00:13:03.125 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:13:03.128 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:13:03.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13973 0.11 MB/sec execute 520 sec latency 434.190 ms 2023-12-13T00:13:04.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13979 0.11 MB/sec execute 521 sec latency 332.744 ms 2023-12-13T00:13:05.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13982 0.11 MB/sec execute 522 sec latency 349.431 ms 2023-12-13T00:13:06.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 13985 0.11 MB/sec execute 523 sec latency 338.415 ms 2023-12-13T00:13:07.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14000 0.11 MB/sec execute 524 sec latency 387.535 ms 2023-12-13T00:13:08.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14014 0.11 MB/sec execute 525 sec latency 189.012 ms 2023-12-13T00:13:09.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14028 0.11 MB/sec execute 526 sec latency 204.543 ms 2023-12-13T00:13:10.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14044 0.11 MB/sec execute 527 sec latency 323.022 ms 2023-12-13T00:13:11.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14149 0.11 MB/sec execute 528 sec latency 320.664 ms 2023-12-13T00:13:12.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14172 0.11 MB/sec execute 529 sec latency 130.716 ms 2023-12-13T00:13:13.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14194 0.11 MB/sec execute 530 sec latency 315.053 ms 2023-12-13T00:13:14.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14204 0.11 MB/sec execute 531 sec latency 333.242 ms 2023-12-13T00:13:15.586 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14223 0.11 MB/sec execute 532 sec latency 317.726 ms 2023-12-13T00:13:16.587 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14269 0.11 MB/sec execute 533 sec latency 303.513 ms 2023-12-13T00:13:17.587 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14283 0.11 MB/sec execute 534 sec latency 242.522 ms 2023-12-13T00:13:18.587 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14307 0.11 MB/sec execute 535 sec latency 304.595 ms 2023-12-13T00:13:19.587 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14318 0.11 MB/sec execute 536 sec latency 315.582 ms 2023-12-13T00:13:20.587 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14336 0.11 MB/sec execute 537 sec latency 306.070 ms 2023-12-13T00:13:21.587 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14356 0.11 MB/sec execute 538 sec latency 222.794 ms 2023-12-13T00:13:22.587 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14397 0.11 MB/sec execute 539 sec latency 315.706 ms 2023-12-13T00:13:23.587 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14412 0.11 MB/sec execute 540 sec latency 419.029 ms 2023-12-13T00:13:24.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14424 0.11 MB/sec execute 541 sec latency 181.536 ms 2023-12-13T00:13:25.587 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14431 0.11 MB/sec execute 542 sec latency 237.959 ms 2023-12-13T00:13:26.587 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14440 0.11 MB/sec execute 543 sec latency 267.369 ms 2023-12-13T00:13:27.587 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14451 0.11 MB/sec execute 544 sec latency 284.883 ms 2023-12-13T00:13:28.587 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14463 0.11 MB/sec execute 545 sec latency 200.056 ms 2023-12-13T00:13:29.587 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14475 0.11 MB/sec execute 546 sec latency 193.535 ms 2023-12-13T00:13:30.587 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14487 0.11 MB/sec execute 547 sec latency 185.488 ms 2023-12-13T00:13:31.587 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14499 0.11 MB/sec execute 548 sec latency 177.385 ms 2023-12-13T00:13:32.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14509 0.11 MB/sec execute 549 sec latency 274.940 ms 2023-12-13T00:13:33.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:13:33.241 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:13:33.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14518 0.11 MB/sec execute 550 sec latency 413.234 ms 2023-12-13T00:13:34.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14535 0.11 MB/sec execute 551 sec latency 302.874 ms 2023-12-13T00:13:35.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14553 0.11 MB/sec execute 552 sec latency 330.466 ms 2023-12-13T00:13:36.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14564 0.11 MB/sec execute 553 sec latency 334.214 ms 2023-12-13T00:13:37.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14574 0.11 MB/sec execute 554 sec latency 234.455 ms 2023-12-13T00:13:38.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14581 0.11 MB/sec execute 555 sec latency 283.251 ms 2023-12-13T00:13:39.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14590 0.11 MB/sec execute 556 sec latency 279.669 ms 2023-12-13T00:13:40.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14602 0.11 MB/sec execute 557 sec latency 217.475 ms 2023-12-13T00:13:41.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14614 0.11 MB/sec execute 558 sec latency 178.297 ms 2023-12-13T00:13:42.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14625 0.11 MB/sec execute 559 sec latency 188.307 ms 2023-12-13T00:13:43.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14638 0.11 MB/sec execute 560 sec latency 167.608 ms 2023-12-13T00:13:44.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14649 0.11 MB/sec execute 561 sec latency 183.879 ms 2023-12-13T00:13:45.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14661 0.11 MB/sec execute 562 sec latency 188.228 ms 2023-12-13T00:13:46.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14670 0.11 MB/sec execute 563 sec latency 302.408 ms 2023-12-13T00:13:47.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14676 0.11 MB/sec execute 564 sec latency 345.883 ms 2023-12-13T00:13:48.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14697 0.11 MB/sec execute 565 sec latency 332.485 ms 2023-12-13T00:13:49.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14710 0.11 MB/sec execute 566 sec latency 336.978 ms 2023-12-13T00:13:50.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14730 0.11 MB/sec execute 567 sec latency 325.004 ms 2023-12-13T00:13:51.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14743 0.11 MB/sec execute 568 sec latency 142.850 ms 2023-12-13T00:13:52.588 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14754 0.11 MB/sec execute 569 sec latency 196.879 ms 2023-12-13T00:13:53.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14770 0.11 MB/sec execute 570 sec latency 139.203 ms 2023-12-13T00:13:54.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14783 0.11 MB/sec execute 571 sec latency 148.712 ms 2023-12-13T00:13:55.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14796 0.11 MB/sec execute 572 sec latency 173.390 ms 2023-12-13T00:13:56.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14809 0.11 MB/sec execute 573 sec latency 136.547 ms 2023-12-13T00:13:57.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14817 0.11 MB/sec execute 574 sec latency 369.714 ms 2023-12-13T00:13:58.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14853 0.11 MB/sec execute 575 sec latency 332.480 ms 2023-12-13T00:13:59.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14862 0.11 MB/sec execute 576 sec latency 328.992 ms 2023-12-13T00:14:00.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14890 0.11 MB/sec execute 577 sec latency 314.057 ms 2023-12-13T00:14:01.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14918 0.11 MB/sec execute 578 sec latency 314.058 ms 2023-12-13T00:14:02.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14949 0.11 MB/sec execute 579 sec latency 296.164 ms 2023-12-13T00:14:03.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:14:03.429 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:14:03.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14972 0.11 MB/sec execute 580 sec latency 346.953 ms 2023-12-13T00:14:04.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 14987 0.11 MB/sec execute 581 sec latency 201.752 ms 2023-12-13T00:14:05.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15020 0.11 MB/sec execute 582 sec latency 328.127 ms 2023-12-13T00:14:06.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15029 0.11 MB/sec execute 583 sec latency 308.779 ms 2023-12-13T00:14:07.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15063 0.11 MB/sec execute 584 sec latency 351.675 ms 2023-12-13T00:14:08.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15079 0.11 MB/sec execute 585 sec latency 330.613 ms 2023-12-13T00:14:09.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15108 0.11 MB/sec execute 586 sec latency 304.410 ms 2023-12-13T00:14:10.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15133 0.11 MB/sec execute 587 sec latency 196.602 ms 2023-12-13T00:14:11.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15137 0.11 MB/sec execute 588 sec latency 302.837 ms 2023-12-13T00:14:12.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15147 0.11 MB/sec execute 589 sec latency 386.287 ms 2023-12-13T00:14:13.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15175 0.11 MB/sec execute 590 sec latency 335.381 ms 2023-12-13T00:14:14.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15200 0.11 MB/sec execute 591 sec latency 326.799 ms 2023-12-13T00:14:15.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15241 0.11 MB/sec execute 592 sec latency 312.752 ms 2023-12-13T00:14:16.589 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15252 0.11 MB/sec execute 593 sec latency 330.567 ms 2023-12-13T00:14:17.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15267 0.11 MB/sec execute 594 sec latency 311.856 ms 2023-12-13T00:14:18.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15295 0.11 MB/sec execute 595 sec latency 339.100 ms 2023-12-13T00:14:19.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15317 0.11 MB/sec execute 596 sec latency 320.774 ms 2023-12-13T00:14:20.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15350 0.11 MB/sec execute 597 sec latency 325.809 ms 2023-12-13T00:14:21.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15370 0.11 MB/sec execute 598 sec latency 308.474 ms 2023-12-13T00:14:22.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 15372 0.11 MB/sec execute 599 sec latency 449.572 ms 2023-12-13T00:14:23.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 cleanup 600 sec 2023-12-13T00:14:24.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 cleanup 601 sec 2023-12-13T00:14:25.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 cleanup 602 sec 2023-12-13T00:14:26.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 cleanup 603 sec 2023-12-13T00:14:27.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 cleanup 604 sec 2023-12-13T00:14:28.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 cleanup 605 sec 2023-12-13T00:14:29.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 cleanup 606 sec 2023-12-13T00:14:30.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 cleanup 607 sec 2023-12-13T00:14:31.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 cleanup 608 sec 2023-12-13T00:14:32.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 cleanup 609 sec 2023-12-13T00:14:33.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:14:33.584 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:14:33.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 cleanup 610 sec 2023-12-13T00:14:34.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 cleanup 611 sec 2023-12-13T00:14:35.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 cleanup 612 sec 2023-12-13T00:14:36.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 cleanup 613 sec 2023-12-13T00:14:37.590 INFO:tasks.workunit.client.0.smithi072.stdout: 1 cleanup 614 sec 2023-12-13T00:14:37.713 INFO:tasks.workunit.client.0.smithi072.stdout: 0 cleanup 614 sec 2023-12-13T00:14:37.714 INFO:tasks.workunit.client.0.smithi072.stdout: 2023-12-13T00:14:37.714 INFO:tasks.workunit.client.0.smithi072.stdout: Operation Count AvgLat MaxLat 2023-12-13T00:14:37.714 INFO:tasks.workunit.client.0.smithi072.stdout: ---------------------------------------- 2023-12-13T00:14:37.714 INFO:tasks.workunit.client.0.smithi072.stdout: NTCreateX 2136 78.798 369.758 2023-12-13T00:14:37.714 INFO:tasks.workunit.client.0.smithi072.stdout: Close 1544 1.152 9.522 2023-12-13T00:14:37.714 INFO:tasks.workunit.client.0.smithi072.stdout: Rename 89 179.691 314.620 2023-12-13T00:14:37.714 INFO:tasks.workunit.client.0.smithi072.stdout: Unlink 460 97.086 184.295 2023-12-13T00:14:37.714 INFO:tasks.workunit.client.0.smithi072.stdout: Qpathinfo 1904 59.475 268.257 2023-12-13T00:14:37.714 INFO:tasks.workunit.client.0.smithi072.stdout: Qfileinfo 313 0.991 7.341 2023-12-13T00:14:37.714 INFO:tasks.workunit.client.0.smithi072.stdout: Qfsinfo 375 7.012 95.706 2023-12-13T00:14:37.715 INFO:tasks.workunit.client.0.smithi072.stdout: Sfileinfo 175 22.671 190.345 2023-12-13T00:14:37.715 INFO:tasks.workunit.client.0.smithi072.stdout: Find 761 317.129 529.520 2023-12-13T00:14:37.715 INFO:tasks.workunit.client.0.smithi072.stdout: WriteX 1028 3.362 43.607 2023-12-13T00:14:37.715 INFO:tasks.workunit.client.0.smithi072.stdout: ReadX 3164 0.024 1.970 2023-12-13T00:14:37.715 INFO:tasks.workunit.client.0.smithi072.stdout: LockX 6 15.484 16.755 2023-12-13T00:14:37.715 INFO:tasks.workunit.client.0.smithi072.stdout: UnlockX 6 16.661 19.582 2023-12-13T00:14:37.715 INFO:tasks.workunit.client.0.smithi072.stdout: Flush 157 27.260 54.113 2023-12-13T00:14:37.715 INFO:tasks.workunit.client.0.smithi072.stdout: 2023-12-13T00:14:37.715 INFO:tasks.workunit.client.0.smithi072.stdout:Throughput 0.107122 MB/sec 1 clients 1 procs max_latency=529.527 ms 2023-12-13T00:14:37.715 INFO:tasks.workunit.client.0.smithi072.stderr:+ dbench 10 2023-12-13T00:14:37.716 INFO:tasks.workunit.client.0.smithi072.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-12-13T00:14:37.716 INFO:tasks.workunit.client.0.smithi072.stdout: 2023-12-13T00:14:37.716 INFO:tasks.workunit.client.0.smithi072.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-12-13T00:14:37.716 INFO:tasks.workunit.client.0.smithi072.stdout:8 of 10 processes prepared for launch 0 sec 2023-12-13T00:14:37.815 INFO:tasks.workunit.client.0.smithi072.stdout:10 of 10 processes prepared for launch 0 sec 2023-12-13T00:14:37.815 INFO:tasks.workunit.client.0.smithi072.stdout:releasing clients 2023-12-13T00:14:38.815 INFO:tasks.workunit.client.0.smithi072.stdout: 0 3 0.00 MB/sec warmup 1 sec latency 999.844 ms 2023-12-13T00:14:39.815 INFO:tasks.workunit.client.0.smithi072.stdout: 0 7 0.00 MB/sec warmup 2 sec latency 303.449 ms 2023-12-13T00:14:40.815 INFO:tasks.workunit.client.0.smithi072.stdout: 2 13 0.70 MB/sec warmup 3 sec latency 561.507 ms 2023-12-13T00:14:41.815 INFO:tasks.workunit.client.0.smithi072.stdout: 9 30 2.52 MB/sec warmup 4 sec latency 636.532 ms 2023-12-13T00:14:42.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 47 3.75 MB/sec warmup 5 sec latency 753.204 ms 2023-12-13T00:14:43.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 63 4.60 MB/sec warmup 6 sec latency 804.676 ms 2023-12-13T00:14:44.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 75 4.80 MB/sec warmup 7 sec latency 1099.837 ms 2023-12-13T00:14:45.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 93 5.40 MB/sec warmup 8 sec latency 1090.131 ms 2023-12-13T00:14:46.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 107 5.60 MB/sec warmup 9 sec latency 961.001 ms 2023-12-13T00:14:47.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 115 5.32 MB/sec warmup 10 sec latency 865.925 ms 2023-12-13T00:14:48.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 120 5.00 MB/sec warmup 11 sec latency 1672.112 ms 2023-12-13T00:14:49.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 123 4.65 MB/sec warmup 12 sec latency 2672.156 ms 2023-12-13T00:14:50.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 129 4.43 MB/sec warmup 13 sec latency 2985.155 ms 2023-12-13T00:14:51.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 136 4.27 MB/sec warmup 14 sec latency 2775.476 ms 2023-12-13T00:14:52.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 143 4.12 MB/sec warmup 15 sec latency 1521.217 ms 2023-12-13T00:14:53.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 152 4.02 MB/sec warmup 16 sec latency 1026.789 ms 2023-12-13T00:14:54.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 159 3.90 MB/sec warmup 17 sec latency 889.270 ms 2023-12-13T00:14:55.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 167 3.82 MB/sec warmup 18 sec latency 945.688 ms 2023-12-13T00:14:56.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 177 3.80 MB/sec warmup 19 sec latency 1044.303 ms 2023-12-13T00:14:57.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 186 3.74 MB/sec warmup 20 sec latency 865.064 ms 2023-12-13T00:14:58.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 194 3.68 MB/sec warmup 21 sec latency 1734.703 ms 2023-12-13T00:14:59.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 202 3.62 MB/sec warmup 22 sec latency 2318.710 ms 2023-12-13T00:15:00.815 INFO:tasks.workunit.client.0.smithi072.stdout: 10 210 3.57 MB/sec warmup 23 sec latency 874.888 ms 2023-12-13T00:15:01.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 219 3.54 MB/sec warmup 24 sec latency 915.790 ms 2023-12-13T00:15:02.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 227 3.51 MB/sec warmup 25 sec latency 982.288 ms 2023-12-13T00:15:03.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:15:03.647 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:15:03.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 235 3.48 MB/sec warmup 26 sec latency 943.363 ms 2023-12-13T00:15:04.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 245 3.46 MB/sec warmup 27 sec latency 1124.488 ms 2023-12-13T00:15:05.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 253 3.44 MB/sec warmup 28 sec latency 904.047 ms 2023-12-13T00:15:06.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 262 3.41 MB/sec warmup 29 sec latency 828.023 ms 2023-12-13T00:15:07.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 269 3.37 MB/sec warmup 30 sec latency 964.585 ms 2023-12-13T00:15:08.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 278 3.35 MB/sec warmup 31 sec latency 1055.002 ms 2023-12-13T00:15:09.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 284 3.30 MB/sec warmup 32 sec latency 912.633 ms 2023-12-13T00:15:10.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 291 3.27 MB/sec warmup 33 sec latency 969.717 ms 2023-12-13T00:15:11.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 300 3.26 MB/sec warmup 34 sec latency 1149.380 ms 2023-12-13T00:15:12.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 308 3.24 MB/sec warmup 35 sec latency 1001.303 ms 2023-12-13T00:15:13.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 316 3.21 MB/sec warmup 36 sec latency 1035.861 ms 2023-12-13T00:15:14.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 324 3.19 MB/sec warmup 37 sec latency 1028.446 ms 2023-12-13T00:15:15.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 332 3.17 MB/sec warmup 38 sec latency 851.077 ms 2023-12-13T00:15:16.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 341 3.16 MB/sec warmup 39 sec latency 980.028 ms 2023-12-13T00:15:17.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 348 3.13 MB/sec warmup 40 sec latency 895.548 ms 2023-12-13T00:15:18.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 356 3.12 MB/sec warmup 41 sec latency 1185.320 ms 2023-12-13T00:15:19.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 365 3.11 MB/sec warmup 42 sec latency 881.098 ms 2023-12-13T00:15:20.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 373 3.09 MB/sec warmup 43 sec latency 976.325 ms 2023-12-13T00:15:21.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 381 3.08 MB/sec warmup 44 sec latency 888.890 ms 2023-12-13T00:15:22.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 389 3.07 MB/sec warmup 45 sec latency 1128.550 ms 2023-12-13T00:15:23.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 396 3.06 MB/sec warmup 46 sec latency 1147.548 ms 2023-12-13T00:15:24.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 404 3.05 MB/sec warmup 47 sec latency 1335.094 ms 2023-12-13T00:15:25.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 413 3.04 MB/sec warmup 48 sec latency 967.155 ms 2023-12-13T00:15:26.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 421 3.03 MB/sec warmup 49 sec latency 1378.268 ms 2023-12-13T00:15:27.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 428 3.02 MB/sec warmup 50 sec latency 1022.262 ms 2023-12-13T00:15:28.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 436 3.01 MB/sec warmup 51 sec latency 1093.119 ms 2023-12-13T00:15:29.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 444 3.00 MB/sec warmup 52 sec latency 966.870 ms 2023-12-13T00:15:30.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 452 3.00 MB/sec warmup 53 sec latency 1340.840 ms 2023-12-13T00:15:31.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 459 2.98 MB/sec warmup 54 sec latency 1190.172 ms 2023-12-13T00:15:32.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 467 2.98 MB/sec warmup 55 sec latency 1412.327 ms 2023-12-13T00:15:33.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:15:33.802 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:15:33.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 473 2.96 MB/sec warmup 56 sec latency 1379.923 ms 2023-12-13T00:15:34.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 484 2.96 MB/sec warmup 57 sec latency 1034.649 ms 2023-12-13T00:15:35.816 INFO:tasks.workunit.client.0.smithi072.stdout: 10 492 2.96 MB/sec warmup 58 sec latency 1006.004 ms 2023-12-13T00:15:36.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 499 2.95 MB/sec warmup 59 sec latency 1156.101 ms 2023-12-13T00:15:37.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 507 2.95 MB/sec warmup 60 sec latency 1212.030 ms 2023-12-13T00:15:38.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 512 2.92 MB/sec warmup 61 sec latency 1192.061 ms 2023-12-13T00:15:39.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 523 2.93 MB/sec warmup 62 sec latency 1193.176 ms 2023-12-13T00:15:40.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 536 2.96 MB/sec warmup 63 sec latency 1336.206 ms 2023-12-13T00:15:41.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 548 2.93 MB/sec warmup 64 sec latency 1101.353 ms 2023-12-13T00:15:42.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 562 2.99 MB/sec warmup 65 sec latency 1234.357 ms 2023-12-13T00:15:43.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 571 2.98 MB/sec warmup 66 sec latency 1316.226 ms 2023-12-13T00:15:44.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 578 2.97 MB/sec warmup 67 sec latency 1434.681 ms 2023-12-13T00:15:45.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 590 2.96 MB/sec warmup 68 sec latency 1104.332 ms 2023-12-13T00:15:46.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 600 2.95 MB/sec warmup 69 sec latency 1431.073 ms 2023-12-13T00:15:47.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 610 2.97 MB/sec warmup 70 sec latency 1725.824 ms 2023-12-13T00:15:48.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 623 2.94 MB/sec warmup 71 sec latency 1811.583 ms 2023-12-13T00:15:49.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 633 2.92 MB/sec warmup 72 sec latency 1323.215 ms 2023-12-13T00:15:50.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 634 2.88 MB/sec warmup 73 sec latency 1424.100 ms 2023-12-13T00:15:51.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 639 2.84 MB/sec warmup 74 sec latency 1562.202 ms 2023-12-13T00:15:52.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 645 2.81 MB/sec warmup 75 sec latency 1659.282 ms 2023-12-13T00:15:53.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 653 2.77 MB/sec warmup 76 sec latency 1739.103 ms 2023-12-13T00:15:54.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 655 2.74 MB/sec warmup 77 sec latency 1496.313 ms 2023-12-13T00:15:55.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 660 2.70 MB/sec warmup 78 sec latency 1454.584 ms 2023-12-13T00:15:56.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 669 2.68 MB/sec warmup 79 sec latency 1296.365 ms 2023-12-13T00:15:57.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 676 2.64 MB/sec warmup 80 sec latency 1422.677 ms 2023-12-13T00:15:58.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 679 2.61 MB/sec warmup 81 sec latency 1188.144 ms 2023-12-13T00:15:59.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 682 2.58 MB/sec warmup 82 sec latency 1372.470 ms 2023-12-13T00:16:00.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 688 2.55 MB/sec warmup 83 sec latency 1449.771 ms 2023-12-13T00:16:01.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 697 2.52 MB/sec warmup 84 sec latency 1277.596 ms 2023-12-13T00:16:02.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 704 2.50 MB/sec warmup 85 sec latency 1331.268 ms 2023-12-13T00:16:03.750 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:16:28.290 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:03.755 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:16:28.295 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:03.762 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:16:28.296 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:03.763 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:16:28.297 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:03.811 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:16:28.345 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:03.811 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:16:28.345 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:03.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 708 2.47 MB/sec warmup 86 sec latency 1331.819 ms 2023-12-13T00:16:03.886 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:16:28.420 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:03.886 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:16:28.420 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:03.901 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:16:28.441 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:03.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:16:03.957 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:16:04.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 711 2.44 MB/sec warmup 87 sec latency 1763.145 ms 2023-12-13T00:16:05.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 719 2.42 MB/sec warmup 88 sec latency 1415.989 ms 2023-12-13T00:16:06.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 730 2.39 MB/sec warmup 89 sec latency 1497.111 ms 2023-12-13T00:16:07.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 736 2.37 MB/sec warmup 90 sec latency 959.068 ms 2023-12-13T00:16:08.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 740 2.34 MB/sec warmup 91 sec latency 1241.719 ms 2023-12-13T00:16:09.817 INFO:tasks.workunit.client.0.smithi072.stdout: 10 744 2.32 MB/sec warmup 92 sec latency 1728.013 ms 2023-12-13T00:16:10.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 751 2.29 MB/sec warmup 93 sec latency 1291.201 ms 2023-12-13T00:16:11.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 761 2.27 MB/sec warmup 94 sec latency 877.300 ms 2023-12-13T00:16:12.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 767 2.25 MB/sec warmup 95 sec latency 1203.642 ms 2023-12-13T00:16:13.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 771 2.23 MB/sec warmup 96 sec latency 1345.881 ms 2023-12-13T00:16:14.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 778 2.20 MB/sec warmup 97 sec latency 1243.503 ms 2023-12-13T00:16:15.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 783 2.19 MB/sec warmup 98 sec latency 1256.227 ms 2023-12-13T00:16:16.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 792 2.17 MB/sec warmup 99 sec latency 1370.525 ms 2023-12-13T00:16:17.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 798 2.14 MB/sec warmup 100 sec latency 1370.902 ms 2023-12-13T00:16:18.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 804 2.12 MB/sec warmup 101 sec latency 1356.067 ms 2023-12-13T00:16:19.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 808 2.10 MB/sec warmup 102 sec latency 1402.021 ms 2023-12-13T00:16:20.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 812 2.09 MB/sec warmup 103 sec latency 1302.310 ms 2023-12-13T00:16:21.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 819 2.07 MB/sec warmup 104 sec latency 1360.279 ms 2023-12-13T00:16:22.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 822 2.05 MB/sec warmup 105 sec latency 1288.369 ms 2023-12-13T00:16:23.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 826 2.03 MB/sec warmup 106 sec latency 1487.254 ms 2023-12-13T00:16:24.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 834 2.01 MB/sec warmup 107 sec latency 1322.659 ms 2023-12-13T00:16:25.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 844 2.00 MB/sec warmup 108 sec latency 1415.438 ms 2023-12-13T00:16:26.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 846 1.98 MB/sec warmup 109 sec latency 1296.031 ms 2023-12-13T00:16:27.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 850 1.96 MB/sec warmup 110 sec latency 1428.979 ms 2023-12-13T00:16:28.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 853 1.94 MB/sec warmup 111 sec latency 1421.406 ms 2023-12-13T00:16:29.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 861 1.93 MB/sec warmup 112 sec latency 1356.399 ms 2023-12-13T00:16:30.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 866 1.91 MB/sec warmup 113 sec latency 1321.169 ms 2023-12-13T00:16:31.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 870 1.90 MB/sec warmup 114 sec latency 1512.464 ms 2023-12-13T00:16:32.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 874 1.88 MB/sec warmup 115 sec latency 1493.640 ms 2023-12-13T00:16:33.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 879 1.87 MB/sec warmup 116 sec latency 1305.692 ms 2023-12-13T00:16:34.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:16:34.079 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:16:34.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 884 1.85 MB/sec warmup 117 sec latency 1309.248 ms 2023-12-13T00:16:35.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 888 1.84 MB/sec warmup 118 sec latency 1344.331 ms 2023-12-13T00:16:36.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 893 1.82 MB/sec warmup 119 sec latency 1492.592 ms 2023-12-13T00:16:38.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 903 0.12 MB/sec execute 1 sec latency 1659.454 ms 2023-12-13T00:16:39.818 INFO:tasks.workunit.client.0.smithi072.stdout: 10 910 0.20 MB/sec execute 2 sec latency 1063.386 ms 2023-12-13T00:16:40.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 916 0.15 MB/sec execute 3 sec latency 1165.400 ms 2023-12-13T00:16:41.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 921 0.14 MB/sec execute 4 sec latency 1279.129 ms 2023-12-13T00:16:42.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 926 0.15 MB/sec execute 5 sec latency 1531.738 ms 2023-12-13T00:16:43.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 928 0.13 MB/sec execute 6 sec latency 1699.035 ms 2023-12-13T00:16:44.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 932 0.13 MB/sec execute 7 sec latency 1367.033 ms 2023-12-13T00:16:45.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 940 0.22 MB/sec execute 8 sec latency 1077.560 ms 2023-12-13T00:16:46.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 943 0.23 MB/sec execute 9 sec latency 1246.412 ms 2023-12-13T00:16:47.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 946 0.20 MB/sec execute 10 sec latency 1478.664 ms 2023-12-13T00:16:48.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 951 0.28 MB/sec execute 11 sec latency 1423.356 ms 2023-12-13T00:16:49.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 954 0.25 MB/sec execute 12 sec latency 1564.595 ms 2023-12-13T00:16:50.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 959 0.24 MB/sec execute 13 sec latency 1370.579 ms 2023-12-13T00:16:51.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 963 0.23 MB/sec execute 14 sec latency 1216.569 ms 2023-12-13T00:16:52.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 969 0.22 MB/sec execute 15 sec latency 1343.616 ms 2023-12-13T00:16:53.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 974 0.21 MB/sec execute 16 sec latency 1264.901 ms 2023-12-13T00:16:54.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 976 0.20 MB/sec execute 17 sec latency 1234.337 ms 2023-12-13T00:16:55.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 981 0.20 MB/sec execute 18 sec latency 1558.095 ms 2023-12-13T00:16:56.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 990 0.25 MB/sec execute 19 sec latency 1314.300 ms 2023-12-13T00:16:57.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 994 0.24 MB/sec execute 20 sec latency 1208.652 ms 2023-12-13T00:16:57.848 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:17:22.389 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:57.851 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:17:22.392 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:57.880 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:17:22.420 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:57.902 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:17:22.436 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:57.905 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:17:22.439 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:57.924 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:17:22.458 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:57.926 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:17:22.461 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:57.932 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:17:22.466 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:58.024 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:17:22.558 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:16:58.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1000 0.23 MB/sec execute 21 sec latency 1513.989 ms 2023-12-13T00:16:59.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1005 0.24 MB/sec execute 22 sec latency 1187.072 ms 2023-12-13T00:17:00.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1015 0.32 MB/sec execute 23 sec latency 1103.137 ms 2023-12-13T00:17:01.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1021 0.34 MB/sec execute 24 sec latency 1265.774 ms 2023-12-13T00:17:02.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1027 0.36 MB/sec execute 25 sec latency 1338.064 ms 2023-12-13T00:17:03.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1030 0.35 MB/sec execute 26 sec latency 1393.632 ms 2023-12-13T00:17:04.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:17:04.149 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:17:04.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1035 0.34 MB/sec execute 27 sec latency 1412.742 ms 2023-12-13T00:17:05.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1041 0.36 MB/sec execute 28 sec latency 1337.319 ms 2023-12-13T00:17:06.819 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1045 0.35 MB/sec execute 29 sec latency 1509.357 ms 2023-12-13T00:17:07.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1050 0.35 MB/sec execute 30 sec latency 1559.620 ms 2023-12-13T00:17:08.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1056 0.36 MB/sec execute 31 sec latency 1359.579 ms 2023-12-13T00:17:09.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1059 0.35 MB/sec execute 32 sec latency 1413.196 ms 2023-12-13T00:17:10.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1063 0.34 MB/sec execute 33 sec latency 1302.177 ms 2023-12-13T00:17:11.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1069 0.34 MB/sec execute 34 sec latency 1235.885 ms 2023-12-13T00:17:12.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1075 0.35 MB/sec execute 35 sec latency 1525.611 ms 2023-12-13T00:17:13.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1080 0.34 MB/sec execute 36 sec latency 1595.158 ms 2023-12-13T00:17:14.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1086 0.34 MB/sec execute 37 sec latency 2117.375 ms 2023-12-13T00:17:15.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1090 0.33 MB/sec execute 38 sec latency 1202.563 ms 2023-12-13T00:17:16.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1093 0.32 MB/sec execute 39 sec latency 1434.415 ms 2023-12-13T00:17:17.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1096 0.31 MB/sec execute 40 sec latency 1741.926 ms 2023-12-13T00:17:18.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1102 0.31 MB/sec execute 41 sec latency 1875.570 ms 2023-12-13T00:17:19.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1106 0.30 MB/sec execute 42 sec latency 1158.239 ms 2023-12-13T00:17:20.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1110 0.29 MB/sec execute 43 sec latency 1371.473 ms 2023-12-13T00:17:21.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1116 0.29 MB/sec execute 44 sec latency 1399.011 ms 2023-12-13T00:17:22.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1120 0.28 MB/sec execute 45 sec latency 1243.596 ms 2023-12-13T00:17:23.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1125 0.28 MB/sec execute 46 sec latency 1457.990 ms 2023-12-13T00:17:24.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1130 0.28 MB/sec execute 47 sec latency 1124.888 ms 2023-12-13T00:17:25.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1137 0.27 MB/sec execute 48 sec latency 1145.122 ms 2023-12-13T00:17:26.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1142 0.27 MB/sec execute 49 sec latency 1107.114 ms 2023-12-13T00:17:27.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1148 0.26 MB/sec execute 50 sec latency 1301.582 ms 2023-12-13T00:17:28.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1153 0.26 MB/sec execute 51 sec latency 971.095 ms 2023-12-13T00:17:29.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1158 0.25 MB/sec execute 52 sec latency 1559.459 ms 2023-12-13T00:17:30.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1162 0.25 MB/sec execute 53 sec latency 1233.803 ms 2023-12-13T00:17:31.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1167 0.25 MB/sec execute 54 sec latency 1283.963 ms 2023-12-13T00:17:32.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1172 0.24 MB/sec execute 55 sec latency 1184.887 ms 2023-12-13T00:17:33.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1175 0.24 MB/sec execute 56 sec latency 1452.163 ms 2023-12-13T00:17:34.207 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:17:34.210 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:17:34.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1179 0.24 MB/sec execute 57 sec latency 1458.192 ms 2023-12-13T00:17:35.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1184 0.23 MB/sec execute 58 sec latency 1395.379 ms 2023-12-13T00:17:36.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1188 0.23 MB/sec execute 59 sec latency 1322.330 ms 2023-12-13T00:17:37.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1191 0.22 MB/sec execute 60 sec latency 1466.952 ms 2023-12-13T00:17:38.820 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1195 0.22 MB/sec execute 61 sec latency 1193.123 ms 2023-12-13T00:17:39.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1199 0.22 MB/sec execute 62 sec latency 1455.939 ms 2023-12-13T00:17:40.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1207 0.22 MB/sec execute 63 sec latency 1321.102 ms 2023-12-13T00:17:41.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1213 0.23 MB/sec execute 64 sec latency 1135.131 ms 2023-12-13T00:17:42.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1223 0.26 MB/sec execute 65 sec latency 1377.509 ms 2023-12-13T00:17:43.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1225 0.25 MB/sec execute 66 sec latency 1485.943 ms 2023-12-13T00:17:44.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1230 0.25 MB/sec execute 67 sec latency 1505.948 ms 2023-12-13T00:17:45.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1234 0.25 MB/sec execute 68 sec latency 1327.398 ms 2023-12-13T00:17:46.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1239 0.24 MB/sec execute 69 sec latency 1238.694 ms 2023-12-13T00:17:47.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1247 0.25 MB/sec execute 70 sec latency 1362.980 ms 2023-12-13T00:17:48.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1260 0.28 MB/sec execute 71 sec latency 1075.313 ms 2023-12-13T00:17:49.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1263 0.27 MB/sec execute 72 sec latency 1149.378 ms 2023-12-13T00:17:50.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1266 0.27 MB/sec execute 73 sec latency 1227.011 ms 2023-12-13T00:17:51.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1271 0.27 MB/sec execute 74 sec latency 1330.683 ms 2023-12-13T00:17:52.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1275 0.26 MB/sec execute 75 sec latency 1373.479 ms 2023-12-13T00:17:53.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1281 0.26 MB/sec execute 76 sec latency 1107.980 ms 2023-12-13T00:17:54.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1295 0.30 MB/sec execute 77 sec latency 1200.185 ms 2023-12-13T00:17:55.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1299 0.29 MB/sec execute 78 sec latency 1164.872 ms 2023-12-13T00:17:56.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1302 0.29 MB/sec execute 79 sec latency 1279.333 ms 2023-12-13T00:17:57.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1307 0.29 MB/sec execute 80 sec latency 1693.896 ms 2023-12-13T00:17:58.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1314 0.30 MB/sec execute 81 sec latency 1634.069 ms 2023-12-13T00:17:59.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1322 0.32 MB/sec execute 82 sec latency 1171.542 ms 2023-12-13T00:18:00.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1326 0.32 MB/sec execute 83 sec latency 1454.938 ms 2023-12-13T00:18:01.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1338 0.35 MB/sec execute 84 sec latency 1392.536 ms 2023-12-13T00:18:02.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1357 0.41 MB/sec execute 85 sec latency 1568.796 ms 2023-12-13T00:18:03.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1360 0.40 MB/sec execute 86 sec latency 1438.029 ms 2023-12-13T00:18:04.326 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:18:04.328 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:18:04.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1364 0.40 MB/sec execute 87 sec latency 1395.169 ms 2023-12-13T00:18:05.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1371 0.40 MB/sec execute 88 sec latency 1408.490 ms 2023-12-13T00:18:06.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1381 0.42 MB/sec execute 89 sec latency 1190.132 ms 2023-12-13T00:18:07.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1383 0.42 MB/sec execute 90 sec latency 1447.894 ms 2023-12-13T00:18:08.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1386 0.41 MB/sec execute 91 sec latency 1408.237 ms 2023-12-13T00:18:09.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1389 0.41 MB/sec execute 92 sec latency 1296.816 ms 2023-12-13T00:18:10.821 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1392 0.40 MB/sec execute 93 sec latency 1148.711 ms 2023-12-13T00:18:11.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1400 0.41 MB/sec execute 94 sec latency 1394.589 ms 2023-12-13T00:18:12.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1409 0.43 MB/sec execute 95 sec latency 1330.947 ms 2023-12-13T00:18:13.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1421 0.45 MB/sec execute 96 sec latency 1547.514 ms 2023-12-13T00:18:14.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1426 0.45 MB/sec execute 97 sec latency 1223.653 ms 2023-12-13T00:18:15.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1431 0.44 MB/sec execute 98 sec latency 1313.372 ms 2023-12-13T00:18:16.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1434 0.44 MB/sec execute 99 sec latency 1322.382 ms 2023-12-13T00:18:17.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1438 0.43 MB/sec execute 100 sec latency 1385.246 ms 2023-12-13T00:18:18.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1441 0.43 MB/sec execute 101 sec latency 1468.103 ms 2023-12-13T00:18:19.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1446 0.43 MB/sec execute 102 sec latency 1441.672 ms 2023-12-13T00:18:20.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1452 0.42 MB/sec execute 103 sec latency 1275.849 ms 2023-12-13T00:18:21.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1455 0.42 MB/sec execute 104 sec latency 1069.789 ms 2023-12-13T00:18:22.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1460 0.41 MB/sec execute 105 sec latency 1267.893 ms 2023-12-13T00:18:23.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1463 0.41 MB/sec execute 106 sec latency 1356.083 ms 2023-12-13T00:18:24.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1468 0.41 MB/sec execute 107 sec latency 1502.958 ms 2023-12-13T00:18:25.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1474 0.40 MB/sec execute 108 sec latency 1642.389 ms 2023-12-13T00:18:26.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1477 0.40 MB/sec execute 109 sec latency 1344.930 ms 2023-12-13T00:18:27.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1481 0.40 MB/sec execute 110 sec latency 1366.533 ms 2023-12-13T00:18:28.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1485 0.39 MB/sec execute 111 sec latency 1243.883 ms 2023-12-13T00:18:29.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1491 0.39 MB/sec execute 112 sec latency 1242.602 ms 2023-12-13T00:18:30.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1497 0.39 MB/sec execute 113 sec latency 1214.110 ms 2023-12-13T00:18:31.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1500 0.38 MB/sec execute 114 sec latency 1084.670 ms 2023-12-13T00:18:32.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1502 0.38 MB/sec execute 115 sec latency 1616.824 ms 2023-12-13T00:18:33.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1507 0.38 MB/sec execute 116 sec latency 1659.352 ms 2023-12-13T00:18:34.382 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:18:34.385 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:18:34.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1514 0.37 MB/sec execute 117 sec latency 999.809 ms 2023-12-13T00:18:35.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1519 0.37 MB/sec execute 118 sec latency 1190.466 ms 2023-12-13T00:18:36.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1522 0.37 MB/sec execute 119 sec latency 1228.590 ms 2023-12-13T00:18:37.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1524 0.37 MB/sec execute 120 sec latency 1328.692 ms 2023-12-13T00:18:38.822 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1528 0.36 MB/sec execute 121 sec latency 1648.623 ms 2023-12-13T00:18:39.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1532 0.36 MB/sec execute 122 sec latency 1323.776 ms 2023-12-13T00:18:40.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1538 0.36 MB/sec execute 123 sec latency 1195.213 ms 2023-12-13T00:18:41.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1543 0.36 MB/sec execute 124 sec latency 1429.444 ms 2023-12-13T00:18:42.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1548 0.35 MB/sec execute 125 sec latency 1198.586 ms 2023-12-13T00:18:43.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1552 0.35 MB/sec execute 126 sec latency 1411.565 ms 2023-12-13T00:18:44.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1555 0.35 MB/sec execute 127 sec latency 1349.309 ms 2023-12-13T00:18:45.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1559 0.35 MB/sec execute 128 sec latency 1439.294 ms 2023-12-13T00:18:46.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1564 0.34 MB/sec execute 129 sec latency 1123.742 ms 2023-12-13T00:18:47.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1569 0.34 MB/sec execute 130 sec latency 1302.455 ms 2023-12-13T00:18:48.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1573 0.34 MB/sec execute 131 sec latency 1275.055 ms 2023-12-13T00:18:49.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1579 0.34 MB/sec execute 132 sec latency 1179.304 ms 2023-12-13T00:18:50.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1584 0.33 MB/sec execute 133 sec latency 1387.241 ms 2023-12-13T00:18:51.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1589 0.33 MB/sec execute 134 sec latency 994.785 ms 2023-12-13T00:18:52.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1592 0.33 MB/sec execute 135 sec latency 1434.298 ms 2023-12-13T00:18:53.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1596 0.33 MB/sec execute 136 sec latency 1323.793 ms 2023-12-13T00:18:54.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1601 0.33 MB/sec execute 137 sec latency 1330.204 ms 2023-12-13T00:18:55.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1606 0.32 MB/sec execute 138 sec latency 1222.300 ms 2023-12-13T00:18:56.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1609 0.32 MB/sec execute 139 sec latency 1921.485 ms 2023-12-13T00:18:57.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1613 0.32 MB/sec execute 140 sec latency 1364.981 ms 2023-12-13T00:18:58.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1615 0.32 MB/sec execute 141 sec latency 1696.534 ms 2023-12-13T00:18:59.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1619 0.32 MB/sec execute 142 sec latency 1391.306 ms 2023-12-13T00:19:00.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1626 0.31 MB/sec execute 143 sec latency 1307.725 ms 2023-12-13T00:19:01.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1632 0.31 MB/sec execute 144 sec latency 1200.158 ms 2023-12-13T00:19:02.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1639 0.31 MB/sec execute 145 sec latency 1607.823 ms 2023-12-13T00:19:03.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1643 0.31 MB/sec execute 146 sec latency 1649.099 ms 2023-12-13T00:19:04.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1648 0.31 MB/sec execute 147 sec latency 1279.063 ms 2023-12-13T00:19:05.089 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:19:05.093 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:19:05.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1652 0.30 MB/sec execute 148 sec latency 1296.867 ms 2023-12-13T00:19:06.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1655 0.30 MB/sec execute 149 sec latency 1746.741 ms 2023-12-13T00:19:07.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1661 0.30 MB/sec execute 150 sec latency 1526.370 ms 2023-12-13T00:19:08.823 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1668 0.30 MB/sec execute 151 sec latency 1586.580 ms 2023-12-13T00:19:09.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1673 0.30 MB/sec execute 152 sec latency 1154.627 ms 2023-12-13T00:19:10.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1676 0.30 MB/sec execute 153 sec latency 1483.401 ms 2023-12-13T00:19:11.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1681 0.29 MB/sec execute 154 sec latency 1220.402 ms 2023-12-13T00:19:12.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1685 0.29 MB/sec execute 155 sec latency 1275.167 ms 2023-12-13T00:19:13.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1690 0.29 MB/sec execute 156 sec latency 1332.048 ms 2023-12-13T00:19:14.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1695 0.29 MB/sec execute 157 sec latency 1407.991 ms 2023-12-13T00:19:15.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1700 0.29 MB/sec execute 158 sec latency 1722.753 ms 2023-12-13T00:19:16.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1708 0.29 MB/sec execute 159 sec latency 1252.737 ms 2023-12-13T00:19:17.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1713 0.28 MB/sec execute 160 sec latency 1226.389 ms 2023-12-13T00:19:18.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1718 0.28 MB/sec execute 161 sec latency 1139.705 ms 2023-12-13T00:19:19.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1724 0.28 MB/sec execute 162 sec latency 1378.310 ms 2023-12-13T00:19:20.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1730 0.28 MB/sec execute 163 sec latency 1109.157 ms 2023-12-13T00:19:21.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1736 0.28 MB/sec execute 164 sec latency 1346.559 ms 2023-12-13T00:19:22.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1743 0.28 MB/sec execute 165 sec latency 1108.335 ms 2023-12-13T00:19:23.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1748 0.28 MB/sec execute 166 sec latency 1170.407 ms 2023-12-13T00:19:24.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1753 0.27 MB/sec execute 167 sec latency 1167.777 ms 2023-12-13T00:19:25.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1757 0.27 MB/sec execute 168 sec latency 1309.287 ms 2023-12-13T00:19:26.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1763 0.27 MB/sec execute 169 sec latency 1648.611 ms 2023-12-13T00:19:27.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1768 0.27 MB/sec execute 170 sec latency 1563.776 ms 2023-12-13T00:19:28.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1773 0.27 MB/sec execute 171 sec latency 1746.406 ms 2023-12-13T00:19:29.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1778 0.27 MB/sec execute 172 sec latency 1416.896 ms 2023-12-13T00:19:30.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1782 0.27 MB/sec execute 173 sec latency 1170.273 ms 2023-12-13T00:19:31.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1785 0.27 MB/sec execute 174 sec latency 1783.149 ms 2023-12-13T00:19:32.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1791 0.26 MB/sec execute 175 sec latency 1160.564 ms 2023-12-13T00:19:33.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1795 0.26 MB/sec execute 176 sec latency 1263.195 ms 2023-12-13T00:19:34.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1800 0.26 MB/sec execute 177 sec latency 1354.202 ms 2023-12-13T00:19:35.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:19:35.202 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:19:35.824 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1806 0.26 MB/sec execute 178 sec latency 1122.523 ms 2023-12-13T00:19:36.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1813 0.26 MB/sec execute 179 sec latency 1256.274 ms 2023-12-13T00:19:37.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1818 0.26 MB/sec execute 180 sec latency 1310.711 ms 2023-12-13T00:19:38.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1820 0.26 MB/sec execute 181 sec latency 1346.559 ms 2023-12-13T00:19:39.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1825 0.26 MB/sec execute 182 sec latency 1180.081 ms 2023-12-13T00:19:40.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1830 0.25 MB/sec execute 183 sec latency 1284.494 ms 2023-12-13T00:19:41.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1835 0.25 MB/sec execute 184 sec latency 1331.709 ms 2023-12-13T00:19:42.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1838 0.25 MB/sec execute 185 sec latency 852.832 ms 2023-12-13T00:19:43.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1840 0.25 MB/sec execute 186 sec latency 1384.791 ms 2023-12-13T00:19:44.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1849 0.25 MB/sec execute 187 sec latency 1418.656 ms 2023-12-13T00:19:45.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1855 0.25 MB/sec execute 188 sec latency 1194.941 ms 2023-12-13T00:19:46.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1860 0.25 MB/sec execute 189 sec latency 1076.712 ms 2023-12-13T00:19:47.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1863 0.25 MB/sec execute 190 sec latency 1169.449 ms 2023-12-13T00:19:48.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1866 0.25 MB/sec execute 191 sec latency 1462.428 ms 2023-12-13T00:19:49.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1870 0.24 MB/sec execute 192 sec latency 1343.298 ms 2023-12-13T00:19:50.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1875 0.24 MB/sec execute 193 sec latency 1266.314 ms 2023-12-13T00:19:51.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1877 0.24 MB/sec execute 194 sec latency 1186.859 ms 2023-12-13T00:19:52.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1883 0.24 MB/sec execute 195 sec latency 1526.741 ms 2023-12-13T00:19:53.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1888 0.24 MB/sec execute 196 sec latency 1257.478 ms 2023-12-13T00:19:54.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1891 0.24 MB/sec execute 197 sec latency 1299.516 ms 2023-12-13T00:19:55.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1899 0.24 MB/sec execute 198 sec latency 1314.617 ms 2023-12-13T00:19:56.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1904 0.24 MB/sec execute 199 sec latency 1384.268 ms 2023-12-13T00:19:57.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1908 0.24 MB/sec execute 200 sec latency 1354.953 ms 2023-12-13T00:19:58.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1913 0.24 MB/sec execute 201 sec latency 1319.811 ms 2023-12-13T00:19:59.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1919 0.23 MB/sec execute 202 sec latency 1367.072 ms 2023-12-13T00:20:00.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1923 0.23 MB/sec execute 203 sec latency 1239.002 ms 2023-12-13T00:20:01.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1927 0.23 MB/sec execute 204 sec latency 1633.835 ms 2023-12-13T00:20:02.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1934 0.23 MB/sec execute 205 sec latency 1662.249 ms 2023-12-13T00:20:03.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1941 0.23 MB/sec execute 206 sec latency 1480.406 ms 2023-12-13T00:20:04.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1946 0.23 MB/sec execute 207 sec latency 1280.439 ms 2023-12-13T00:20:05.255 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:20:05.258 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:20:05.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1952 0.23 MB/sec execute 208 sec latency 1372.067 ms 2023-12-13T00:20:06.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1954 0.23 MB/sec execute 209 sec latency 1575.243 ms 2023-12-13T00:20:07.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1959 0.23 MB/sec execute 210 sec latency 1344.692 ms 2023-12-13T00:20:08.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1963 0.23 MB/sec execute 211 sec latency 1592.362 ms 2023-12-13T00:20:09.825 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1968 0.23 MB/sec execute 212 sec latency 1557.769 ms 2023-12-13T00:20:10.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1975 0.23 MB/sec execute 213 sec latency 1351.075 ms 2023-12-13T00:20:11.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1980 0.22 MB/sec execute 214 sec latency 1207.139 ms 2023-12-13T00:20:12.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1984 0.22 MB/sec execute 215 sec latency 1205.197 ms 2023-12-13T00:20:13.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1990 0.22 MB/sec execute 216 sec latency 1364.860 ms 2023-12-13T00:20:14.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 1996 0.22 MB/sec execute 217 sec latency 1142.849 ms 2023-12-13T00:20:15.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2001 0.22 MB/sec execute 218 sec latency 1493.092 ms 2023-12-13T00:20:16.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2005 0.22 MB/sec execute 219 sec latency 1236.788 ms 2023-12-13T00:20:17.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2012 0.22 MB/sec execute 220 sec latency 1654.541 ms 2023-12-13T00:20:18.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2016 0.22 MB/sec execute 221 sec latency 1209.714 ms 2023-12-13T00:20:19.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2019 0.22 MB/sec execute 222 sec latency 1302.176 ms 2023-12-13T00:20:20.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2023 0.22 MB/sec execute 223 sec latency 1420.917 ms 2023-12-13T00:20:21.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2029 0.22 MB/sec execute 224 sec latency 1304.632 ms 2023-12-13T00:20:22.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2035 0.22 MB/sec execute 225 sec latency 1350.488 ms 2023-12-13T00:20:23.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2040 0.22 MB/sec execute 226 sec latency 1267.930 ms 2023-12-13T00:20:24.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2043 0.22 MB/sec execute 227 sec latency 1221.589 ms 2023-12-13T00:20:25.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2049 0.21 MB/sec execute 228 sec latency 1271.516 ms 2023-12-13T00:20:26.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2054 0.21 MB/sec execute 229 sec latency 1136.028 ms 2023-12-13T00:20:27.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2057 0.21 MB/sec execute 230 sec latency 1375.545 ms 2023-12-13T00:20:28.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2060 0.21 MB/sec execute 231 sec latency 1213.645 ms 2023-12-13T00:20:29.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2065 0.21 MB/sec execute 232 sec latency 1420.859 ms 2023-12-13T00:20:30.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2071 0.21 MB/sec execute 233 sec latency 1524.450 ms 2023-12-13T00:20:31.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2075 0.21 MB/sec execute 234 sec latency 1161.709 ms 2023-12-13T00:20:32.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2082 0.21 MB/sec execute 235 sec latency 1395.429 ms 2023-12-13T00:20:33.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2087 0.21 MB/sec execute 236 sec latency 1350.579 ms 2023-12-13T00:20:34.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2089 0.21 MB/sec execute 237 sec latency 1309.264 ms 2023-12-13T00:20:35.385 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:20:35.388 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:20:35.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2095 0.21 MB/sec execute 238 sec latency 1307.048 ms 2023-12-13T00:20:36.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2099 0.21 MB/sec execute 239 sec latency 1404.441 ms 2023-12-13T00:20:37.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2104 0.21 MB/sec execute 240 sec latency 1495.513 ms 2023-12-13T00:20:38.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2110 0.21 MB/sec execute 241 sec latency 1184.819 ms 2023-12-13T00:20:39.826 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2119 0.21 MB/sec execute 242 sec latency 1304.388 ms 2023-12-13T00:20:40.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2123 0.21 MB/sec execute 243 sec latency 1492.294 ms 2023-12-13T00:20:41.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2125 0.20 MB/sec execute 244 sec latency 1333.032 ms 2023-12-13T00:20:42.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2131 0.20 MB/sec execute 245 sec latency 1808.126 ms 2023-12-13T00:20:43.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2135 0.20 MB/sec execute 246 sec latency 1251.743 ms 2023-12-13T00:20:44.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2141 0.20 MB/sec execute 247 sec latency 1388.764 ms 2023-12-13T00:20:45.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2145 0.21 MB/sec execute 248 sec latency 2057.865 ms 2023-12-13T00:20:46.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2149 0.21 MB/sec execute 249 sec latency 1636.461 ms 2023-12-13T00:20:47.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2155 0.20 MB/sec execute 250 sec latency 1153.784 ms 2023-12-13T00:20:48.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2160 0.20 MB/sec execute 251 sec latency 1220.819 ms 2023-12-13T00:20:49.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2162 0.20 MB/sec execute 252 sec latency 1275.467 ms 2023-12-13T00:20:50.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2165 0.20 MB/sec execute 253 sec latency 1380.082 ms 2023-12-13T00:20:51.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2171 0.20 MB/sec execute 254 sec latency 1526.218 ms 2023-12-13T00:20:52.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2174 0.20 MB/sec execute 255 sec latency 1244.531 ms 2023-12-13T00:20:53.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2182 0.20 MB/sec execute 256 sec latency 1369.535 ms 2023-12-13T00:20:54.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2193 0.20 MB/sec execute 257 sec latency 1584.713 ms 2023-12-13T00:20:55.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2198 0.20 MB/sec execute 258 sec latency 1130.951 ms 2023-12-13T00:20:56.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2204 0.20 MB/sec execute 259 sec latency 1165.852 ms 2023-12-13T00:20:57.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2211 0.21 MB/sec execute 260 sec latency 1364.364 ms 2023-12-13T00:20:58.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2217 0.21 MB/sec execute 261 sec latency 1420.261 ms 2023-12-13T00:20:59.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2222 0.20 MB/sec execute 262 sec latency 1456.731 ms 2023-12-13T00:21:00.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2227 0.21 MB/sec execute 263 sec latency 1727.347 ms 2023-12-13T00:21:01.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2236 0.21 MB/sec execute 264 sec latency 1445.975 ms 2023-12-13T00:21:02.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2243 0.21 MB/sec execute 265 sec latency 1307.049 ms 2023-12-13T00:21:03.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2247 0.21 MB/sec execute 266 sec latency 1434.908 ms 2023-12-13T00:21:04.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2253 0.21 MB/sec execute 267 sec latency 1420.394 ms 2023-12-13T00:21:05.448 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:21:05.451 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:21:05.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2258 0.21 MB/sec execute 268 sec latency 1506.000 ms 2023-12-13T00:21:06.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2260 0.21 MB/sec execute 269 sec latency 1769.488 ms 2023-12-13T00:21:07.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2263 0.21 MB/sec execute 270 sec latency 1679.609 ms 2023-12-13T00:21:08.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2266 0.21 MB/sec execute 271 sec latency 1793.338 ms 2023-12-13T00:21:09.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2272 0.21 MB/sec execute 272 sec latency 1754.077 ms 2023-12-13T00:21:10.827 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2276 0.21 MB/sec execute 273 sec latency 1349.793 ms 2023-12-13T00:21:11.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2280 0.21 MB/sec execute 274 sec latency 1361.434 ms 2023-12-13T00:21:12.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2286 0.21 MB/sec execute 275 sec latency 1514.685 ms 2023-12-13T00:21:13.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2293 0.21 MB/sec execute 276 sec latency 1299.844 ms 2023-12-13T00:21:14.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2299 0.21 MB/sec execute 277 sec latency 1268.380 ms 2023-12-13T00:21:15.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2302 0.21 MB/sec execute 278 sec latency 1242.347 ms 2023-12-13T00:21:16.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2308 0.21 MB/sec execute 279 sec latency 1255.681 ms 2023-12-13T00:21:17.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2313 0.21 MB/sec execute 280 sec latency 1158.942 ms 2023-12-13T00:21:18.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2318 0.21 MB/sec execute 281 sec latency 1389.950 ms 2023-12-13T00:21:19.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2324 0.21 MB/sec execute 282 sec latency 1215.927 ms 2023-12-13T00:21:20.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2327 0.21 MB/sec execute 283 sec latency 1270.662 ms 2023-12-13T00:21:21.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2332 0.21 MB/sec execute 284 sec latency 1604.895 ms 2023-12-13T00:21:22.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2335 0.21 MB/sec execute 285 sec latency 1705.364 ms 2023-12-13T00:21:23.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2339 0.21 MB/sec execute 286 sec latency 1794.268 ms 2023-12-13T00:21:24.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2343 0.21 MB/sec execute 287 sec latency 1585.146 ms 2023-12-13T00:21:25.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2346 0.21 MB/sec execute 288 sec latency 1438.761 ms 2023-12-13T00:21:26.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2349 0.21 MB/sec execute 289 sec latency 1378.308 ms 2023-12-13T00:21:27.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2355 0.21 MB/sec execute 290 sec latency 1602.837 ms 2023-12-13T00:21:28.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2358 0.21 MB/sec execute 291 sec latency 1585.493 ms 2023-12-13T00:21:29.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2362 0.21 MB/sec execute 292 sec latency 1322.449 ms 2023-12-13T00:21:30.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2369 0.21 MB/sec execute 293 sec latency 1395.905 ms 2023-12-13T00:21:31.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2375 0.21 MB/sec execute 294 sec latency 1308.361 ms 2023-12-13T00:21:32.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2378 0.21 MB/sec execute 295 sec latency 1372.186 ms 2023-12-13T00:21:33.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2383 0.21 MB/sec execute 296 sec latency 1556.994 ms 2023-12-13T00:21:34.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2388 0.21 MB/sec execute 297 sec latency 1212.613 ms 2023-12-13T00:21:35.596 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:21:35.598 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:21:35.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2390 0.21 MB/sec execute 298 sec latency 1312.091 ms 2023-12-13T00:21:36.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2393 0.21 MB/sec execute 299 sec latency 1479.062 ms 2023-12-13T00:21:37.828 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2397 0.21 MB/sec execute 300 sec latency 1501.584 ms 2023-12-13T00:21:38.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2400 0.21 MB/sec execute 301 sec latency 1425.977 ms 2023-12-13T00:21:39.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2405 0.21 MB/sec execute 302 sec latency 1459.317 ms 2023-12-13T00:21:40.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2409 0.21 MB/sec execute 303 sec latency 1086.299 ms 2023-12-13T00:21:41.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2411 0.21 MB/sec execute 304 sec latency 1415.781 ms 2023-12-13T00:21:42.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2419 0.21 MB/sec execute 305 sec latency 1615.069 ms 2023-12-13T00:21:43.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2421 0.21 MB/sec execute 306 sec latency 1794.810 ms 2023-12-13T00:21:44.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2424 0.21 MB/sec execute 307 sec latency 1637.868 ms 2023-12-13T00:21:45.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2428 0.21 MB/sec execute 308 sec latency 1467.266 ms 2023-12-13T00:21:46.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2433 0.21 MB/sec execute 309 sec latency 1375.802 ms 2023-12-13T00:21:47.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2438 0.21 MB/sec execute 310 sec latency 1289.589 ms 2023-12-13T00:21:48.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2443 0.21 MB/sec execute 311 sec latency 1387.161 ms 2023-12-13T00:21:49.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2447 0.21 MB/sec execute 312 sec latency 1193.061 ms 2023-12-13T00:21:50.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2452 0.22 MB/sec execute 313 sec latency 1259.712 ms 2023-12-13T00:21:51.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2455 0.21 MB/sec execute 314 sec latency 1451.483 ms 2023-12-13T00:21:52.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2458 0.21 MB/sec execute 315 sec latency 1509.373 ms 2023-12-13T00:21:53.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2462 0.21 MB/sec execute 316 sec latency 1445.087 ms 2023-12-13T00:21:54.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2466 0.21 MB/sec execute 317 sec latency 1310.130 ms 2023-12-13T00:21:55.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2471 0.21 MB/sec execute 318 sec latency 1042.061 ms 2023-12-13T00:21:56.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2478 0.21 MB/sec execute 319 sec latency 1304.463 ms 2023-12-13T00:21:57.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2484 0.21 MB/sec execute 320 sec latency 1357.902 ms 2023-12-13T00:21:58.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2491 0.21 MB/sec execute 321 sec latency 1482.422 ms 2023-12-13T00:21:59.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2492 0.21 MB/sec execute 322 sec latency 1409.569 ms 2023-12-13T00:22:00.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2497 0.21 MB/sec execute 323 sec latency 1490.811 ms 2023-12-13T00:22:01.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2501 0.21 MB/sec execute 324 sec latency 1268.792 ms 2023-12-13T00:22:02.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2512 0.21 MB/sec execute 325 sec latency 1457.165 ms 2023-12-13T00:22:03.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2515 0.21 MB/sec execute 326 sec latency 1564.625 ms 2023-12-13T00:22:04.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2519 0.21 MB/sec execute 327 sec latency 1245.195 ms 2023-12-13T00:22:05.759 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:22:05.761 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:22:05.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2524 0.21 MB/sec execute 328 sec latency 1260.373 ms 2023-12-13T00:22:06.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2527 0.21 MB/sec execute 329 sec latency 1368.853 ms 2023-12-13T00:22:07.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2538 0.22 MB/sec execute 330 sec latency 1394.205 ms 2023-12-13T00:22:08.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2542 0.22 MB/sec execute 331 sec latency 1380.746 ms 2023-12-13T00:22:09.829 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2547 0.22 MB/sec execute 332 sec latency 1277.367 ms 2023-12-13T00:22:10.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2553 0.22 MB/sec execute 333 sec latency 1324.974 ms 2023-12-13T00:22:11.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2557 0.22 MB/sec execute 334 sec latency 1348.613 ms 2023-12-13T00:22:12.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2559 0.22 MB/sec execute 335 sec latency 1353.069 ms 2023-12-13T00:22:13.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2564 0.22 MB/sec execute 336 sec latency 1174.693 ms 2023-12-13T00:22:14.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2568 0.22 MB/sec execute 337 sec latency 1372.820 ms 2023-12-13T00:22:15.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2571 0.22 MB/sec execute 338 sec latency 1301.582 ms 2023-12-13T00:22:16.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2579 0.22 MB/sec execute 339 sec latency 1399.455 ms 2023-12-13T00:22:17.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2583 0.22 MB/sec execute 340 sec latency 1355.879 ms 2023-12-13T00:22:18.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2585 0.22 MB/sec execute 341 sec latency 1380.074 ms 2023-12-13T00:22:19.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2592 0.22 MB/sec execute 342 sec latency 1149.254 ms 2023-12-13T00:22:20.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2601 0.23 MB/sec execute 343 sec latency 1380.665 ms 2023-12-13T00:22:21.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2609 0.23 MB/sec execute 344 sec latency 1418.183 ms 2023-12-13T00:22:22.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2629 0.24 MB/sec execute 345 sec latency 1445.928 ms 2023-12-13T00:22:23.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2641 0.24 MB/sec execute 346 sec latency 1287.604 ms 2023-12-13T00:22:24.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2646 0.24 MB/sec execute 347 sec latency 1281.723 ms 2023-12-13T00:22:25.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2649 0.24 MB/sec execute 348 sec latency 1286.894 ms 2023-12-13T00:22:26.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2657 0.25 MB/sec execute 349 sec latency 1415.103 ms 2023-12-13T00:22:27.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2684 0.26 MB/sec execute 350 sec latency 1409.108 ms 2023-12-13T00:22:28.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2687 0.26 MB/sec execute 351 sec latency 1403.548 ms 2023-12-13T00:22:29.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2697 0.26 MB/sec execute 352 sec latency 1296.235 ms 2023-12-13T00:22:30.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2701 0.26 MB/sec execute 353 sec latency 1115.868 ms 2023-12-13T00:22:31.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2705 0.26 MB/sec execute 354 sec latency 1026.818 ms 2023-12-13T00:22:32.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2708 0.26 MB/sec execute 355 sec latency 1351.502 ms 2023-12-13T00:22:33.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2712 0.26 MB/sec execute 356 sec latency 1367.719 ms 2023-12-13T00:22:34.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2724 0.26 MB/sec execute 357 sec latency 1407.766 ms 2023-12-13T00:22:35.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2734 0.26 MB/sec execute 358 sec latency 1042.511 ms 2023-12-13T00:22:35.847 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:22:35.850 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:22:36.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2741 0.26 MB/sec execute 359 sec latency 1069.813 ms 2023-12-13T00:22:37.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2744 0.26 MB/sec execute 360 sec latency 1447.238 ms 2023-12-13T00:22:38.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2749 0.26 MB/sec execute 361 sec latency 1291.202 ms 2023-12-13T00:22:39.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2759 0.26 MB/sec execute 362 sec latency 1417.839 ms 2023-12-13T00:22:40.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2775 0.27 MB/sec execute 363 sec latency 1239.068 ms 2023-12-13T00:22:41.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2794 0.27 MB/sec execute 364 sec latency 759.366 ms 2023-12-13T00:22:42.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2798 0.27 MB/sec execute 365 sec latency 1234.729 ms 2023-12-13T00:22:43.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2806 0.27 MB/sec execute 366 sec latency 1012.255 ms 2023-12-13T00:22:44.830 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2809 0.27 MB/sec execute 367 sec latency 1278.815 ms 2023-12-13T00:22:45.089 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:23:09.630 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:22:45.098 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:23:09.639 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:22:45.102 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:23:09.636 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:22:45.105 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:23:09.639 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:22:45.106 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:23:09.641 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:22:45.110 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:23:09.644 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:22:45.231 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:23:09.765 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:22:45.239 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:23:09.774 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:22:45.244 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:23:09.784 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:22:45.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2814 0.27 MB/sec execute 368 sec latency 1439.552 ms 2023-12-13T00:22:46.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2819 0.28 MB/sec execute 369 sec latency 1233.151 ms 2023-12-13T00:22:47.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2825 0.28 MB/sec execute 370 sec latency 1342.414 ms 2023-12-13T00:22:48.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2838 0.28 MB/sec execute 371 sec latency 1367.096 ms 2023-12-13T00:22:49.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2842 0.29 MB/sec execute 372 sec latency 1263.017 ms 2023-12-13T00:22:50.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2850 0.29 MB/sec execute 373 sec latency 1373.385 ms 2023-12-13T00:22:51.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2862 0.29 MB/sec execute 374 sec latency 1206.445 ms 2023-12-13T00:22:52.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2866 0.29 MB/sec execute 375 sec latency 1443.829 ms 2023-12-13T00:22:53.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2887 0.29 MB/sec execute 376 sec latency 1420.112 ms 2023-12-13T00:22:54.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2900 0.30 MB/sec execute 377 sec latency 1527.669 ms 2023-12-13T00:22:55.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2914 0.30 MB/sec execute 378 sec latency 1069.564 ms 2023-12-13T00:22:56.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2918 0.30 MB/sec execute 379 sec latency 1315.028 ms 2023-12-13T00:22:57.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2924 0.30 MB/sec execute 380 sec latency 1403.066 ms 2023-12-13T00:22:58.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2928 0.30 MB/sec execute 381 sec latency 1511.273 ms 2023-12-13T00:22:59.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2932 0.30 MB/sec execute 382 sec latency 1249.756 ms 2023-12-13T00:23:00.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2938 0.30 MB/sec execute 383 sec latency 918.524 ms 2023-12-13T00:23:01.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2942 0.30 MB/sec execute 384 sec latency 1197.449 ms 2023-12-13T00:23:02.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2955 0.30 MB/sec execute 385 sec latency 1070.394 ms 2023-12-13T00:23:03.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2961 0.30 MB/sec execute 386 sec latency 1213.509 ms 2023-12-13T00:23:04.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2975 0.30 MB/sec execute 387 sec latency 1231.362 ms 2023-12-13T00:23:05.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2993 0.30 MB/sec execute 388 sec latency 1097.839 ms 2023-12-13T00:23:05.978 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:23:05.980 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:23:06.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 2998 0.30 MB/sec execute 389 sec latency 1462.971 ms 2023-12-13T00:23:07.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3001 0.30 MB/sec execute 390 sec latency 1391.782 ms 2023-12-13T00:23:08.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3020 0.30 MB/sec execute 391 sec latency 1418.154 ms 2023-12-13T00:23:09.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3033 0.30 MB/sec execute 392 sec latency 1102.553 ms 2023-12-13T00:23:10.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3038 0.30 MB/sec execute 393 sec latency 1331.207 ms 2023-12-13T00:23:11.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3042 0.31 MB/sec execute 394 sec latency 1201.010 ms 2023-12-13T00:23:12.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3073 0.31 MB/sec execute 395 sec latency 1376.543 ms 2023-12-13T00:23:13.831 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3091 0.31 MB/sec execute 396 sec latency 1370.136 ms 2023-12-13T00:23:14.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3094 0.31 MB/sec execute 397 sec latency 1387.356 ms 2023-12-13T00:23:15.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3098 0.31 MB/sec execute 398 sec latency 1156.846 ms 2023-12-13T00:23:16.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3106 0.31 MB/sec execute 399 sec latency 1292.805 ms 2023-12-13T00:23:17.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3114 0.31 MB/sec execute 400 sec latency 1190.439 ms 2023-12-13T00:23:18.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3121 0.31 MB/sec execute 401 sec latency 1409.275 ms 2023-12-13T00:23:19.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3128 0.31 MB/sec execute 402 sec latency 1352.452 ms 2023-12-13T00:23:20.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3133 0.31 MB/sec execute 403 sec latency 1209.071 ms 2023-12-13T00:23:21.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3136 0.31 MB/sec execute 404 sec latency 1173.388 ms 2023-12-13T00:23:22.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3142 0.31 MB/sec execute 405 sec latency 1389.900 ms 2023-12-13T00:23:23.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3153 0.31 MB/sec execute 406 sec latency 1395.352 ms 2023-12-13T00:23:24.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3161 0.32 MB/sec execute 407 sec latency 1209.275 ms 2023-12-13T00:23:25.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3163 0.32 MB/sec execute 408 sec latency 1316.417 ms 2023-12-13T00:23:26.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3166 0.32 MB/sec execute 409 sec latency 1577.987 ms 2023-12-13T00:23:27.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3168 0.32 MB/sec execute 410 sec latency 1503.494 ms 2023-12-13T00:23:28.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3186 0.32 MB/sec execute 411 sec latency 1474.006 ms 2023-12-13T00:23:29.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3188 0.32 MB/sec execute 412 sec latency 1421.207 ms 2023-12-13T00:23:30.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3190 0.31 MB/sec execute 413 sec latency 1451.146 ms 2023-12-13T00:23:31.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3192 0.31 MB/sec execute 414 sec latency 1349.978 ms 2023-12-13T00:23:32.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3195 0.31 MB/sec execute 415 sec latency 1412.904 ms 2023-12-13T00:23:33.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3197 0.31 MB/sec execute 416 sec latency 1580.582 ms 2023-12-13T00:23:34.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3199 0.31 MB/sec execute 417 sec latency 1457.525 ms 2023-12-13T00:23:35.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3216 0.31 MB/sec execute 418 sec latency 1324.213 ms 2023-12-13T00:23:36.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:23:36.036 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:23:36.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3231 0.31 MB/sec execute 419 sec latency 1421.309 ms 2023-12-13T00:23:37.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3233 0.31 MB/sec execute 420 sec latency 1601.421 ms 2023-12-13T00:23:38.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3237 0.31 MB/sec execute 421 sec latency 1312.356 ms 2023-12-13T00:23:39.031 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:24:03.571 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:23:39.106 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:24:03.647 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:23:39.142 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:24:03.683 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:23:39.190 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:24:03.724 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:23:39.192 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:24:03.726 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:23:39.195 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:24:03.729 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:23:39.197 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:24:03.732 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:23:39.226 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:24:03.761 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:23:39.233 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:24:03.767 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:23:39.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3241 0.31 MB/sec execute 422 sec latency 1525.264 ms 2023-12-13T00:23:40.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3245 0.31 MB/sec execute 423 sec latency 1319.983 ms 2023-12-13T00:23:41.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3246 0.31 MB/sec execute 424 sec latency 1494.679 ms 2023-12-13T00:23:42.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3248 0.31 MB/sec execute 425 sec latency 1405.659 ms 2023-12-13T00:23:43.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3266 0.31 MB/sec execute 426 sec latency 1515.901 ms 2023-12-13T00:23:44.832 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3268 0.31 MB/sec execute 427 sec latency 1310.135 ms 2023-12-13T00:23:45.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3272 0.31 MB/sec execute 428 sec latency 1412.725 ms 2023-12-13T00:23:46.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3279 0.31 MB/sec execute 429 sec latency 1376.420 ms 2023-12-13T00:23:47.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3284 0.32 MB/sec execute 430 sec latency 1490.651 ms 2023-12-13T00:23:48.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3285 0.31 MB/sec execute 431 sec latency 1327.816 ms 2023-12-13T00:23:49.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3287 0.31 MB/sec execute 432 sec latency 1483.730 ms 2023-12-13T00:23:50.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3290 0.31 MB/sec execute 433 sec latency 1357.883 ms 2023-12-13T00:23:51.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3292 0.31 MB/sec execute 434 sec latency 1388.964 ms 2023-12-13T00:23:52.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3294 0.31 MB/sec execute 435 sec latency 1393.751 ms 2023-12-13T00:23:53.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3297 0.31 MB/sec execute 436 sec latency 1488.803 ms 2023-12-13T00:23:54.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3300 0.31 MB/sec execute 437 sec latency 1506.227 ms 2023-12-13T00:23:55.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3301 0.31 MB/sec execute 438 sec latency 1453.849 ms 2023-12-13T00:23:56.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3302 0.31 MB/sec execute 439 sec latency 1422.425 ms 2023-12-13T00:23:57.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3303 0.31 MB/sec execute 440 sec latency 1341.335 ms 2023-12-13T00:23:58.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3305 0.31 MB/sec execute 441 sec latency 1424.615 ms 2023-12-13T00:23:59.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3306 0.31 MB/sec execute 442 sec latency 1489.948 ms 2023-12-13T00:24:00.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3306 0.31 MB/sec execute 443 sec latency 1726.893 ms 2023-12-13T00:24:01.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3307 0.31 MB/sec execute 444 sec latency 1454.109 ms 2023-12-13T00:24:02.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3308 0.31 MB/sec execute 445 sec latency 1466.857 ms 2023-12-13T00:24:03.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3310 0.31 MB/sec execute 446 sec latency 1638.773 ms 2023-12-13T00:24:04.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3312 0.31 MB/sec execute 447 sec latency 1498.249 ms 2023-12-13T00:24:05.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3313 0.31 MB/sec execute 448 sec latency 1411.561 ms 2023-12-13T00:24:06.172 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:24:06.174 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:24:06.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3314 0.30 MB/sec execute 449 sec latency 1432.975 ms 2023-12-13T00:24:07.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3316 0.30 MB/sec execute 450 sec latency 1386.428 ms 2023-12-13T00:24:08.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3318 0.30 MB/sec execute 451 sec latency 1432.238 ms 2023-12-13T00:24:09.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3319 0.30 MB/sec execute 452 sec latency 1500.605 ms 2023-12-13T00:24:10.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3320 0.30 MB/sec execute 453 sec latency 1363.068 ms 2023-12-13T00:24:11.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3322 0.30 MB/sec execute 454 sec latency 1398.060 ms 2023-12-13T00:24:12.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3323 0.30 MB/sec execute 455 sec latency 1396.632 ms 2023-12-13T00:24:13.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3325 0.30 MB/sec execute 456 sec latency 1407.412 ms 2023-12-13T00:24:14.833 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3325 0.30 MB/sec execute 457 sec latency 1290.192 ms 2023-12-13T00:24:15.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3327 0.30 MB/sec execute 458 sec latency 1489.377 ms 2023-12-13T00:24:16.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3328 0.30 MB/sec execute 459 sec latency 1466.550 ms 2023-12-13T00:24:17.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3330 0.30 MB/sec execute 460 sec latency 1307.648 ms 2023-12-13T00:24:18.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3339 0.30 MB/sec execute 461 sec latency 1408.553 ms 2023-12-13T00:24:19.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3341 0.30 MB/sec execute 462 sec latency 1349.735 ms 2023-12-13T00:24:20.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3343 0.30 MB/sec execute 463 sec latency 1422.356 ms 2023-12-13T00:24:21.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3344 0.30 MB/sec execute 464 sec latency 1282.868 ms 2023-12-13T00:24:22.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3346 0.30 MB/sec execute 465 sec latency 1456.511 ms 2023-12-13T00:24:23.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3349 0.30 MB/sec execute 466 sec latency 1371.965 ms 2023-12-13T00:24:24.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3352 0.30 MB/sec execute 467 sec latency 1363.038 ms 2023-12-13T00:24:25.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3354 0.30 MB/sec execute 468 sec latency 1336.251 ms 2023-12-13T00:24:26.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3358 0.30 MB/sec execute 469 sec latency 1494.576 ms 2023-12-13T00:24:27.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3361 0.30 MB/sec execute 470 sec latency 1280.919 ms 2023-12-13T00:24:28.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3364 0.30 MB/sec execute 471 sec latency 1637.122 ms 2023-12-13T00:24:29.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3367 0.30 MB/sec execute 472 sec latency 1203.640 ms 2023-12-13T00:24:30.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3368 0.30 MB/sec execute 473 sec latency 1784.962 ms 2023-12-13T00:24:31.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3371 0.30 MB/sec execute 474 sec latency 1584.587 ms 2023-12-13T00:24:32.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3375 0.30 MB/sec execute 475 sec latency 1368.465 ms 2023-12-13T00:24:33.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3377 0.29 MB/sec execute 476 sec latency 1814.137 ms 2023-12-13T00:24:34.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3379 0.29 MB/sec execute 477 sec latency 1864.367 ms 2023-12-13T00:24:35.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3381 0.29 MB/sec execute 478 sec latency 1352.496 ms 2023-12-13T00:24:36.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:24:36.305 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:24:36.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3383 0.29 MB/sec execute 479 sec latency 1265.656 ms 2023-12-13T00:24:37.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3386 0.29 MB/sec execute 480 sec latency 1430.616 ms 2023-12-13T00:24:38.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3403 0.30 MB/sec execute 481 sec latency 1536.280 ms 2023-12-13T00:24:39.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3414 0.31 MB/sec execute 482 sec latency 1567.686 ms 2023-12-13T00:24:40.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3423 0.31 MB/sec execute 483 sec latency 1292.713 ms 2023-12-13T00:24:41.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3427 0.31 MB/sec execute 484 sec latency 1450.592 ms 2023-12-13T00:24:42.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3430 0.31 MB/sec execute 485 sec latency 1714.906 ms 2023-12-13T00:24:43.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3433 0.31 MB/sec execute 486 sec latency 1456.195 ms 2023-12-13T00:24:44.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3446 0.31 MB/sec execute 487 sec latency 1417.857 ms 2023-12-13T00:24:45.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3457 0.32 MB/sec execute 488 sec latency 1626.242 ms 2023-12-13T00:24:46.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3460 0.32 MB/sec execute 489 sec latency 1435.778 ms 2023-12-13T00:24:47.834 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3467 0.32 MB/sec execute 490 sec latency 1360.654 ms 2023-12-13T00:24:48.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3471 0.32 MB/sec execute 491 sec latency 1535.828 ms 2023-12-13T00:24:49.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3475 0.32 MB/sec execute 492 sec latency 1544.824 ms 2023-12-13T00:24:50.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3478 0.32 MB/sec execute 493 sec latency 1506.538 ms 2023-12-13T00:24:51.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3480 0.31 MB/sec execute 494 sec latency 1551.650 ms 2023-12-13T00:24:52.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3484 0.31 MB/sec execute 495 sec latency 1390.968 ms 2023-12-13T00:24:53.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3488 0.31 MB/sec execute 496 sec latency 1389.242 ms 2023-12-13T00:24:54.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3493 0.31 MB/sec execute 497 sec latency 1221.883 ms 2023-12-13T00:24:55.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3497 0.31 MB/sec execute 498 sec latency 1420.840 ms 2023-12-13T00:24:56.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3501 0.31 MB/sec execute 499 sec latency 1235.605 ms 2023-12-13T00:24:57.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3505 0.31 MB/sec execute 500 sec latency 1252.741 ms 2023-12-13T00:24:58.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3508 0.31 MB/sec execute 501 sec latency 1422.964 ms 2023-12-13T00:24:59.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3514 0.31 MB/sec execute 502 sec latency 1165.264 ms 2023-12-13T00:25:00.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3521 0.31 MB/sec execute 503 sec latency 1337.004 ms 2023-12-13T00:25:01.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3528 0.31 MB/sec execute 504 sec latency 1405.152 ms 2023-12-13T00:25:02.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3543 0.32 MB/sec execute 505 sec latency 1206.049 ms 2023-12-13T00:25:03.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3556 0.32 MB/sec execute 506 sec latency 1375.193 ms 2023-12-13T00:25:04.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3562 0.32 MB/sec execute 507 sec latency 1588.228 ms 2023-12-13T00:25:05.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3568 0.32 MB/sec execute 508 sec latency 1239.661 ms 2023-12-13T00:25:06.803 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:25:06.806 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:25:06.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3573 0.32 MB/sec execute 509 sec latency 1461.355 ms 2023-12-13T00:25:07.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3580 0.32 MB/sec execute 510 sec latency 1150.001 ms 2023-12-13T00:25:08.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3585 0.32 MB/sec execute 511 sec latency 1252.285 ms 2023-12-13T00:25:09.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3588 0.32 MB/sec execute 512 sec latency 1366.212 ms 2023-12-13T00:25:10.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3595 0.32 MB/sec execute 513 sec latency 1139.908 ms 2023-12-13T00:25:11.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3605 0.32 MB/sec execute 514 sec latency 1276.451 ms 2023-12-13T00:25:12.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3609 0.32 MB/sec execute 515 sec latency 1403.965 ms 2023-12-13T00:25:13.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3613 0.32 MB/sec execute 516 sec latency 1600.219 ms 2023-12-13T00:25:14.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3618 0.32 MB/sec execute 517 sec latency 1203.413 ms 2023-12-13T00:25:15.835 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3622 0.32 MB/sec execute 518 sec latency 1598.426 ms 2023-12-13T00:25:16.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3627 0.32 MB/sec execute 519 sec latency 1268.434 ms 2023-12-13T00:25:17.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3638 0.33 MB/sec execute 520 sec latency 1210.728 ms 2023-12-13T00:25:18.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3642 0.33 MB/sec execute 521 sec latency 1445.465 ms 2023-12-13T00:25:19.423 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:25:43.964 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:25:19.483 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:25:44.023 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:25:19.524 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:25:44.064 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:25:19.538 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:25:44.072 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:25:19.540 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:25:44.074 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:25:19.541 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:25:44.075 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:25:19.543 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:25:44.077 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:25:19.578 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:25:44.112 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:25:19.583 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:25:44.117 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:25:19.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3646 0.33 MB/sec execute 522 sec latency 1399.477 ms 2023-12-13T00:25:20.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3652 0.33 MB/sec execute 523 sec latency 1094.324 ms 2023-12-13T00:25:21.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3656 0.33 MB/sec execute 524 sec latency 1093.344 ms 2023-12-13T00:25:22.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3663 0.32 MB/sec execute 525 sec latency 1280.529 ms 2023-12-13T00:25:23.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3671 0.33 MB/sec execute 526 sec latency 1371.075 ms 2023-12-13T00:25:24.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3678 0.33 MB/sec execute 527 sec latency 1438.517 ms 2023-12-13T00:25:25.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3681 0.33 MB/sec execute 528 sec latency 1430.120 ms 2023-12-13T00:25:26.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3687 0.33 MB/sec execute 529 sec latency 1371.520 ms 2023-12-13T00:25:27.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3691 0.33 MB/sec execute 530 sec latency 811.470 ms 2023-12-13T00:25:28.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3696 0.33 MB/sec execute 531 sec latency 1246.846 ms 2023-12-13T00:25:29.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3699 0.33 MB/sec execute 532 sec latency 1427.950 ms 2023-12-13T00:25:30.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3709 0.33 MB/sec execute 533 sec latency 1101.411 ms 2023-12-13T00:25:31.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3715 0.33 MB/sec execute 534 sec latency 1281.667 ms 2023-12-13T00:25:32.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3722 0.33 MB/sec execute 535 sec latency 1351.197 ms 2023-12-13T00:25:33.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3727 0.33 MB/sec execute 536 sec latency 1595.149 ms 2023-12-13T00:25:34.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3730 0.33 MB/sec execute 537 sec latency 1695.941 ms 2023-12-13T00:25:35.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3733 0.33 MB/sec execute 538 sec latency 1421.046 ms 2023-12-13T00:25:36.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3737 0.33 MB/sec execute 539 sec latency 702.928 ms 2023-12-13T00:25:36.878 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:25:36.880 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:25:37.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3740 0.33 MB/sec execute 540 sec latency 892.760 ms 2023-12-13T00:25:38.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3743 0.33 MB/sec execute 541 sec latency 1510.152 ms 2023-12-13T00:25:39.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3748 0.33 MB/sec execute 542 sec latency 1418.975 ms 2023-12-13T00:25:40.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3752 0.32 MB/sec execute 543 sec latency 918.212 ms 2023-12-13T00:25:41.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3755 0.32 MB/sec execute 544 sec latency 1255.185 ms 2023-12-13T00:25:42.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3759 0.32 MB/sec execute 545 sec latency 826.271 ms 2023-12-13T00:25:43.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3763 0.32 MB/sec execute 546 sec latency 842.411 ms 2023-12-13T00:25:44.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3767 0.32 MB/sec execute 547 sec latency 1302.316 ms 2023-12-13T00:25:45.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3770 0.32 MB/sec execute 548 sec latency 1306.219 ms 2023-12-13T00:25:46.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3775 0.32 MB/sec execute 549 sec latency 1412.779 ms 2023-12-13T00:25:47.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3784 0.32 MB/sec execute 550 sec latency 1118.338 ms 2023-12-13T00:25:48.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3787 0.32 MB/sec execute 551 sec latency 1305.706 ms 2023-12-13T00:25:49.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3791 0.32 MB/sec execute 552 sec latency 1062.999 ms 2023-12-13T00:25:50.836 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3795 0.32 MB/sec execute 553 sec latency 875.687 ms 2023-12-13T00:25:51.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3798 0.32 MB/sec execute 554 sec latency 1451.351 ms 2023-12-13T00:25:52.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3802 0.32 MB/sec execute 555 sec latency 567.071 ms 2023-12-13T00:25:53.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3805 0.32 MB/sec execute 556 sec latency 687.972 ms 2023-12-13T00:25:54.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3808 0.32 MB/sec execute 557 sec latency 790.109 ms 2023-12-13T00:25:55.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3812 0.32 MB/sec execute 558 sec latency 1029.462 ms 2023-12-13T00:25:56.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3817 0.32 MB/sec execute 559 sec latency 793.882 ms 2023-12-13T00:25:57.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3821 0.32 MB/sec execute 560 sec latency 760.347 ms 2023-12-13T00:25:58.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3824 0.32 MB/sec execute 561 sec latency 1457.172 ms 2023-12-13T00:25:59.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3827 0.32 MB/sec execute 562 sec latency 776.399 ms 2023-12-13T00:26:00.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3831 0.32 MB/sec execute 563 sec latency 828.362 ms 2023-12-13T00:26:01.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3834 0.32 MB/sec execute 564 sec latency 735.157 ms 2023-12-13T00:26:02.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3838 0.32 MB/sec execute 565 sec latency 983.596 ms 2023-12-13T00:26:03.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3842 0.32 MB/sec execute 566 sec latency 947.743 ms 2023-12-13T00:26:04.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3847 0.32 MB/sec execute 567 sec latency 1427.177 ms 2023-12-13T00:26:05.791 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:26:30.331 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:26:05.796 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:26:30.337 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:26:05.804 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:26:30.338 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:26:05.806 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:26:30.340 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:26:05.810 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:26:30.344 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:26:05.812 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:26:30.346 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:26:05.836 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:26:30.376 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:26:05.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3849 0.32 MB/sec execute 568 sec latency 1094.851 ms 2023-12-13T00:26:05.844 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:26:30.378 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:26:05.848 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:26:30.383 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:26:06.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3852 0.32 MB/sec execute 569 sec latency 1325.756 ms 2023-12-13T00:26:06.950 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:26:06.953 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:26:07.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3856 0.32 MB/sec execute 570 sec latency 737.604 ms 2023-12-13T00:26:08.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3859 0.32 MB/sec execute 571 sec latency 1516.528 ms 2023-12-13T00:26:09.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3863 0.32 MB/sec execute 572 sec latency 887.628 ms 2023-12-13T00:26:10.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3865 0.32 MB/sec execute 573 sec latency 1210.821 ms 2023-12-13T00:26:11.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3869 0.32 MB/sec execute 574 sec latency 1535.646 ms 2023-12-13T00:26:12.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3872 0.32 MB/sec execute 575 sec latency 1097.432 ms 2023-12-13T00:26:13.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3876 0.32 MB/sec execute 576 sec latency 1278.416 ms 2023-12-13T00:26:14.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3880 0.32 MB/sec execute 577 sec latency 1093.728 ms 2023-12-13T00:26:15.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3882 0.32 MB/sec execute 578 sec latency 1291.093 ms 2023-12-13T00:26:16.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3886 0.32 MB/sec execute 579 sec latency 1311.056 ms 2023-12-13T00:26:17.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3889 0.31 MB/sec execute 580 sec latency 1231.577 ms 2023-12-13T00:26:18.837 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3893 0.31 MB/sec execute 581 sec latency 947.316 ms 2023-12-13T00:26:19.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3896 0.31 MB/sec execute 582 sec latency 1155.364 ms 2023-12-13T00:26:20.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3900 0.31 MB/sec execute 583 sec latency 665.676 ms 2023-12-13T00:26:21.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3903 0.31 MB/sec execute 584 sec latency 1123.692 ms 2023-12-13T00:26:22.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3906 0.31 MB/sec execute 585 sec latency 1274.483 ms 2023-12-13T00:26:23.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3909 0.31 MB/sec execute 586 sec latency 1308.862 ms 2023-12-13T00:26:24.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3912 0.31 MB/sec execute 587 sec latency 1194.088 ms 2023-12-13T00:26:25.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3915 0.31 MB/sec execute 588 sec latency 1443.342 ms 2023-12-13T00:26:26.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3917 0.31 MB/sec execute 589 sec latency 860.440 ms 2023-12-13T00:26:27.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3921 0.31 MB/sec execute 590 sec latency 1346.659 ms 2023-12-13T00:26:28.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3924 0.31 MB/sec execute 591 sec latency 983.753 ms 2023-12-13T00:26:29.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3927 0.31 MB/sec execute 592 sec latency 1331.438 ms 2023-12-13T00:26:30.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3930 0.31 MB/sec execute 593 sec latency 1141.058 ms 2023-12-13T00:26:31.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3933 0.31 MB/sec execute 594 sec latency 1132.470 ms 2023-12-13T00:26:32.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3936 0.31 MB/sec execute 595 sec latency 666.807 ms 2023-12-13T00:26:33.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3939 0.31 MB/sec execute 596 sec latency 1300.110 ms 2023-12-13T00:26:34.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3942 0.31 MB/sec execute 597 sec latency 1194.272 ms 2023-12-13T00:26:35.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3946 0.31 MB/sec execute 598 sec latency 1278.996 ms 2023-12-13T00:26:36.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 3950 0.31 MB/sec execute 599 sec latency 970.774 ms 2023-12-13T00:26:37.421 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:26:37.424 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:26:37.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 600 sec 2023-12-13T00:26:38.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 601 sec 2023-12-13T00:26:39.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 602 sec 2023-12-13T00:26:40.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 603 sec 2023-12-13T00:26:41.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 604 sec 2023-12-13T00:26:42.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 605 sec 2023-12-13T00:26:43.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 606 sec 2023-12-13T00:26:44.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 607 sec 2023-12-13T00:26:45.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 608 sec 2023-12-13T00:26:46.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 609 sec 2023-12-13T00:26:47.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 610 sec 2023-12-13T00:26:48.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 611 sec 2023-12-13T00:26:49.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 612 sec 2023-12-13T00:26:50.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 613 sec 2023-12-13T00:26:51.838 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 614 sec 2023-12-13T00:26:52.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 615 sec 2023-12-13T00:26:53.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 616 sec 2023-12-13T00:26:54.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 617 sec 2023-12-13T00:26:55.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 618 sec 2023-12-13T00:26:56.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 619 sec 2023-12-13T00:26:57.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 620 sec 2023-12-13T00:26:58.842 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 621 sec 2023-12-13T00:26:59.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 622 sec 2023-12-13T00:27:00.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 623 sec 2023-12-13T00:27:01.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 624 sec 2023-12-13T00:27:02.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 625 sec 2023-12-13T00:27:03.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 626 sec 2023-12-13T00:27:04.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 627 sec 2023-12-13T00:27:05.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 628 sec 2023-12-13T00:27:06.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 629 sec 2023-12-13T00:27:07.485 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:27:07.487 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:27:07.839 INFO:tasks.workunit.client.0.smithi072.stdout: 10 cleanup 630 sec 2023-12-13T00:27:08.839 INFO:tasks.workunit.client.0.smithi072.stdout: 9 cleanup 631 sec 2023-12-13T00:27:09.839 INFO:tasks.workunit.client.0.smithi072.stdout: 9 cleanup 632 sec 2023-12-13T00:27:10.839 INFO:tasks.workunit.client.0.smithi072.stdout: 9 cleanup 633 sec 2023-12-13T00:27:11.839 INFO:tasks.workunit.client.0.smithi072.stdout: 9 cleanup 634 sec 2023-12-13T00:27:12.839 INFO:tasks.workunit.client.0.smithi072.stdout: 9 cleanup 635 sec 2023-12-13T00:27:13.839 INFO:tasks.workunit.client.0.smithi072.stdout: 9 cleanup 636 sec 2023-12-13T00:27:14.839 INFO:tasks.workunit.client.0.smithi072.stdout: 8 cleanup 637 sec 2023-12-13T00:27:15.839 INFO:tasks.workunit.client.0.smithi072.stdout: 8 cleanup 638 sec 2023-12-13T00:27:16.839 INFO:tasks.workunit.client.0.smithi072.stdout: 7 cleanup 639 sec 2023-12-13T00:27:17.839 INFO:tasks.workunit.client.0.smithi072.stdout: 7 cleanup 640 sec 2023-12-13T00:27:18.840 INFO:tasks.workunit.client.0.smithi072.stdout: 7 cleanup 641 sec 2023-12-13T00:27:19.840 INFO:tasks.workunit.client.0.smithi072.stdout: 5 cleanup 642 sec 2023-12-13T00:27:20.840 INFO:tasks.workunit.client.0.smithi072.stdout: 5 cleanup 643 sec 2023-12-13T00:27:21.840 INFO:tasks.workunit.client.0.smithi072.stdout: 4 cleanup 644 sec 2023-12-13T00:27:22.840 INFO:tasks.workunit.client.0.smithi072.stdout: 4 cleanup 645 sec 2023-12-13T00:27:23.840 INFO:tasks.workunit.client.0.smithi072.stdout: 4 cleanup 646 sec 2023-12-13T00:27:24.840 INFO:tasks.workunit.client.0.smithi072.stdout: 3 cleanup 647 sec 2023-12-13T00:27:25.840 INFO:tasks.workunit.client.0.smithi072.stdout: 2 cleanup 648 sec 2023-12-13T00:27:26.840 INFO:tasks.workunit.client.0.smithi072.stdout: 2 cleanup 649 sec 2023-12-13T00:27:27.840 INFO:tasks.workunit.client.0.smithi072.stdout: 1 cleanup 650 sec 2023-12-13T00:27:28.840 INFO:tasks.workunit.client.0.smithi072.stdout: 1 cleanup 651 sec 2023-12-13T00:27:29.794 INFO:tasks.workunit.client.0.smithi072.stdout: 0 cleanup 652 sec 2023-12-13T00:27:29.794 INFO:tasks.workunit.client.0.smithi072.stdout: 2023-12-13T00:27:29.794 INFO:tasks.workunit.client.0.smithi072.stdout: Operation Count AvgLat MaxLat 2023-12-13T00:27:29.794 INFO:tasks.workunit.client.0.smithi072.stdout: ---------------------------------------- 2023-12-13T00:27:29.794 INFO:tasks.workunit.client.0.smithi072.stdout: NTCreateX 5058 390.656 1461.063 2023-12-13T00:27:29.794 INFO:tasks.workunit.client.0.smithi072.stdout: Close 3865 6.454 85.203 2023-12-13T00:27:29.794 INFO:tasks.workunit.client.0.smithi072.stdout: Rename 236 796.898 1587.924 2023-12-13T00:27:29.794 INFO:tasks.workunit.client.0.smithi072.stdout: Unlink 779 333.016 681.549 2023-12-13T00:27:29.794 INFO:tasks.workunit.client.0.smithi072.stdout: Qpathinfo 4936 215.714 1123.805 2023-12-13T00:27:29.794 INFO:tasks.workunit.client.0.smithi072.stdout: Qfileinfo 897 19.162 82.817 2023-12-13T00:27:29.795 INFO:tasks.workunit.client.0.smithi072.stdout: Qfsinfo 832 42.530 116.384 2023-12-13T00:27:29.795 INFO:tasks.workunit.client.0.smithi072.stdout: Sfileinfo 371 135.905 477.431 2023-12-13T00:27:29.795 INFO:tasks.workunit.client.0.smithi072.stdout: Find 1795 1276.393 2117.365 2023-12-13T00:27:29.795 INFO:tasks.workunit.client.0.smithi072.stdout: WriteX 2647 27.136 150.337 2023-12-13T00:27:29.795 INFO:tasks.workunit.client.0.smithi072.stdout: ReadX 8873 0.136 37.422 2023-12-13T00:27:29.795 INFO:tasks.workunit.client.0.smithi072.stdout: LockX 20 43.015 78.940 2023-12-13T00:27:29.795 INFO:tasks.workunit.client.0.smithi072.stdout: UnlockX 20 49.597 103.238 2023-12-13T00:27:29.795 INFO:tasks.workunit.client.0.smithi072.stdout: Flush 230 100.002 250.379 2023-12-13T00:27:29.795 INFO:tasks.workunit.client.0.smithi072.stdout: 2023-12-13T00:27:29.795 INFO:tasks.workunit.client.0.smithi072.stdout:Throughput 0.305812 MB/sec 10 clients 10 procs max_latency=2117.375 ms 2023-12-13T00:27:29.796 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-13T00:27:29.796 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-13T00:27:37.599 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:27:37.602 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:27:56.501 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2023-12-13T00:27:56.502 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-13T00:27:56.762 DEBUG:teuthology.parallel:result is None 2023-12-13T00:27:56.763 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-13T00:27:57.059 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-13T00:27:57.059 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-13T00:27:57.070 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-13T00:27:57.070 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-13T00:27:57.071 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-13T00:27:57.087 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-13T00:27:57.089 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-13T00:27:57.144 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:27:57.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.285+0000 7f005c58a640 1 Processor -- start 2023-12-13T00:27:57.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.285+0000 7f005c58a640 1 -- start start 2023-12-13T00:27:57.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.286+0000 7f005c58a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00540c4aa0 0x7f005414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:57.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.286+0000 7f005c58a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0054150290 0x7f00540c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:57.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.286+0000 7f005c58a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00540c76f0 con 0x7f00540c46c0 2023-12-13T00:27:57.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.286+0000 7f005c58a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00540c2bc0 con 0x7f0054150290 2023-12-13T00:27:57.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.286+0000 7f005c58a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00540c6dc0 con 0x7f00540c4aa0 2023-12-13T00:27:57.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.287+0000 7f005ab27640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0054150290 0x7f00540c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:57.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.287+0000 7f0059b25640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00540c4aa0 0x7f005414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:57.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.287+0000 7f0059b25640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00540c4aa0 0x7f005414fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:33904/0 (socket says 172.21.15.72:33904) 2023-12-13T00:27:57.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.287+0000 7f0059b25640 1 -- 172.21.15.72:0/730830001 learned_addr learned my addr 172.21.15.72:0/730830001 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:27:57.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.289+0000 7f0059b25640 1 -- 172.21.15.72:0/730830001 >> v2:172.21.15.72:3300/0 conn(0x7f0054150290 msgr2=0x7f00540c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:27:57.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.289+0000 7f0059b25640 1 --2- 172.21.15.72:0/730830001 >> v2:172.21.15.72:3300/0 conn(0x7f0054150290 0x7f00540c1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:57.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.289+0000 7f0059b25640 1 -- 172.21.15.72:0/730830001 >> v1:172.21.15.72:6789/0 conn(0x7f00540c46c0 legacy=0x7f00540c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:57.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.289+0000 7f0059b25640 1 -- 172.21.15.72:0/730830001 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00540c70a0 con 0x7f00540c4aa0 2023-12-13T00:27:57.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.291+0000 7f0059b25640 1 --2- 172.21.15.72:0/730830001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00540c4aa0 0x7f005414fd50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0044009870 tx=0x7f004402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2671b4c5cc5ffc52 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:27:57.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.295+0000 7f0059324640 1 -- 172.21.15.72:0/730830001 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044030840 con 0x7f00540c4aa0 2023-12-13T00:27:57.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.295+0000 7f0059324640 1 -- 172.21.15.72:0/730830001 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00440309a0 con 0x7f00540c4aa0 2023-12-13T00:27:57.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.295+0000 7f0059324640 1 -- 172.21.15.72:0/730830001 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044030d30 con 0x7f00540c4aa0 2023-12-13T00:27:57.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.295+0000 7f005c58a640 1 -- 172.21.15.72:0/730830001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00540c4aa0 msgr2=0x7f005414fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:57.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.295+0000 7f005c58a640 1 --2- 172.21.15.72:0/730830001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00540c4aa0 0x7f005414fd50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0044009870 tx=0x7f004402b980 comp rx=0 tx=0).stop 2023-12-13T00:27:57.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.296+0000 7f005c58a640 1 -- 172.21.15.72:0/730830001 shutdown_connections 2023-12-13T00:27:57.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.296+0000 7f005c58a640 1 --2- 172.21.15.72:0/730830001 >> v2:172.21.15.72:3300/0 conn(0x7f0054150290 0x7f00540c1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:57.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.296+0000 7f005c58a640 1 --2- 172.21.15.72:0/730830001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00540c4aa0 0x7f005414fd50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:57.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.296+0000 7f005c58a640 1 -- 172.21.15.72:0/730830001 >> 172.21.15.72:0/730830001 conn(0x7f005406c5f0 msgr2=0x7f005406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:27:57.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.296+0000 7f005c58a640 1 -- 172.21.15.72:0/730830001 shutdown_connections 2023-12-13T00:27:57.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.296+0000 7f005c58a640 1 -- 172.21.15.72:0/730830001 wait complete. 2023-12-13T00:27:57.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.297+0000 7f005c58a640 1 Processor -- start 2023-12-13T00:27:57.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.297+0000 7f005c58a640 1 -- start start 2023-12-13T00:27:57.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.297+0000 7f005c58a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00540c46c0 0x7f005406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:57.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.297+0000 7f005c58a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00540c4aa0 0x7f00541509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:57.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.297+0000 7f005c58a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0054150290 0x7f00541515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:57.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.297+0000 7f005c58a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00541eef00 con 0x7f00540c4aa0 2023-12-13T00:27:57.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.297+0000 7f005c58a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0054146dd0 con 0x7f0054150290 2023-12-13T00:27:57.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.297+0000 7f005c58a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00541ef1a0 con 0x7f00540c46c0 2023-12-13T00:27:57.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.298+0000 7f0059b25640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00540c4aa0 0x7f00541509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:57.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.298+0000 7f005a326640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00540c46c0 0x7f005406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:57.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.298+0000 7f005ab27640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0054150290 0x7f00541515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:57.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.298+0000 7f0059b25640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00540c4aa0 0x7f00541509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45900/0 (socket says 172.21.15.72:45900) 2023-12-13T00:27:57.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.298+0000 7f0059b25640 1 -- 172.21.15.72:0/1807686290 learned_addr learned my addr 172.21.15.72:0/1807686290 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:27:57.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.301+0000 7f0059b25640 1 -- 172.21.15.72:0/1807686290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00540c46c0 msgr2=0x7f005406e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:57.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.301+0000 7f0059b25640 1 --2- 172.21.15.72:0/1807686290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00540c46c0 0x7f005406e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:57.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.301+0000 7f0059b25640 1 -- 172.21.15.72:0/1807686290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0054150290 msgr2=0x7f00541515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:57.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.301+0000 7f0059b25640 1 --2- 172.21.15.72:0/1807686290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0054150290 0x7f00541515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:57.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.302+0000 7f0059b25640 1 -- 172.21.15.72:0/1807686290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00440094d0 con 0x7f00540c4aa0 2023-12-13T00:27:57.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.304+0000 7f0059b25640 1 --2- 172.21.15.72:0/1807686290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00540c4aa0 0x7f00541509a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0044000c00 tx=0x7f0044004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:27:57.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.308+0000 7f004affd640 1 -- 172.21.15.72:0/1807686290 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044039c90 con 0x7f00540c4aa0 2023-12-13T00:27:57.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.308+0000 7f004affd640 1 -- 172.21.15.72:0/1807686290 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0044039df0 con 0x7f00540c4aa0 2023-12-13T00:27:57.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.308+0000 7f005c58a640 1 -- 172.21.15.72:0/1807686290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00541ef480 con 0x7f00540c4aa0 2023-12-13T00:27:57.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.308+0000 7f004affd640 1 -- 172.21.15.72:0/1807686290 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044043640 con 0x7f00540c4aa0 2023-12-13T00:27:57.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.308+0000 7f005c58a640 1 -- 172.21.15.72:0/1807686290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00541470b0 con 0x7f00540c4aa0 2023-12-13T00:27:57.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.309+0000 7f005c58a640 1 -- 172.21.15.72:0/1807686290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00541ef9a0 con 0x7f00540c4aa0 2023-12-13T00:27:57.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.328+0000 7f004affd640 1 -- 172.21.15.72:0/1807686290 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f00440437a0 con 0x7f00540c4aa0 2023-12-13T00:27:57.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.328+0000 7f004affd640 1 --2- 172.21.15.72:0/1807686290 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f003806b1c0 0x7f003806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:57.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.328+0000 7f005a326640 1 --2- 172.21.15.72:0/1807686290 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f003806b1c0 0x7f003806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:57.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.329+0000 7f005a326640 1 --2- 172.21.15.72:0/1807686290 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f003806b1c0 0x7f003806d680 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f00500012e0 tx=0x7f0050009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:27:57.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.567+0000 7f004affd640 1 -- 172.21.15.72:0/1807686290 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f004403e070 con 0x7f00540c4aa0 2023-12-13T00:27:57.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.567+0000 7f004affd640 1 -- 172.21.15.72:0/1807686290 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0044078050 con 0x7f00540c4aa0 2023-12-13T00:27:57.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.736+0000 7f005c58a640 1 -- 172.21.15.72:0/1807686290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00541ef9a0 con 0x7f00540c4aa0 2023-12-13T00:27:57.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.775+0000 7f004affd640 1 -- 172.21.15.72:0/1807686290 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18563 (secure 0 0 0) 0x7f00541ef9a0 con 0x7f00540c4aa0 2023-12-13T00:27:57.776 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:27:57.777 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:01:00.435991+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T00:00:27.701252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T00:00:29.324356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T00:00:33.363089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.3","mappings":[{"from":7,"to":5}]},{"pgid":"4.10","mappings":[{"from":7,"to":0}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:27:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.778+0000 7f005c58a640 1 -- 172.21.15.72:0/1807686290 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f003806b1c0 msgr2=0x7f003806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.778+0000 7f005c58a640 1 --2- 172.21.15.72:0/1807686290 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f003806b1c0 0x7f003806d680 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f00500012e0 tx=0x7f0050009040 comp rx=0 tx=0).stop 2023-12-13T00:27:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.778+0000 7f005c58a640 1 -- 172.21.15.72:0/1807686290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00540c4aa0 msgr2=0x7f00541509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.778+0000 7f005c58a640 1 --2- 172.21.15.72:0/1807686290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00540c4aa0 0x7f00541509a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0044000c00 tx=0x7f0044004730 comp rx=0 tx=0).stop 2023-12-13T00:27:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.778+0000 7f005c58a640 1 -- 172.21.15.72:0/1807686290 shutdown_connections 2023-12-13T00:27:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.778+0000 7f005c58a640 1 --2- 172.21.15.72:0/1807686290 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f003806b1c0 0x7f003806d680 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.778+0000 7f005c58a640 1 --2- 172.21.15.72:0/1807686290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0054150290 0x7f00541515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.778+0000 7f005c58a640 1 --2- 172.21.15.72:0/1807686290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00540c4aa0 0x7f00541509a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.778+0000 7f005c58a640 1 --2- 172.21.15.72:0/1807686290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00540c46c0 0x7f005406e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.778+0000 7f005c58a640 1 -- 172.21.15.72:0/1807686290 >> 172.21.15.72:0/1807686290 conn(0x7f005406c5f0 msgr2=0x7f0054070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:27:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.778+0000 7f005c58a640 1 -- 172.21.15.72:0/1807686290 shutdown_connections 2023-12-13T00:27:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.778+0000 7f005c58a640 1 -- 172.21.15.72:0/1807686290 wait complete. 2023-12-13T00:27:57.790 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-13T00:00:06.839153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-13T00:00:27.701252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-13T00:00:29.324356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-13T00:00:33.363089+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-13T00:27:57.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-13T00:27:57.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.892+0000 7fec0c984640 1 Processor -- start 2023-12-13T00:27:57.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.892+0000 7fec0c984640 1 -- start start 2023-12-13T00:27:57.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.892+0000 7fec0c984640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec080ccb60 0x7fec080ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:57.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.892+0000 7fec0c984640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec08157330 0x7fec08157760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:57.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.892+0000 7fec0c984640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec08158340 con 0x7fec081514a0 2023-12-13T00:27:57.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.893+0000 7fec0c984640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec080cd4a0 con 0x7fec08157330 2023-12-13T00:27:57.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.893+0000 7fec0c984640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec081580a0 con 0x7fec080ccb60 2023-12-13T00:27:57.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.893+0000 7fec06d9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec08157330 0x7fec08157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:57.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.893+0000 7fec0659c640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fec081514a0 0x7fec080c3110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:36838/0 (socket says 172.21.15.72:36838) 2023-12-13T00:27:57.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.893+0000 7fec0659c640 1 -- 172.21.15.72:0/4135577402 learned_addr learned my addr 172.21.15.72:0/4135577402 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:27:57.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.893+0000 7fec05d9b640 1 --2- 172.21.15.72:0/4135577402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec080ccb60 0x7fec080ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:57.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.896+0000 7fec0559a640 1 -- 172.21.15.72:0/4135577402 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920142892 0 0) 0x7fec08158340 con 0x7fec081514a0 2023-12-13T00:27:57.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.896+0000 7fec0559a640 1 -- 172.21.15.72:0/4135577402 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febf0003520 con 0x7fec081514a0 2023-12-13T00:27:57.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.896+0000 7fec05d9b640 1 -- 172.21.15.72:0/4135577402 >> v2:172.21.15.72:3300/0 conn(0x7fec08157330 msgr2=0x7fec08157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:27:57.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.896+0000 7fec05d9b640 1 --2- 172.21.15.72:0/4135577402 >> v2:172.21.15.72:3300/0 conn(0x7fec08157330 0x7fec08157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:57.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.896+0000 7fec05d9b640 1 -- 172.21.15.72:0/4135577402 >> v1:172.21.15.176:6789/0 conn(0x7fec081514a0 legacy=0x7fec080c3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:57.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.896+0000 7fec05d9b640 1 -- 172.21.15.72:0/4135577402 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec080c2370 con 0x7fec080ccb60 2023-12-13T00:27:57.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.898+0000 7fec05d9b640 1 --2- 172.21.15.72:0/4135577402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec080ccb60 0x7fec080ccf60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7febfc0097a0 tx=0x7febfc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cc199e9e1b99aca server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:27:57.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.902+0000 7fec0559a640 1 -- 172.21.15.72:0/4135577402 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc031830 con 0x7fec080ccb60 2023-12-13T00:27:57.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.902+0000 7fec0559a640 1 -- 172.21.15.72:0/4135577402 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc031990 con 0x7fec080ccb60 2023-12-13T00:27:57.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.902+0000 7fec0559a640 1 -- 172.21.15.72:0/4135577402 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc031d20 con 0x7fec080ccb60 2023-12-13T00:27:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.903+0000 7fec0c984640 1 -- 172.21.15.72:0/4135577402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec080ccb60 msgr2=0x7fec080ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.903+0000 7fec0c984640 1 --2- 172.21.15.72:0/4135577402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec080ccb60 0x7fec080ccf60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7febfc0097a0 tx=0x7febfc02b8d0 comp rx=0 tx=0).stop 2023-12-13T00:27:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.903+0000 7fec0c984640 1 -- 172.21.15.72:0/4135577402 shutdown_connections 2023-12-13T00:27:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.903+0000 7fec0c984640 1 --2- 172.21.15.72:0/4135577402 >> v2:172.21.15.72:3300/0 conn(0x7fec08157330 0x7fec08157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.903+0000 7fec0c984640 1 --2- 172.21.15.72:0/4135577402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec080ccb60 0x7fec080ccf60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.903+0000 7fec0c984640 1 -- 172.21.15.72:0/4135577402 >> 172.21.15.72:0/4135577402 conn(0x7fec08070790 msgr2=0x7fec08070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:27:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.903+0000 7fec0c984640 1 -- 172.21.15.72:0/4135577402 shutdown_connections 2023-12-13T00:27:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.903+0000 7fec0c984640 1 -- 172.21.15.72:0/4135577402 wait complete. 2023-12-13T00:27:57.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.904+0000 7fec0c984640 1 Processor -- start 2023-12-13T00:27:57.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.904+0000 7fec0c984640 1 -- start start 2023-12-13T00:27:57.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.905+0000 7fec0c984640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec080ccb60 0x7fec0814db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:57.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.905+0000 7fec0c984640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec081514a0 0x7fec0814e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:57.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.905+0000 7fec0c984640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec08157330 0x7fec0814b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:57.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.905+0000 7fec0c984640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0814d6f0 con 0x7fec08157330 2023-12-13T00:27:57.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.905+0000 7fec0c984640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0814ec90 con 0x7fec081514a0 2023-12-13T00:27:57.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.905+0000 7fec0c984640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0814d0c0 con 0x7fec080ccb60 2023-12-13T00:27:57.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.906+0000 7fec06d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec08157330 0x7fec0814b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:57.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.906+0000 7fec05d9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec081514a0 0x7fec0814e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:57.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.906+0000 7fec0659c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec080ccb60 0x7fec0814db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:57.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.906+0000 7fec05d9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec081514a0 0x7fec0814e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:57230/0 (socket says 172.21.15.72:57230) 2023-12-13T00:27:57.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.906+0000 7fec05d9b640 1 -- 172.21.15.72:0/2081844261 learned_addr learned my addr 172.21.15.72:0/2081844261 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:27:57.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.909+0000 7fec05d9b640 1 -- 172.21.15.72:0/2081844261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec080ccb60 msgr2=0x7fec0814db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:57.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.909+0000 7fec05d9b640 1 --2- 172.21.15.72:0/2081844261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec080ccb60 0x7fec0814db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:57.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.909+0000 7fec05d9b640 1 -- 172.21.15.72:0/2081844261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec08157330 msgr2=0x7fec0814b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:57.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.909+0000 7fec05d9b640 1 --2- 172.21.15.72:0/2081844261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec08157330 0x7fec0814b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:57.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.909+0000 7fec05d9b640 1 -- 172.21.15.72:0/2081844261 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc009400 con 0x7fec081514a0 2023-12-13T00:27:57.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.909+0000 7fec06d9d640 1 --2- 172.21.15.72:0/2081844261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec08157330 0x7fec0814b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T00:27:57.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.912+0000 7fec05d9b640 1 --2- 172.21.15.72:0/2081844261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec081514a0 0x7fec0814e050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7febfc034040 tx=0x7febfc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:27:57.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.915+0000 7febf6ffd640 1 -- 172.21.15.72:0/2081844261 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc03a8f0 con 0x7fec081514a0 2023-12-13T00:27:57.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.916+0000 7febf6ffd640 1 -- 172.21.15.72:0/2081844261 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc03aa70 con 0x7fec081514a0 2023-12-13T00:27:57.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.916+0000 7fec0c984640 1 -- 172.21.15.72:0/2081844261 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0814ce10 con 0x7fec081514a0 2023-12-13T00:27:57.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.916+0000 7febf6ffd640 1 -- 172.21.15.72:0/2081844261 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc03ae20 con 0x7fec081514a0 2023-12-13T00:27:57.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.916+0000 7fec0c984640 1 -- 172.21.15.72:0/2081844261 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec081f00a0 con 0x7fec081514a0 2023-12-13T00:27:57.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:57.917+0000 7fec0c984640 1 -- 172.21.15.72:0/2081844261 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0814d830 con 0x7fec081514a0 2023-12-13T00:27:58.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.162+0000 7febf6ffd640 1 -- 172.21.15.72:0/2081844261 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7febfc04d440 con 0x7fec081514a0 2023-12-13T00:27:58.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.163+0000 7febf6ffd640 1 --2- 172.21.15.72:0/2081844261 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7febe806b210 0x7febe806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:58.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.163+0000 7fec0659c640 1 --2- 172.21.15.72:0/2081844261 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7febe806b210 0x7febe806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:58.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.163+0000 7fec0659c640 1 --2- 172.21.15.72:0/2081844261 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7febe806b210 0x7febe806d6d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7febf8005880 tx=0x7febf8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:27:58.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.167+0000 7febf6ffd640 1 -- 172.21.15.72:0/2081844261 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7febfc07a8f0 con 0x7fec081514a0 2023-12-13T00:27:58.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.177+0000 7febf6ffd640 1 -- 172.21.15.72:0/2081844261 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7febfc076c30 con 0x7fec081514a0 2023-12-13T00:27:58.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.359+0000 7fec0c984640 1 -- 172.21.15.72:0/2081844261 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec0814d830 con 0x7fec081514a0 2023-12-13T00:27:58.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.365+0000 7febf6ffd640 1 -- 172.21.15.72:0/2081844261 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec0814d830 con 0x7fec081514a0 2023-12-13T00:27:58.365 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-12-13T00:27:58.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.367+0000 7fec0c984640 1 -- 172.21.15.72:0/2081844261 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7febe806b210 msgr2=0x7febe806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:58.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.367+0000 7fec0c984640 1 --2- 172.21.15.72:0/2081844261 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7febe806b210 0x7febe806d6d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7febf8005880 tx=0x7febf8009040 comp rx=0 tx=0).stop 2023-12-13T00:27:58.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.367+0000 7fec0c984640 1 -- 172.21.15.72:0/2081844261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec081514a0 msgr2=0x7fec0814e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:58.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.367+0000 7fec0c984640 1 --2- 172.21.15.72:0/2081844261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec081514a0 0x7fec0814e050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7febfc034040 tx=0x7febfc0046c0 comp rx=0 tx=0).stop 2023-12-13T00:27:58.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.367+0000 7fec0c984640 1 -- 172.21.15.72:0/2081844261 shutdown_connections 2023-12-13T00:27:58.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.367+0000 7fec0c984640 1 --2- 172.21.15.72:0/2081844261 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7febe806b210 0x7febe806d6d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:58.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.367+0000 7fec0c984640 1 --2- 172.21.15.72:0/2081844261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec08157330 0x7fec0814b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:58.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.367+0000 7fec0c984640 1 --2- 172.21.15.72:0/2081844261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec081514a0 0x7fec0814e050 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:58.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.367+0000 7fec0c984640 1 --2- 172.21.15.72:0/2081844261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec080ccb60 0x7fec0814db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:58.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.367+0000 7fec0c984640 1 -- 172.21.15.72:0/2081844261 >> 172.21.15.72:0/2081844261 conn(0x7fec08070790 msgr2=0x7fec081552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:27:58.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.367+0000 7fec0c984640 1 -- 172.21.15.72:0/2081844261 shutdown_connections 2023-12-13T00:27:58.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.367+0000 7fec0c984640 1 -- 172.21.15.72:0/2081844261 wait complete. 2023-12-13T00:27:58.379 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-13T00:27:58.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.481+0000 7ff4b3753640 1 Processor -- start 2023-12-13T00:27:58.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.481+0000 7ff4b3753640 1 -- start start 2023-12-13T00:27:58.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.482+0000 7ff4b3753640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4ac0cda70 0x7ff4ac0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:58.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.482+0000 7ff4b3753640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff4ac0cc420 0x7ff4ac159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:58.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.482+0000 7ff4b3753640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4ac159b50 0x7ff4ac0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:58.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.482+0000 7ff4b3753640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac0cc230 con 0x7ff4ac159b50 2023-12-13T00:27:58.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.482+0000 7ff4b3753640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac0cbda0 con 0x7ff4ac0cc420 2023-12-13T00:27:58.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.482+0000 7ff4b3753640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac0cb4e0 con 0x7ff4ac0cda70 2023-12-13T00:27:58.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.483+0000 7ff4b1cf0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4ac159b50 0x7ff4ac0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:58.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.483+0000 7ff4b0cee640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff4ac0cc420 0x7ff4ac159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:58.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.483+0000 7ff4b14ef640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4ac0cda70 0x7ff4ac0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:58.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.483+0000 7ff4b1cf0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4ac159b50 0x7ff4ac0c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45920/0 (socket says 172.21.15.72:45920) 2023-12-13T00:27:58.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.483+0000 7ff4b1cf0640 1 -- 172.21.15.72:0/822800310 learned_addr learned my addr 172.21.15.72:0/822800310 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:27:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.485+0000 7ff4b1cf0640 1 -- 172.21.15.72:0/822800310 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4ac0cda70 msgr2=0x7ff4ac0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:27:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.485+0000 7ff4b1cf0640 1 --2- 172.21.15.72:0/822800310 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4ac0cda70 0x7ff4ac0ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.485+0000 7ff4b1cf0640 1 -- 172.21.15.72:0/822800310 >> v2:172.21.15.176:3300/0 conn(0x7ff4ac0cc420 msgr2=0x7ff4ac159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:27:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.485+0000 7ff4b1cf0640 1 --2- 172.21.15.72:0/822800310 >> v2:172.21.15.176:3300/0 conn(0x7ff4ac0cc420 0x7ff4ac159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.485+0000 7ff4b1cf0640 1 -- 172.21.15.72:0/822800310 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac0cce00 con 0x7ff4ac159b50 2023-12-13T00:27:58.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.485+0000 7ff4b0cee640 1 --2- 172.21.15.72:0/822800310 >> v2:172.21.15.176:3300/0 conn(0x7ff4ac0cc420 0x7ff4ac159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T00:27:58.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.488+0000 7ff4b1cf0640 1 --2- 172.21.15.72:0/822800310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac159b50 0x7ff4ac0c9620 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac072b20 tx=0x7ff4a402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f885026de778fc server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:27:58.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.491+0000 7ff4a3fff640 1 -- 172.21.15.72:0/822800310 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4030860 con 0x7ff4ac159b50 2023-12-13T00:27:58.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.491+0000 7ff4a3fff640 1 -- 172.21.15.72:0/822800310 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a40309c0 con 0x7ff4ac159b50 2023-12-13T00:27:58.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.491+0000 7ff4a3fff640 1 -- 172.21.15.72:0/822800310 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4030d50 con 0x7ff4ac159b50 2023-12-13T00:27:58.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.492+0000 7ff4b3753640 1 -- 172.21.15.72:0/822800310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac159b50 msgr2=0x7ff4ac0c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:58.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.492+0000 7ff4b3753640 1 --2- 172.21.15.72:0/822800310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac159b50 0x7ff4ac0c9620 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac072b20 tx=0x7ff4a402b9a0 comp rx=0 tx=0).stop 2023-12-13T00:27:58.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.492+0000 7ff4b3753640 1 -- 172.21.15.72:0/822800310 shutdown_connections 2023-12-13T00:27:58.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.492+0000 7ff4b3753640 1 --2- 172.21.15.72:0/822800310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac159b50 0x7ff4ac0c9620 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:58.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.492+0000 7ff4b3753640 1 --2- 172.21.15.72:0/822800310 >> v2:172.21.15.176:3300/0 conn(0x7ff4ac0cc420 0x7ff4ac159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:58.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.492+0000 7ff4b3753640 1 --2- 172.21.15.72:0/822800310 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4ac0cda70 0x7ff4ac0ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:58.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.492+0000 7ff4b3753640 1 -- 172.21.15.72:0/822800310 >> 172.21.15.72:0/822800310 conn(0x7ff4ac0b07b0 msgr2=0x7ff4ac0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:27:58.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.492+0000 7ff4b3753640 1 -- 172.21.15.72:0/822800310 shutdown_connections 2023-12-13T00:27:58.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.492+0000 7ff4b3753640 1 -- 172.21.15.72:0/822800310 wait complete. 2023-12-13T00:27:58.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.494+0000 7ff4b3753640 1 Processor -- start 2023-12-13T00:27:58.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.494+0000 7ff4b3753640 1 -- start start 2023-12-13T00:27:58.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.494+0000 7ff4b3753640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac0cc420 0x7ff4ac1ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:58.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.494+0000 7ff4b3753640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4ac0cda70 0x7ff4ac0b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:58.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.494+0000 7ff4b3753640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4ac159b50 0x7ff4ac0b4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:58.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.494+0000 7ff4b3753640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac0ab800 con 0x7ff4ac0cc420 2023-12-13T00:27:58.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.494+0000 7ff4b3753640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac1ef190 con 0x7ff4ac0cda70 2023-12-13T00:27:58.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.494+0000 7ff4b3753640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac0c4a10 con 0x7ff4ac159b50 2023-12-13T00:27:58.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.495+0000 7ff4b14ef640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac0cc420 0x7ff4ac1ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:58.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.495+0000 7ff4b0cee640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4ac0cda70 0x7ff4ac0b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:58.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.495+0000 7ff4b1cf0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4ac159b50 0x7ff4ac0b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:58.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.495+0000 7ff4b14ef640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac0cc420 0x7ff4ac1ef8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45928/0 (socket says 172.21.15.72:45928) 2023-12-13T00:27:58.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.495+0000 7ff4b14ef640 1 -- 172.21.15.72:0/3878551511 learned_addr learned my addr 172.21.15.72:0/3878551511 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:27:58.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.498+0000 7ff4b14ef640 1 -- 172.21.15.72:0/3878551511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4ac159b50 msgr2=0x7ff4ac0b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:58.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.498+0000 7ff4b14ef640 1 --2- 172.21.15.72:0/3878551511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4ac159b50 0x7ff4ac0b4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:58.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.498+0000 7ff4b14ef640 1 -- 172.21.15.72:0/3878551511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4ac0cda70 msgr2=0x7ff4ac0b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:58.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.498+0000 7ff4b14ef640 1 --2- 172.21.15.72:0/3878551511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4ac0cda70 0x7ff4ac0b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:58.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.498+0000 7ff4b14ef640 1 -- 172.21.15.72:0/3878551511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c009400 con 0x7ff4ac0cc420 2023-12-13T00:27:58.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.501+0000 7ff4b14ef640 1 --2- 172.21.15.72:0/3878551511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac0cc420 0x7ff4ac1ef8a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009db0 tx=0x7ff4a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:27:58.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.504+0000 7ff4a1ffb640 1 -- 172.21.15.72:0/3878551511 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8014480 con 0x7ff4ac0cc420 2023-12-13T00:27:58.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.504+0000 7ff4a1ffb640 1 -- 172.21.15.72:0/3878551511 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a800f040 con 0x7ff4ac0cc420 2023-12-13T00:27:58.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.504+0000 7ff4a1ffb640 1 -- 172.21.15.72:0/3878551511 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8014800 con 0x7ff4ac0cc420 2023-12-13T00:27:58.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.504+0000 7ff4b3753640 1 -- 172.21.15.72:0/3878551511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a40094d0 con 0x7ff4ac0cc420 2023-12-13T00:27:58.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.505+0000 7ff4b3753640 1 -- 172.21.15.72:0/3878551511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ac1ef410 con 0x7ff4ac0cc420 2023-12-13T00:27:58.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.506+0000 7ff4b3753640 1 -- 172.21.15.72:0/3878551511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ac0ccaa0 con 0x7ff4ac0cc420 2023-12-13T00:27:58.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.746+0000 7ff4a1ffb640 1 -- 172.21.15.72:0/3878551511 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff4a8014960 con 0x7ff4ac0cc420 2023-12-13T00:27:58.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.747+0000 7ff4a1ffb640 1 --2- 172.21.15.72:0/3878551511 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff49006b240 0x7ff49006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:58.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.747+0000 7ff4b0cee640 1 --2- 172.21.15.72:0/3878551511 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff49006b240 0x7ff49006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:58.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.747+0000 7ff4b0cee640 1 --2- 172.21.15.72:0/3878551511 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff49006b240 0x7ff49006d700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac1ecdc0 tx=0x7ff49c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:27:58.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.760+0000 7ff4a1ffb640 1 -- 172.21.15.72:0/3878551511 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7ff4a80597b0 con 0x7ff4ac0cc420 2023-12-13T00:27:58.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.760+0000 7ff4a1ffb640 1 -- 172.21.15.72:0/3878551511 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff4a8055af0 con 0x7ff4ac0cc420 2023-12-13T00:27:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.931+0000 7ff4b3753640 1 -- 172.21.15.72:0/3878551511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4ac0ca180 con 0x7ff4ac0cc420 2023-12-13T00:27:58.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.936+0000 7ff4a1ffb640 1 -- 172.21.15.72:0/3878551511 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4a8059110 con 0x7ff4ac0cc420 2023-12-13T00:27:58.937 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-12-13T00:27:58.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.938+0000 7ff4b3753640 1 -- 172.21.15.72:0/3878551511 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff49006b240 msgr2=0x7ff49006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:58.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.938+0000 7ff4b3753640 1 --2- 172.21.15.72:0/3878551511 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff49006b240 0x7ff49006d700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac1ecdc0 tx=0x7ff49c009190 comp rx=0 tx=0).stop 2023-12-13T00:27:58.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.938+0000 7ff4b3753640 1 -- 172.21.15.72:0/3878551511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac0cc420 msgr2=0x7ff4ac1ef8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:58.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.938+0000 7ff4b3753640 1 --2- 172.21.15.72:0/3878551511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac0cc420 0x7ff4ac1ef8a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009db0 tx=0x7ff4a800c490 comp rx=0 tx=0).stop 2023-12-13T00:27:58.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.938+0000 7ff4b3753640 1 -- 172.21.15.72:0/3878551511 shutdown_connections 2023-12-13T00:27:58.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.938+0000 7ff4b3753640 1 --2- 172.21.15.72:0/3878551511 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7ff49006b240 0x7ff49006d700 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:58.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.938+0000 7ff4b3753640 1 --2- 172.21.15.72:0/3878551511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4ac159b50 0x7ff4ac0b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:58.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.938+0000 7ff4b3753640 1 --2- 172.21.15.72:0/3878551511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4ac0cda70 0x7ff4ac0b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:58.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.938+0000 7ff4b3753640 1 --2- 172.21.15.72:0/3878551511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac0cc420 0x7ff4ac1ef8a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:58.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.938+0000 7ff4b3753640 1 -- 172.21.15.72:0/3878551511 >> 172.21.15.72:0/3878551511 conn(0x7ff4ac0b07b0 msgr2=0x7ff4ac0c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:27:58.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.938+0000 7ff4b3753640 1 -- 172.21.15.72:0/3878551511 shutdown_connections 2023-12-13T00:27:58.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:58.938+0000 7ff4b3753640 1 -- 172.21.15.72:0/3878551511 wait complete. 2023-12-13T00:27:58.950 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-13T00:27:59.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.053+0000 7fd44361e640 1 Processor -- start 2023-12-13T00:27:59.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.053+0000 7fd44361e640 1 -- start start 2023-12-13T00:27:59.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.054+0000 7fd44361e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd43c06e480 0x7fd43c06e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:59.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.054+0000 7fd44361e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c0c1ba0 con 0x7fd43c14fba0 2023-12-13T00:27:59.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.054+0000 7fd44361e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c0c3c20 con 0x7fd43c14ff80 2023-12-13T00:27:59.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.054+0000 7fd44361e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c0c3f00 con 0x7fd43c06e480 2023-12-13T00:27:59.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.054+0000 7fd441bbb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd43c06e480 0x7fd43c06e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:59.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.054+0000 7fd440bb9640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fd43c14ff80 0x7fd43c0c12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:36840/0 (socket says 172.21.15.72:36840) 2023-12-13T00:27:59.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.054+0000 7fd440bb9640 1 -- 172.21.15.72:0/1428157283 learned_addr learned my addr 172.21.15.72:0/1428157283 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:27:59.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.057+0000 7fd433fff640 1 -- 172.21.15.72:0/1428157283 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247323448 0 0) 0x7fd43c0c3c20 con 0x7fd43c14ff80 2023-12-13T00:27:59.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.057+0000 7fd433fff640 1 -- 172.21.15.72:0/1428157283 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd428003520 con 0x7fd43c14ff80 2023-12-13T00:27:59.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.059+0000 7fd441bbb640 1 -- 172.21.15.72:0/1428157283 >> v1:172.21.15.176:6789/0 conn(0x7fd43c14ff80 legacy=0x7fd43c0c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:59.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.059+0000 7fd441bbb640 1 -- 172.21.15.72:0/1428157283 >> v1:172.21.15.72:6789/0 conn(0x7fd43c14fba0 legacy=0x7fd43c0c1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:59.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.059+0000 7fd441bbb640 1 -- 172.21.15.72:0/1428157283 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c0c41e0 con 0x7fd43c06e480 2023-12-13T00:27:59.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.062+0000 7fd441bbb640 1 --2- 172.21.15.72:0/1428157283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd43c06e480 0x7fd43c06e8b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd43400aea0 tx=0x7fd43402d0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6e41ff63a8a76c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:27:59.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.066+0000 7fd433fff640 1 -- 172.21.15.72:0/1428157283 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43402dc70 con 0x7fd43c06e480 2023-12-13T00:27:59.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.066+0000 7fd433fff640 1 -- 172.21.15.72:0/1428157283 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43402ddd0 con 0x7fd43c06e480 2023-12-13T00:27:59.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.066+0000 7fd433fff640 1 -- 172.21.15.72:0/1428157283 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd434008660 con 0x7fd43c06e480 2023-12-13T00:27:59.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.067+0000 7fd44361e640 1 -- 172.21.15.72:0/1428157283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd43c06e480 msgr2=0x7fd43c06e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:59.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.067+0000 7fd44361e640 1 --2- 172.21.15.72:0/1428157283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd43c06e480 0x7fd43c06e8b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd43400aea0 tx=0x7fd43402d0d0 comp rx=0 tx=0).stop 2023-12-13T00:27:59.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.067+0000 7fd44361e640 1 -- 172.21.15.72:0/1428157283 shutdown_connections 2023-12-13T00:27:59.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.067+0000 7fd44361e640 1 --2- 172.21.15.72:0/1428157283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd43c06e480 0x7fd43c06e8b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:59.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.067+0000 7fd44361e640 1 -- 172.21.15.72:0/1428157283 >> 172.21.15.72:0/1428157283 conn(0x7fd43c06c5f0 msgr2=0x7fd43c06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:27:59.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.067+0000 7fd44361e640 1 -- 172.21.15.72:0/1428157283 shutdown_connections 2023-12-13T00:27:59.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.067+0000 7fd44361e640 1 -- 172.21.15.72:0/1428157283 wait complete. 2023-12-13T00:27:59.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.069+0000 7fd44361e640 1 Processor -- start 2023-12-13T00:27:59.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.069+0000 7fd44361e640 1 -- start start 2023-12-13T00:27:59.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.069+0000 7fd44361e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd43c06e480 0x7fd43c147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:59.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.069+0000 7fd44361e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd43c14fba0 0x7fd43c1f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:59.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.069+0000 7fd44361e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd43c1edc20 0x7fd43c0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:59.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.069+0000 7fd44361e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c1ed800 con 0x7fd43c14fba0 2023-12-13T00:27:59.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.069+0000 7fd44361e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c1483a0 con 0x7fd43c1edc20 2023-12-13T00:27:59.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.069+0000 7fd44361e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c1ecf30 con 0x7fd43c06e480 2023-12-13T00:27:59.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.070+0000 7fd440bb9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd43c14fba0 0x7fd43c1f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:59.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.070+0000 7fd441bbb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd43c1edc20 0x7fd43c0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:59.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.070+0000 7fd440bb9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd43c14fba0 0x7fd43c1f04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45952/0 (socket says 172.21.15.72:45952) 2023-12-13T00:27:59.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.070+0000 7fd440bb9640 1 -- 172.21.15.72:0/308226314 learned_addr learned my addr 172.21.15.72:0/308226314 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:27:59.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.070+0000 7fd4413ba640 1 --2- 172.21.15.72:0/308226314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd43c06e480 0x7fd43c147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:59.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.073+0000 7fd440bb9640 1 -- 172.21.15.72:0/308226314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd43c06e480 msgr2=0x7fd43c147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:59.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.073+0000 7fd440bb9640 1 --2- 172.21.15.72:0/308226314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd43c06e480 0x7fd43c147e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:59.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.073+0000 7fd440bb9640 1 -- 172.21.15.72:0/308226314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd43c1edc20 msgr2=0x7fd43c0c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:59.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.073+0000 7fd440bb9640 1 --2- 172.21.15.72:0/308226314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd43c1edc20 0x7fd43c0c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:59.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.073+0000 7fd440bb9640 1 -- 172.21.15.72:0/308226314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43400ab80 con 0x7fd43c14fba0 2023-12-13T00:27:59.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.075+0000 7fd440bb9640 1 --2- 172.21.15.72:0/308226314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd43c14fba0 0x7fd43c1f04a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00c440 tx=0x7fd42c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:27:59.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.079+0000 7fd431ffb640 1 -- 172.21.15.72:0/308226314 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c005ce0 con 0x7fd43c14fba0 2023-12-13T00:27:59.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.079+0000 7fd431ffb640 1 -- 172.21.15.72:0/308226314 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c005e40 con 0x7fd43c14fba0 2023-12-13T00:27:59.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.079+0000 7fd431ffb640 1 -- 172.21.15.72:0/308226314 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0072b0 con 0x7fd43c14fba0 2023-12-13T00:27:59.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.079+0000 7fd44361e640 1 -- 172.21.15.72:0/308226314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43c148580 con 0x7fd43c14fba0 2023-12-13T00:27:59.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.079+0000 7fd44361e640 1 -- 172.21.15.72:0/308226314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c1ed140 con 0x7fd43c14fba0 2023-12-13T00:27:59.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.080+0000 7fd44361e640 1 -- 172.21.15.72:0/308226314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43c1ed940 con 0x7fd43c14fba0 2023-12-13T00:27:59.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.323+0000 7fd431ffb640 1 -- 172.21.15.72:0/308226314 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd42c007410 con 0x7fd43c14fba0 2023-12-13T00:27:59.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.323+0000 7fd431ffb640 1 --2- 172.21.15.72:0/308226314 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd42006b240 0x7fd42006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:59.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.324+0000 7fd4413ba640 1 --2- 172.21.15.72:0/308226314 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd42006b240 0x7fd42006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:59.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.324+0000 7fd4413ba640 1 --2- 172.21.15.72:0/308226314 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd42006b240 0x7fd42006d700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd438001780 tx=0x7fd438009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:27:59.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.338+0000 7fd431ffb640 1 -- 172.21.15.72:0/308226314 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fd42c057ca0 con 0x7fd43c14fba0 2023-12-13T00:27:59.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.338+0000 7fd431ffb640 1 -- 172.21.15.72:0/308226314 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd42c053fe0 con 0x7fd43c14fba0 2023-12-13T00:27:59.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.532+0000 7fd44361e640 1 -- 172.21.15.72:0/308226314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd43c1ed940 con 0x7fd43c14fba0 2023-12-13T00:27:59.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.547+0000 7fd431ffb640 1 -- 172.21.15.72:0/308226314 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd43c1ed940 con 0x7fd43c14fba0 2023-12-13T00:27:59.548 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-12-13T00:27:59.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.549+0000 7fd44361e640 1 -- 172.21.15.72:0/308226314 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd42006b240 msgr2=0x7fd42006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:59.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.549+0000 7fd44361e640 1 --2- 172.21.15.72:0/308226314 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd42006b240 0x7fd42006d700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd438001780 tx=0x7fd438009040 comp rx=0 tx=0).stop 2023-12-13T00:27:59.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.549+0000 7fd44361e640 1 -- 172.21.15.72:0/308226314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd43c14fba0 msgr2=0x7fd43c1f04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:59.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.549+0000 7fd44361e640 1 --2- 172.21.15.72:0/308226314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd43c14fba0 0x7fd43c1f04a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00c440 tx=0x7fd42c00c900 comp rx=0 tx=0).stop 2023-12-13T00:27:59.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.550+0000 7fd44361e640 1 -- 172.21.15.72:0/308226314 shutdown_connections 2023-12-13T00:27:59.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.550+0000 7fd44361e640 1 --2- 172.21.15.72:0/308226314 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fd42006b240 0x7fd42006d700 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:59.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.550+0000 7fd44361e640 1 --2- 172.21.15.72:0/308226314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd43c1edc20 0x7fd43c0c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:59.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.550+0000 7fd44361e640 1 --2- 172.21.15.72:0/308226314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd43c14fba0 0x7fd43c1f04a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:59.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.550+0000 7fd44361e640 1 --2- 172.21.15.72:0/308226314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd43c06e480 0x7fd43c147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:59.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.550+0000 7fd44361e640 1 -- 172.21.15.72:0/308226314 >> 172.21.15.72:0/308226314 conn(0x7fd43c06c5f0 msgr2=0x7fd43c14a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:27:59.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.550+0000 7fd44361e640 1 -- 172.21.15.72:0/308226314 shutdown_connections 2023-12-13T00:27:59.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.550+0000 7fd44361e640 1 -- 172.21.15.72:0/308226314 wait complete. 2023-12-13T00:27:59.562 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-13T00:27:59.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.663+0000 7fbcc2e90640 1 Processor -- start 2023-12-13T00:27:59.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.664+0000 7fbcc2e90640 1 -- start start 2023-12-13T00:27:59.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.664+0000 7fbcc2e90640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcbc0c7650 0x7fbcbc15a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:59.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.664+0000 7fbcc2e90640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbcbc0c7a30 0x7fbcbc1560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:59.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.664+0000 7fbcc2e90640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcbc159dd0 con 0x7fbcbc0c6c40 2023-12-13T00:27:59.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.664+0000 7fbcc2e90640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcbc0c5ad0 con 0x7fbcbc0c7a30 2023-12-13T00:27:59.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.664+0000 7fbcc2e90640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc0c5cc0 con 0x7fbcbc0c7650 2023-12-13T00:27:59.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.665+0000 7fbcbbfff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbcbc0c7a30 0x7fbcbc1560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:59.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.665+0000 7fbcc142d640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fbcbc0c6c40 0x7fbcbc0c53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:36844/0 (socket says 172.21.15.72:36844) 2023-12-13T00:27:59.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.665+0000 7fbcc142d640 1 -- 172.21.15.72:0/3065155888 learned_addr learned my addr 172.21.15.72:0/3065155888 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:27:59.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.665+0000 7fbcc0c2c640 1 --2- 172.21.15.72:0/3065155888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcbc0c7650 0x7fbcbc15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:59.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.668+0000 7fbcbb7fe640 1 -- 172.21.15.72:0/3065155888 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581317159 0 0) 0x7fbcbc159dd0 con 0x7fbcbc0c6c40 2023-12-13T00:27:59.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.668+0000 7fbcbbfff640 1 -- 172.21.15.72:0/3065155888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcbc0c7650 msgr2=0x7fbcbc15a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:27:59.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.668+0000 7fbcbbfff640 1 --2- 172.21.15.72:0/3065155888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcbc0c7650 0x7fbcbc15a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:59.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.668+0000 7fbcbbfff640 1 -- 172.21.15.72:0/3065155888 >> v1:172.21.15.176:6789/0 conn(0x7fbcbc0c6c40 legacy=0x7fbcbc0c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:59.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.668+0000 7fbcbbfff640 1 -- 172.21.15.72:0/3065155888 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc0c6260 con 0x7fbcbc0c7a30 2023-12-13T00:27:59.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.669+0000 7fbcbbfff640 1 --2- 172.21.15.72:0/3065155888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcbc0c7a30 0x7fbcbc1560f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbca80097d0 tx=0x7fbca802b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9ddae3caa650c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:27:59.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.673+0000 7fbcbb7fe640 1 -- 172.21.15.72:0/3065155888 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8031770 con 0x7fbcbc0c7a30 2023-12-13T00:27:59.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.673+0000 7fbcbb7fe640 1 -- 172.21.15.72:0/3065155888 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca80318d0 con 0x7fbcbc0c7a30 2023-12-13T00:27:59.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.673+0000 7fbcbb7fe640 1 -- 172.21.15.72:0/3065155888 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8031c60 con 0x7fbcbc0c7a30 2023-12-13T00:27:59.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.674+0000 7fbcc2e90640 1 -- 172.21.15.72:0/3065155888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcbc0c7a30 msgr2=0x7fbcbc1560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:59.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.674+0000 7fbcc2e90640 1 --2- 172.21.15.72:0/3065155888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcbc0c7a30 0x7fbcbc1560f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbca80097d0 tx=0x7fbca802b810 comp rx=0 tx=0).stop 2023-12-13T00:27:59.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.674+0000 7fbcc2e90640 1 -- 172.21.15.72:0/3065155888 shutdown_connections 2023-12-13T00:27:59.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.674+0000 7fbcc2e90640 1 --2- 172.21.15.72:0/3065155888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcbc0c7a30 0x7fbcbc1560f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:59.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.674+0000 7fbcc2e90640 1 --2- 172.21.15.72:0/3065155888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcbc0c7650 0x7fbcbc15a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:59.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.674+0000 7fbcc2e90640 1 -- 172.21.15.72:0/3065155888 >> 172.21.15.72:0/3065155888 conn(0x7fbcbc06c5f0 msgr2=0x7fbcbc06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:27:59.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.674+0000 7fbcc2e90640 1 -- 172.21.15.72:0/3065155888 shutdown_connections 2023-12-13T00:27:59.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.674+0000 7fbcc2e90640 1 -- 172.21.15.72:0/3065155888 wait complete. 2023-12-13T00:27:59.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.675+0000 7fbcc2e90640 1 Processor -- start 2023-12-13T00:27:59.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.675+0000 7fbcc2e90640 1 -- start start 2023-12-13T00:27:59.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.676+0000 7fbcc2e90640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcbc0c6c40 0x7fbcbc151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:59.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.676+0000 7fbcc2e90640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcbc0c7650 0x7fbcbc0c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:59.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.676+0000 7fbcc2e90640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcbc0c7a30 0x7fbcbc150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:59.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.676+0000 7fbcc2e90640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc0c99c0 con 0x7fbcbc0c6c40 2023-12-13T00:27:59.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.676+0000 7fbcc2e90640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc0caa50 con 0x7fbcbc0c7a30 2023-12-13T00:27:59.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.676+0000 7fbcc2e90640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc151070 con 0x7fbcbc0c7650 2023-12-13T00:27:59.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.677+0000 7fbcc0c2c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcbc0c6c40 0x7fbcbc151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:59.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.677+0000 7fbcc142d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcbc0c7a30 0x7fbcbc150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:59.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.677+0000 7fbcbbfff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcbc0c7650 0x7fbcbc0c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:59.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.677+0000 7fbcc0c2c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcbc0c6c40 0x7fbcbc151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45976/0 (socket says 172.21.15.72:45976) 2023-12-13T00:27:59.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.677+0000 7fbcc0c2c640 1 -- 172.21.15.72:0/1775893297 learned_addr learned my addr 172.21.15.72:0/1775893297 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:27:59.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.680+0000 7fbcc0c2c640 1 -- 172.21.15.72:0/1775893297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcbc0c7650 msgr2=0x7fbcbc0c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:59.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.680+0000 7fbcc0c2c640 1 --2- 172.21.15.72:0/1775893297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcbc0c7650 0x7fbcbc0c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:59.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.680+0000 7fbcc0c2c640 1 -- 172.21.15.72:0/1775893297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcbc0c7a30 msgr2=0x7fbcbc150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:27:59.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.680+0000 7fbcc0c2c640 1 --2- 172.21.15.72:0/1775893297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcbc0c7a30 0x7fbcbc150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:27:59.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.681+0000 7fbcc0c2c640 1 -- 172.21.15.72:0/1775893297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca8009400 con 0x7fbcbc0c6c40 2023-12-13T00:27:59.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.683+0000 7fbcc0c2c640 1 --2- 172.21.15.72:0/1775893297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcbc0c6c40 0x7fbcbc151780 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000e9e0 tx=0x7fbcb000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:27:59.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.686+0000 7fbcb97fa640 1 -- 172.21.15.72:0/1775893297 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0009670 con 0x7fbcbc0c6c40 2023-12-13T00:27:59.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.686+0000 7fbcb97fa640 1 -- 172.21.15.72:0/1775893297 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb000c9d0 con 0x7fbcbc0c6c40 2023-12-13T00:27:59.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.686+0000 7fbcb97fa640 1 -- 172.21.15.72:0/1775893297 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb000cd80 con 0x7fbcbc0c6c40 2023-12-13T00:27:59.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.686+0000 7fbcc2e90640 1 -- 172.21.15.72:0/1775893297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcbc0cacc0 con 0x7fbcbc0c6c40 2023-12-13T00:27:59.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.687+0000 7fbcc2e90640 1 -- 172.21.15.72:0/1775893297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcbc0c9650 con 0x7fbcbc0c6c40 2023-12-13T00:27:59.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.687+0000 7fbcc2e90640 1 -- 172.21.15.72:0/1775893297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcbc0c91d0 con 0x7fbcbc0c6c40 2023-12-13T00:27:59.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.928+0000 7fbcb97fa640 1 -- 172.21.15.72:0/1775893297 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbcb0013470 con 0x7fbcbc0c6c40 2023-12-13T00:27:59.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.928+0000 7fbcb97fa640 1 --2- 172.21.15.72:0/1775893297 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbca006b210 0x7fbca006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:27:59.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.929+0000 7fbcbbfff640 1 --2- 172.21.15.72:0/1775893297 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbca006b210 0x7fbca006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:27:59.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.929+0000 7fbcbbfff640 1 --2- 172.21.15.72:0/1775893297 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbca006b210 0x7fbca006d6d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbca8036000 tx=0x7fbca803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:27:59.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.970+0000 7fbcb97fa640 1 -- 172.21.15.72:0/1775893297 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fbcb0058c90 con 0x7fbcbc0c6c40 2023-12-13T00:27:59.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:27:59.971+0000 7fbcb97fa640 1 -- 172.21.15.72:0/1775893297 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbcb0054fd0 con 0x7fbcbc0c6c40 2023-12-13T00:28:00.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.166+0000 7fbcc2e90640 1 -- 172.21.15.72:0/1775893297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbcbc0c91d0 con 0x7fbcbc0c6c40 2023-12-13T00:28:00.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.185+0000 7fbcb97fa640 1 -- 172.21.15.72:0/1775893297 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbcbc0c91d0 con 0x7fbcbc0c6c40 2023-12-13T00:28:00.186 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-12-13T00:28:00.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.187+0000 7fbcc2e90640 1 -- 172.21.15.72:0/1775893297 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbca006b210 msgr2=0x7fbca006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:00.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.187+0000 7fbcc2e90640 1 --2- 172.21.15.72:0/1775893297 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbca006b210 0x7fbca006d6d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbca8036000 tx=0x7fbca803d040 comp rx=0 tx=0).stop 2023-12-13T00:28:00.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.187+0000 7fbcc2e90640 1 -- 172.21.15.72:0/1775893297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcbc0c6c40 msgr2=0x7fbcbc151780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:00.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.187+0000 7fbcc2e90640 1 --2- 172.21.15.72:0/1775893297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcbc0c6c40 0x7fbcbc151780 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000e9e0 tx=0x7fbcb000eea0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.187+0000 7fbcc2e90640 1 -- 172.21.15.72:0/1775893297 shutdown_connections 2023-12-13T00:28:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.187+0000 7fbcc2e90640 1 --2- 172.21.15.72:0/1775893297 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbca006b210 0x7fbca006d6d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.187+0000 7fbcc2e90640 1 --2- 172.21.15.72:0/1775893297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcbc0c7a30 0x7fbcbc150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.187+0000 7fbcc2e90640 1 --2- 172.21.15.72:0/1775893297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcbc0c7650 0x7fbcbc0c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.187+0000 7fbcc2e90640 1 --2- 172.21.15.72:0/1775893297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcbc0c6c40 0x7fbcbc151780 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.187+0000 7fbcc2e90640 1 -- 172.21.15.72:0/1775893297 >> 172.21.15.72:0/1775893297 conn(0x7fbcbc06c5f0 msgr2=0x7fbcbc06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.187+0000 7fbcc2e90640 1 -- 172.21.15.72:0/1775893297 shutdown_connections 2023-12-13T00:28:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.187+0000 7fbcc2e90640 1 -- 172.21.15.72:0/1775893297 wait complete. 2023-12-13T00:28:00.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-13T00:28:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.300+0000 7f6797689640 1 Processor -- start 2023-12-13T00:28:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.301+0000 7f6797689640 1 -- start start 2023-12-13T00:28:00.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.301+0000 7f6797689640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f67900cda70 0x7f67900ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:00.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.301+0000 7f6797689640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67900c9620 0x7f67900c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:00.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.301+0000 7f6797689640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67900cbda0 con 0x7f67900cc420 2023-12-13T00:28:00.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.301+0000 7f6797689640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67900cc230 con 0x7f67900cda70 2023-12-13T00:28:00.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.301+0000 7f6797689640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67900cb4e0 con 0x7f67900c9620 2023-12-13T00:28:00.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.302+0000 7f6795c26640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67900c9620 0x7f67900c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:00.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.302+0000 7f6794c24640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f67900cc420 0x7f6790159610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:36850/0 (socket says 172.21.15.72:36850) 2023-12-13T00:28:00.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.302+0000 7f6794c24640 1 -- 172.21.15.72:0/1249584175 learned_addr learned my addr 172.21.15.72:0/1249584175 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:28:00.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.302+0000 7f6795425640 1 --2- 172.21.15.72:0/1249584175 >> v2:172.21.15.176:3300/0 conn(0x7f67900cda70 0x7f67900ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:00.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.304+0000 7f6795c26640 1 -- 172.21.15.72:0/1249584175 >> v2:172.21.15.176:3300/0 conn(0x7f67900cda70 msgr2=0x7f67900ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:00.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.305+0000 7f6795c26640 1 --2- 172.21.15.72:0/1249584175 >> v2:172.21.15.176:3300/0 conn(0x7f67900cda70 0x7f67900ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.305+0000 7f6795c26640 1 -- 172.21.15.72:0/1249584175 >> v1:172.21.15.176:6789/0 conn(0x7f67900cc420 legacy=0x7f6790159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:00.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.305+0000 7f6795c26640 1 -- 172.21.15.72:0/1249584175 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67900cce00 con 0x7f67900c9620 2023-12-13T00:28:00.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.307+0000 7f6795c26640 1 --2- 172.21.15.72:0/1249584175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67900c9620 0x7f67900c9a70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f67880097a0 tx=0x7f678802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da764a6aae49b482 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:00.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.311+0000 7f6787fff640 1 -- 172.21.15.72:0/1249584175 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788030610 con 0x7f67900c9620 2023-12-13T00:28:00.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.311+0000 7f6787fff640 1 -- 172.21.15.72:0/1249584175 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6788030770 con 0x7f67900c9620 2023-12-13T00:28:00.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.311+0000 7f6787fff640 1 -- 172.21.15.72:0/1249584175 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788030b00 con 0x7f67900c9620 2023-12-13T00:28:00.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.312+0000 7f6797689640 1 -- 172.21.15.72:0/1249584175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67900c9620 msgr2=0x7f67900c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:00.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.312+0000 7f6797689640 1 --2- 172.21.15.72:0/1249584175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67900c9620 0x7f67900c9a70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f67880097a0 tx=0x7f678802b960 comp rx=0 tx=0).stop 2023-12-13T00:28:00.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.312+0000 7f6797689640 1 -- 172.21.15.72:0/1249584175 shutdown_connections 2023-12-13T00:28:00.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.312+0000 7f6797689640 1 --2- 172.21.15.72:0/1249584175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67900c9620 0x7f67900c9a70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.312+0000 7f6797689640 1 --2- 172.21.15.72:0/1249584175 >> v2:172.21.15.176:3300/0 conn(0x7f67900cda70 0x7f67900ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.312+0000 7f6797689640 1 -- 172.21.15.72:0/1249584175 >> 172.21.15.72:0/1249584175 conn(0x7f67900b07b0 msgr2=0x7f67900b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:00.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.312+0000 7f6797689640 1 -- 172.21.15.72:0/1249584175 shutdown_connections 2023-12-13T00:28:00.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.312+0000 7f6797689640 1 -- 172.21.15.72:0/1249584175 wait complete. 2023-12-13T00:28:00.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.313+0000 7f6797689640 1 Processor -- start 2023-12-13T00:28:00.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.313+0000 7f6797689640 1 -- start start 2023-12-13T00:28:00.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.314+0000 7f6797689640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67900c9620 0x7f67900b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:00.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.314+0000 7f6797689640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67900cc420 0x7f67901f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:00.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.314+0000 7f6797689640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67900cda70 0x7f67900afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:00.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.314+0000 7f6797689640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67901f2b60 con 0x7f67900c9620 2023-12-13T00:28:00.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.314+0000 7f6797689640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67900b3aa0 con 0x7f67900cda70 2023-12-13T00:28:00.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.314+0000 7f6797689640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67901f3530 con 0x7f67900cc420 2023-12-13T00:28:00.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.314+0000 7f6795c26640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67900cda70 0x7f67900afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:00.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.314+0000 7f6795425640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67900c9620 0x7f67900b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:00.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.314+0000 7f6794c24640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67900cc420 0x7f67901f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:00.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.314+0000 7f6795c26640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67900cda70 0x7f67900afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:57294/0 (socket says 172.21.15.72:57294) 2023-12-13T00:28:00.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.314+0000 7f6795c26640 1 -- 172.21.15.72:0/3494080132 learned_addr learned my addr 172.21.15.72:0/3494080132 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:00.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.318+0000 7f6795c26640 1 -- 172.21.15.72:0/3494080132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67900cc420 msgr2=0x7f67901f2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:00.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.318+0000 7f6795c26640 1 --2- 172.21.15.72:0/3494080132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67900cc420 0x7f67901f2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.318+0000 7f6795c26640 1 -- 172.21.15.72:0/3494080132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67900c9620 msgr2=0x7f67900b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:00.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.318+0000 7f6795c26640 1 --2- 172.21.15.72:0/3494080132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67900c9620 0x7f67900b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.318+0000 7f6795c26640 1 -- 172.21.15.72:0/3494080132 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6788009400 con 0x7f67900cda70 2023-12-13T00:28:00.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.320+0000 7f6795c26640 1 --2- 172.21.15.72:0/3494080132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67900cda70 0x7f67900afdb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f67880098c0 tx=0x7f6788004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:00.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.324+0000 7f6785ffb640 1 -- 172.21.15.72:0/3494080132 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678803e040 con 0x7f67900cda70 2023-12-13T00:28:00.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.324+0000 7f6785ffb640 1 -- 172.21.15.72:0/3494080132 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6788039a20 con 0x7f67900cda70 2023-12-13T00:28:00.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.324+0000 7f6797689640 1 -- 172.21.15.72:0/3494080132 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67900b23b0 con 0x7f67900cda70 2023-12-13T00:28:00.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.324+0000 7f6785ffb640 1 -- 172.21.15.72:0/3494080132 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788039dd0 con 0x7f67900cda70 2023-12-13T00:28:00.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.324+0000 7f6797689640 1 -- 172.21.15.72:0/3494080132 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67900b2970 con 0x7f67900cda70 2023-12-13T00:28:00.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.325+0000 7f6797689640 1 -- 172.21.15.72:0/3494080132 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67900ca180 con 0x7f67900cda70 2023-12-13T00:28:00.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.565+0000 7f6785ffb640 1 -- 172.21.15.72:0/3494080132 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f678804d3b0 con 0x7f67900cda70 2023-12-13T00:28:00.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.565+0000 7f6785ffb640 1 --2- 172.21.15.72:0/3494080132 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f677406b210 0x7f677406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:00.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.565+0000 7f6795425640 1 --2- 172.21.15.72:0/3494080132 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f677406b210 0x7f677406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:00.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.566+0000 7f6795425640 1 --2- 172.21.15.72:0/3494080132 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f677406b210 0x7f677406d6d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f678c011340 tx=0x7f678c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:00.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.569+0000 7f6785ffb640 1 -- 172.21.15.72:0/3494080132 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f678807ac50 con 0x7f67900cda70 2023-12-13T00:28:00.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.581+0000 7f6785ffb640 1 -- 172.21.15.72:0/3494080132 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6788076f90 con 0x7f67900cda70 2023-12-13T00:28:00.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.767+0000 7f6797689640 1 -- 172.21.15.72:0/3494080132 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f67901f2cd0 con 0x7f67900cda70 2023-12-13T00:28:00.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.772+0000 7f6785ffb640 1 -- 172.21.15.72:0/3494080132 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6788049080 con 0x7f67900cda70 2023-12-13T00:28:00.772 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-12-13T00:28:00.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.774+0000 7f6797689640 1 -- 172.21.15.72:0/3494080132 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f677406b210 msgr2=0x7f677406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:00.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.774+0000 7f6797689640 1 --2- 172.21.15.72:0/3494080132 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f677406b210 0x7f677406d6d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f678c011340 tx=0x7f678c00b040 comp rx=0 tx=0).stop 2023-12-13T00:28:00.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.774+0000 7f6797689640 1 -- 172.21.15.72:0/3494080132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67900cda70 msgr2=0x7f67900afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:00.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.774+0000 7f6797689640 1 --2- 172.21.15.72:0/3494080132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67900cda70 0x7f67900afdb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f67880098c0 tx=0x7f6788004730 comp rx=0 tx=0).stop 2023-12-13T00:28:00.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.774+0000 7f6797689640 1 -- 172.21.15.72:0/3494080132 shutdown_connections 2023-12-13T00:28:00.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.774+0000 7f6797689640 1 --2- 172.21.15.72:0/3494080132 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f677406b210 0x7f677406d6d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.774+0000 7f6797689640 1 --2- 172.21.15.72:0/3494080132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67900cda70 0x7f67900afdb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.774+0000 7f6797689640 1 --2- 172.21.15.72:0/3494080132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67900cc420 0x7f67901f2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.774+0000 7f6797689640 1 --2- 172.21.15.72:0/3494080132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67900c9620 0x7f67900b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.774+0000 7f6797689640 1 -- 172.21.15.72:0/3494080132 >> 172.21.15.72:0/3494080132 conn(0x7f67900b07b0 msgr2=0x7f67900c6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:00.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.774+0000 7f6797689640 1 -- 172.21.15.72:0/3494080132 shutdown_connections 2023-12-13T00:28:00.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.774+0000 7f6797689640 1 -- 172.21.15.72:0/3494080132 wait complete. 2023-12-13T00:28:00.786 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-12-13T00:28:00.786 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-13T00:28:00.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:28:00.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.951+0000 7f9f80ee7640 1 Processor -- start 2023-12-13T00:28:00.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.951+0000 7f9f80ee7640 1 -- start start 2023-12-13T00:28:00.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.952+0000 7f9f80ee7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f7c0cda70 0x7f9f7c0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:00.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.952+0000 7f9f80ee7640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9f7c0cc420 0x7f9f7c159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:00.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.952+0000 7f9f80ee7640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7c0cbda0 con 0x7f9f7c159b50 2023-12-13T00:28:00.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.952+0000 7f9f80ee7640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7c0cc230 con 0x7f9f7c0cda70 2023-12-13T00:28:00.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.952+0000 7f9f80ee7640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7c0cb4e0 con 0x7f9f7c0cc420 2023-12-13T00:28:00.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.952+0000 7f9f7a59c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f7c0cda70 0x7f9f7c0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:00.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.953+0000 7f9f79d9b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9f7c0cc420 0x7f9f7c159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:00.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.953+0000 7f9f7a59c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f7c0cda70 0x7f9f7c0ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45994/0 (socket says 172.21.15.72:45994) 2023-12-13T00:28:00.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.953+0000 7f9f7a59c640 1 -- 172.21.15.72:0/1323591124 learned_addr learned my addr 172.21.15.72:0/1323591124 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:00.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.955+0000 7f9f7a59c640 1 -- 172.21.15.72:0/1323591124 >> v2:172.21.15.176:3300/0 conn(0x7f9f7c0cc420 msgr2=0x7f9f7c159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:00.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.955+0000 7f9f7a59c640 1 --2- 172.21.15.72:0/1323591124 >> v2:172.21.15.176:3300/0 conn(0x7f9f7c0cc420 0x7f9f7c159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.955+0000 7f9f7a59c640 1 -- 172.21.15.72:0/1323591124 >> v1:172.21.15.176:6789/0 conn(0x7f9f7c159b50 legacy=0x7f9f7c0c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:00.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.955+0000 7f9f7a59c640 1 -- 172.21.15.72:0/1323591124 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c0cce00 con 0x7f9f7c0cda70 2023-12-13T00:28:00.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.958+0000 7f9f7a59c640 1 --2- 172.21.15.72:0/1323591124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f7c0cda70 0x7f9f7c0ce350 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0cfda0 tx=0x7f9f7402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7b189ded340d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:00.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.961+0000 7f9f7959a640 1 -- 172.21.15.72:0/1323591124 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7402f850 con 0x7f9f7c0cda70 2023-12-13T00:28:00.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.961+0000 7f9f7959a640 1 -- 172.21.15.72:0/1323591124 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7402f9b0 con 0x7f9f7c0cda70 2023-12-13T00:28:00.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.961+0000 7f9f7959a640 1 -- 172.21.15.72:0/1323591124 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7402fd40 con 0x7f9f7c0cda70 2023-12-13T00:28:00.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.962+0000 7f9f80ee7640 1 -- 172.21.15.72:0/1323591124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f7c0cda70 msgr2=0x7f9f7c0ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:00.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.962+0000 7f9f80ee7640 1 --2- 172.21.15.72:0/1323591124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f7c0cda70 0x7f9f7c0ce350 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0cfda0 tx=0x7f9f7402ba30 comp rx=0 tx=0).stop 2023-12-13T00:28:00.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.962+0000 7f9f80ee7640 1 -- 172.21.15.72:0/1323591124 shutdown_connections 2023-12-13T00:28:00.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.962+0000 7f9f80ee7640 1 --2- 172.21.15.72:0/1323591124 >> v2:172.21.15.176:3300/0 conn(0x7f9f7c0cc420 0x7f9f7c159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.962+0000 7f9f80ee7640 1 --2- 172.21.15.72:0/1323591124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f7c0cda70 0x7f9f7c0ce350 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.962+0000 7f9f80ee7640 1 -- 172.21.15.72:0/1323591124 >> 172.21.15.72:0/1323591124 conn(0x7f9f7c0b07b0 msgr2=0x7f9f7c0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:00.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.962+0000 7f9f80ee7640 1 -- 172.21.15.72:0/1323591124 shutdown_connections 2023-12-13T00:28:00.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.962+0000 7f9f80ee7640 1 -- 172.21.15.72:0/1323591124 wait complete. 2023-12-13T00:28:00.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.963+0000 7f9f80ee7640 1 Processor -- start 2023-12-13T00:28:00.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.963+0000 7f9f80ee7640 1 -- start start 2023-12-13T00:28:00.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.964+0000 7f9f80ee7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f7c0cc420 0x7f9f7c157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:00.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.964+0000 7f9f80ee7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f7c0cda70 0x7f9f7c1e5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:00.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.964+0000 7f9f80ee7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f7c159b50 0x7f9f7c158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:00.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.964+0000 7f9f80ee7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c154ae0 con 0x7f9f7c159b50 2023-12-13T00:28:00.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.964+0000 7f9f80ee7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c154da0 con 0x7f9f7c0cc420 2023-12-13T00:28:00.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.964+0000 7f9f80ee7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c1582b0 con 0x7f9f7c0cda70 2023-12-13T00:28:00.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.965+0000 7f9f7ad9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f7c159b50 0x7f9f7c158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:00.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.965+0000 7f9f7a59c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f7c0cc420 0x7f9f7c157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:00.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.965+0000 7f9f7ad9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f7c159b50 0x7f9f7c158ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46000/0 (socket says 172.21.15.72:46000) 2023-12-13T00:28:00.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.965+0000 7f9f7ad9d640 1 -- 172.21.15.72:0/4185232729 learned_addr learned my addr 172.21.15.72:0/4185232729 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:00.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.965+0000 7f9f79d9b640 1 --2- 172.21.15.72:0/4185232729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f7c0cda70 0x7f9f7c1e5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:00.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.968+0000 7f9f7ad9d640 1 -- 172.21.15.72:0/4185232729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f7c0cda70 msgr2=0x7f9f7c1e5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:00.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.968+0000 7f9f7ad9d640 1 --2- 172.21.15.72:0/4185232729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f7c0cda70 0x7f9f7c1e5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.968+0000 7f9f7ad9d640 1 -- 172.21.15.72:0/4185232729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f7c0cc420 msgr2=0x7f9f7c157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:00.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.968+0000 7f9f7ad9d640 1 --2- 172.21.15.72:0/4185232729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f7c0cc420 0x7f9f7c157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:00.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.968+0000 7f9f7ad9d640 1 -- 172.21.15.72:0/4185232729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f740094d0 con 0x7f9f7c159b50 2023-12-13T00:28:00.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.971+0000 7f9f7ad9d640 1 --2- 172.21.15.72:0/4185232729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f7c159b50 0x7f9f7c158ec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c00c730 tx=0x7f9f6c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:00.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.974+0000 7f9f6affd640 1 -- 172.21.15.72:0/4185232729 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c003b70 con 0x7f9f7c159b50 2023-12-13T00:28:00.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.974+0000 7f9f6affd640 1 -- 172.21.15.72:0/4185232729 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c003cf0 con 0x7f9f7c159b50 2023-12-13T00:28:00.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.974+0000 7f9f6affd640 1 -- 172.21.15.72:0/4185232729 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c003ea0 con 0x7f9f7c159b50 2023-12-13T00:28:00.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.974+0000 7f9f80ee7640 1 -- 172.21.15.72:0/4185232729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7c1597e0 con 0x7f9f7c159b50 2023-12-13T00:28:00.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.974+0000 7f9f80ee7640 1 -- 172.21.15.72:0/4185232729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7c1552f0 con 0x7f9f7c159b50 2023-12-13T00:28:00.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.975+0000 7f9f80ee7640 1 -- 172.21.15.72:0/4185232729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7c067470 con 0x7f9f7c159b50 2023-12-13T00:28:00.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.993+0000 7f9f6affd640 1 -- 172.21.15.72:0/4185232729 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9f6c005310 con 0x7f9f7c159b50 2023-12-13T00:28:00.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.993+0000 7f9f6affd640 1 --2- 172.21.15.72:0/4185232729 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9f5c06b240 0x7f9f5c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:00.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.994+0000 7f9f7a59c640 1 --2- 172.21.15.72:0/4185232729 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9f5c06b240 0x7f9f5c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:00.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.994+0000 7f9f7a59c640 1 --2- 172.21.15.72:0/4185232729 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9f5c06b240 0x7f9f5c06d700 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9f74036000 tx=0x7f9f74008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:00.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:00.997+0000 7f9f6affd640 1 -- 172.21.15.72:0/4185232729 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f9f6c058b70 con 0x7f9f7c159b50 2023-12-13T00:28:01.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.230+0000 7f9f6affd640 1 -- 172.21.15.72:0/4185232729 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9f6c054eb0 con 0x7f9f7c159b50 2023-12-13T00:28:01.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.410+0000 7f9f80ee7640 1 -- 172.21.15.72:0/4185232729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f7c153c40 con 0x7f9f7c159b50 2023-12-13T00:28:01.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.447+0000 7f9f6affd640 1 -- 172.21.15.72:0/4185232729 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18563 (secure 0 0 0) 0x7f9f6c0584d0 con 0x7f9f7c159b50 2023-12-13T00:28:01.448 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:28:01.448 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:01:00.435991+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T00:00:27.701252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T00:00:29.324356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T00:00:33.363089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.3","mappings":[{"from":7,"to":5}]},{"pgid":"4.10","mappings":[{"from":7,"to":0}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:28:01.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.450+0000 7f9f80ee7640 1 -- 172.21.15.72:0/4185232729 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9f5c06b240 msgr2=0x7f9f5c06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.450+0000 7f9f80ee7640 1 --2- 172.21.15.72:0/4185232729 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9f5c06b240 0x7f9f5c06d700 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9f74036000 tx=0x7f9f74008030 comp rx=0 tx=0).stop 2023-12-13T00:28:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.450+0000 7f9f80ee7640 1 -- 172.21.15.72:0/4185232729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f7c159b50 msgr2=0x7f9f7c158ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.450+0000 7f9f80ee7640 1 --2- 172.21.15.72:0/4185232729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f7c159b50 0x7f9f7c158ec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c00c730 tx=0x7f9f6c00cbf0 comp rx=0 tx=0).stop 2023-12-13T00:28:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.450+0000 7f9f80ee7640 1 -- 172.21.15.72:0/4185232729 shutdown_connections 2023-12-13T00:28:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.450+0000 7f9f80ee7640 1 --2- 172.21.15.72:0/4185232729 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9f5c06b240 0x7f9f5c06d700 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.450+0000 7f9f80ee7640 1 --2- 172.21.15.72:0/4185232729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f7c159b50 0x7f9f7c158ec0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.450+0000 7f9f80ee7640 1 --2- 172.21.15.72:0/4185232729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f7c0cda70 0x7f9f7c1e5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.450+0000 7f9f80ee7640 1 --2- 172.21.15.72:0/4185232729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f7c0cc420 0x7f9f7c157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.450+0000 7f9f80ee7640 1 -- 172.21.15.72:0/4185232729 >> 172.21.15.72:0/4185232729 conn(0x7f9f7c0b07b0 msgr2=0x7f9f7c0af7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.450+0000 7f9f80ee7640 1 -- 172.21.15.72:0/4185232729 shutdown_connections 2023-12-13T00:28:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.450+0000 7f9f80ee7640 1 -- 172.21.15.72:0/4185232729 wait complete. 2023-12-13T00:28:01.461 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-13T00:00:06.839153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-13T00:00:27.701252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-13T00:00:29.324356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-13T00:00:33.363089+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-13T00:28:01.462 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-13T00:28:01.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.565+0000 7f85cf461640 1 Processor -- start 2023-12-13T00:28:01.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.565+0000 7f85cf461640 1 -- start start 2023-12-13T00:28:01.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.566+0000 7f85cf461640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f85c80c79d0 0x7f85c80ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:01.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.566+0000 7f85cf461640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80cd0a0 0x7f85c80c9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:01.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.566+0000 7f85cf461640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c80c8380 con 0x7f85c8153770 2023-12-13T00:28:01.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.566+0000 7f85cf461640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c80c8ee0 con 0x7f85c80c79d0 2023-12-13T00:28:01.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.566+0000 7f85cf461640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c815cdd0 con 0x7f85c80cd0a0 2023-12-13T00:28:01.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.567+0000 7f85cc9fc640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f85c80c79d0 0x7f85c80ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:01.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.567+0000 7f85cd9fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80cd0a0 0x7f85c80c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:01.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.567+0000 7f85cd1fd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f85c8153770 0x7f85c8159f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:45974/0 (socket says 172.21.15.72:45974) 2023-12-13T00:28:01.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.567+0000 7f85cd1fd640 1 -- 172.21.15.72:0/4152763091 learned_addr learned my addr 172.21.15.72:0/4152763091 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:28:01.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.570+0000 7f85cd9fe640 1 -- 172.21.15.72:0/4152763091 >> v2:172.21.15.72:3300/0 conn(0x7f85c80c79d0 msgr2=0x7f85c80ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:01.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.570+0000 7f85cd9fe640 1 --2- 172.21.15.72:0/4152763091 >> v2:172.21.15.72:3300/0 conn(0x7f85c80c79d0 0x7f85c80ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:01.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.570+0000 7f85cd9fe640 1 -- 172.21.15.72:0/4152763091 >> v1:172.21.15.72:6789/0 conn(0x7f85c8153770 legacy=0x7f85c8159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:01.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.570+0000 7f85cd9fe640 1 -- 172.21.15.72:0/4152763091 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c815d0b0 con 0x7f85c80cd0a0 2023-12-13T00:28:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.572+0000 7f85cd9fe640 1 --2- 172.21.15.72:0/4152763091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80cd0a0 0x7f85c80c9390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f85c00097a0 tx=0x7f85c002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3fe421483524cd5 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:01.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.576+0000 7f85bffff640 1 -- 172.21.15.72:0/4152763091 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c0031830 con 0x7f85c80cd0a0 2023-12-13T00:28:01.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.576+0000 7f85bffff640 1 -- 172.21.15.72:0/4152763091 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c0031990 con 0x7f85c80cd0a0 2023-12-13T00:28:01.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.576+0000 7f85bffff640 1 -- 172.21.15.72:0/4152763091 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c0031d20 con 0x7f85c80cd0a0 2023-12-13T00:28:01.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.576+0000 7f85cf461640 1 -- 172.21.15.72:0/4152763091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80cd0a0 msgr2=0x7f85c80c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:01.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.576+0000 7f85cf461640 1 --2- 172.21.15.72:0/4152763091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80cd0a0 0x7f85c80c9390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f85c00097a0 tx=0x7f85c002b8d0 comp rx=0 tx=0).stop 2023-12-13T00:28:01.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.576+0000 7f85cf461640 1 -- 172.21.15.72:0/4152763091 shutdown_connections 2023-12-13T00:28:01.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.576+0000 7f85cf461640 1 --2- 172.21.15.72:0/4152763091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80cd0a0 0x7f85c80c9390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:01.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.576+0000 7f85cf461640 1 --2- 172.21.15.72:0/4152763091 >> v2:172.21.15.72:3300/0 conn(0x7f85c80c79d0 0x7f85c80ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:01.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.576+0000 7f85cf461640 1 -- 172.21.15.72:0/4152763091 >> 172.21.15.72:0/4152763091 conn(0x7f85c8070790 msgr2=0x7f85c8070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:01.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.577+0000 7f85cf461640 1 -- 172.21.15.72:0/4152763091 shutdown_connections 2023-12-13T00:28:01.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.577+0000 7f85cf461640 1 -- 172.21.15.72:0/4152763091 wait complete. 2023-12-13T00:28:01.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.578+0000 7f85cf461640 1 Processor -- start 2023-12-13T00:28:01.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.578+0000 7f85cf461640 1 -- start start 2023-12-13T00:28:01.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.578+0000 7f85cf461640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85c80c79d0 0x7f85c8155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:01.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.578+0000 7f85cf461640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85c80cd0a0 0x7f85c815bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:01.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.578+0000 7f85cf461640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c8153770 0x7f85c815c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:01.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.578+0000 7f85cf461640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80c5040 con 0x7f85c80c79d0 2023-12-13T00:28:01.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.578+0000 7f85cf461640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c8156c10 con 0x7f85c80cd0a0 2023-12-13T00:28:01.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.578+0000 7f85cf461640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80c4a80 con 0x7f85c8153770 2023-12-13T00:28:01.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.579+0000 7f85cd1fd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85c80c79d0 0x7f85c8155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:01.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.579+0000 7f85cd9fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c8153770 0x7f85c815c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:01.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.579+0000 7f85cc9fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85c80cd0a0 0x7f85c815bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:01.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.579+0000 7f85cd1fd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85c80c79d0 0x7f85c8155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46014/0 (socket says 172.21.15.72:46014) 2023-12-13T00:28:01.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.579+0000 7f85cd1fd640 1 -- 172.21.15.72:0/2807691476 learned_addr learned my addr 172.21.15.72:0/2807691476 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:01.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.583+0000 7f85cd1fd640 1 -- 172.21.15.72:0/2807691476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c8153770 msgr2=0x7f85c815c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:01.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.583+0000 7f85cd1fd640 1 --2- 172.21.15.72:0/2807691476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c8153770 0x7f85c815c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:01.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.583+0000 7f85cd1fd640 1 -- 172.21.15.72:0/2807691476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85c80cd0a0 msgr2=0x7f85c815bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:01.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.583+0000 7f85cd1fd640 1 --2- 172.21.15.72:0/2807691476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85c80cd0a0 0x7f85c815bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:01.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.583+0000 7f85cd1fd640 1 -- 172.21.15.72:0/2807691476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c0009400 con 0x7f85c80c79d0 2023-12-13T00:28:01.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.585+0000 7f85cd1fd640 1 --2- 172.21.15.72:0/2807691476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85c80c79d0 0x7f85c8155c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f85c400cb10 tx=0x7f85c400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:01.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.589+0000 7f85bdffb640 1 -- 172.21.15.72:0/2807691476 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c400ac70 con 0x7f85c80c79d0 2023-12-13T00:28:01.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.589+0000 7f85cf461640 1 -- 172.21.15.72:0/2807691476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c80c4d60 con 0x7f85c80c79d0 2023-12-13T00:28:01.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.590+0000 7f85cf461640 1 -- 172.21.15.72:0/2807691476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c8156930 con 0x7f85c80c79d0 2023-12-13T00:28:01.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.591+0000 7f85cf461640 1 -- 172.21.15.72:0/2807691476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c81564b0 con 0x7f85c80c79d0 2023-12-13T00:28:01.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.836+0000 7f85bdffb640 1 -- 172.21.15.72:0/2807691476 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c4001bd0 con 0x7f85c80c79d0 2023-12-13T00:28:01.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.836+0000 7f85bdffb640 1 -- 172.21.15.72:0/2807691476 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4004b60 con 0x7f85c80c79d0 2023-12-13T00:28:01.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.837+0000 7f85bdffb640 1 -- 172.21.15.72:0/2807691476 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f85c4012420 con 0x7f85c80c79d0 2023-12-13T00:28:01.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.837+0000 7f85bdffb640 1 --2- 172.21.15.72:0/2807691476 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f85ac06b1f0 0x7f85ac06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:01.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.837+0000 7f85cc9fc640 1 --2- 172.21.15.72:0/2807691476 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f85ac06b1f0 0x7f85ac06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:01.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.838+0000 7f85cc9fc640 1 --2- 172.21.15.72:0/2807691476 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f85ac06b1f0 0x7f85ac06d6b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f85c80c2a20 tx=0x7f85b8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:01.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.850+0000 7f85bdffb640 1 -- 172.21.15.72:0/2807691476 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f85c401de70 con 0x7f85c80c79d0 2023-12-13T00:28:01.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:01.850+0000 7f85bdffb640 1 -- 172.21.15.72:0/2807691476 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f85c4058460 con 0x7f85c80c79d0 2023-12-13T00:28:02.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.049+0000 7f85cf461640 1 -- 172.21.15.72:0/2807691476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85c8153d90 con 0x7f85c80c79d0 2023-12-13T00:28:02.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.055+0000 7f85bdffb640 1 -- 172.21.15.72:0/2807691476 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85c8153d90 con 0x7f85c80c79d0 2023-12-13T00:28:02.055 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-12-13T00:28:02.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.057+0000 7f85cf461640 1 -- 172.21.15.72:0/2807691476 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f85ac06b1f0 msgr2=0x7f85ac06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:02.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.057+0000 7f85cf461640 1 --2- 172.21.15.72:0/2807691476 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f85ac06b1f0 0x7f85ac06d6b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f85c80c2a20 tx=0x7f85b8009190 comp rx=0 tx=0).stop 2023-12-13T00:28:02.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.057+0000 7f85cf461640 1 -- 172.21.15.72:0/2807691476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85c80c79d0 msgr2=0x7f85c8155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:02.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.057+0000 7f85cf461640 1 --2- 172.21.15.72:0/2807691476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85c80c79d0 0x7f85c8155c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f85c400cb10 tx=0x7f85c400a060 comp rx=0 tx=0).stop 2023-12-13T00:28:02.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.057+0000 7f85cf461640 1 -- 172.21.15.72:0/2807691476 shutdown_connections 2023-12-13T00:28:02.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.057+0000 7f85cf461640 1 --2- 172.21.15.72:0/2807691476 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f85ac06b1f0 0x7f85ac06d6b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.057+0000 7f85cf461640 1 --2- 172.21.15.72:0/2807691476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c8153770 0x7f85c815c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.057+0000 7f85cf461640 1 --2- 172.21.15.72:0/2807691476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85c80cd0a0 0x7f85c815bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.057+0000 7f85cf461640 1 --2- 172.21.15.72:0/2807691476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85c80c79d0 0x7f85c8155c30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.057+0000 7f85cf461640 1 -- 172.21.15.72:0/2807691476 >> 172.21.15.72:0/2807691476 conn(0x7f85c8070790 msgr2=0x7f85c814f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:02.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.057+0000 7f85cf461640 1 -- 172.21.15.72:0/2807691476 shutdown_connections 2023-12-13T00:28:02.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.057+0000 7f85cf461640 1 -- 172.21.15.72:0/2807691476 wait complete. 2023-12-13T00:28:02.069 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-13T00:28:02.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.173+0000 7f0a85694640 1 Processor -- start 2023-12-13T00:28:02.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.173+0000 7f0a85694640 1 -- start start 2023-12-13T00:28:02.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.174+0000 7f0a85694640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800cc420 0x7f0a80159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:02.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.174+0000 7f0a85694640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a80159b50 0x7f0a800c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:02.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.174+0000 7f0a85694640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a800cbda0 con 0x7f0a800cda70 2023-12-13T00:28:02.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.174+0000 7f0a85694640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a800cc230 con 0x7f0a80159b50 2023-12-13T00:28:02.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.174+0000 7f0a85694640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a800cea60 con 0x7f0a800cc420 2023-12-13T00:28:02.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.175+0000 7f0a7f7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a80159b50 0x7f0a800c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:02.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.175+0000 7f0a7e7fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800cc420 0x7f0a80159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:02.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.175+0000 7f0a7f7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a80159b50 0x7f0a800c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46018/0 (socket says 172.21.15.72:46018) 2023-12-13T00:28:02.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.175+0000 7f0a7f7fe640 1 -- 172.21.15.72:0/3683579391 learned_addr learned my addr 172.21.15.72:0/3683579391 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:02.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.177+0000 7f0a7e7fc640 1 -- 172.21.15.72:0/3683579391 >> v2:172.21.15.72:3300/0 conn(0x7f0a80159b50 msgr2=0x7f0a800c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:02.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.177+0000 7f0a7e7fc640 1 --2- 172.21.15.72:0/3683579391 >> v2:172.21.15.72:3300/0 conn(0x7f0a80159b50 0x7f0a800c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.177+0000 7f0a7e7fc640 1 -- 172.21.15.72:0/3683579391 >> v1:172.21.15.72:6789/0 conn(0x7f0a800cda70 legacy=0x7f0a800ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:02.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.177+0000 7f0a7e7fc640 1 -- 172.21.15.72:0/3683579391 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a800cb4e0 con 0x7f0a800cc420 2023-12-13T00:28:02.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.180+0000 7f0a7e7fc640 1 --2- 172.21.15.72:0/3683579391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800cc420 0x7f0a80159610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0a740097a0 tx=0x7f0a7402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aea1b9bf3cd1bf1 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:02.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.183+0000 7f0a7dffb640 1 -- 172.21.15.72:0/3683579391 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74030610 con 0x7f0a800cc420 2023-12-13T00:28:02.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.184+0000 7f0a7dffb640 1 -- 172.21.15.72:0/3683579391 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a74030770 con 0x7f0a800cc420 2023-12-13T00:28:02.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.184+0000 7f0a7dffb640 1 -- 172.21.15.72:0/3683579391 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74030b00 con 0x7f0a800cc420 2023-12-13T00:28:02.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.184+0000 7f0a85694640 1 -- 172.21.15.72:0/3683579391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800cc420 msgr2=0x7f0a80159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:02.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.184+0000 7f0a85694640 1 --2- 172.21.15.72:0/3683579391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800cc420 0x7f0a80159610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0a740097a0 tx=0x7f0a7402b960 comp rx=0 tx=0).stop 2023-12-13T00:28:02.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.184+0000 7f0a85694640 1 -- 172.21.15.72:0/3683579391 shutdown_connections 2023-12-13T00:28:02.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.184+0000 7f0a85694640 1 --2- 172.21.15.72:0/3683579391 >> v2:172.21.15.72:3300/0 conn(0x7f0a80159b50 0x7f0a800c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.184+0000 7f0a85694640 1 --2- 172.21.15.72:0/3683579391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800cc420 0x7f0a80159610 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.184+0000 7f0a85694640 1 -- 172.21.15.72:0/3683579391 >> 172.21.15.72:0/3683579391 conn(0x7f0a800b07b0 msgr2=0x7f0a800b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:02.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.184+0000 7f0a85694640 1 -- 172.21.15.72:0/3683579391 shutdown_connections 2023-12-13T00:28:02.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.184+0000 7f0a85694640 1 -- 172.21.15.72:0/3683579391 wait complete. 2023-12-13T00:28:02.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.186+0000 7f0a85694640 1 Processor -- start 2023-12-13T00:28:02.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.186+0000 7f0a85694640 1 -- start start 2023-12-13T00:28:02.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.186+0000 7f0a85694640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800cc420 0x7f0a801f0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:02.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.186+0000 7f0a85694640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a800cda70 0x7f0a800ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:02.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.186+0000 7f0a85694640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a80159b50 0x7f0a801ef090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:02.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.186+0000 7f0a85694640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a800b3a00 con 0x7f0a80159b50 2023-12-13T00:28:02.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.186+0000 7f0a85694640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a800b2890 con 0x7f0a800cda70 2023-12-13T00:28:02.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.186+0000 7f0a85694640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a800b2aa0 con 0x7f0a800cc420 2023-12-13T00:28:02.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.187+0000 7f0a7effd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800cc420 0x7f0a801f0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:02.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.187+0000 7f0a7f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a80159b50 0x7f0a801ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:02.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.187+0000 7f0a7e7fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a800cda70 0x7f0a800ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:02.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.187+0000 7f0a7f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a80159b50 0x7f0a801ef090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46020/0 (socket says 172.21.15.72:46020) 2023-12-13T00:28:02.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.187+0000 7f0a7f7fe640 1 -- 172.21.15.72:0/1718849705 learned_addr learned my addr 172.21.15.72:0/1718849705 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:02.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.190+0000 7f0a7effd640 1 -- 172.21.15.72:0/1718849705 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a800cda70 msgr2=0x7f0a800ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:02.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.190+0000 7f0a7effd640 1 --2- 172.21.15.72:0/1718849705 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a800cda70 0x7f0a800ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.191+0000 7f0a7effd640 1 -- 172.21.15.72:0/1718849705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a80159b50 msgr2=0x7f0a801ef090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:02.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.191+0000 7f0a7effd640 1 --2- 172.21.15.72:0/1718849705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a80159b50 0x7f0a801ef090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.191+0000 7f0a7effd640 1 -- 172.21.15.72:0/1718849705 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a74009400 con 0x7f0a800cc420 2023-12-13T00:28:02.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.193+0000 7f0a7effd640 1 --2- 172.21.15.72:0/1718849705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800cc420 0x7f0a801f0500 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000c730 tx=0x7f0a7000cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:02.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.196+0000 7f0a677fe640 1 -- 172.21.15.72:0/1718849705 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70006d50 con 0x7f0a800cc420 2023-12-13T00:28:02.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.196+0000 7f0a677fe640 1 -- 172.21.15.72:0/1718849705 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7000ce40 con 0x7f0a800cc420 2023-12-13T00:28:02.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.196+0000 7f0a677fe640 1 -- 172.21.15.72:0/1718849705 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70003bb0 con 0x7f0a800cc420 2023-12-13T00:28:02.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.196+0000 7f0a85694640 1 -- 172.21.15.72:0/1718849705 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a800b2d80 con 0x7f0a800cc420 2023-12-13T00:28:02.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.196+0000 7f0a85694640 1 -- 172.21.15.72:0/1718849705 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a800b3340 con 0x7f0a800cc420 2023-12-13T00:28:02.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.197+0000 7f0a85694640 1 -- 172.21.15.72:0/1718849705 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a80067470 con 0x7f0a800cc420 2023-12-13T00:28:02.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.216+0000 7f0a677fe640 1 -- 172.21.15.72:0/1718849705 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0a70003d10 con 0x7f0a800cc420 2023-12-13T00:28:02.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.216+0000 7f0a677fe640 1 --2- 172.21.15.72:0/1718849705 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0a6c06b1f0 0x7f0a6c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:02.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.217+0000 7f0a7e7fc640 1 --2- 172.21.15.72:0/1718849705 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0a6c06b1f0 0x7f0a6c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:02.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.217+0000 7f0a7e7fc640 1 --2- 172.21.15.72:0/1718849705 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0a6c06b1f0 0x7f0a6c06d6b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0a74036000 tx=0x7f0a74008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:02.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.219+0000 7f0a677fe640 1 -- 172.21.15.72:0/1718849705 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f0a70058cc0 con 0x7f0a800cc420 2023-12-13T00:28:02.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.476+0000 7f0a677fe640 1 -- 172.21.15.72:0/1718849705 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0a70058a90 con 0x7f0a800cc420 2023-12-13T00:28:02.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.642+0000 7f0a85694640 1 -- 172.21.15.72:0/1718849705 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a800b4c20 con 0x7f0a800cc420 2023-12-13T00:28:02.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.663+0000 7f0a677fe640 1 -- 172.21.15.72:0/1718849705 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a70058620 con 0x7f0a800cc420 2023-12-13T00:28:02.663 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-12-13T00:28:02.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.665+0000 7f0a85694640 1 -- 172.21.15.72:0/1718849705 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0a6c06b1f0 msgr2=0x7f0a6c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:02.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.665+0000 7f0a85694640 1 --2- 172.21.15.72:0/1718849705 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0a6c06b1f0 0x7f0a6c06d6b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0a74036000 tx=0x7f0a74008030 comp rx=0 tx=0).stop 2023-12-13T00:28:02.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.665+0000 7f0a85694640 1 -- 172.21.15.72:0/1718849705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800cc420 msgr2=0x7f0a801f0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:02.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.665+0000 7f0a85694640 1 --2- 172.21.15.72:0/1718849705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800cc420 0x7f0a801f0500 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000c730 tx=0x7f0a7000cbf0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.665+0000 7f0a85694640 1 -- 172.21.15.72:0/1718849705 shutdown_connections 2023-12-13T00:28:02.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.665+0000 7f0a85694640 1 --2- 172.21.15.72:0/1718849705 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0a6c06b1f0 0x7f0a6c06d6b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.665+0000 7f0a85694640 1 --2- 172.21.15.72:0/1718849705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a80159b50 0x7f0a801ef090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.665+0000 7f0a85694640 1 --2- 172.21.15.72:0/1718849705 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a800cda70 0x7f0a800ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.665+0000 7f0a85694640 1 --2- 172.21.15.72:0/1718849705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800cc420 0x7f0a801f0500 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.665+0000 7f0a85694640 1 -- 172.21.15.72:0/1718849705 >> 172.21.15.72:0/1718849705 conn(0x7f0a800b07b0 msgr2=0x7f0a800c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:02.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.665+0000 7f0a85694640 1 -- 172.21.15.72:0/1718849705 shutdown_connections 2023-12-13T00:28:02.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.665+0000 7f0a85694640 1 -- 172.21.15.72:0/1718849705 wait complete. 2023-12-13T00:28:02.677 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-13T00:28:02.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.778+0000 7f4925eb4640 1 Processor -- start 2023-12-13T00:28:02.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.778+0000 7f4925eb4640 1 -- start start 2023-12-13T00:28:02.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.779+0000 7f4925eb4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49200c59e0 0x7f492006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:02.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.779+0000 7f4925eb4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f492015d0d0 0x7f492006a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:02.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.779+0000 7f4925eb4640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4920159f80 con 0x7f492006a4b0 2023-12-13T00:28:02.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.779+0000 7f4925eb4640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492006adf0 con 0x7f492015d0d0 2023-12-13T00:28:02.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.779+0000 7f4925eb4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49201593d0 con 0x7f49200c59e0 2023-12-13T00:28:02.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.780+0000 7f491ffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f492015d0d0 0x7f492006a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:02.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.780+0000 7f491f7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49200c59e0 0x7f492006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:02.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.780+0000 7f491f7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49200c59e0 0x7f492006d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:34062/0 (socket says 172.21.15.72:34062) 2023-12-13T00:28:02.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.780+0000 7f491f7fe640 1 -- 172.21.15.72:0/97543213 learned_addr learned my addr 172.21.15.72:0/97543213 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:02.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.782+0000 7f491f7fe640 1 -- 172.21.15.72:0/97543213 >> v2:172.21.15.72:3300/0 conn(0x7f492015d0d0 msgr2=0x7f492006a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:02.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.782+0000 7f491f7fe640 1 --2- 172.21.15.72:0/97543213 >> v2:172.21.15.72:3300/0 conn(0x7f492015d0d0 0x7f492006a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.782+0000 7f491f7fe640 1 -- 172.21.15.72:0/97543213 >> v1:172.21.15.72:6789/0 conn(0x7f492006a4b0 legacy=0x7f492015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:02.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.782+0000 7f491f7fe640 1 -- 172.21.15.72:0/97543213 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4920072650 con 0x7f49200c59e0 2023-12-13T00:28:02.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.784+0000 7f491f7fe640 1 --2- 172.21.15.72:0/97543213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49200c59e0 0x7f492006d9b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4910009870 tx=0x7f491002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=575f8d79270571d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:02.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.788+0000 7f491e7fc640 1 -- 172.21.15.72:0/97543213 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491002f840 con 0x7f49200c59e0 2023-12-13T00:28:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.788+0000 7f491e7fc640 1 -- 172.21.15.72:0/97543213 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491002f9a0 con 0x7f49200c59e0 2023-12-13T00:28:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.788+0000 7f491e7fc640 1 -- 172.21.15.72:0/97543213 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491002fd30 con 0x7f49200c59e0 2023-12-13T00:28:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.789+0000 7f4925eb4640 1 -- 172.21.15.72:0/97543213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49200c59e0 msgr2=0x7f492006d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:02.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.789+0000 7f4925eb4640 1 --2- 172.21.15.72:0/97543213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49200c59e0 0x7f492006d9b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4910009870 tx=0x7f491002ba20 comp rx=0 tx=0).stop 2023-12-13T00:28:02.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.789+0000 7f4925eb4640 1 -- 172.21.15.72:0/97543213 shutdown_connections 2023-12-13T00:28:02.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.789+0000 7f4925eb4640 1 --2- 172.21.15.72:0/97543213 >> v2:172.21.15.72:3300/0 conn(0x7f492015d0d0 0x7f492006a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.789+0000 7f4925eb4640 1 --2- 172.21.15.72:0/97543213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49200c59e0 0x7f492006d9b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.789+0000 7f4925eb4640 1 -- 172.21.15.72:0/97543213 >> 172.21.15.72:0/97543213 conn(0x7f492006f6d0 msgr2=0x7f492006fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:02.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.789+0000 7f4925eb4640 1 -- 172.21.15.72:0/97543213 shutdown_connections 2023-12-13T00:28:02.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.789+0000 7f4925eb4640 1 -- 172.21.15.72:0/97543213 wait complete. 2023-12-13T00:28:02.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.790+0000 7f4925eb4640 1 Processor -- start 2023-12-13T00:28:02.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.790+0000 7f4925eb4640 1 -- start start 2023-12-13T00:28:02.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.791+0000 7f4925eb4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f492006a4b0 0x7f492014bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:02.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.791+0000 7f4925eb4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49200c59e0 0x7f49201ef1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:02.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.791+0000 7f4925eb4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f492015c610 0x7f492015a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:02.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.791+0000 7f4925eb4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4920158e40 con 0x7f49200c59e0 2023-12-13T00:28:02.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.791+0000 7f4925eb4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4920146f90 con 0x7f492015c610 2023-12-13T00:28:02.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.791+0000 7f4925eb4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49201efad0 con 0x7f492006a4b0 2023-12-13T00:28:02.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.791+0000 7f491f7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f492006a4b0 0x7f492014bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:02.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.791+0000 7f491ffff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f492015c610 0x7f492015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:02.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.791+0000 7f491effd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49200c59e0 0x7f49201ef1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:02.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.792+0000 7f491f7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f492006a4b0 0x7f492014bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:34074/0 (socket says 172.21.15.72:34074) 2023-12-13T00:28:02.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.792+0000 7f491f7fe640 1 -- 172.21.15.72:0/662132013 learned_addr learned my addr 172.21.15.72:0/662132013 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.795+0000 7f491f7fe640 1 -- 172.21.15.72:0/662132013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f492015c610 msgr2=0x7f492015a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.795+0000 7f491f7fe640 1 --2- 172.21.15.72:0/662132013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f492015c610 0x7f492015a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.795+0000 7f491f7fe640 1 -- 172.21.15.72:0/662132013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49200c59e0 msgr2=0x7f49201ef1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.795+0000 7f491f7fe640 1 --2- 172.21.15.72:0/662132013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49200c59e0 0x7f49201ef1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.795+0000 7f491f7fe640 1 -- 172.21.15.72:0/662132013 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49100094d0 con 0x7f492006a4b0 2023-12-13T00:28:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.797+0000 7f491f7fe640 1 --2- 172.21.15.72:0/662132013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f492006a4b0 0x7f492014bf80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4910009990 tx=0x7f49100046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.799+0000 7f4907fff640 1 -- 172.21.15.72:0/662132013 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491003b040 con 0x7f492006a4b0 2023-12-13T00:28:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.799+0000 7f4925eb4640 1 -- 172.21.15.72:0/662132013 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49201efd90 con 0x7f492006a4b0 2023-12-13T00:28:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.799+0000 7f4925eb4640 1 -- 172.21.15.72:0/662132013 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49201e2ca0 con 0x7f492006a4b0 2023-12-13T00:28:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.800+0000 7f4925eb4640 1 -- 172.21.15.72:0/662132013 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4920067d90 con 0x7f492006a4b0 2023-12-13T00:28:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.801+0000 7f4907fff640 1 -- 172.21.15.72:0/662132013 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491004b460 con 0x7f492006a4b0 2023-12-13T00:28:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:02.801+0000 7f4907fff640 1 -- 172.21.15.72:0/662132013 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491004b7d0 con 0x7f492006a4b0 2023-12-13T00:28:03.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.049+0000 7f4907fff640 1 -- 172.21.15.72:0/662132013 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f491004b930 con 0x7f492006a4b0 2023-12-13T00:28:03.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.049+0000 7f4907fff640 1 --2- 172.21.15.72:0/662132013 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f490c06b1f0 0x7f490c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:03.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.050+0000 7f491effd640 1 --2- 172.21.15.72:0/662132013 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f490c06b1f0 0x7f490c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:03.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.050+0000 7f491effd640 1 --2- 172.21.15.72:0/662132013 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f490c06b1f0 0x7f490c06d6b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f492014d9d0 tx=0x7f4914009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:03.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.053+0000 7f4907fff640 1 -- 172.21.15.72:0/662132013 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f4910042e30 con 0x7f492006a4b0 2023-12-13T00:28:03.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.064+0000 7f4907fff640 1 -- 172.21.15.72:0/662132013 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4910078280 con 0x7f492006a4b0 2023-12-13T00:28:03.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.252+0000 7f4925eb4640 1 -- 172.21.15.72:0/662132013 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4920067470 con 0x7f492006a4b0 2023-12-13T00:28:03.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.257+0000 7f4907fff640 1 -- 172.21.15.72:0/662132013 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f491007b8a0 con 0x7f492006a4b0 2023-12-13T00:28:03.258 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-12-13T00:28:03.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.259+0000 7f4925eb4640 1 -- 172.21.15.72:0/662132013 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f490c06b1f0 msgr2=0x7f490c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:03.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.259+0000 7f4925eb4640 1 --2- 172.21.15.72:0/662132013 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f490c06b1f0 0x7f490c06d6b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f492014d9d0 tx=0x7f4914009040 comp rx=0 tx=0).stop 2023-12-13T00:28:03.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.259+0000 7f4925eb4640 1 -- 172.21.15.72:0/662132013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f492006a4b0 msgr2=0x7f492014bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:03.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.259+0000 7f4925eb4640 1 --2- 172.21.15.72:0/662132013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f492006a4b0 0x7f492014bf80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4910009990 tx=0x7f49100046c0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.260+0000 7f4925eb4640 1 -- 172.21.15.72:0/662132013 shutdown_connections 2023-12-13T00:28:03.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.260+0000 7f4925eb4640 1 --2- 172.21.15.72:0/662132013 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f490c06b1f0 0x7f490c06d6b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.260+0000 7f4925eb4640 1 --2- 172.21.15.72:0/662132013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f492015c610 0x7f492015a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.260+0000 7f4925eb4640 1 --2- 172.21.15.72:0/662132013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49200c59e0 0x7f49201ef1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.260+0000 7f4925eb4640 1 --2- 172.21.15.72:0/662132013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f492006a4b0 0x7f492014bf80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.260+0000 7f4925eb4640 1 -- 172.21.15.72:0/662132013 >> 172.21.15.72:0/662132013 conn(0x7f492006f6d0 msgr2=0x7f4920158480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:03.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.260+0000 7f4925eb4640 1 -- 172.21.15.72:0/662132013 shutdown_connections 2023-12-13T00:28:03.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.260+0000 7f4925eb4640 1 -- 172.21.15.72:0/662132013 wait complete. 2023-12-13T00:28:03.272 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-13T00:28:03.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.376+0000 7f5058431640 1 Processor -- start 2023-12-13T00:28:03.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.376+0000 7f5058431640 1 -- start start 2023-12-13T00:28:03.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.377+0000 7f5058431640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f50500cda70 0x7f50500ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:03.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.377+0000 7f5058431640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50500cc420 0x7f5050159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:03.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.377+0000 7f5058431640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50500cbda0 con 0x7f5050159b50 2023-12-13T00:28:03.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.377+0000 7f5058431640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50500cc230 con 0x7f50500cda70 2023-12-13T00:28:03.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.377+0000 7f5058431640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50500cb4e0 con 0x7f50500cc420 2023-12-13T00:28:03.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.378+0000 7f50561cd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f50500cda70 0x7f50500ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:03.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.378+0000 7f50569ce640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5050159b50 0x7f50500c9620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46008/0 (socket says 172.21.15.72:46008) 2023-12-13T00:28:03.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.378+0000 7f50569ce640 1 -- 172.21.15.72:0/3835575834 learned_addr learned my addr 172.21.15.72:0/3835575834 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:28:03.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.378+0000 7f50559cc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50500cc420 0x7f5050159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:03.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.380+0000 7f50561cd640 1 -- 172.21.15.72:0/3835575834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50500cc420 msgr2=0x7f5050159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:03.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.380+0000 7f50561cd640 1 --2- 172.21.15.72:0/3835575834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50500cc420 0x7f5050159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.380+0000 7f50561cd640 1 -- 172.21.15.72:0/3835575834 >> v1:172.21.15.72:6789/0 conn(0x7f5050159b50 legacy=0x7f50500c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:03.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.380+0000 7f50561cd640 1 -- 172.21.15.72:0/3835575834 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50500cce00 con 0x7f50500cda70 2023-12-13T00:28:03.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.382+0000 7f50561cd640 1 --2- 172.21.15.72:0/3835575834 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50500cda70 0x7f50500ce350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f50400097a0 tx=0x7f504002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b757afd6de699c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:03.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.384+0000 7f50551cb640 1 -- 172.21.15.72:0/3835575834 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040030610 con 0x7f50500cda70 2023-12-13T00:28:03.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.385+0000 7f50551cb640 1 -- 172.21.15.72:0/3835575834 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5040030770 con 0x7f50500cda70 2023-12-13T00:28:03.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.386+0000 7f50551cb640 1 -- 172.21.15.72:0/3835575834 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040030b00 con 0x7f50500cda70 2023-12-13T00:28:03.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.386+0000 7f5058431640 1 -- 172.21.15.72:0/3835575834 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50500cda70 msgr2=0x7f50500ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:03.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.386+0000 7f5058431640 1 --2- 172.21.15.72:0/3835575834 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50500cda70 0x7f50500ce350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f50400097a0 tx=0x7f504002b960 comp rx=0 tx=0).stop 2023-12-13T00:28:03.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.386+0000 7f5058431640 1 -- 172.21.15.72:0/3835575834 shutdown_connections 2023-12-13T00:28:03.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.386+0000 7f5058431640 1 --2- 172.21.15.72:0/3835575834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50500cc420 0x7f5050159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.386+0000 7f5058431640 1 --2- 172.21.15.72:0/3835575834 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50500cda70 0x7f50500ce350 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.386+0000 7f5058431640 1 -- 172.21.15.72:0/3835575834 >> 172.21.15.72:0/3835575834 conn(0x7f50500b07b0 msgr2=0x7f50500b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:03.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.386+0000 7f5058431640 1 -- 172.21.15.72:0/3835575834 shutdown_connections 2023-12-13T00:28:03.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.386+0000 7f5058431640 1 -- 172.21.15.72:0/3835575834 wait complete. 2023-12-13T00:28:03.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.387+0000 7f5058431640 1 Processor -- start 2023-12-13T00:28:03.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.388+0000 7f5058431640 1 -- start start 2023-12-13T00:28:03.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.388+0000 7f5058431640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50500cc420 0x7f5050156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:03.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.388+0000 7f5058431640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50500cda70 0x7f5050157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:03.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.388+0000 7f5058431640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5050159b50 0x7f50500c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:03.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.388+0000 7f5058431640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5050156ca0 con 0x7f50500cda70 2023-12-13T00:28:03.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.388+0000 7f5058431640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50501f2390 con 0x7f5050159b50 2023-12-13T00:28:03.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.388+0000 7f5058431640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50501f31f0 con 0x7f50500cc420 2023-12-13T00:28:03.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.389+0000 7f50559cc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50500cda70 0x7f5050157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:03.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.389+0000 7f50569ce640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5050159b50 0x7f50500c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:03.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.389+0000 7f50561cd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50500cc420 0x7f5050156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:03.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.389+0000 7f50559cc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50500cda70 0x7f5050157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46046/0 (socket says 172.21.15.72:46046) 2023-12-13T00:28:03.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.389+0000 7f50559cc640 1 -- 172.21.15.72:0/1687469927 learned_addr learned my addr 172.21.15.72:0/1687469927 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:03.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.392+0000 7f50559cc640 1 -- 172.21.15.72:0/1687469927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50500cc420 msgr2=0x7f5050156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:03.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.392+0000 7f50559cc640 1 --2- 172.21.15.72:0/1687469927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50500cc420 0x7f5050156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.392+0000 7f50559cc640 1 -- 172.21.15.72:0/1687469927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5050159b50 msgr2=0x7f50500c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:03.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.392+0000 7f50559cc640 1 --2- 172.21.15.72:0/1687469927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5050159b50 0x7f50500c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.392+0000 7f50559cc640 1 -- 172.21.15.72:0/1687469927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5040009400 con 0x7f50500cda70 2023-12-13T00:28:03.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.395+0000 7f50559cc640 1 --2- 172.21.15.72:0/1687469927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50500cda70 0x7f5050157470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f504c00e840 tx=0x7f504c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:03.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.398+0000 7f5046ffd640 1 -- 172.21.15.72:0/1687469927 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c0094f0 con 0x7f50500cda70 2023-12-13T00:28:03.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.398+0000 7f5046ffd640 1 -- 172.21.15.72:0/1687469927 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c00c940 con 0x7f50500cda70 2023-12-13T00:28:03.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.398+0000 7f5058431640 1 -- 172.21.15.72:0/1687469927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50501f25e0 con 0x7f50500cda70 2023-12-13T00:28:03.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.398+0000 7f5046ffd640 1 -- 172.21.15.72:0/1687469927 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c00ccd0 con 0x7f50500cda70 2023-12-13T00:28:03.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.398+0000 7f5058431640 1 -- 172.21.15.72:0/1687469927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50501f2ba0 con 0x7f50500cda70 2023-12-13T00:28:03.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.400+0000 7f5058431640 1 -- 172.21.15.72:0/1687469927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50501eee70 con 0x7f50500cda70 2023-12-13T00:28:03.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.639+0000 7f5046ffd640 1 -- 172.21.15.72:0/1687469927 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f504c013470 con 0x7f50500cda70 2023-12-13T00:28:03.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.639+0000 7f5046ffd640 1 --2- 172.21.15.72:0/1687469927 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f503406b240 0x7f503406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:03.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.640+0000 7f50561cd640 1 --2- 172.21.15.72:0/1687469927 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f503406b240 0x7f503406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:03.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.640+0000 7f50561cd640 1 --2- 172.21.15.72:0/1687469927 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f503406b240 0x7f503406d700 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5040036000 tx=0x7f5040008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.653+0000 7f5046ffd640 1 -- 172.21.15.72:0/1687469927 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f504c00ce30 con 0x7f50500cda70 2023-12-13T00:28:03.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.653+0000 7f5046ffd640 1 -- 172.21.15.72:0/1687469927 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f504c054fa0 con 0x7f50500cda70 2023-12-13T00:28:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.822+0000 7f5058431640 1 -- 172.21.15.72:0/1687469927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5050067470 con 0x7f50500cda70 2023-12-13T00:28:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.826+0000 7f5046ffd640 1 -- 172.21.15.72:0/1687469927 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f504c0210a0 con 0x7f50500cda70 2023-12-13T00:28:03.827 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-12-13T00:28:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.829+0000 7f5058431640 1 -- 172.21.15.72:0/1687469927 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f503406b240 msgr2=0x7f503406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.829+0000 7f5058431640 1 --2- 172.21.15.72:0/1687469927 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f503406b240 0x7f503406d700 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5040036000 tx=0x7f5040008030 comp rx=0 tx=0).stop 2023-12-13T00:28:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.829+0000 7f5058431640 1 -- 172.21.15.72:0/1687469927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50500cda70 msgr2=0x7f5050157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.829+0000 7f5058431640 1 --2- 172.21.15.72:0/1687469927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50500cda70 0x7f5050157470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f504c00e840 tx=0x7f504c00ed00 comp rx=0 tx=0).stop 2023-12-13T00:28:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.829+0000 7f5058431640 1 -- 172.21.15.72:0/1687469927 shutdown_connections 2023-12-13T00:28:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.829+0000 7f5058431640 1 --2- 172.21.15.72:0/1687469927 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f503406b240 0x7f503406d700 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.829+0000 7f5058431640 1 --2- 172.21.15.72:0/1687469927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5050159b50 0x7f50500c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.829+0000 7f5058431640 1 --2- 172.21.15.72:0/1687469927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50500cda70 0x7f5050157470 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.829+0000 7f5058431640 1 --2- 172.21.15.72:0/1687469927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50500cc420 0x7f5050156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.829+0000 7f5058431640 1 -- 172.21.15.72:0/1687469927 >> 172.21.15.72:0/1687469927 conn(0x7f50500b07b0 msgr2=0x7f50500cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.829+0000 7f5058431640 1 -- 172.21.15.72:0/1687469927 shutdown_connections 2023-12-13T00:28:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.829+0000 7f5058431640 1 -- 172.21.15.72:0/1687469927 wait complete. 2023-12-13T00:28:03.841 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-13T00:28:03.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.945+0000 7fbb48a9b640 1 Processor -- start 2023-12-13T00:28:03.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.946+0000 7fbb48a9b640 1 -- start start 2023-12-13T00:28:03.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.946+0000 7fbb48a9b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbb440cc420 0x7fbb44159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:03.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.946+0000 7fbb48a9b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb440cbda0 con 0x7fbb440cda70 2023-12-13T00:28:03.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.946+0000 7fbb48a9b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb440cea60 con 0x7fbb44159b50 2023-12-13T00:28:03.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.946+0000 7fbb48a9b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb440cc230 con 0x7fbb440cc420 2023-12-13T00:28:03.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.947+0000 7fbb4259c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbb440cda70 0x7fbb440ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46014/0 (socket says 172.21.15.72:46014) 2023-12-13T00:28:03.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.947+0000 7fbb4259c640 1 -- 172.21.15.72:0/3176603186 learned_addr learned my addr 172.21.15.72:0/3176603186 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:28:03.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.947+0000 7fbb41d9b640 1 --2- 172.21.15.72:0/3176603186 >> v2:172.21.15.176:3300/0 conn(0x7fbb440cc420 0x7fbb44159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.950+0000 7fbb4159a640 1 -- 172.21.15.72:0/3176603186 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414255013 0 0) 0x7fbb440cbda0 con 0x7fbb440cda70 2023-12-13T00:28:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.950+0000 7fbb4159a640 1 -- 172.21.15.72:0/3176603186 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb2c003520 con 0x7fbb440cda70 2023-12-13T00:28:03.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.952+0000 7fbb41d9b640 1 -- 172.21.15.72:0/3176603186 >> v1:172.21.15.176:6789/0 conn(0x7fbb44159b50 legacy=0x7fbb440c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:03.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.952+0000 7fbb41d9b640 1 -- 172.21.15.72:0/3176603186 >> v1:172.21.15.72:6789/0 conn(0x7fbb440cda70 legacy=0x7fbb440ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:03.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.952+0000 7fbb41d9b640 1 -- 172.21.15.72:0/3176603186 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb440cb4e0 con 0x7fbb440cc420 2023-12-13T00:28:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.955+0000 7fbb41d9b640 1 --2- 172.21.15.72:0/3176603186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb440cc420 0x7fbb44159610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbb340097a0 tx=0x7fbb3402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe0987c84f40b02c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.960+0000 7fbb4159a640 1 -- 172.21.15.72:0/3176603186 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3402f810 con 0x7fbb440cc420 2023-12-13T00:28:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.960+0000 7fbb4159a640 1 -- 172.21.15.72:0/3176603186 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3402f970 con 0x7fbb440cc420 2023-12-13T00:28:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.960+0000 7fbb4159a640 1 -- 172.21.15.72:0/3176603186 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3402fd00 con 0x7fbb440cc420 2023-12-13T00:28:03.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.961+0000 7fbb48a9b640 1 -- 172.21.15.72:0/3176603186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb440cc420 msgr2=0x7fbb44159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:03.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.961+0000 7fbb48a9b640 1 --2- 172.21.15.72:0/3176603186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb440cc420 0x7fbb44159610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbb340097a0 tx=0x7fbb3402b9f0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.961+0000 7fbb48a9b640 1 -- 172.21.15.72:0/3176603186 shutdown_connections 2023-12-13T00:28:03.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.961+0000 7fbb48a9b640 1 --2- 172.21.15.72:0/3176603186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb440cc420 0x7fbb44159610 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.961+0000 7fbb48a9b640 1 -- 172.21.15.72:0/3176603186 >> 172.21.15.72:0/3176603186 conn(0x7fbb440b07b0 msgr2=0x7fbb440b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:03.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.961+0000 7fbb48a9b640 1 -- 172.21.15.72:0/3176603186 shutdown_connections 2023-12-13T00:28:03.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.961+0000 7fbb48a9b640 1 -- 172.21.15.72:0/3176603186 wait complete. 2023-12-13T00:28:03.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.962+0000 7fbb48a9b640 1 Processor -- start 2023-12-13T00:28:03.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.962+0000 7fbb48a9b640 1 -- start start 2023-12-13T00:28:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.963+0000 7fbb48a9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb440cc420 0x7fbb440c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:03.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.963+0000 7fbb48a9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb440cda70 0x7fbb44158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:03.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.963+0000 7fbb48a9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb44159b50 0x7fbb441500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:03.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.963+0000 7fbb48a9b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb44154260 con 0x7fbb44159b50 2023-12-13T00:28:03.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.963+0000 7fbb48a9b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb440b2680 con 0x7fbb440cc420 2023-12-13T00:28:03.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.963+0000 7fbb48a9b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb440c52b0 con 0x7fbb440cda70 2023-12-13T00:28:03.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.963+0000 7fbb42d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb44159b50 0x7fbb441500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:03.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.963+0000 7fbb4259c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb440cc420 0x7fbb440c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:03.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.964+0000 7fbb41d9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb440cda70 0x7fbb44158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:03.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.964+0000 7fbb4259c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb440cc420 0x7fbb440c4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:57376/0 (socket says 172.21.15.72:57376) 2023-12-13T00:28:03.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.964+0000 7fbb4259c640 1 -- 172.21.15.72:0/1650140572 learned_addr learned my addr 172.21.15.72:0/1650140572 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:03.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.967+0000 7fbb4259c640 1 -- 172.21.15.72:0/1650140572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb440cda70 msgr2=0x7fbb44158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:03.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.967+0000 7fbb4259c640 1 --2- 172.21.15.72:0/1650140572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb440cda70 0x7fbb44158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.967+0000 7fbb4259c640 1 -- 172.21.15.72:0/1650140572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb44159b50 msgr2=0x7fbb441500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:03.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.967+0000 7fbb4259c640 1 --2- 172.21.15.72:0/1650140572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb44159b50 0x7fbb441500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:03.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.967+0000 7fbb4259c640 1 -- 172.21.15.72:0/1650140572 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb34009400 con 0x7fbb440cc420 2023-12-13T00:28:03.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.967+0000 7fbb42d9d640 1 --2- 172.21.15.72:0/1650140572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb44159b50 0x7fbb441500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T00:28:03.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.969+0000 7fbb4259c640 1 --2- 172.21.15.72:0/1650140572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb440cc420 0x7fbb440c4710 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800c500 tx=0x7fbb3800c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:03.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.973+0000 7fbb32ffd640 1 -- 172.21.15.72:0/1650140572 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb38005ce0 con 0x7fbb440cc420 2023-12-13T00:28:03.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.973+0000 7fbb32ffd640 1 -- 172.21.15.72:0/1650140572 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb38005e40 con 0x7fbb440cc420 2023-12-13T00:28:03.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.973+0000 7fbb32ffd640 1 -- 172.21.15.72:0/1650140572 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb38007330 con 0x7fbb440cc420 2023-12-13T00:28:03.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.973+0000 7fbb48a9b640 1 -- 172.21.15.72:0/1650140572 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb441598c0 con 0x7fbb440cc420 2023-12-13T00:28:03.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.973+0000 7fbb48a9b640 1 -- 172.21.15.72:0/1650140572 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb440c4fd0 con 0x7fbb440cc420 2023-12-13T00:28:03.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.974+0000 7fbb48a9b640 1 -- 172.21.15.72:0/1650140572 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb44067470 con 0x7fbb440cc420 2023-12-13T00:28:03.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.994+0000 7fbb32ffd640 1 -- 172.21.15.72:0/1650140572 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbb38007550 con 0x7fbb440cc420 2023-12-13T00:28:03.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.994+0000 7fbb32ffd640 1 --2- 172.21.15.72:0/1650140572 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbb2406b210 0x7fbb2406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:03.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.994+0000 7fbb41d9b640 1 --2- 172.21.15.72:0/1650140572 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbb2406b210 0x7fbb2406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:03.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:03.995+0000 7fbb41d9b640 1 --2- 172.21.15.72:0/1650140572 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbb2406b210 0x7fbb2406d6d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbb34036000 tx=0x7fbb34008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:04.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:04.220+0000 7fbb32ffd640 1 -- 172.21.15.72:0/1650140572 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fbb380580d0 con 0x7fbb440cc420 2023-12-13T00:28:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:04.232+0000 7fbb32ffd640 1 -- 172.21.15.72:0/1650140572 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbb38054410 con 0x7fbb440cc420 2023-12-13T00:28:04.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:04.418+0000 7fbb48a9b640 1 -- 172.21.15.72:0/1650140572 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbb440b4c20 con 0x7fbb440cc420 2023-12-13T00:28:04.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:04.423+0000 7fbb32ffd640 1 -- 172.21.15.72:0/1650140572 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbb38057a30 con 0x7fbb440cc420 2023-12-13T00:28:04.425 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-12-13T00:28:04.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:04.425+0000 7fbb48a9b640 1 -- 172.21.15.72:0/1650140572 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbb2406b210 msgr2=0x7fbb2406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:04.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:04.425+0000 7fbb48a9b640 1 --2- 172.21.15.72:0/1650140572 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbb2406b210 0x7fbb2406d6d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbb34036000 tx=0x7fbb34008030 comp rx=0 tx=0).stop 2023-12-13T00:28:04.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:04.426+0000 7fbb48a9b640 1 -- 172.21.15.72:0/1650140572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb440cc420 msgr2=0x7fbb440c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:04.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:04.426+0000 7fbb48a9b640 1 --2- 172.21.15.72:0/1650140572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb440cc420 0x7fbb440c4710 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800c500 tx=0x7fbb3800c9c0 comp rx=0 tx=0).stop 2023-12-13T00:28:04.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:04.426+0000 7fbb48a9b640 1 -- 172.21.15.72:0/1650140572 shutdown_connections 2023-12-13T00:28:04.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:04.426+0000 7fbb48a9b640 1 --2- 172.21.15.72:0/1650140572 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbb2406b210 0x7fbb2406d6d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:04.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:04.426+0000 7fbb48a9b640 1 --2- 172.21.15.72:0/1650140572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb44159b50 0x7fbb441500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:04.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:04.426+0000 7fbb48a9b640 1 --2- 172.21.15.72:0/1650140572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb440cda70 0x7fbb44158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:04.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:04.426+0000 7fbb48a9b640 1 --2- 172.21.15.72:0/1650140572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb440cc420 0x7fbb440c4710 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:04.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:04.426+0000 7fbb48a9b640 1 -- 172.21.15.72:0/1650140572 >> 172.21.15.72:0/1650140572 conn(0x7fbb440b07b0 msgr2=0x7fbb440c6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:04.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:04.426+0000 7fbb48a9b640 1 -- 172.21.15.72:0/1650140572 shutdown_connections 2023-12-13T00:28:04.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:04.426+0000 7fbb48a9b640 1 -- 172.21.15.72:0/1650140572 wait complete. 2023-12-13T00:28:04.438 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2023-12-13T00:28:04.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:28:04.438 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-13T00:28:04.466 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:28:04.490 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[99551]: fuse finished with error 0 and tester_r 0 2023-12-13T00:28:05.297 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:==00:00:26:38.371 99551== 2023-12-13T00:28:05.297 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:==00:00:26:38.371 99551== Exit program on first error (--exit-on-first-error=yes) 2023-12-13T00:28:05.410 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:daemon-helper: command failed with exit status 42 2023-12-13T00:28:07.763 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:28:07.766 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:28:10.567 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-13T00:28:10.568 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-12-13T00:28:10.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:28:10.568 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-13T00:28:10.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:28:10.585 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-12-13T00:28:10.640 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-13T00:28:10.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:28:10.641 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T00:28:10.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T00:28:10.709 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-12-13T00:28:10.811 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-13T00:28:10.824 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-13T00:28:10.825 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T00:28:10.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.926+0000 7fc8c3890640 1 Processor -- start 2023-12-13T00:28:10.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.927+0000 7fc8c3890640 1 -- start start 2023-12-13T00:28:10.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.927+0000 7fc8c3890640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc8bc0cda70 0x7fc8bc0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:10.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.927+0000 7fc8c3890640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8bc0cc420 0x7fc8bc159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:10.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.927+0000 7fc8c3890640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc0cbda0 con 0x7fc8bc159b50 2023-12-13T00:28:10.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.927+0000 7fc8c3890640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc0cc230 con 0x7fc8bc0cc420 2023-12-13T00:28:10.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.927+0000 7fc8c3890640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc0cb4e0 con 0x7fc8bc0cda70 2023-12-13T00:28:10.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.928+0000 7fc8c162c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc8bc0cda70 0x7fc8bc0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:10.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.929+0000 7fc8c162c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc8bc0cda70 0x7fc8bc0ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:45058/0 (socket says 172.21.15.72:45058) 2023-12-13T00:28:10.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.929+0000 7fc8c162c640 1 -- 172.21.15.72:0/2477301854 learned_addr learned my addr 172.21.15.72:0/2477301854 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.931+0000 7fc8c0e2b640 1 --2- 172.21.15.72:0/2477301854 >> v2:172.21.15.72:3300/0 conn(0x7fc8bc0cc420 0x7fc8bc159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.931+0000 7fc8c162c640 1 -- 172.21.15.72:0/2477301854 >> v2:172.21.15.72:3300/0 conn(0x7fc8bc0cc420 msgr2=0x7fc8bc159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:10.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.931+0000 7fc8c162c640 1 --2- 172.21.15.72:0/2477301854 >> v2:172.21.15.72:3300/0 conn(0x7fc8bc0cc420 0x7fc8bc159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:10.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.931+0000 7fc8c162c640 1 -- 172.21.15.72:0/2477301854 >> v1:172.21.15.72:6789/0 conn(0x7fc8bc159b50 legacy=0x7fc8bc0c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:10.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.931+0000 7fc8c162c640 1 -- 172.21.15.72:0/2477301854 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc0cce00 con 0x7fc8bc0cda70 2023-12-13T00:28:10.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.934+0000 7fc8c162c640 1 --2- 172.21.15.72:0/2477301854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0cda70 0x7fc8bc0ce350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc072a20 tx=0x7fc8b802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=883f647252bbb640 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:10.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.938+0000 7fc8b3fff640 1 -- 172.21.15.72:0/2477301854 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8030860 con 0x7fc8bc0cda70 2023-12-13T00:28:10.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.938+0000 7fc8b3fff640 1 -- 172.21.15.72:0/2477301854 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b80309c0 con 0x7fc8bc0cda70 2023-12-13T00:28:10.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.938+0000 7fc8b3fff640 1 -- 172.21.15.72:0/2477301854 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8030d50 con 0x7fc8bc0cda70 2023-12-13T00:28:10.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.939+0000 7fc8c3890640 1 -- 172.21.15.72:0/2477301854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0cda70 msgr2=0x7fc8bc0ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:10.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.939+0000 7fc8c3890640 1 --2- 172.21.15.72:0/2477301854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0cda70 0x7fc8bc0ce350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc072a20 tx=0x7fc8b802b9a0 comp rx=0 tx=0).stop 2023-12-13T00:28:10.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.939+0000 7fc8c3890640 1 -- 172.21.15.72:0/2477301854 shutdown_connections 2023-12-13T00:28:10.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.939+0000 7fc8c3890640 1 --2- 172.21.15.72:0/2477301854 >> v2:172.21.15.72:3300/0 conn(0x7fc8bc0cc420 0x7fc8bc159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:10.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.939+0000 7fc8c3890640 1 --2- 172.21.15.72:0/2477301854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0cda70 0x7fc8bc0ce350 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:10.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.939+0000 7fc8c3890640 1 -- 172.21.15.72:0/2477301854 >> 172.21.15.72:0/2477301854 conn(0x7fc8bc0b07b0 msgr2=0x7fc8bc0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:10.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.939+0000 7fc8c3890640 1 -- 172.21.15.72:0/2477301854 shutdown_connections 2023-12-13T00:28:10.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.939+0000 7fc8c3890640 1 -- 172.21.15.72:0/2477301854 wait complete. 2023-12-13T00:28:10.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.940+0000 7fc8c3890640 1 Processor -- start 2023-12-13T00:28:10.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.940+0000 7fc8c3890640 1 -- start start 2023-12-13T00:28:10.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.941+0000 7fc8c3890640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8bc0cc420 0x7fc8bc1524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:10.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.941+0000 7fc8c3890640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0cda70 0x7fc8bc158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:10.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.941+0000 7fc8c3890640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc159b50 0x7fc8bc157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:10.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.941+0000 7fc8c3890640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc1ef260 con 0x7fc8bc159b50 2023-12-13T00:28:10.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.941+0000 7fc8c3890640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc1ef540 con 0x7fc8bc0cda70 2023-12-13T00:28:10.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.941+0000 7fc8c3890640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc1ef820 con 0x7fc8bc0cc420 2023-12-13T00:28:10.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.941+0000 7fc8c1e2d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc159b50 0x7fc8bc157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:10.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.942+0000 7fc8c0e2b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0cda70 0x7fc8bc158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:10.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.942+0000 7fc8c1e2d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc159b50 0x7fc8bc157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51422/0 (socket says 172.21.15.72:51422) 2023-12-13T00:28:10.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.942+0000 7fc8c1e2d640 1 -- 172.21.15.72:0/2645578159 learned_addr learned my addr 172.21.15.72:0/2645578159 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:10.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.942+0000 7fc8c162c640 1 --2- 172.21.15.72:0/2645578159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8bc0cc420 0x7fc8bc1524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:10.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.945+0000 7fc8c1e2d640 1 -- 172.21.15.72:0/2645578159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8bc0cc420 msgr2=0x7fc8bc1524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.945+0000 7fc8c1e2d640 1 --2- 172.21.15.72:0/2645578159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8bc0cc420 0x7fc8bc1524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.945+0000 7fc8c1e2d640 1 -- 172.21.15.72:0/2645578159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0cda70 msgr2=0x7fc8bc158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.945+0000 7fc8c1e2d640 1 --2- 172.21.15.72:0/2645578159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0cda70 0x7fc8bc158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.945+0000 7fc8c1e2d640 1 -- 172.21.15.72:0/2645578159 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b80094d0 con 0x7fc8bc159b50 2023-12-13T00:28:10.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.947+0000 7fc8c1e2d640 1 --2- 172.21.15.72:0/2645578159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc159b50 0x7fc8bc157380 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400b9e0 tx=0x7fc8b400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:10.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.951+0000 7fc8b1ffb640 1 -- 172.21.15.72:0/2645578159 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4003b70 con 0x7fc8bc159b50 2023-12-13T00:28:10.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.951+0000 7fc8b1ffb640 1 -- 172.21.15.72:0/2645578159 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b4003cd0 con 0x7fc8bc159b50 2023-12-13T00:28:10.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.951+0000 7fc8c3890640 1 -- 172.21.15.72:0/2645578159 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc1efb00 con 0x7fc8bc159b50 2023-12-13T00:28:10.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.951+0000 7fc8b1ffb640 1 -- 172.21.15.72:0/2645578159 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b400cae0 con 0x7fc8bc159b50 2023-12-13T00:28:10.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.951+0000 7fc8c3890640 1 -- 172.21.15.72:0/2645578159 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc159150 con 0x7fc8bc159b50 2023-12-13T00:28:10.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:10.952+0000 7fc8c3890640 1 -- 172.21.15.72:0/2645578159 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8bc1f0020 con 0x7fc8bc159b50 2023-12-13T00:28:11.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.193+0000 7fc8b1ffb640 1 -- 172.21.15.72:0/2645578159 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc8b400cc40 con 0x7fc8bc159b50 2023-12-13T00:28:11.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.194+0000 7fc8b1ffb640 1 --2- 172.21.15.72:0/2645578159 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc8a006b240 0x7fc8a006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:11.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.194+0000 7fc8c162c640 1 --2- 172.21.15.72:0/2645578159 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc8a006b240 0x7fc8a006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:11.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.194+0000 7fc8c162c640 1 --2- 172.21.15.72:0/2645578159 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc8a006b240 0x7fc8a006d700 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8036000 tx=0x7fc8b8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:11.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.206+0000 7fc8b1ffb640 1 -- 172.21.15.72:0/2645578159 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fc8b4058760 con 0x7fc8bc159b50 2023-12-13T00:28:11.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.206+0000 7fc8b1ffb640 1 -- 172.21.15.72:0/2645578159 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc8b4054aa0 con 0x7fc8bc159b50 2023-12-13T00:28:11.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.372+0000 7fc8c3890640 1 -- 172.21.15.72:0/2645578159 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8bc1ef6b0 con 0x7fc8a006b240 2023-12-13T00:28:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.382+0000 7fc8b1ffb640 1 -- 172.21.15.72:0/2645578159 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370978 (secure 0 0 0) 0x7fc8bc1ef6b0 con 0x7fc8a006b240 2023-12-13T00:28:11.386 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:28:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-12-13T00:28:11.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.385+0000 7fc8c3890640 1 -- 172.21.15.72:0/2645578159 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc8a006b240 msgr2=0x7fc8a006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:11.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.385+0000 7fc8c3890640 1 --2- 172.21.15.72:0/2645578159 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc8a006b240 0x7fc8a006d700 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8036000 tx=0x7fc8b8008030 comp rx=0 tx=0).stop 2023-12-13T00:28:11.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.385+0000 7fc8c3890640 1 -- 172.21.15.72:0/2645578159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc159b50 msgr2=0x7fc8bc157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:11.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.385+0000 7fc8c3890640 1 --2- 172.21.15.72:0/2645578159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc159b50 0x7fc8bc157380 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400b9e0 tx=0x7fc8b400bea0 comp rx=0 tx=0).stop 2023-12-13T00:28:11.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.386+0000 7fc8c3890640 1 -- 172.21.15.72:0/2645578159 shutdown_connections 2023-12-13T00:28:11.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.386+0000 7fc8c3890640 1 --2- 172.21.15.72:0/2645578159 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc8a006b240 0x7fc8a006d700 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:11.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.386+0000 7fc8c3890640 1 --2- 172.21.15.72:0/2645578159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc159b50 0x7fc8bc157380 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:11.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.386+0000 7fc8c3890640 1 --2- 172.21.15.72:0/2645578159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0cda70 0x7fc8bc158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:11.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.386+0000 7fc8c3890640 1 --2- 172.21.15.72:0/2645578159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8bc0cc420 0x7fc8bc1524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:11.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.386+0000 7fc8c3890640 1 -- 172.21.15.72:0/2645578159 >> 172.21.15.72:0/2645578159 conn(0x7fc8bc0b07b0 msgr2=0x7fc8bc0c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:11.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.386+0000 7fc8c3890640 1 -- 172.21.15.72:0/2645578159 shutdown_connections 2023-12-13T00:28:11.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.386+0000 7fc8c3890640 1 -- 172.21.15.72:0/2645578159 wait complete. 2023-12-13T00:28:11.397 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":863,"stamp":"2023-12-13T00:28:10.907487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44494843,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1597,"num_read_kb":1872,"num_write":18961,"num_write_kb":384585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22498,"ondisk_log_size":22498,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":560752,"kb_used_data":89264,"kb_used_omap":12,"kb_used_meta":471411,"kb_avail":754413968,"statfs":{"total":773094113280,"available":772519903232,"internally_reserved":0,"allocated":91406336,"data_stored":89913478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":482725426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":84915,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":57,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003257"},"pg_stats":[{"pgid":"2.1f","version":"27'888","reported_seq":919,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:33.949039+0000","last_change":"2023-12-13T00:00:29.997631+0000","last_active":"2023-12-13T00:27:33.949039+0000","last_peered":"2023-12-13T00:27:33.949039+0000","last_clean":"2023-12-13T00:27:33.949039+0000","last_became_active":"2023-12-13T00:00:29.997381+0000","last_became_peered":"2023-12-13T00:00:29.997381+0000","last_unstale":"2023-12-13T00:27:33.949039+0000","last_undegraded":"2023-12-13T00:27:33.949039+0000","last_fullsized":"2023-12-13T00:27:33.949039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:33:37.976462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":4535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'54","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.857641+0000","last_change":"2023-12-13T00:00:31.138533+0000","last_active":"2023-12-13T00:28:04.857641+0000","last_peered":"2023-12-13T00:28:04.857641+0000","last_clean":"2023-12-13T00:28:04.857641+0000","last_became_active":"2023-12-13T00:00:31.138242+0000","last_became_peered":"2023-12-13T00:00:31.138242+0000","last_unstale":"2023-12-13T00:28:04.857641+0000","last_undegraded":"2023-12-13T00:28:04.857641+0000","last_fullsized":"2023-12-13T00:28:04.857641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:39:59.955103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'155","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:25.503482+0000","last_change":"2023-12-13T00:00:35.667840+0000","last_active":"2023-12-13T00:27:25.503482+0000","last_peered":"2023-12-13T00:27:25.503482+0000","last_clean":"2023-12-13T00:27:25.503482+0000","last_became_active":"2023-12-13T00:00:35.667498+0000","last_became_peered":"2023-12-13T00:00:35.667498+0000","last_unstale":"2023-12-13T00:27:25.503482+0000","last_undegraded":"2023-12-13T00:27:25.503482+0000","last_fullsized":"2023-12-13T00:27:25.503482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:17.304722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'846","reported_seq":877,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:35.941673+0000","last_change":"2023-12-13T00:00:30.001888+0000","last_active":"2023-12-13T00:27:35.941673+0000","last_peered":"2023-12-13T00:27:35.941673+0000","last_clean":"2023-12-13T00:27:35.941673+0000","last_became_active":"2023-12-13T00:00:30.001628+0000","last_became_peered":"2023-12-13T00:00:30.001628+0000","last_unstale":"2023-12-13T00:27:35.941673+0000","last_undegraded":"2023-12-13T00:27:35.941673+0000","last_fullsized":"2023-12-13T00:27:35.941673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:48:30.422214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'62","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.860247+0000","last_change":"2023-12-13T00:00:31.036420+0000","last_active":"2023-12-13T00:28:04.860247+0000","last_peered":"2023-12-13T00:28:04.860247+0000","last_clean":"2023-12-13T00:28:04.860247+0000","last_became_active":"2023-12-13T00:00:31.036197+0000","last_became_peered":"2023-12-13T00:00:31.036197+0000","last_unstale":"2023-12-13T00:28:04.860247+0000","last_undegraded":"2023-12-13T00:28:04.860247+0000","last_fullsized":"2023-12-13T00:28:04.860247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:05:56.876593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'165","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.828080+0000","last_change":"2023-12-13T00:00:35.665348+0000","last_active":"2023-12-13T00:27:29.828080+0000","last_peered":"2023-12-13T00:27:29.828080+0000","last_clean":"2023-12-13T00:27:29.828080+0000","last_became_active":"2023-12-13T00:00:35.664981+0000","last_became_peered":"2023-12-13T00:00:35.664981+0000","last_unstale":"2023-12-13T00:27:29.828080+0000","last_undegraded":"2023-12-13T00:27:29.828080+0000","last_fullsized":"2023-12-13T00:27:29.828080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:55.759392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":248,"num_write":136,"num_write_kb":7125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'11","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:53.927716+0000","last_change":"2023-12-13T00:00:30.009983+0000","last_active":"2023-12-13T00:27:53.927716+0000","last_peered":"2023-12-13T00:27:53.927716+0000","last_clean":"2023-12-13T00:27:53.927716+0000","last_became_active":"2023-12-13T00:00:30.009724+0000","last_became_peered":"2023-12-13T00:00:30.009724+0000","last_unstale":"2023-12-13T00:27:53.927716+0000","last_undegraded":"2023-12-13T00:27:53.927716+0000","last_fullsized":"2023-12-13T00:27:53.927716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:20:28.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'58","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.897710+0000","last_change":"2023-12-13T00:00:31.151042+0000","last_active":"2023-12-13T00:28:04.897710+0000","last_peered":"2023-12-13T00:28:04.897710+0000","last_clean":"2023-12-13T00:28:04.897710+0000","last_became_active":"2023-12-13T00:00:31.150735+0000","last_became_peered":"2023-12-13T00:00:31.150735+0000","last_unstale":"2023-12-13T00:28:04.897710+0000","last_undegraded":"2023-12-13T00:28:04.897710+0000","last_fullsized":"2023-12-13T00:28:04.897710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:36.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'163","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:28.829499+0000","last_change":"2023-12-13T00:00:35.668759+0000","last_active":"2023-12-13T00:27:28.829499+0000","last_peered":"2023-12-13T00:27:28.829499+0000","last_clean":"2023-12-13T00:27:28.829499+0000","last_became_active":"2023-12-13T00:00:35.668361+0000","last_became_peered":"2023-12-13T00:00:35.668361+0000","last_unstale":"2023-12-13T00:27:28.829499+0000","last_undegraded":"2023-12-13T00:27:28.829499+0000","last_fullsized":"2023-12-13T00:27:28.829499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:05.770014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":10445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.166172+0000","last_change":"2023-12-13T00:00:30.009921+0000","last_active":"2023-12-13T00:27:57.166172+0000","last_peered":"2023-12-13T00:27:57.166172+0000","last_clean":"2023-12-13T00:27:57.166172+0000","last_became_active":"2023-12-13T00:00:30.009644+0000","last_became_peered":"2023-12-13T00:00:30.009644+0000","last_unstale":"2023-12-13T00:27:57.166172+0000","last_undegraded":"2023-12-13T00:27:57.166172+0000","last_fullsized":"2023-12-13T00:27:57.166172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:48:30.422214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'63","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.878581+0000","last_change":"2023-12-13T00:00:31.146801+0000","last_active":"2023-12-13T00:28:04.878581+0000","last_peered":"2023-12-13T00:28:04.878581+0000","last_clean":"2023-12-13T00:28:04.878581+0000","last_became_active":"2023-12-13T00:00:31.146516+0000","last_became_peered":"2023-12-13T00:00:31.146516+0000","last_unstale":"2023-12-13T00:28:04.878581+0000","last_undegraded":"2023-12-13T00:28:04.878581+0000","last_fullsized":"2023-12-13T00:28:04.878581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:44:23.442162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'175","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.590878+0000","last_change":"2023-12-13T00:00:35.668621+0000","last_active":"2023-12-13T00:27:29.590878+0000","last_peered":"2023-12-13T00:27:29.590878+0000","last_clean":"2023-12-13T00:27:29.590878+0000","last_became_active":"2023-12-13T00:00:35.668298+0000","last_became_peered":"2023-12-13T00:00:35.668298+0000","last_unstale":"2023-12-13T00:27:29.590878+0000","last_undegraded":"2023-12-13T00:27:29.590878+0000","last_fullsized":"2023-12-13T00:27:29.590878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:40:04.506084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'50","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.877283+0000","last_change":"2023-12-13T00:00:31.036347+0000","last_active":"2023-12-13T00:28:04.877283+0000","last_peered":"2023-12-13T00:28:04.877283+0000","last_clean":"2023-12-13T00:28:04.877283+0000","last_became_active":"2023-12-13T00:00:31.036062+0000","last_became_peered":"2023-12-13T00:00:31.036062+0000","last_unstale":"2023-12-13T00:28:04.877283+0000","last_undegraded":"2023-12-13T00:28:04.877283+0000","last_fullsized":"2023-12-13T00:28:04.877283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:15:29.783257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'849","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:40.229848+0000","last_change":"2023-12-13T00:00:30.001066+0000","last_active":"2023-12-13T00:27:40.229848+0000","last_peered":"2023-12-13T00:27:40.229848+0000","last_clean":"2023-12-13T00:27:40.229848+0000","last_became_active":"2023-12-13T00:00:30.000782+0000","last_became_peered":"2023-12-13T00:00:30.000782+0000","last_unstale":"2023-12-13T00:27:40.229848+0000","last_undegraded":"2023-12-13T00:27:40.229848+0000","last_fullsized":"2023-12-13T00:27:40.229848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:53.977921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":4547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'149","reported_seq":176,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:28.850150+0000","last_change":"2023-12-13T00:00:35.662038+0000","last_active":"2023-12-13T00:27:28.850150+0000","last_peered":"2023-12-13T00:27:28.850150+0000","last_clean":"2023-12-13T00:27:28.850150+0000","last_became_active":"2023-12-13T00:00:35.661458+0000","last_became_peered":"2023-12-13T00:00:35.661458+0000","last_unstale":"2023-12-13T00:27:28.850150+0000","last_undegraded":"2023-12-13T00:27:28.850150+0000","last_fullsized":"2023-12-13T00:27:28.850150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:12:27.307277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":11179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'55","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.754043+0000","last_change":"2023-12-13T00:00:31.119718+0000","last_active":"2023-12-13T00:28:04.754043+0000","last_peered":"2023-12-13T00:28:04.754043+0000","last_clean":"2023-12-13T00:28:04.754043+0000","last_became_active":"2023-12-13T00:00:31.119447+0000","last_became_peered":"2023-12-13T00:00:31.119447+0000","last_unstale":"2023-12-13T00:28:04.754043+0000","last_undegraded":"2023-12-13T00:28:04.754043+0000","last_fullsized":"2023-12-13T00:28:04.754043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:08.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'215","reported_seq":245,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:55.948505+0000","last_change":"2023-12-13T00:00:29.968425+0000","last_active":"2023-12-13T00:27:55.948505+0000","last_peered":"2023-12-13T00:27:55.948505+0000","last_clean":"2023-12-13T00:27:55.948505+0000","last_became_active":"2023-12-13T00:00:29.967929+0000","last_became_peered":"2023-12-13T00:00:29.967929+0000","last_unstale":"2023-12-13T00:27:55.948505+0000","last_undegraded":"2023-12-13T00:27:55.948505+0000","last_fullsized":"2023-12-13T00:27:55.948505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:53.977921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":581,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'167","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:26.447351+0000","last_change":"2023-12-13T00:00:35.662848+0000","last_active":"2023-12-13T00:27:26.447351+0000","last_peered":"2023-12-13T00:27:26.447351+0000","last_clean":"2023-12-13T00:27:26.447351+0000","last_became_active":"2023-12-13T00:00:35.662469+0000","last_became_peered":"2023-12-13T00:00:35.662469+0000","last_unstale":"2023-12-13T00:27:26.447351+0000","last_undegraded":"2023-12-13T00:27:26.447351+0000","last_fullsized":"2023-12-13T00:27:26.447351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:17:20.456996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":19086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'57","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.831523+0000","last_change":"2023-12-13T00:00:31.143108+0000","last_active":"2023-12-13T00:28:04.831523+0000","last_peered":"2023-12-13T00:28:04.831523+0000","last_clean":"2023-12-13T00:28:04.831523+0000","last_became_active":"2023-12-13T00:00:31.142847+0000","last_became_peered":"2023-12-13T00:00:31.142847+0000","last_unstale":"2023-12-13T00:28:04.831523+0000","last_undegraded":"2023-12-13T00:28:04.831523+0000","last_fullsized":"2023-12-13T00:28:04.831523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:20.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'374","reported_seq":404,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.166869+0000","last_change":"2023-12-13T00:00:30.004483+0000","last_active":"2023-12-13T00:27:57.166869+0000","last_peered":"2023-12-13T00:27:57.166869+0000","last_clean":"2023-12-13T00:27:57.166869+0000","last_became_active":"2023-12-13T00:00:30.004195+0000","last_became_peered":"2023-12-13T00:00:30.004195+0000","last_unstale":"2023-12-13T00:27:57.166869+0000","last_undegraded":"2023-12-13T00:27:57.166869+0000","last_fullsized":"2023-12-13T00:27:57.166869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:35.192132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":373,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'154","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:28.849973+0000","last_change":"2023-12-13T00:00:35.660024+0000","last_active":"2023-12-13T00:27:28.849973+0000","last_peered":"2023-12-13T00:27:28.849973+0000","last_clean":"2023-12-13T00:27:28.849973+0000","last_became_active":"2023-12-13T00:00:35.659637+0000","last_became_peered":"2023-12-13T00:00:35.659637+0000","last_unstale":"2023-12-13T00:27:28.849973+0000","last_undegraded":"2023-12-13T00:27:28.849973+0000","last_fullsized":"2023-12-13T00:27:28.849973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:19.752973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":10280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.870851+0000","last_change":"2023-12-13T00:00:31.143938+0000","last_active":"2023-12-13T00:28:04.870851+0000","last_peered":"2023-12-13T00:28:04.870851+0000","last_clean":"2023-12-13T00:28:04.870851+0000","last_became_active":"2023-12-13T00:00:31.143673+0000","last_became_peered":"2023-12-13T00:00:31.143673+0000","last_unstale":"2023-12-13T00:28:04.870851+0000","last_undegraded":"2023-12-13T00:28:04.870851+0000","last_fullsized":"2023-12-13T00:28:04.870851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:56:04.585998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:51.140407+0000","last_change":"2023-12-13T00:00:30.005987+0000","last_active":"2023-12-13T00:27:51.140407+0000","last_peered":"2023-12-13T00:27:51.140407+0000","last_clean":"2023-12-13T00:27:51.140407+0000","last_became_active":"2023-12-13T00:00:30.005740+0000","last_became_peered":"2023-12-13T00:00:30.005740+0000","last_unstale":"2023-12-13T00:27:51.140407+0000","last_undegraded":"2023-12-13T00:27:51.140407+0000","last_fullsized":"2023-12-13T00:27:51.140407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:03:55.109283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'170","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.827065+0000","last_change":"2023-12-13T00:00:35.666041+0000","last_active":"2023-12-13T00:27:29.827065+0000","last_peered":"2023-12-13T00:27:29.827065+0000","last_clean":"2023-12-13T00:27:29.827065+0000","last_became_active":"2023-12-13T00:00:35.665670+0000","last_became_peered":"2023-12-13T00:00:35.665670+0000","last_unstale":"2023-12-13T00:27:29.827065+0000","last_undegraded":"2023-12-13T00:27:29.827065+0000","last_fullsized":"2023-12-13T00:27:29.827065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:10.984025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'51","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.831801+0000","last_change":"2023-12-13T00:00:31.146677+0000","last_active":"2023-12-13T00:28:04.831801+0000","last_peered":"2023-12-13T00:28:04.831801+0000","last_clean":"2023-12-13T00:28:04.831801+0000","last_became_active":"2023-12-13T00:00:31.146435+0000","last_became_peered":"2023-12-13T00:00:31.146435+0000","last_unstale":"2023-12-13T00:28:04.831801+0000","last_undegraded":"2023-12-13T00:28:04.831801+0000","last_fullsized":"2023-12-13T00:28:04.831801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:32:52.059012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'8","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:53.927419+0000","last_change":"2023-12-13T00:00:30.006240+0000","last_active":"2023-12-13T00:27:53.927419+0000","last_peered":"2023-12-13T00:27:53.927419+0000","last_clean":"2023-12-13T00:27:53.927419+0000","last_became_active":"2023-12-13T00:00:30.005909+0000","last_became_peered":"2023-12-13T00:00:30.005909+0000","last_unstale":"2023-12-13T00:27:53.927419+0000","last_undegraded":"2023-12-13T00:27:53.927419+0000","last_fullsized":"2023-12-13T00:27:53.927419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:59:20.687032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'164","reported_seq":192,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:27.796815+0000","last_change":"2023-12-13T00:00:35.665918+0000","last_active":"2023-12-13T00:27:27.796815+0000","last_peered":"2023-12-13T00:27:27.796815+0000","last_clean":"2023-12-13T00:27:27.796815+0000","last_became_active":"2023-12-13T00:00:35.665521+0000","last_became_peered":"2023-12-13T00:00:35.665521+0000","last_unstale":"2023-12-13T00:27:27.796815+0000","last_undegraded":"2023-12-13T00:27:27.796815+0000","last_fullsized":"2023-12-13T00:27:27.796815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:05.461575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'57","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.832310+0000","last_change":"2023-12-13T00:00:31.145392+0000","last_active":"2023-12-13T00:28:04.832310+0000","last_peered":"2023-12-13T00:28:04.832310+0000","last_clean":"2023-12-13T00:28:04.832310+0000","last_became_active":"2023-12-13T00:00:31.145115+0000","last_became_peered":"2023-12-13T00:00:31.145115+0000","last_unstale":"2023-12-13T00:28:04.832310+0000","last_undegraded":"2023-12-13T00:28:04.832310+0000","last_fullsized":"2023-12-13T00:28:04.832310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:15.201991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'169","reported_seq":199,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:58.269876+0000","last_change":"2023-12-13T00:00:30.006295+0000","last_active":"2023-12-13T00:27:58.269876+0000","last_peered":"2023-12-13T00:27:58.269876+0000","last_clean":"2023-12-13T00:27:58.269876+0000","last_became_active":"2023-12-13T00:00:30.005988+0000","last_became_peered":"2023-12-13T00:00:30.005988+0000","last_unstale":"2023-12-13T00:27:58.269876+0000","last_undegraded":"2023-12-13T00:27:58.269876+0000","last_fullsized":"2023-12-13T00:27:58.269876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:15:15.243155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'165","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:26.980294+0000","last_change":"2023-12-13T00:00:35.662996+0000","last_active":"2023-12-13T00:27:26.980294+0000","last_peered":"2023-12-13T00:27:26.980294+0000","last_clean":"2023-12-13T00:27:26.980294+0000","last_became_active":"2023-12-13T00:00:35.662612+0000","last_became_peered":"2023-12-13T00:00:35.662612+0000","last_unstale":"2023-12-13T00:27:26.980294+0000","last_undegraded":"2023-12-13T00:27:26.980294+0000","last_fullsized":"2023-12-13T00:27:26.980294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:58.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":14176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.822535+0000","last_change":"2023-12-13T00:00:31.118054+0000","last_active":"2023-12-13T00:28:04.822535+0000","last_peered":"2023-12-13T00:28:04.822535+0000","last_clean":"2023-12-13T00:28:04.822535+0000","last_became_active":"2023-12-13T00:00:31.117814+0000","last_became_peered":"2023-12-13T00:00:31.117814+0000","last_unstale":"2023-12-13T00:28:04.822535+0000","last_undegraded":"2023-12-13T00:28:04.822535+0000","last_fullsized":"2023-12-13T00:28:04.822535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:15.201991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:46.081058+0000","last_change":"2023-12-13T00:00:30.001001+0000","last_active":"2023-12-13T00:27:46.081058+0000","last_peered":"2023-12-13T00:27:46.081058+0000","last_clean":"2023-12-13T00:27:46.081058+0000","last_became_active":"2023-12-13T00:00:30.000755+0000","last_became_peered":"2023-12-13T00:00:30.000755+0000","last_unstale":"2023-12-13T00:27:46.081058+0000","last_undegraded":"2023-12-13T00:27:46.081058+0000","last_fullsized":"2023-12-13T00:27:46.081058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:02:11.314721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'145","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.942343+0000","last_change":"2023-12-13T00:01:00.545340+0000","last_active":"2023-12-13T00:27:31.942343+0000","last_peered":"2023-12-13T00:27:31.942343+0000","last_clean":"2023-12-13T00:27:31.942343+0000","last_became_active":"2023-12-13T00:01:00.544906+0000","last_became_peered":"2023-12-13T00:01:00.544906+0000","last_unstale":"2023-12-13T00:27:31.942343+0000","last_undegraded":"2023-12-13T00:27:31.942343+0000","last_fullsized":"2023-12-13T00:27:31.942343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:44:27.993144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,5],"acting":[6,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.887652+0000","last_change":"2023-12-13T00:00:31.143429+0000","last_active":"2023-12-13T00:28:04.887652+0000","last_peered":"2023-12-13T00:28:04.887652+0000","last_clean":"2023-12-13T00:28:04.887652+0000","last_became_active":"2023-12-13T00:00:31.143182+0000","last_became_peered":"2023-12-13T00:00:31.143182+0000","last_unstale":"2023-12-13T00:28:04.887652+0000","last_undegraded":"2023-12-13T00:28:04.887652+0000","last_fullsized":"2023-12-13T00:28:04.887652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:09:34.339195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:36.956936+0000","last_change":"2023-12-13T00:00:29.969160+0000","last_active":"2023-12-13T00:27:36.956936+0000","last_peered":"2023-12-13T00:27:36.956936+0000","last_clean":"2023-12-13T00:27:36.956936+0000","last_became_active":"2023-12-13T00:00:29.968860+0000","last_became_peered":"2023-12-13T00:00:29.968860+0000","last_unstale":"2023-12-13T00:27:36.956936+0000","last_undegraded":"2023-12-13T00:27:36.956936+0000","last_fullsized":"2023-12-13T00:27:36.956936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:42:13.602889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'163","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.585490+0000","last_change":"2023-12-13T00:00:35.642597+0000","last_active":"2023-12-13T00:27:29.585490+0000","last_peered":"2023-12-13T00:27:29.585490+0000","last_clean":"2023-12-13T00:27:29.585490+0000","last_became_active":"2023-12-13T00:00:35.642215+0000","last_became_peered":"2023-12-13T00:00:35.642215+0000","last_unstale":"2023-12-13T00:27:29.585490+0000","last_undegraded":"2023-12-13T00:27:29.585490+0000","last_fullsized":"2023-12-13T00:27:29.585490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:54:48.007993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":6488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'62","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.867805+0000","last_change":"2023-12-13T00:00:31.149832+0000","last_active":"2023-12-13T00:28:04.867805+0000","last_peered":"2023-12-13T00:28:04.867805+0000","last_clean":"2023-12-13T00:28:04.867805+0000","last_became_active":"2023-12-13T00:00:31.149587+0000","last_became_peered":"2023-12-13T00:00:31.149587+0000","last_unstale":"2023-12-13T00:28:04.867805+0000","last_undegraded":"2023-12-13T00:28:04.867805+0000","last_fullsized":"2023-12-13T00:28:04.867805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:00.910594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'792","reported_seq":823,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:38.142347+0000","last_change":"2023-12-13T00:00:29.998103+0000","last_active":"2023-12-13T00:27:38.142347+0000","last_peered":"2023-12-13T00:27:38.142347+0000","last_clean":"2023-12-13T00:27:38.142347+0000","last_became_active":"2023-12-13T00:00:29.997848+0000","last_became_peered":"2023-12-13T00:00:29.997848+0000","last_unstale":"2023-12-13T00:27:38.142347+0000","last_undegraded":"2023-12-13T00:27:38.142347+0000","last_fullsized":"2023-12-13T00:27:38.142347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:52:58.951228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":4476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'121","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.942347+0000","last_change":"2023-12-13T00:00:35.652104+0000","last_active":"2023-12-13T00:27:31.942347+0000","last_peered":"2023-12-13T00:27:31.942347+0000","last_clean":"2023-12-13T00:27:31.942347+0000","last_became_active":"2023-12-13T00:00:35.651766+0000","last_became_peered":"2023-12-13T00:00:35.651766+0000","last_unstale":"2023-12-13T00:27:31.942347+0000","last_undegraded":"2023-12-13T00:27:31.942347+0000","last_fullsized":"2023-12-13T00:27:31.942347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:08:10.211533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":7468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'58","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.860786+0000","last_change":"2023-12-13T00:00:31.120580+0000","last_active":"2023-12-13T00:28:04.860786+0000","last_peered":"2023-12-13T00:28:04.860786+0000","last_clean":"2023-12-13T00:28:04.860786+0000","last_became_active":"2023-12-13T00:00:31.120330+0000","last_became_peered":"2023-12-13T00:00:31.120330+0000","last_unstale":"2023-12-13T00:28:04.860786+0000","last_undegraded":"2023-12-13T00:28:04.860786+0000","last_fullsized":"2023-12-13T00:28:04.860786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:04:30.356287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'411","reported_seq":748,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:59.442964+0000","last_change":"2023-12-13T00:00:30.000752+0000","last_active":"2023-12-13T00:27:59.442964+0000","last_peered":"2023-12-13T00:27:59.442964+0000","last_clean":"2023-12-13T00:27:59.442964+0000","last_became_active":"2023-12-13T00:00:30.000015+0000","last_became_peered":"2023-12-13T00:00:30.000015+0000","last_unstale":"2023-12-13T00:27:59.442964+0000","last_undegraded":"2023-12-13T00:27:59.442964+0000","last_fullsized":"2023-12-13T00:27:59.442964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:20:46.566684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58234,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":306,"num_read_kb":318,"num_write":408,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'147","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:30.828661+0000","last_change":"2023-12-13T00:00:35.667415+0000","last_active":"2023-12-13T00:27:30.828661+0000","last_peered":"2023-12-13T00:27:30.828661+0000","last_clean":"2023-12-13T00:27:30.828661+0000","last_became_active":"2023-12-13T00:00:35.667028+0000","last_became_peered":"2023-12-13T00:00:35.667028+0000","last_unstale":"2023-12-13T00:27:30.828661+0000","last_undegraded":"2023-12-13T00:27:30.828661+0000","last_fullsized":"2023-12-13T00:27:30.828661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:58.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":5383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'60","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.822616+0000","last_change":"2023-12-13T00:00:31.140853+0000","last_active":"2023-12-13T00:28:04.822616+0000","last_peered":"2023-12-13T00:28:04.822616+0000","last_clean":"2023-12-13T00:28:04.822616+0000","last_became_active":"2023-12-13T00:00:31.140597+0000","last_became_peered":"2023-12-13T00:00:31.140597+0000","last_unstale":"2023-12-13T00:28:04.822616+0000","last_undegraded":"2023-12-13T00:28:04.822616+0000","last_fullsized":"2023-12-13T00:28:04.822616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:13.923453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:44.241631+0000","last_change":"2023-12-13T00:00:29.998765+0000","last_active":"2023-12-13T00:27:44.241631+0000","last_peered":"2023-12-13T00:27:44.241631+0000","last_clean":"2023-12-13T00:27:44.241631+0000","last_became_active":"2023-12-13T00:00:29.998552+0000","last_became_peered":"2023-12-13T00:00:29.998552+0000","last_unstale":"2023-12-13T00:27:44.241631+0000","last_undegraded":"2023-12-13T00:27:44.241631+0000","last_fullsized":"2023-12-13T00:27:44.241631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:54:42.351946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'127","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:28.839739+0000","last_change":"2023-12-13T00:00:35.666575+0000","last_active":"2023-12-13T00:27:28.839739+0000","last_peered":"2023-12-13T00:27:28.839739+0000","last_clean":"2023-12-13T00:27:28.839739+0000","last_became_active":"2023-12-13T00:00:35.666135+0000","last_became_peered":"2023-12-13T00:00:35.666135+0000","last_unstale":"2023-12-13T00:27:28.839739+0000","last_undegraded":"2023-12-13T00:27:28.839739+0000","last_fullsized":"2023-12-13T00:27:28.839739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:02:03.031651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":7535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'49","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.832939+0000","last_change":"2023-12-13T00:00:31.148698+0000","last_active":"2023-12-13T00:28:04.832939+0000","last_peered":"2023-12-13T00:28:04.832939+0000","last_clean":"2023-12-13T00:28:04.832939+0000","last_became_active":"2023-12-13T00:00:31.148421+0000","last_became_peered":"2023-12-13T00:00:31.148421+0000","last_unstale":"2023-12-13T00:28:04.832939+0000","last_undegraded":"2023-12-13T00:28:04.832939+0000","last_fullsized":"2023-12-13T00:28:04.832939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:53:00.056294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:47.328629+0000","last_change":"2023-12-13T00:00:30.001220+0000","last_active":"2023-12-13T00:27:47.328629+0000","last_peered":"2023-12-13T00:27:47.328629+0000","last_clean":"2023-12-13T00:27:47.328629+0000","last_became_active":"2023-12-13T00:00:30.000854+0000","last_became_peered":"2023-12-13T00:00:30.000854+0000","last_unstale":"2023-12-13T00:27:47.328629+0000","last_undegraded":"2023-12-13T00:27:47.328629+0000","last_fullsized":"2023-12-13T00:27:47.328629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:50:11.243011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:24:12.872552+0000","last_change":"2023-12-13T00:00:08.575071+0000","last_active":"2023-12-13T00:24:12.872552+0000","last_peered":"2023-12-13T00:24:12.872552+0000","last_clean":"2023-12-13T00:24:12.872552+0000","last_became_active":"2023-12-13T00:00:08.574464+0000","last_became_peered":"2023-12-13T00:00:08.574464+0000","last_unstale":"2023-12-13T00:24:12.872552+0000","last_undegraded":"2023-12-13T00:24:12.872552+0000","last_fullsized":"2023-12-13T00:24:12.872552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:07.226606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:07.226606+0000","last_clean_scrub_stamp":"2023-12-13T00:00:07.226606+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:51:39.168480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'166","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.589507+0000","last_change":"2023-12-13T00:00:35.661806+0000","last_active":"2023-12-13T00:27:29.589507+0000","last_peered":"2023-12-13T00:27:29.589507+0000","last_clean":"2023-12-13T00:27:29.589507+0000","last_became_active":"2023-12-13T00:00:35.660976+0000","last_became_peered":"2023-12-13T00:00:35.660976+0000","last_unstale":"2023-12-13T00:27:29.589507+0000","last_undegraded":"2023-12-13T00:27:29.589507+0000","last_fullsized":"2023-12-13T00:27:29.589507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:04:57.617925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":12423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'58","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.876713+0000","last_change":"2023-12-13T00:00:31.036383+0000","last_active":"2023-12-13T00:28:04.876713+0000","last_peered":"2023-12-13T00:28:04.876713+0000","last_clean":"2023-12-13T00:28:04.876713+0000","last_became_active":"2023-12-13T00:00:31.036127+0000","last_became_peered":"2023-12-13T00:00:31.036127+0000","last_unstale":"2023-12-13T00:28:04.876713+0000","last_undegraded":"2023-12-13T00:28:04.876713+0000","last_fullsized":"2023-12-13T00:28:04.876713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:12:16.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'7","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:40.042854+0000","last_change":"2023-12-13T00:00:30.006258+0000","last_active":"2023-12-13T00:27:40.042854+0000","last_peered":"2023-12-13T00:27:40.042854+0000","last_clean":"2023-12-13T00:27:40.042854+0000","last_became_active":"2023-12-13T00:00:30.005943+0000","last_became_peered":"2023-12-13T00:00:30.005943+0000","last_unstale":"2023-12-13T00:27:40.042854+0000","last_undegraded":"2023-12-13T00:27:40.042854+0000","last_fullsized":"2023-12-13T00:27:40.042854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:52:45.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'164","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:24.019860+0000","last_change":"2023-12-13T00:00:35.665140+0000","last_active":"2023-12-13T00:27:24.019860+0000","last_peered":"2023-12-13T00:27:24.019860+0000","last_clean":"2023-12-13T00:27:24.019860+0000","last_became_active":"2023-12-13T00:00:35.664071+0000","last_became_peered":"2023-12-13T00:00:35.664071+0000","last_unstale":"2023-12-13T00:27:24.019860+0000","last_undegraded":"2023-12-13T00:27:24.019860+0000","last_fullsized":"2023-12-13T00:27:24.019860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:06:01.427574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":5432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'59","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.870090+0000","last_change":"2023-12-13T00:00:31.147760+0000","last_active":"2023-12-13T00:28:04.870090+0000","last_peered":"2023-12-13T00:28:04.870090+0000","last_clean":"2023-12-13T00:28:04.870090+0000","last_became_active":"2023-12-13T00:00:31.147523+0000","last_became_peered":"2023-12-13T00:00:31.147523+0000","last_unstale":"2023-12-13T00:28:04.870090+0000","last_undegraded":"2023-12-13T00:28:04.870090+0000","last_fullsized":"2023-12-13T00:28:04.870090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:56:28.188041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:32.947591+0000","last_change":"2023-12-13T00:00:30.002705+0000","last_active":"2023-12-13T00:27:32.947591+0000","last_peered":"2023-12-13T00:27:32.947591+0000","last_clean":"2023-12-13T00:27:32.947591+0000","last_became_active":"2023-12-13T00:00:30.002427+0000","last_became_peered":"2023-12-13T00:00:30.002427+0000","last_unstale":"2023-12-13T00:27:32.947591+0000","last_undegraded":"2023-12-13T00:27:32.947591+0000","last_fullsized":"2023-12-13T00:27:32.947591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:06:37.325239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'177","reported_seq":204,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.562109+0000","last_change":"2023-12-13T00:00:35.661309+0000","last_active":"2023-12-13T00:27:29.562109+0000","last_peered":"2023-12-13T00:27:29.562109+0000","last_clean":"2023-12-13T00:27:29.562109+0000","last_became_active":"2023-12-13T00:00:35.660939+0000","last_became_peered":"2023-12-13T00:00:35.660939+0000","last_unstale":"2023-12-13T00:27:29.562109+0000","last_undegraded":"2023-12-13T00:27:29.562109+0000","last_fullsized":"2023-12-13T00:27:29.562109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:49:19.372464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":11316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'64","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.871881+0000","last_change":"2023-12-13T00:00:31.146265+0000","last_active":"2023-12-13T00:28:04.871881+0000","last_peered":"2023-12-13T00:28:04.871881+0000","last_clean":"2023-12-13T00:28:04.871881+0000","last_became_active":"2023-12-13T00:00:31.145997+0000","last_became_peered":"2023-12-13T00:00:31.145997+0000","last_unstale":"2023-12-13T00:28:04.871881+0000","last_undegraded":"2023-12-13T00:28:04.871881+0000","last_fullsized":"2023-12-13T00:28:04.871881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:53:32.846210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:40.149153+0000","last_change":"2023-12-13T00:00:29.968222+0000","last_active":"2023-12-13T00:27:40.149153+0000","last_peered":"2023-12-13T00:27:40.149153+0000","last_clean":"2023-12-13T00:27:40.149153+0000","last_became_active":"2023-12-13T00:00:29.967916+0000","last_became_peered":"2023-12-13T00:00:29.967916+0000","last_unstale":"2023-12-13T00:27:40.149153+0000","last_undegraded":"2023-12-13T00:27:40.149153+0000","last_fullsized":"2023-12-13T00:27:40.149153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:12.818387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'137","reported_seq":164,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:27.462473+0000","last_change":"2023-12-13T00:00:35.667745+0000","last_active":"2023-12-13T00:27:27.462473+0000","last_peered":"2023-12-13T00:27:27.462473+0000","last_clean":"2023-12-13T00:27:27.462473+0000","last_became_active":"2023-12-13T00:00:35.666891+0000","last_became_peered":"2023-12-13T00:00:35.666891+0000","last_unstale":"2023-12-13T00:27:27.462473+0000","last_undegraded":"2023-12-13T00:27:27.462473+0000","last_fullsized":"2023-12-13T00:27:27.462473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:30:53.285154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":9622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'54","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.890957+0000","last_change":"2023-12-13T00:00:31.148279+0000","last_active":"2023-12-13T00:28:04.890957+0000","last_peered":"2023-12-13T00:28:04.890957+0000","last_clean":"2023-12-13T00:28:04.890957+0000","last_became_active":"2023-12-13T00:00:31.148016+0000","last_became_peered":"2023-12-13T00:00:31.148016+0000","last_unstale":"2023-12-13T00:28:04.890957+0000","last_undegraded":"2023-12-13T00:28:04.890957+0000","last_fullsized":"2023-12-13T00:28:04.890957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:37:40.762676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'289","reported_seq":319,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:52.762132+0000","last_change":"2023-12-13T00:00:30.008152+0000","last_active":"2023-12-13T00:27:52.762132+0000","last_peered":"2023-12-13T00:27:52.762132+0000","last_clean":"2023-12-13T00:27:52.762132+0000","last_became_active":"2023-12-13T00:00:30.007907+0000","last_became_peered":"2023-12-13T00:00:30.007907+0000","last_unstale":"2023-12-13T00:27:52.762132+0000","last_undegraded":"2023-12-13T00:27:52.762132+0000","last_fullsized":"2023-12-13T00:27:52.762132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:46:40.001298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'132","reported_seq":159,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:21.922520+0000","last_change":"2023-12-13T00:00:35.660971+0000","last_active":"2023-12-13T00:27:21.922520+0000","last_peered":"2023-12-13T00:27:21.922520+0000","last_clean":"2023-12-13T00:27:21.922520+0000","last_became_active":"2023-12-13T00:00:35.660627+0000","last_became_peered":"2023-12-13T00:00:35.660627+0000","last_unstale":"2023-12-13T00:27:21.922520+0000","last_undegraded":"2023-12-13T00:27:21.922520+0000","last_fullsized":"2023-12-13T00:27:21.922520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:18.474434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":10143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'55","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.870793+0000","last_change":"2023-12-13T00:00:31.142437+0000","last_active":"2023-12-13T00:28:04.870793+0000","last_peered":"2023-12-13T00:28:04.870793+0000","last_clean":"2023-12-13T00:28:04.870793+0000","last_became_active":"2023-12-13T00:00:31.142150+0000","last_became_peered":"2023-12-13T00:00:31.142150+0000","last_unstale":"2023-12-13T00:28:04.870793+0000","last_undegraded":"2023-12-13T00:28:04.870793+0000","last_fullsized":"2023-12-13T00:28:04.870793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:10:54.020587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'797","reported_seq":826,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.530963+0000","last_change":"2023-12-13T00:00:30.000646+0000","last_active":"2023-12-13T00:28:04.530963+0000","last_peered":"2023-12-13T00:28:04.530963+0000","last_clean":"2023-12-13T00:28:04.530963+0000","last_became_active":"2023-12-13T00:00:30.000388+0000","last_became_peered":"2023-12-13T00:00:30.000388+0000","last_unstale":"2023-12-13T00:28:04.530963+0000","last_undegraded":"2023-12-13T00:28:04.530963+0000","last_fullsized":"2023-12-13T00:28:04.530963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:07.704455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277997,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'170","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.589842+0000","last_change":"2023-12-13T00:00:35.666659+0000","last_active":"2023-12-13T00:27:29.589842+0000","last_peered":"2023-12-13T00:27:29.589842+0000","last_clean":"2023-12-13T00:27:29.589842+0000","last_became_active":"2023-12-13T00:00:35.666304+0000","last_became_peered":"2023-12-13T00:00:35.666304+0000","last_unstale":"2023-12-13T00:27:29.589842+0000","last_undegraded":"2023-12-13T00:27:29.589842+0000","last_fullsized":"2023-12-13T00:27:29.589842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:35:49.956369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":11255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'48","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.894217+0000","last_change":"2023-12-13T00:00:31.037568+0000","last_active":"2023-12-13T00:28:04.894217+0000","last_peered":"2023-12-13T00:28:04.894217+0000","last_clean":"2023-12-13T00:28:04.894217+0000","last_became_active":"2023-12-13T00:00:31.037398+0000","last_became_peered":"2023-12-13T00:00:31.037398+0000","last_unstale":"2023-12-13T00:28:04.894217+0000","last_undegraded":"2023-12-13T00:28:04.894217+0000","last_fullsized":"2023-12-13T00:28:04.894217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:08.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'1355","reported_seq":1384,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:53.446607+0000","last_change":"2023-12-13T00:00:30.006086+0000","last_active":"2023-12-13T00:27:53.446607+0000","last_peered":"2023-12-13T00:27:53.446607+0000","last_clean":"2023-12-13T00:27:53.446607+0000","last_became_active":"2023-12-13T00:00:30.005752+0000","last_became_peered":"2023-12-13T00:00:30.005752+0000","last_unstale":"2023-12-13T00:27:53.446607+0000","last_undegraded":"2023-12-13T00:27:53.446607+0000","last_fullsized":"2023-12-13T00:27:53.446607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1355,"log_dups_size":0,"ondisk_log_size":1355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:06:37.325239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1349,"num_write_kb":4734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'175","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.548973+0000","last_change":"2023-12-13T00:00:35.666467+0000","last_active":"2023-12-13T00:27:29.548973+0000","last_peered":"2023-12-13T00:27:29.548973+0000","last_clean":"2023-12-13T00:27:29.548973+0000","last_became_active":"2023-12-13T00:00:35.666061+0000","last_became_peered":"2023-12-13T00:00:35.666061+0000","last_unstale":"2023-12-13T00:27:29.548973+0000","last_undegraded":"2023-12-13T00:27:29.548973+0000","last_fullsized":"2023-12-13T00:27:29.548973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:19:16.858246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":9890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'68","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.869910+0000","last_change":"2023-12-13T00:01:00.702387+0000","last_active":"2023-12-13T00:28:04.869910+0000","last_peered":"2023-12-13T00:28:04.869910+0000","last_clean":"2023-12-13T00:28:04.869910+0000","last_became_active":"2023-12-13T00:01:00.702089+0000","last_became_peered":"2023-12-13T00:01:00.702089+0000","last_unstale":"2023-12-13T00:28:04.869910+0000","last_undegraded":"2023-12-13T00:28:04.869910+0000","last_fullsized":"2023-12-13T00:28:04.869910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:48:49.380742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'393","reported_seq":422,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.528820+0000","last_change":"2023-12-13T00:00:30.001171+0000","last_active":"2023-12-13T00:28:04.528820+0000","last_peered":"2023-12-13T00:28:04.528820+0000","last_clean":"2023-12-13T00:28:04.528820+0000","last_became_active":"2023-12-13T00:00:30.000803+0000","last_became_peered":"2023-12-13T00:00:30.000803+0000","last_unstale":"2023-12-13T00:28:04.528820+0000","last_undegraded":"2023-12-13T00:28:04.528820+0000","last_fullsized":"2023-12-13T00:28:04.528820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:19.012092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2931508,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":386,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'176","reported_seq":202,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.548618+0000","last_change":"2023-12-13T00:00:35.649561+0000","last_active":"2023-12-13T00:27:29.548618+0000","last_peered":"2023-12-13T00:27:29.548618+0000","last_clean":"2023-12-13T00:27:29.548618+0000","last_became_active":"2023-12-13T00:00:35.649151+0000","last_became_peered":"2023-12-13T00:00:35.649151+0000","last_unstale":"2023-12-13T00:27:29.548618+0000","last_undegraded":"2023-12-13T00:27:29.548618+0000","last_fullsized":"2023-12-13T00:27:29.548618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:06:34.023899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'60","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.821458+0000","last_change":"2023-12-13T00:00:31.116002+0000","last_active":"2023-12-13T00:28:04.821458+0000","last_peered":"2023-12-13T00:28:04.821458+0000","last_clean":"2023-12-13T00:28:04.821458+0000","last_became_active":"2023-12-13T00:00:31.115678+0000","last_became_peered":"2023-12-13T00:00:31.115678+0000","last_unstale":"2023-12-13T00:28:04.821458+0000","last_undegraded":"2023-12-13T00:28:04.821458+0000","last_fullsized":"2023-12-13T00:28:04.821458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:21:51.967408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'11","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:48.225267+0000","last_change":"2023-12-13T00:00:30.004329+0000","last_active":"2023-12-13T00:27:48.225267+0000","last_peered":"2023-12-13T00:27:48.225267+0000","last_clean":"2023-12-13T00:27:48.225267+0000","last_became_active":"2023-12-13T00:00:30.004089+0000","last_became_peered":"2023-12-13T00:00:30.004089+0000","last_unstale":"2023-12-13T00:27:48.225267+0000","last_undegraded":"2023-12-13T00:27:48.225267+0000","last_fullsized":"2023-12-13T00:27:48.225267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:05:04.403249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'148","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.520279+0000","last_change":"2023-12-13T00:00:35.652272+0000","last_active":"2023-12-13T00:27:29.520279+0000","last_peered":"2023-12-13T00:27:29.520279+0000","last_clean":"2023-12-13T00:27:29.520279+0000","last_became_active":"2023-12-13T00:00:35.651907+0000","last_became_peered":"2023-12-13T00:00:35.651907+0000","last_unstale":"2023-12-13T00:27:29.520279+0000","last_undegraded":"2023-12-13T00:27:29.520279+0000","last_fullsized":"2023-12-13T00:27:29.520279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:15:01.873129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":7909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'46","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.863565+0000","last_change":"2023-12-13T00:00:31.148754+0000","last_active":"2023-12-13T00:28:04.863565+0000","last_peered":"2023-12-13T00:28:04.863565+0000","last_clean":"2023-12-13T00:28:04.863565+0000","last_became_active":"2023-12-13T00:00:31.147846+0000","last_became_peered":"2023-12-13T00:00:31.147846+0000","last_unstale":"2023-12-13T00:28:04.863565+0000","last_undegraded":"2023-12-13T00:28:04.863565+0000","last_fullsized":"2023-12-13T00:28:04.863565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:39:59.955103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'1473","reported_seq":1502,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:48.433505+0000","last_change":"2023-12-13T00:00:30.001703+0000","last_active":"2023-12-13T00:27:48.433505+0000","last_peered":"2023-12-13T00:27:48.433505+0000","last_clean":"2023-12-13T00:27:48.433505+0000","last_became_active":"2023-12-13T00:00:30.001420+0000","last_became_peered":"2023-12-13T00:00:30.001420+0000","last_unstale":"2023-12-13T00:27:48.433505+0000","last_undegraded":"2023-12-13T00:27:48.433505+0000","last_fullsized":"2023-12-13T00:27:48.433505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1473,"log_dups_size":0,"ondisk_log_size":1473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:02:06.211723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1472,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'148","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:21.985391+0000","last_change":"2023-12-13T00:01:00.546607+0000","last_active":"2023-12-13T00:27:21.985391+0000","last_peered":"2023-12-13T00:27:21.985391+0000","last_clean":"2023-12-13T00:27:21.985391+0000","last_became_active":"2023-12-13T00:01:00.546264+0000","last_became_peered":"2023-12-13T00:01:00.546264+0000","last_unstale":"2023-12-13T00:27:21.985391+0000","last_undegraded":"2023-12-13T00:27:21.985391+0000","last_fullsized":"2023-12-13T00:27:21.985391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:12:57.696627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'60","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.870044+0000","last_change":"2023-12-13T00:00:31.138998+0000","last_active":"2023-12-13T00:28:04.870044+0000","last_peered":"2023-12-13T00:28:04.870044+0000","last_clean":"2023-12-13T00:28:04.870044+0000","last_became_active":"2023-12-13T00:00:31.138723+0000","last_became_peered":"2023-12-13T00:00:31.138723+0000","last_unstale":"2023-12-13T00:28:04.870044+0000","last_undegraded":"2023-12-13T00:28:04.870044+0000","last_fullsized":"2023-12-13T00:28:04.870044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:24:05.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'217","reported_seq":246,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.944367+0000","last_change":"2023-12-13T00:00:30.003079+0000","last_active":"2023-12-13T00:27:57.944367+0000","last_peered":"2023-12-13T00:27:57.944367+0000","last_clean":"2023-12-13T00:27:57.944367+0000","last_became_active":"2023-12-13T00:00:30.002823+0000","last_became_peered":"2023-12-13T00:00:30.002823+0000","last_unstale":"2023-12-13T00:27:57.944367+0000","last_undegraded":"2023-12-13T00:27:57.944367+0000","last_fullsized":"2023-12-13T00:27:57.944367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:07.829448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'219","reported_seq":254,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:26.979813+0000","last_change":"2023-12-13T00:01:00.697705+0000","last_active":"2023-12-13T00:27:26.979813+0000","last_peered":"2023-12-13T00:27:26.979813+0000","last_clean":"2023-12-13T00:27:26.979813+0000","last_became_active":"2023-12-13T00:01:00.697231+0000","last_became_peered":"2023-12-13T00:01:00.697231+0000","last_unstale":"2023-12-13T00:27:26.979813+0000","last_undegraded":"2023-12-13T00:27:26.979813+0000","last_fullsized":"2023-12-13T00:27:26.979813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:54:04.994059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":195,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'66","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.875139+0000","last_change":"2023-12-13T00:00:31.027503+0000","last_active":"2023-12-13T00:28:04.875139+0000","last_peered":"2023-12-13T00:28:04.875139+0000","last_clean":"2023-12-13T00:28:04.875139+0000","last_became_active":"2023-12-13T00:00:31.027239+0000","last_became_peered":"2023-12-13T00:00:31.027239+0000","last_unstale":"2023-12-13T00:28:04.875139+0000","last_undegraded":"2023-12-13T00:28:04.875139+0000","last_fullsized":"2023-12-13T00:28:04.875139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:50:58.339436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:32.953266+0000","last_change":"2023-12-13T00:00:30.009592+0000","last_active":"2023-12-13T00:27:32.953266+0000","last_peered":"2023-12-13T00:27:32.953266+0000","last_clean":"2023-12-13T00:27:32.953266+0000","last_became_active":"2023-12-13T00:00:30.009351+0000","last_became_peered":"2023-12-13T00:00:30.009351+0000","last_unstale":"2023-12-13T00:27:32.953266+0000","last_undegraded":"2023-12-13T00:27:32.953266+0000","last_fullsized":"2023-12-13T00:27:32.953266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:46:22.716022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'190","reported_seq":213,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.547065+0000","last_change":"2023-12-13T00:01:00.717446+0000","last_active":"2023-12-13T00:27:29.547065+0000","last_peered":"2023-12-13T00:27:29.547065+0000","last_clean":"2023-12-13T00:27:29.547065+0000","last_became_active":"2023-12-13T00:01:00.717019+0000","last_became_peered":"2023-12-13T00:01:00.717019+0000","last_unstale":"2023-12-13T00:27:29.547065+0000","last_undegraded":"2023-12-13T00:27:29.547065+0000","last_fullsized":"2023-12-13T00:27:29.547065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:22:05.566928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":9378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"27'64","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.889753+0000","last_change":"2023-12-13T00:00:31.139946+0000","last_active":"2023-12-13T00:28:04.889753+0000","last_peered":"2023-12-13T00:28:04.889753+0000","last_clean":"2023-12-13T00:28:04.889753+0000","last_became_active":"2023-12-13T00:00:31.139656+0000","last_became_peered":"2023-12-13T00:00:31.139656+0000","last_unstale":"2023-12-13T00:28:04.889753+0000","last_undegraded":"2023-12-13T00:28:04.889753+0000","last_fullsized":"2023-12-13T00:28:04.889753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:13:39.042325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'83","reported_seq":112,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:43.428733+0000","last_change":"2023-12-13T00:00:30.003511+0000","last_active":"2023-12-13T00:27:43.428733+0000","last_peered":"2023-12-13T00:27:43.428733+0000","last_clean":"2023-12-13T00:27:43.428733+0000","last_became_active":"2023-12-13T00:00:30.002630+0000","last_became_peered":"2023-12-13T00:00:30.002630+0000","last_unstale":"2023-12-13T00:27:43.428733+0000","last_undegraded":"2023-12-13T00:27:43.428733+0000","last_fullsized":"2023-12-13T00:27:43.428733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:58:21.724544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'123","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.543938+0000","last_change":"2023-12-13T00:00:35.649725+0000","last_active":"2023-12-13T00:27:29.543938+0000","last_peered":"2023-12-13T00:27:29.543938+0000","last_clean":"2023-12-13T00:27:29.543938+0000","last_became_active":"2023-12-13T00:00:35.649401+0000","last_became_peered":"2023-12-13T00:00:35.649401+0000","last_unstale":"2023-12-13T00:27:29.543938+0000","last_undegraded":"2023-12-13T00:27:29.543938+0000","last_fullsized":"2023-12-13T00:27:29.543938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:56:09.136979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":7272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'122","reported_seq":150,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.575066+0000","last_change":"2023-12-13T00:00:35.662790+0000","last_active":"2023-12-13T00:27:29.575066+0000","last_peered":"2023-12-13T00:27:29.575066+0000","last_clean":"2023-12-13T00:27:29.575066+0000","last_became_active":"2023-12-13T00:00:35.662406+0000","last_became_peered":"2023-12-13T00:00:35.662406+0000","last_unstale":"2023-12-13T00:27:29.575066+0000","last_undegraded":"2023-12-13T00:27:29.575066+0000","last_fullsized":"2023-12-13T00:27:29.575066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:10:58.571569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":7728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'66","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.834067+0000","last_change":"2023-12-13T00:00:31.143141+0000","last_active":"2023-12-13T00:28:04.834067+0000","last_peered":"2023-12-13T00:28:04.834067+0000","last_clean":"2023-12-13T00:28:04.834067+0000","last_became_active":"2023-12-13T00:00:31.142823+0000","last_became_peered":"2023-12-13T00:00:31.142823+0000","last_unstale":"2023-12-13T00:28:04.834067+0000","last_undegraded":"2023-12-13T00:28:04.834067+0000","last_fullsized":"2023-12-13T00:28:04.834067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:22:51.335464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'7","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:44.283017+0000","last_change":"2023-12-13T00:00:30.004773+0000","last_active":"2023-12-13T00:27:44.283017+0000","last_peered":"2023-12-13T00:27:44.283017+0000","last_clean":"2023-12-13T00:27:44.283017+0000","last_became_active":"2023-12-13T00:00:30.004496+0000","last_became_peered":"2023-12-13T00:00:30.004496+0000","last_unstale":"2023-12-13T00:27:44.283017+0000","last_undegraded":"2023-12-13T00:27:44.283017+0000","last_fullsized":"2023-12-13T00:27:44.283017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:51:20.708568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'188","reported_seq":216,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:30.822992+0000","last_change":"2023-12-13T00:00:35.666457+0000","last_active":"2023-12-13T00:27:30.822992+0000","last_peered":"2023-12-13T00:27:30.822992+0000","last_clean":"2023-12-13T00:27:30.822992+0000","last_became_active":"2023-12-13T00:00:35.666075+0000","last_became_peered":"2023-12-13T00:00:35.666075+0000","last_unstale":"2023-12-13T00:27:30.822992+0000","last_undegraded":"2023-12-13T00:27:30.822992+0000","last_fullsized":"2023-12-13T00:27:30.822992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:18:38.741479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":17531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'63","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.854672+0000","last_change":"2023-12-13T00:00:31.116511+0000","last_active":"2023-12-13T00:28:04.854672+0000","last_peered":"2023-12-13T00:28:04.854672+0000","last_clean":"2023-12-13T00:28:04.854672+0000","last_became_active":"2023-12-13T00:00:31.116209+0000","last_became_peered":"2023-12-13T00:00:31.116209+0000","last_unstale":"2023-12-13T00:28:04.854672+0000","last_undegraded":"2023-12-13T00:28:04.854672+0000","last_fullsized":"2023-12-13T00:28:04.854672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:06.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'484","reported_seq":991,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.156120+0000","last_change":"2023-12-13T00:00:30.006475+0000","last_active":"2023-12-13T00:27:57.156120+0000","last_peered":"2023-12-13T00:27:57.156120+0000","last_clean":"2023-12-13T00:27:57.156120+0000","last_became_active":"2023-12-13T00:00:30.006026+0000","last_became_peered":"2023-12-13T00:00:30.006026+0000","last_unstale":"2023-12-13T00:27:57.156120+0000","last_undegraded":"2023-12-13T00:27:57.156120+0000","last_fullsized":"2023-12-13T00:27:57.156120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:29.225167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92099,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":501,"num_write":481,"num_write_kb":501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'1030","reported_seq":1752,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.518326+0000","last_change":"2023-12-13T00:00:30.004483+0000","last_active":"2023-12-13T00:28:04.518326+0000","last_peered":"2023-12-13T00:28:04.518326+0000","last_clean":"2023-12-13T00:28:04.518326+0000","last_became_active":"2023-12-13T00:00:30.004214+0000","last_became_peered":"2023-12-13T00:00:30.004214+0000","last_unstale":"2023-12-13T00:28:04.518326+0000","last_undegraded":"2023-12-13T00:28:04.518326+0000","last_fullsized":"2023-12-13T00:28:04.518326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:14.096925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1792997,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":693,"num_read_kb":705,"num_write":1026,"num_write_kb":2509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'68","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.837208+0000","last_change":"2023-12-13T00:00:31.147121+0000","last_active":"2023-12-13T00:28:04.837208+0000","last_peered":"2023-12-13T00:28:04.837208+0000","last_clean":"2023-12-13T00:28:04.837208+0000","last_became_active":"2023-12-13T00:00:31.146818+0000","last_became_peered":"2023-12-13T00:00:31.146818+0000","last_unstale":"2023-12-13T00:28:04.837208+0000","last_undegraded":"2023-12-13T00:28:04.837208+0000","last_fullsized":"2023-12-13T00:28:04.837208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:12.753740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'150","reported_seq":176,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:26.446711+0000","last_change":"2023-12-13T00:00:35.642485+0000","last_active":"2023-12-13T00:27:26.446711+0000","last_peered":"2023-12-13T00:27:26.446711+0000","last_clean":"2023-12-13T00:27:26.446711+0000","last_became_active":"2023-12-13T00:00:35.642114+0000","last_became_peered":"2023-12-13T00:00:35.642114+0000","last_unstale":"2023-12-13T00:27:26.446711+0000","last_undegraded":"2023-12-13T00:27:26.446711+0000","last_fullsized":"2023-12-13T00:27:26.446711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:24:10.067039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":10646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'2837","reported_seq":2866,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:53.923570+0000","last_change":"2023-12-13T00:00:29.972296+0000","last_active":"2023-12-13T00:27:53.923570+0000","last_peered":"2023-12-13T00:27:53.923570+0000","last_clean":"2023-12-13T00:27:53.923570+0000","last_became_active":"2023-12-13T00:00:29.972018+0000","last_became_peered":"2023-12-13T00:00:29.972018+0000","last_unstale":"2023-12-13T00:27:53.923570+0000","last_undegraded":"2023-12-13T00:27:53.923570+0000","last_fullsized":"2023-12-13T00:27:53.923570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2837,"log_dups_size":0,"ondisk_log_size":2837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:30:26.126361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2827,"num_write_kb":13646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'70","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.898663+0000","last_change":"2023-12-13T00:00:31.037679+0000","last_active":"2023-12-13T00:28:04.898663+0000","last_peered":"2023-12-13T00:28:04.898663+0000","last_clean":"2023-12-13T00:28:04.898663+0000","last_became_active":"2023-12-13T00:00:31.037445+0000","last_became_peered":"2023-12-13T00:00:31.037445+0000","last_unstale":"2023-12-13T00:28:04.898663+0000","last_undegraded":"2023-12-13T00:28:04.898663+0000","last_fullsized":"2023-12-13T00:28:04.898663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:55.082987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'116","reported_seq":142,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.942392+0000","last_change":"2023-12-13T00:00:35.661405+0000","last_active":"2023-12-13T00:27:31.942392+0000","last_peered":"2023-12-13T00:27:31.942392+0000","last_clean":"2023-12-13T00:27:31.942392+0000","last_became_active":"2023-12-13T00:00:35.660984+0000","last_became_peered":"2023-12-13T00:00:35.660984+0000","last_unstale":"2023-12-13T00:27:31.942392+0000","last_undegraded":"2023-12-13T00:27:31.942392+0000","last_fullsized":"2023-12-13T00:27:31.942392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:24.668139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":9076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.885751+0000","last_change":"2023-12-13T00:00:31.147104+0000","last_active":"2023-12-13T00:28:04.885751+0000","last_peered":"2023-12-13T00:28:04.885751+0000","last_clean":"2023-12-13T00:28:04.885751+0000","last_became_active":"2023-12-13T00:00:31.145225+0000","last_became_peered":"2023-12-13T00:00:31.145225+0000","last_unstale":"2023-12-13T00:28:04.885751+0000","last_undegraded":"2023-12-13T00:28:04.885751+0000","last_fullsized":"2023-12-13T00:28:04.885751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:42:14.707955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'66","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.758045+0000","last_change":"2023-12-13T00:00:31.119735+0000","last_active":"2023-12-13T00:28:04.758045+0000","last_peered":"2023-12-13T00:28:04.758045+0000","last_clean":"2023-12-13T00:28:04.758045+0000","last_became_active":"2023-12-13T00:00:31.119474+0000","last_became_peered":"2023-12-13T00:00:31.119474+0000","last_unstale":"2023-12-13T00:28:04.758045+0000","last_undegraded":"2023-12-13T00:28:04.758045+0000","last_fullsized":"2023-12-13T00:28:04.758045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:30.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'62","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.877774+0000","last_change":"2023-12-13T00:00:31.027180+0000","last_active":"2023-12-13T00:28:04.877774+0000","last_peered":"2023-12-13T00:28:04.877774+0000","last_clean":"2023-12-13T00:28:04.877774+0000","last_became_active":"2023-12-13T00:00:31.026922+0000","last_became_peered":"2023-12-13T00:00:31.026922+0000","last_unstale":"2023-12-13T00:28:04.877774+0000","last_undegraded":"2023-12-13T00:28:04.877774+0000","last_fullsized":"2023-12-13T00:28:04.877774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:58:37.933386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'58","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.859144+0000","last_change":"2023-12-13T00:00:31.119937+0000","last_active":"2023-12-13T00:28:04.859144+0000","last_peered":"2023-12-13T00:28:04.859144+0000","last_clean":"2023-12-13T00:28:04.859144+0000","last_became_active":"2023-12-13T00:00:31.119685+0000","last_became_peered":"2023-12-13T00:00:31.119685+0000","last_unstale":"2023-12-13T00:28:04.859144+0000","last_undegraded":"2023-12-13T00:28:04.859144+0000","last_fullsized":"2023-12-13T00:28:04.859144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:00.910594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.818174+0000","last_change":"2023-12-13T00:00:31.150597+0000","last_active":"2023-12-13T00:28:04.818174+0000","last_peered":"2023-12-13T00:28:04.818174+0000","last_clean":"2023-12-13T00:28:04.818174+0000","last_became_active":"2023-12-13T00:00:31.150275+0000","last_became_peered":"2023-12-13T00:00:31.150275+0000","last_unstale":"2023-12-13T00:28:04.818174+0000","last_undegraded":"2023-12-13T00:28:04.818174+0000","last_fullsized":"2023-12-13T00:28:04.818174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:20.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'47","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.817976+0000","last_change":"2023-12-13T00:00:31.117688+0000","last_active":"2023-12-13T00:28:04.817976+0000","last_peered":"2023-12-13T00:28:04.817976+0000","last_clean":"2023-12-13T00:28:04.817976+0000","last_became_active":"2023-12-13T00:00:31.117409+0000","last_became_peered":"2023-12-13T00:00:31.117409+0000","last_unstale":"2023-12-13T00:28:04.817976+0000","last_undegraded":"2023-12-13T00:28:04.817976+0000","last_fullsized":"2023-12-13T00:28:04.817976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:12.753740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'59","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.891063+0000","last_change":"2023-12-13T00:00:31.142584+0000","last_active":"2023-12-13T00:28:04.891063+0000","last_peered":"2023-12-13T00:28:04.891063+0000","last_clean":"2023-12-13T00:28:04.891063+0000","last_became_active":"2023-12-13T00:00:31.141656+0000","last_became_peered":"2023-12-13T00:00:31.141656+0000","last_unstale":"2023-12-13T00:28:04.891063+0000","last_undegraded":"2023-12-13T00:28:04.891063+0000","last_fullsized":"2023-12-13T00:28:04.891063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:49:22.676243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'47","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.860118+0000","last_change":"2023-12-13T00:00:31.036263+0000","last_active":"2023-12-13T00:28:04.860118+0000","last_peered":"2023-12-13T00:28:04.860118+0000","last_clean":"2023-12-13T00:28:04.860118+0000","last_became_active":"2023-12-13T00:00:31.036113+0000","last_became_peered":"2023-12-13T00:00:31.036113+0000","last_unstale":"2023-12-13T00:28:04.860118+0000","last_undegraded":"2023-12-13T00:28:04.860118+0000","last_fullsized":"2023-12-13T00:28:04.860118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:01.219033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'57","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.872949+0000","last_change":"2023-12-13T00:00:31.027230+0000","last_active":"2023-12-13T00:28:04.872949+0000","last_peered":"2023-12-13T00:28:04.872949+0000","last_clean":"2023-12-13T00:28:04.872949+0000","last_became_active":"2023-12-13T00:00:31.026968+0000","last_became_peered":"2023-12-13T00:00:31.026968+0000","last_unstale":"2023-12-13T00:28:04.872949+0000","last_undegraded":"2023-12-13T00:28:04.872949+0000","last_fullsized":"2023-12-13T00:28:04.872949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:53.920022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'71","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.858163+0000","last_change":"2023-12-13T00:00:31.139140+0000","last_active":"2023-12-13T00:28:04.858163+0000","last_peered":"2023-12-13T00:28:04.858163+0000","last_clean":"2023-12-13T00:28:04.858163+0000","last_became_active":"2023-12-13T00:00:31.138869+0000","last_became_peered":"2023-12-13T00:00:31.138869+0000","last_unstale":"2023-12-13T00:28:04.858163+0000","last_undegraded":"2023-12-13T00:28:04.858163+0000","last_fullsized":"2023-12-13T00:28:04.858163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:03:13.913502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'64","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.902318+0000","last_change":"2023-12-13T00:00:31.146522+0000","last_active":"2023-12-13T00:28:04.902318+0000","last_peered":"2023-12-13T00:28:04.902318+0000","last_clean":"2023-12-13T00:28:04.902318+0000","last_became_active":"2023-12-13T00:00:31.146264+0000","last_became_peered":"2023-12-13T00:00:31.146264+0000","last_unstale":"2023-12-13T00:28:04.902318+0000","last_undegraded":"2023-12-13T00:28:04.902318+0000","last_fullsized":"2023-12-13T00:28:04.902318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:20:47.671750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'68","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.832827+0000","last_change":"2023-12-13T00:00:31.143709+0000","last_active":"2023-12-13T00:28:04.832827+0000","last_peered":"2023-12-13T00:28:04.832827+0000","last_clean":"2023-12-13T00:28:04.832827+0000","last_became_active":"2023-12-13T00:00:31.143472+0000","last_became_peered":"2023-12-13T00:00:31.143472+0000","last_unstale":"2023-12-13T00:28:04.832827+0000","last_undegraded":"2023-12-13T00:28:04.832827+0000","last_fullsized":"2023-12-13T00:28:04.832827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:21:51.967408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'52","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.878271+0000","last_change":"2023-12-13T00:00:31.146698+0000","last_active":"2023-12-13T00:28:04.878271+0000","last_peered":"2023-12-13T00:28:04.878271+0000","last_clean":"2023-12-13T00:28:04.878271+0000","last_became_active":"2023-12-13T00:00:31.146159+0000","last_became_peered":"2023-12-13T00:00:31.146159+0000","last_unstale":"2023-12-13T00:28:04.878271+0000","last_undegraded":"2023-12-13T00:28:04.878271+0000","last_fullsized":"2023-12-13T00:28:04.878271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:05:56.876593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'67","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.876344+0000","last_change":"2023-12-13T00:00:31.143946+0000","last_active":"2023-12-13T00:28:04.876344+0000","last_peered":"2023-12-13T00:28:04.876344+0000","last_clean":"2023-12-13T00:28:04.876344+0000","last_became_active":"2023-12-13T00:00:31.143663+0000","last_became_peered":"2023-12-13T00:00:31.143663+0000","last_unstale":"2023-12-13T00:28:04.876344+0000","last_undegraded":"2023-12-13T00:28:04.876344+0000","last_fullsized":"2023-12-13T00:28:04.876344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:27:24.026750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'69","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.756252+0000","last_change":"2023-12-13T00:00:31.142314+0000","last_active":"2023-12-13T00:28:04.756252+0000","last_peered":"2023-12-13T00:28:04.756252+0000","last_clean":"2023-12-13T00:28:04.756252+0000","last_became_active":"2023-12-13T00:00:31.142067+0000","last_became_peered":"2023-12-13T00:00:31.142067+0000","last_unstale":"2023-12-13T00:28:04.756252+0000","last_undegraded":"2023-12-13T00:28:04.756252+0000","last_fullsized":"2023-12-13T00:28:04.756252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:36.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'51","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.874287+0000","last_change":"2023-12-13T00:00:31.146764+0000","last_active":"2023-12-13T00:28:04.874287+0000","last_peered":"2023-12-13T00:28:04.874287+0000","last_clean":"2023-12-13T00:28:04.874287+0000","last_became_active":"2023-12-13T00:00:31.146501+0000","last_became_peered":"2023-12-13T00:00:31.146501+0000","last_unstale":"2023-12-13T00:28:04.874287+0000","last_undegraded":"2023-12-13T00:28:04.874287+0000","last_fullsized":"2023-12-13T00:28:04.874287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:20:36.334790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'67","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.871560+0000","last_change":"2023-12-13T00:00:31.138982+0000","last_active":"2023-12-13T00:28:04.871560+0000","last_peered":"2023-12-13T00:28:04.871560+0000","last_clean":"2023-12-13T00:28:04.871560+0000","last_became_active":"2023-12-13T00:00:31.138738+0000","last_became_peered":"2023-12-13T00:00:31.138738+0000","last_unstale":"2023-12-13T00:28:04.871560+0000","last_undegraded":"2023-12-13T00:28:04.871560+0000","last_fullsized":"2023-12-13T00:28:04.871560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:08:05.660552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'52","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.865407+0000","last_change":"2023-12-13T00:00:31.148499+0000","last_active":"2023-12-13T00:28:04.865407+0000","last_peered":"2023-12-13T00:28:04.865407+0000","last_clean":"2023-12-13T00:28:04.865407+0000","last_became_active":"2023-12-13T00:00:31.148251+0000","last_became_peered":"2023-12-13T00:00:31.148251+0000","last_unstale":"2023-12-13T00:28:04.865407+0000","last_undegraded":"2023-12-13T00:28:04.865407+0000","last_fullsized":"2023-12-13T00:28:04.865407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:46:41.106364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'58","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.817989+0000","last_change":"2023-12-13T00:00:31.117684+0000","last_active":"2023-12-13T00:28:04.817989+0000","last_peered":"2023-12-13T00:28:04.817989+0000","last_clean":"2023-12-13T00:28:04.817989+0000","last_became_active":"2023-12-13T00:00:31.117423+0000","last_became_peered":"2023-12-13T00:00:31.117423+0000","last_unstale":"2023-12-13T00:28:04.817989+0000","last_undegraded":"2023-12-13T00:28:04.817989+0000","last_fullsized":"2023-12-13T00:28:04.817989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:33:39.081529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'67","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.825415+0000","last_change":"2023-12-13T00:00:31.150615+0000","last_active":"2023-12-13T00:28:04.825415+0000","last_peered":"2023-12-13T00:28:04.825415+0000","last_clean":"2023-12-13T00:28:04.825415+0000","last_became_active":"2023-12-13T00:00:31.150324+0000","last_became_peered":"2023-12-13T00:00:31.150324+0000","last_unstale":"2023-12-13T00:28:04.825415+0000","last_undegraded":"2023-12-13T00:28:04.825415+0000","last_fullsized":"2023-12-13T00:28:04.825415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:15:16.348222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'63","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.873042+0000","last_change":"2023-12-13T00:00:31.147145+0000","last_active":"2023-12-13T00:28:04.873042+0000","last_peered":"2023-12-13T00:28:04.873042+0000","last_clean":"2023-12-13T00:28:04.873042+0000","last_became_active":"2023-12-13T00:00:31.146444+0000","last_became_peered":"2023-12-13T00:00:31.146444+0000","last_unstale":"2023-12-13T00:28:04.873042+0000","last_undegraded":"2023-12-13T00:28:04.873042+0000","last_fullsized":"2023-12-13T00:28:04.873042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:52:46.548248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'67","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.876556+0000","last_change":"2023-12-13T00:00:31.148920+0000","last_active":"2023-12-13T00:28:04.876556+0000","last_peered":"2023-12-13T00:28:04.876556+0000","last_clean":"2023-12-13T00:28:04.876556+0000","last_became_active":"2023-12-13T00:00:31.148529+0000","last_became_peered":"2023-12-13T00:00:31.148529+0000","last_unstale":"2023-12-13T00:28:04.876556+0000","last_undegraded":"2023-12-13T00:28:04.876556+0000","last_fullsized":"2023-12-13T00:28:04.876556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:51.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'59","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.866724+0000","last_change":"2023-12-13T00:00:31.149934+0000","last_active":"2023-12-13T00:28:04.866724+0000","last_peered":"2023-12-13T00:28:04.866724+0000","last_clean":"2023-12-13T00:28:04.866724+0000","last_became_active":"2023-12-13T00:00:31.149685+0000","last_became_peered":"2023-12-13T00:00:31.149685+0000","last_unstale":"2023-12-13T00:28:04.866724+0000","last_undegraded":"2023-12-13T00:28:04.866724+0000","last_fullsized":"2023-12-13T00:28:04.866724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:06.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'62","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.897060+0000","last_change":"2023-12-13T00:00:31.035879+0000","last_active":"2023-12-13T00:28:04.897060+0000","last_peered":"2023-12-13T00:28:04.897060+0000","last_clean":"2023-12-13T00:28:04.897060+0000","last_became_active":"2023-12-13T00:00:31.035672+0000","last_became_peered":"2023-12-13T00:00:31.035672+0000","last_unstale":"2023-12-13T00:28:04.897060+0000","last_undegraded":"2023-12-13T00:28:04.897060+0000","last_fullsized":"2023-12-13T00:28:04.897060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:30.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'65","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.864746+0000","last_change":"2023-12-13T00:00:31.146556+0000","last_active":"2023-12-13T00:28:04.864746+0000","last_peered":"2023-12-13T00:28:04.864746+0000","last_clean":"2023-12-13T00:28:04.864746+0000","last_became_active":"2023-12-13T00:00:31.146186+0000","last_became_peered":"2023-12-13T00:00:31.146186+0000","last_unstale":"2023-12-13T00:28:04.864746+0000","last_undegraded":"2023-12-13T00:28:04.864746+0000","last_fullsized":"2023-12-13T00:28:04.864746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:20:30.098687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'52","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.863441+0000","last_change":"2023-12-13T00:00:31.145365+0000","last_active":"2023-12-13T00:28:04.863441+0000","last_peered":"2023-12-13T00:28:04.863441+0000","last_clean":"2023-12-13T00:28:04.863441+0000","last_became_active":"2023-12-13T00:00:31.144458+0000","last_became_peered":"2023-12-13T00:00:31.144458+0000","last_unstale":"2023-12-13T00:28:04.863441+0000","last_undegraded":"2023-12-13T00:28:04.863441+0000","last_fullsized":"2023-12-13T00:28:04.863441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:03:13.913502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'57","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.886975+0000","last_change":"2023-12-13T00:00:31.145052+0000","last_active":"2023-12-13T00:28:04.886975+0000","last_peered":"2023-12-13T00:28:04.886975+0000","last_clean":"2023-12-13T00:28:04.886975+0000","last_became_active":"2023-12-13T00:00:31.144792+0000","last_became_peered":"2023-12-13T00:00:31.144792+0000","last_unstale":"2023-12-13T00:28:04.886975+0000","last_undegraded":"2023-12-13T00:28:04.886975+0000","last_fullsized":"2023-12-13T00:28:04.886975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:30:27.231427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'50","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.866189+0000","last_change":"2023-12-13T00:00:31.149527+0000","last_active":"2023-12-13T00:28:04.866189+0000","last_peered":"2023-12-13T00:28:04.866189+0000","last_clean":"2023-12-13T00:28:04.866189+0000","last_became_active":"2023-12-13T00:00:31.148875+0000","last_became_peered":"2023-12-13T00:00:31.148875+0000","last_unstale":"2023-12-13T00:28:04.866189+0000","last_undegraded":"2023-12-13T00:28:04.866189+0000","last_fullsized":"2023-12-13T00:28:04.866189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:01.219033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'66","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.887626+0000","last_change":"2023-12-13T00:00:31.144423+0000","last_active":"2023-12-13T00:28:04.887626+0000","last_peered":"2023-12-13T00:28:04.887626+0000","last_clean":"2023-12-13T00:28:04.887626+0000","last_became_active":"2023-12-13T00:00:31.144174+0000","last_became_peered":"2023-12-13T00:00:31.144174+0000","last_unstale":"2023-12-13T00:28:04.887626+0000","last_undegraded":"2023-12-13T00:28:04.887626+0000","last_fullsized":"2023-12-13T00:28:04.887626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:10:31.724460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.850484+0000","last_change":"2023-12-13T00:00:31.144074+0000","last_active":"2023-12-13T00:28:04.850484+0000","last_peered":"2023-12-13T00:28:04.850484+0000","last_clean":"2023-12-13T00:28:04.850484+0000","last_became_active":"2023-12-13T00:00:31.143809+0000","last_became_peered":"2023-12-13T00:00:31.143809+0000","last_unstale":"2023-12-13T00:28:04.850484+0000","last_undegraded":"2023-12-13T00:28:04.850484+0000","last_fullsized":"2023-12-13T00:28:04.850484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:51.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'47","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.856227+0000","last_change":"2023-12-13T00:00:31.116522+0000","last_active":"2023-12-13T00:28:04.856227+0000","last_peered":"2023-12-13T00:28:04.856227+0000","last_clean":"2023-12-13T00:28:04.856227+0000","last_became_active":"2023-12-13T00:00:31.116230+0000","last_became_peered":"2023-12-13T00:00:31.116230+0000","last_unstale":"2023-12-13T00:28:04.856227+0000","last_undegraded":"2023-12-13T00:28:04.856227+0000","last_fullsized":"2023-12-13T00:28:04.856227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:52:46.548248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'66","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.877641+0000","last_change":"2023-12-13T00:00:31.149691+0000","last_active":"2023-12-13T00:28:04.877641+0000","last_peered":"2023-12-13T00:28:04.877641+0000","last_clean":"2023-12-13T00:28:04.877641+0000","last_became_active":"2023-12-13T00:00:31.149410+0000","last_became_peered":"2023-12-13T00:00:31.149410+0000","last_unstale":"2023-12-13T00:28:04.877641+0000","last_undegraded":"2023-12-13T00:28:04.877641+0000","last_fullsized":"2023-12-13T00:28:04.877641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:50:58.339436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":248,"num_write":4193,"num_write_kb":331487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5031,"ondisk_log_size":5031,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3759,"ondisk_log_size":3759,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":43904475,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":1477,"num_read_kb":1524,"num_write":14609,"num_write_kb":50682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87957504,"data_stored":87808950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13591,"ondisk_log_size":13591,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509781,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53632,"kb_used_data":8568,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318208,"statfs":{"total":96636764160,"available":96581844992,"internally_reserved":0,"allocated":8773632,"data_stored":8578223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39700000000000002,"15min":0.40000000000000002},"min":{"1min":0.27700000000000002,"5min":0.25800000000000001,"15min":0.23699999999999999},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.65800000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42299999999999999,"15min":0.42899999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.58699999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.45400000000000001}]},{"osd":1,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.441,"15min":0.437},"min":{"1min":0.309,"5min":0.30499999999999999,"15min":0.24299999999999999},"max":{"1min":0.60599999999999998,"5min":0.63500000000000001,"15min":0.68200000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41099999999999998,"15min":0.41899999999999998},"min":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.26000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.61699999999999999},"last":0.47699999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.27100000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.442},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.33000000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.57399999999999995,"5min":0.65100000000000002,"15min":0.65200000000000002},"last":0.39600000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.436,"15min":0.438},"min":{"1min":0.36899999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55800000000000005,"5min":0.623,"15min":0.623},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.309},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.372,"15min":0.375},"min":{"1min":0.249,"5min":0.246,"15min":0.24199999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.39200000000000002,"15min":0.39500000000000002},"min":{"1min":0.28799999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.60099999999999998,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.31}]},{"osd":5,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40799999999999997,"15min":0.40100000000000002},"min":{"1min":0.28299999999999997,"5min":0.26300000000000001,"15min":0.22900000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.45100000000000001,"15min":0.438},"min":{"1min":0.314,"5min":0.29799999999999999,"15min":0.23100000000000001},"max":{"1min":0.68400000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.42699999999999999}]},{"osd":6,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.45700000000000002},"min":{"1min":0.34499999999999997,"5min":0.28899999999999998,"15min":0.23999999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.307,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67900000000000005,"15min":0.71799999999999997},"last":0.35299999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509780,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88192,"kb_used_data":16760,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94283648,"statfs":{"total":96636764160,"available":96546455552,"internally_reserved":0,"allocated":17162240,"data_stored":16985405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.34100000000000003,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.42799999999999999},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.23100000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.70099999999999996}]},{"osd":1,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.30399999999999999,"5min":0.28599999999999998,"15min":0.252},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.41899999999999998,"15min":0.41699999999999998},"min":{"1min":0.34599999999999997,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.58599999999999997}]},{"osd":2,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.42299999999999999,"15min":0.41099999999999998},"min":{"1min":0.35799999999999998,"5min":0.30099999999999999,"15min":0.247},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.627},{"interface":"front","average":{"1min":0.505,"5min":0.437,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.26500000000000001},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.78000000000000003}]},{"osd":3,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.28999999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32300000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.60699999999999998}]},{"osd":4,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.38,"15min":0.379},"min":{"1min":0.254,"5min":0.215,"15min":0.215},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.46600000000000003}]},{"osd":5,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.378},"min":{"1min":0.24399999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.502},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44500000000000001,"15min":0.436},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.249},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.441,"15min":0.44},"min":{"1min":0.32200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.433,"15min":0.439},"min":{"1min":0.29499999999999998,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.56100000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509782,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58980,"kb_used_data":9756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312860,"statfs":{"total":96636764160,"available":96576368640,"internally_reserved":0,"allocated":9990144,"data_stored":9784207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.41999999999999998},"min":{"1min":0.33500000000000002,"5min":0.216,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40400000000000003,"15min":0.40999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.49399999999999999}]},{"osd":1,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.41199999999999998},"min":{"1min":0.373,"5min":0.248,"15min":0.224},"max":{"1min":0.55700000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.432,"15min":0.435},"min":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.251},"max":{"1min":0.53000000000000003,"5min":0.57699999999999996,"15min":0.59999999999999998},"last":0.46200000000000002}]},{"osd":2,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.43099999999999999,"15min":0.432},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27100000000000002},"max":{"1min":0.54800000000000004,"5min":0.60099999999999998,"15min":0.60699999999999998},"last":0.438},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.65500000000000003},"last":0.48499999999999999}]},{"osd":3,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54300000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.378,"5min":0.33200000000000002,"15min":0.28699999999999998},"max":{"1min":0.63100000000000001,"5min":0.65500000000000003,"15min":0.66800000000000004},"last":0.47199999999999998}]},{"osd":5,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38300000000000001,"15min":0.38200000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.221},"max":{"1min":0.61299999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.65100000000000002},"last":0.36199999999999999}]},{"osd":6,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.378,"15min":0.38500000000000001},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.247},"max":{"1min":0.624,"5min":0.63100000000000001,"15min":0.71999999999999997},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.30099999999999999,"5min":0.27300000000000002,"15min":0.23899999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.71899999999999997},"last":0.41999999999999998}]},{"osd":7,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.42999999999999999,"15min":0.42699999999999999},"min":{"1min":0.32500000000000001,"5min":0.26300000000000001,"15min":0.25600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.70299999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47099999999999997,"15min":0.46200000000000002},"min":{"1min":0.34799999999999998,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.38500000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509782,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96880,"kb_used_data":21288,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94274960,"statfs":{"total":96636764160,"available":96537559040,"internally_reserved":0,"allocated":21798912,"data_stored":21617833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.317,"15min":0.316},"min":{"1min":0.22600000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.42699999999999999,"5min":0.53200000000000003,"15min":0.64000000000000001},"last":0.313},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.312,"15min":0.312},"min":{"1min":0.246,"5min":0.19600000000000001,"15min":0.192},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.57899999999999996},"last":0.32700000000000001}]},{"osd":1,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34000000000000002,"15min":0.33000000000000002},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.20200000000000001},"max":{"1min":0.41299999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.28499999999999998,"5min":0.27400000000000002,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.35999999999999999}]},{"osd":2,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.26600000000000001,"5min":0.249,"15min":0.22800000000000001},"max":{"1min":0.47799999999999998,"5min":0.59899999999999998,"15min":0.69399999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39800000000000002,"15min":0.39600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.23799999999999999},"max":{"1min":0.51400000000000001,"5min":0.59699999999999998,"15min":0.66300000000000003},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.311},"max":{"1min":0.72199999999999998,"5min":0.80100000000000005,"15min":0.90700000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.38500000000000001,"5min":0.34100000000000003,"15min":0.316},"max":{"1min":0.64500000000000002,"5min":0.76700000000000002,"15min":0.84199999999999997},"last":0.63200000000000001}]},{"osd":5,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.83199999999999996},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50700000000000001,"15min":0.5},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.30599999999999999},"max":{"1min":0.72799999999999998,"5min":0.76000000000000001,"15min":0.81999999999999995},"last":0.47399999999999998}]},{"osd":6,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.67600000000000005,"5min":0.78600000000000003,"15min":0.80600000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54600000000000004,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.79300000000000004},"last":0.72199999999999998}]},{"osd":7,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.78800000000000003},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.39500000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.85799999999999998},"last":0.51200000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509780,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36200,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335640,"statfs":{"total":96636764160,"available":96599695360,"internally_reserved":0,"allocated":884736,"data_stored":706002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.308,"15min":0.29899999999999999},"min":{"1min":0.20399999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.49299999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.308,"5min":0.32000000000000001,"15min":0.32800000000000001},"min":{"1min":0.251,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.41199999999999998,"5min":0.57599999999999996,"15min":0.63600000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33100000000000002,"15min":0.32500000000000001},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.44500000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.372},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35599999999999998,"15min":0.35199999999999998},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.23100000000000001},"max":{"1min":0.501,"5min":0.53800000000000003,"15min":0.55000000000000004},"last":0.44700000000000001}]},{"osd":3,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38100000000000001,"15min":0.375},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.5,"5min":0.60599999999999998,"15min":0.60799999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.39200000000000002,"15min":0.38400000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.52100000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.42199999999999999}]},{"osd":4,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59199999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.371,"5min":0.316,"15min":0.316},"max":{"1min":0.747,"5min":0.79800000000000004,"15min":0.84699999999999998},"last":0.57099999999999995}]},{"osd":5,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.69099999999999995,"5min":0.78500000000000003,"15min":0.81999999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51000000000000001,"15min":0.48999999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.32000000000000001},"max":{"1min":0.71899999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54400000000000004}]},{"osd":6,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.29099999999999998},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":0.89300000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.35999999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66700000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.622}]},{"osd":7,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.38800000000000001,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":0.67500000000000004,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.34999999999999998},"max":{"1min":0.68999999999999995,"5min":0.82699999999999996,"15min":0.85799999999999998},"last":0.58299999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542484,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70184,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94301656,"statfs":{"total":96636764160,"available":96564895744,"internally_reserved":0,"allocated":8683520,"data_stored":8504788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.313,"15min":0.308},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.38400000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.32200000000000001,"15min":0.32700000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.19},"max":{"1min":0.42799999999999999,"5min":0.53200000000000003,"15min":0.60299999999999998},"last":0.27100000000000002}]},{"osd":1,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.33000000000000002,"15min":0.33100000000000002},"min":{"1min":0.23599999999999999,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.38200000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.746},"last":0.437}]},{"osd":3,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35899999999999999,"15min":0.36799999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46800000000000003,"5min":0.57399999999999995,"15min":1.03},"last":0.313},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.376,"15min":0.38500000000000001},"min":{"1min":0.26000000000000001,"5min":0.247,"15min":0.23499999999999999},"max":{"1min":0.41799999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.33600000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46899999999999997,"15min":0.46600000000000003},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.85399999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.496,"15min":0.48699999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.28499999999999998},"max":{"1min":0.65700000000000003,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.65700000000000003}]},{"osd":5,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.47899999999999998,"15min":0.46899999999999997},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.317},"max":{"1min":0.56899999999999995,"5min":0.70799999999999996,"15min":0.82099999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51600000000000001,"15min":0.496},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.316},"max":{"1min":0.76100000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.76100000000000001}]},{"osd":6,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.36799999999999999,"5min":0.36199999999999999,"15min":0.34499999999999997},"max":{"1min":0.61799999999999999,"5min":0.74399999999999999,"15min":0.79800000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.498,"15min":0.503},"min":{"1min":0.377,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.52500000000000002,"5min":0.75800000000000001,"15min":0.78200000000000003},"last":0.501}]},{"osd":7,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53500000000000003,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35499999999999998},"max":{"1min":0.63800000000000001,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.48699999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542484,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67936,"kb_used_data":6232,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94303904,"statfs":{"total":96636764160,"available":96567197696,"internally_reserved":0,"allocated":6381568,"data_stored":6195602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.32900000000000001,"15min":0.32000000000000001},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.19400000000000001},"max":{"1min":0.56599999999999995,"5min":0.627,"15min":0.66900000000000004},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33000000000000002,"15min":0.316},"min":{"1min":0.22700000000000001,"5min":0.221,"15min":0.19900000000000001},"max":{"1min":0.47299999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.35699999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32600000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57999999999999996,"5min":0.60699999999999998,"15min":0.64600000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.37,"15min":0.35399999999999998},"min":{"1min":0.246,"5min":0.24299999999999999,"15min":0.23000000000000001},"max":{"1min":0.52800000000000002,"5min":0.61299999999999999,"15min":0.72299999999999998},"last":0.27100000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36199999999999999,"15min":0.35499999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.22900000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.36799999999999999},"min":{"1min":0.28999999999999998,"5min":0.26300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.65400000000000003},"last":0.34499999999999997}]},{"osd":4,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.33500000000000002,"5min":0.30499999999999999,"15min":0.25800000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51500000000000001,"15min":0.47899999999999998},"min":{"1min":0.36499999999999999,"5min":0.35899999999999999,"15min":0.27200000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.40899999999999997}]},{"osd":5,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52500000000000002,"15min":0.48499999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.505},"min":{"1min":0.40000000000000002,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.39900000000000002}]},{"osd":6,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52000000000000002},"min":{"1min":0.40200000000000002,"5min":0.33800000000000002,"15min":0.33600000000000002},"max":{"1min":0.71699999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.51900000000000002},"min":{"1min":0.41999999999999998,"5min":0.377,"15min":0.34499999999999997},"max":{"1min":0.81699999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.41999999999999998}]},{"osd":7,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69399999999999995,"5min":0.746,"15min":0.79500000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":0.54100000000000004},"min":{"1min":0.371,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.371}]}]},{"osd":5,"up_from":13,"seq":55834575189,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88748,"kb_used_data":17316,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94283092,"statfs":{"total":96636764160,"available":96545886208,"internally_reserved":0,"allocated":17731584,"data_stored":17541418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.307,"5min":0.255,"15min":0.20200000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.70399999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41399999999999998,"15min":0.40699999999999997},"min":{"1min":0.30099999999999999,"5min":0.28000000000000003,"15min":0.23999999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.67300000000000004},"last":0.48999999999999999}]},{"osd":1,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.434,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.249},"max":{"1min":0.61499999999999999,"5min":0.625,"15min":0.67300000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.33300000000000002,"5min":0.28999999999999998,"15min":0.247},"max":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.73399999999999999},"last":0.60299999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.42999999999999999,"15min":0.42299999999999999},"min":{"1min":0.317,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.628,"5min":0.628,"15min":0.68700000000000006},"last":0.503},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41599999999999998,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.65900000000000003},"last":0.53500000000000003}]},{"osd":3,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44600000000000001,"15min":0.436},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.27300000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.68999999999999995},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.44800000000000001},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.69099999999999995},"last":0.52100000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38800000000000001,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.215},"max":{"1min":0.58599999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40100000000000002,"15min":0.38600000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.22900000000000001},"max":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.65000000000000002},"last":0.41999999999999998}]},{"osd":6,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.374,"15min":0.36499999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.22500000000000001},"max":{"1min":0.48299999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.42299999999999999,"15min":0.41799999999999998},"min":{"1min":0.26100000000000001,"5min":0.25800000000000001,"15min":0.24399999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.77400000000000002},"last":0.39900000000000002}]},{"osd":7,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.41899999999999998},"min":{"1min":0.29999999999999999,"5min":0.27400000000000002,"15min":0.22900000000000001},"max":{"1min":0.60099999999999998,"5min":0.61099999999999999,"15min":0.68899999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.433},"min":{"1min":0.36699999999999999,"5min":0.27000000000000002,"15min":0.26700000000000002},"max":{"1min":0.64500000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.436}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6098944,"data_stored":6080128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21516288,"data_stored":21502359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9707520,"data_stored":9668733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16855040,"data_stored":16835576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16879616,"data_stored":16869931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8491008,"data_stored":8462749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T00:28:11.403 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T00:28:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.537+0000 7f172dcec640 1 Processor -- start 2023-12-13T00:28:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.537+0000 7f172dcec640 1 -- start start 2023-12-13T00:28:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.538+0000 7f172dcec640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f17280c5080 0x7f172806b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.538+0000 7f172dcec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f172815ae40 0x7f172815b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.538+0000 7f172dcec640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172806a4b0 con 0x7f17280c4ca0 2023-12-13T00:28:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.538+0000 7f172dcec640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172815b830 con 0x7f17280c5080 2023-12-13T00:28:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.538+0000 7f172dcec640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17280c8330 con 0x7f172815ae40 2023-12-13T00:28:11.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.545+0000 7f1727fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f172815ae40 0x7f172815b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:11.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.546+0000 7f1727fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f172815ae40 0x7f172815b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:34870/0 (socket says 172.21.15.72:34870) 2023-12-13T00:28:11.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.546+0000 7f1727fff640 1 -- 172.21.15.72:0/3979344086 learned_addr learned my addr 172.21.15.72:0/3979344086 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:11.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.548+0000 7f1727fff640 1 -- 172.21.15.72:0/3979344086 >> v2:172.21.15.176:3300/0 conn(0x7f17280c5080 msgr2=0x7f172806b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:11.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.548+0000 7f1727fff640 1 --2- 172.21.15.72:0/3979344086 >> v2:172.21.15.176:3300/0 conn(0x7f17280c5080 0x7f172806b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:11.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.548+0000 7f1727fff640 1 -- 172.21.15.72:0/3979344086 >> v1:172.21.15.176:6789/0 conn(0x7f17280c4ca0 legacy=0x7f1728157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:11.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.548+0000 7f1727fff640 1 -- 172.21.15.72:0/3979344086 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17280c85d0 con 0x7f172815ae40 2023-12-13T00:28:11.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.552+0000 7f1727fff640 1 --2- 172.21.15.72:0/3979344086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f172815ae40 0x7f172815b2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1720009e80 tx=0x7f172002beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e4aa25a32aa4fc server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:11.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.557+0000 7f1726ffd640 1 -- 172.21.15.72:0/3979344086 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172002ca50 con 0x7f172815ae40 2023-12-13T00:28:11.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.558+0000 7f1726ffd640 1 -- 172.21.15.72:0/3979344086 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172002cbb0 con 0x7f172815ae40 2023-12-13T00:28:11.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.558+0000 7f1726ffd640 1 -- 172.21.15.72:0/3979344086 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17200343f0 con 0x7f172815ae40 2023-12-13T00:28:11.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.558+0000 7f172dcec640 1 -- 172.21.15.72:0/3979344086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f172815ae40 msgr2=0x7f172815b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:11.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.558+0000 7f172dcec640 1 --2- 172.21.15.72:0/3979344086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f172815ae40 0x7f172815b2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1720009e80 tx=0x7f172002beb0 comp rx=0 tx=0).stop 2023-12-13T00:28:11.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.558+0000 7f172dcec640 1 -- 172.21.15.72:0/3979344086 shutdown_connections 2023-12-13T00:28:11.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.558+0000 7f172dcec640 1 --2- 172.21.15.72:0/3979344086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f172815ae40 0x7f172815b2f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:11.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.558+0000 7f172dcec640 1 --2- 172.21.15.72:0/3979344086 >> v2:172.21.15.176:3300/0 conn(0x7f17280c5080 0x7f172806b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:11.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.558+0000 7f172dcec640 1 -- 172.21.15.72:0/3979344086 >> 172.21.15.72:0/3979344086 conn(0x7f172806d170 msgr2=0x7f172806d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:11.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.558+0000 7f172dcec640 1 -- 172.21.15.72:0/3979344086 shutdown_connections 2023-12-13T00:28:11.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.558+0000 7f172dcec640 1 -- 172.21.15.72:0/3979344086 wait complete. 2023-12-13T00:28:11.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.560+0000 7f172dcec640 1 Processor -- start 2023-12-13T00:28:11.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.560+0000 7f172dcec640 1 -- start start 2023-12-13T00:28:11.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.560+0000 7f172dcec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17280c4ca0 0x7f172814b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:11.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.560+0000 7f172dcec640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17280c5080 0x7f17281512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:11.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.560+0000 7f172dcec640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f172815ae40 0x7f17281f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:11.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.560+0000 7f172dcec640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172814cce0 con 0x7f172815ae40 2023-12-13T00:28:11.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.560+0000 7f172dcec640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17281f0440 con 0x7f17280c5080 2023-12-13T00:28:11.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.560+0000 7f172dcec640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172814d160 con 0x7f17280c4ca0 2023-12-13T00:28:11.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.561+0000 7f1727fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f172815ae40 0x7f17281f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:11.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.561+0000 7f171ffff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17280c5080 0x7f17281512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:11.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.561+0000 7f1727fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f172815ae40 0x7f17281f08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51438/0 (socket says 172.21.15.72:51438) 2023-12-13T00:28:11.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.561+0000 7f1727fff640 1 -- 172.21.15.72:0/439179139 learned_addr learned my addr 172.21.15.72:0/439179139 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:11.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.561+0000 7f17277fe640 1 --2- 172.21.15.72:0/439179139 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17280c4ca0 0x7f172814b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:11.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.564+0000 7f1727fff640 1 -- 172.21.15.72:0/439179139 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17280c4ca0 msgr2=0x7f172814b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:11.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.564+0000 7f1727fff640 1 --2- 172.21.15.72:0/439179139 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17280c4ca0 0x7f172814b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:11.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.564+0000 7f1727fff640 1 -- 172.21.15.72:0/439179139 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17280c5080 msgr2=0x7f17281512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:11.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.564+0000 7f1727fff640 1 --2- 172.21.15.72:0/439179139 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17280c5080 0x7f17281512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:11.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.564+0000 7f1727fff640 1 -- 172.21.15.72:0/439179139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1720009b30 con 0x7f172815ae40 2023-12-13T00:28:11.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.567+0000 7f1727fff640 1 --2- 172.21.15.72:0/439179139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f172815ae40 0x7f17281f08d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1720009fa0 tx=0x7f1720004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:11.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.570+0000 7f1724ff9640 1 -- 172.21.15.72:0/439179139 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172003e450 con 0x7f172815ae40 2023-12-13T00:28:11.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.570+0000 7f1724ff9640 1 -- 172.21.15.72:0/439179139 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172003e5b0 con 0x7f172815ae40 2023-12-13T00:28:11.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.570+0000 7f1724ff9640 1 -- 172.21.15.72:0/439179139 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172003e960 con 0x7f172815ae40 2023-12-13T00:28:11.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.570+0000 7f172dcec640 1 -- 172.21.15.72:0/439179139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172814d440 con 0x7f172815ae40 2023-12-13T00:28:11.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.570+0000 7f172dcec640 1 -- 172.21.15.72:0/439179139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172814da00 con 0x7f172815ae40 2023-12-13T00:28:11.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.571+0000 7f172dcec640 1 -- 172.21.15.72:0/439179139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1728067470 con 0x7f172815ae40 2023-12-13T00:28:11.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.591+0000 7f1724ff9640 1 -- 172.21.15.72:0/439179139 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f172003eac0 con 0x7f172815ae40 2023-12-13T00:28:11.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.592+0000 7f1724ff9640 1 --2- 172.21.15.72:0/439179139 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f170806b210 0x7f170806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:11.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.592+0000 7f17277fe640 1 --2- 172.21.15.72:0/439179139 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f170806b210 0x7f170806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:11.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.592+0000 7f17277fe640 1 --2- 172.21.15.72:0/439179139 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f170806b210 0x7f170806d6d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f17180017f0 tx=0x7f1718009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:11.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.829+0000 7f1724ff9640 1 -- 172.21.15.72:0/439179139 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f172007bf50 con 0x7f172815ae40 2023-12-13T00:28:11.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.829+0000 7f1724ff9640 1 -- 172.21.15.72:0/439179139 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1720077b90 con 0x7f172815ae40 2023-12-13T00:28:11.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:11.995+0000 7f172dcec640 1 -- 172.21.15.72:0/439179139 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17280c8bf0 con 0x7f170806b210 2023-12-13T00:28:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.004+0000 7f1724ff9640 1 -- 172.21.15.72:0/439179139 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370978 (secure 0 0 0) 0x7f1718001440 con 0x7f170806b210 2023-12-13T00:28:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:28:12.010 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-12-13T00:28:12.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.007+0000 7f172dcec640 1 -- 172.21.15.72:0/439179139 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f170806b210 msgr2=0x7f170806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:12.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.007+0000 7f172dcec640 1 --2- 172.21.15.72:0/439179139 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f170806b210 0x7f170806d6d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f17180017f0 tx=0x7f1718009040 comp rx=0 tx=0).stop 2023-12-13T00:28:12.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.007+0000 7f172dcec640 1 -- 172.21.15.72:0/439179139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f172815ae40 msgr2=0x7f17281f08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:12.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.007+0000 7f172dcec640 1 --2- 172.21.15.72:0/439179139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f172815ae40 0x7f17281f08d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1720009fa0 tx=0x7f1720004a40 comp rx=0 tx=0).stop 2023-12-13T00:28:12.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.008+0000 7f172dcec640 1 -- 172.21.15.72:0/439179139 shutdown_connections 2023-12-13T00:28:12.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.008+0000 7f172dcec640 1 --2- 172.21.15.72:0/439179139 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f170806b210 0x7f170806d6d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:12.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.008+0000 7f172dcec640 1 --2- 172.21.15.72:0/439179139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f172815ae40 0x7f17281f08d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:12.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.008+0000 7f172dcec640 1 --2- 172.21.15.72:0/439179139 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17280c5080 0x7f17281512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:12.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.008+0000 7f172dcec640 1 --2- 172.21.15.72:0/439179139 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17280c4ca0 0x7f172814b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:12.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.008+0000 7f172dcec640 1 -- 172.21.15.72:0/439179139 >> 172.21.15.72:0/439179139 conn(0x7f172806d170 msgr2=0x7f172806f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:12.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.008+0000 7f172dcec640 1 -- 172.21.15.72:0/439179139 shutdown_connections 2023-12-13T00:28:12.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.008+0000 7f172dcec640 1 -- 172.21.15.72:0/439179139 wait complete. 2023-12-13T00:28:12.019 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":863,"stamp":"2023-12-13T00:28:10.907487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44494843,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1597,"num_read_kb":1872,"num_write":18961,"num_write_kb":384585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22498,"ondisk_log_size":22498,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":560752,"kb_used_data":89264,"kb_used_omap":12,"kb_used_meta":471411,"kb_avail":754413968,"statfs":{"total":773094113280,"available":772519903232,"internally_reserved":0,"allocated":91406336,"data_stored":89913478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":482725426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":84915,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":57,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003257"},"pg_stats":[{"pgid":"2.1f","version":"27'888","reported_seq":919,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:33.949039+0000","last_change":"2023-12-13T00:00:29.997631+0000","last_active":"2023-12-13T00:27:33.949039+0000","last_peered":"2023-12-13T00:27:33.949039+0000","last_clean":"2023-12-13T00:27:33.949039+0000","last_became_active":"2023-12-13T00:00:29.997381+0000","last_became_peered":"2023-12-13T00:00:29.997381+0000","last_unstale":"2023-12-13T00:27:33.949039+0000","last_undegraded":"2023-12-13T00:27:33.949039+0000","last_fullsized":"2023-12-13T00:27:33.949039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:33:37.976462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":4535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'54","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.857641+0000","last_change":"2023-12-13T00:00:31.138533+0000","last_active":"2023-12-13T00:28:04.857641+0000","last_peered":"2023-12-13T00:28:04.857641+0000","last_clean":"2023-12-13T00:28:04.857641+0000","last_became_active":"2023-12-13T00:00:31.138242+0000","last_became_peered":"2023-12-13T00:00:31.138242+0000","last_unstale":"2023-12-13T00:28:04.857641+0000","last_undegraded":"2023-12-13T00:28:04.857641+0000","last_fullsized":"2023-12-13T00:28:04.857641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:39:59.955103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'155","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:25.503482+0000","last_change":"2023-12-13T00:00:35.667840+0000","last_active":"2023-12-13T00:27:25.503482+0000","last_peered":"2023-12-13T00:27:25.503482+0000","last_clean":"2023-12-13T00:27:25.503482+0000","last_became_active":"2023-12-13T00:00:35.667498+0000","last_became_peered":"2023-12-13T00:00:35.667498+0000","last_unstale":"2023-12-13T00:27:25.503482+0000","last_undegraded":"2023-12-13T00:27:25.503482+0000","last_fullsized":"2023-12-13T00:27:25.503482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:17.304722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'846","reported_seq":877,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:35.941673+0000","last_change":"2023-12-13T00:00:30.001888+0000","last_active":"2023-12-13T00:27:35.941673+0000","last_peered":"2023-12-13T00:27:35.941673+0000","last_clean":"2023-12-13T00:27:35.941673+0000","last_became_active":"2023-12-13T00:00:30.001628+0000","last_became_peered":"2023-12-13T00:00:30.001628+0000","last_unstale":"2023-12-13T00:27:35.941673+0000","last_undegraded":"2023-12-13T00:27:35.941673+0000","last_fullsized":"2023-12-13T00:27:35.941673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:48:30.422214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'62","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.860247+0000","last_change":"2023-12-13T00:00:31.036420+0000","last_active":"2023-12-13T00:28:04.860247+0000","last_peered":"2023-12-13T00:28:04.860247+0000","last_clean":"2023-12-13T00:28:04.860247+0000","last_became_active":"2023-12-13T00:00:31.036197+0000","last_became_peered":"2023-12-13T00:00:31.036197+0000","last_unstale":"2023-12-13T00:28:04.860247+0000","last_undegraded":"2023-12-13T00:28:04.860247+0000","last_fullsized":"2023-12-13T00:28:04.860247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:05:56.876593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'165","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.828080+0000","last_change":"2023-12-13T00:00:35.665348+0000","last_active":"2023-12-13T00:27:29.828080+0000","last_peered":"2023-12-13T00:27:29.828080+0000","last_clean":"2023-12-13T00:27:29.828080+0000","last_became_active":"2023-12-13T00:00:35.664981+0000","last_became_peered":"2023-12-13T00:00:35.664981+0000","last_unstale":"2023-12-13T00:27:29.828080+0000","last_undegraded":"2023-12-13T00:27:29.828080+0000","last_fullsized":"2023-12-13T00:27:29.828080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:55.759392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":248,"num_write":136,"num_write_kb":7125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'11","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:53.927716+0000","last_change":"2023-12-13T00:00:30.009983+0000","last_active":"2023-12-13T00:27:53.927716+0000","last_peered":"2023-12-13T00:27:53.927716+0000","last_clean":"2023-12-13T00:27:53.927716+0000","last_became_active":"2023-12-13T00:00:30.009724+0000","last_became_peered":"2023-12-13T00:00:30.009724+0000","last_unstale":"2023-12-13T00:27:53.927716+0000","last_undegraded":"2023-12-13T00:27:53.927716+0000","last_fullsized":"2023-12-13T00:27:53.927716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:20:28.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'58","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.897710+0000","last_change":"2023-12-13T00:00:31.151042+0000","last_active":"2023-12-13T00:28:04.897710+0000","last_peered":"2023-12-13T00:28:04.897710+0000","last_clean":"2023-12-13T00:28:04.897710+0000","last_became_active":"2023-12-13T00:00:31.150735+0000","last_became_peered":"2023-12-13T00:00:31.150735+0000","last_unstale":"2023-12-13T00:28:04.897710+0000","last_undegraded":"2023-12-13T00:28:04.897710+0000","last_fullsized":"2023-12-13T00:28:04.897710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:36.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'163","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:28.829499+0000","last_change":"2023-12-13T00:00:35.668759+0000","last_active":"2023-12-13T00:27:28.829499+0000","last_peered":"2023-12-13T00:27:28.829499+0000","last_clean":"2023-12-13T00:27:28.829499+0000","last_became_active":"2023-12-13T00:00:35.668361+0000","last_became_peered":"2023-12-13T00:00:35.668361+0000","last_unstale":"2023-12-13T00:27:28.829499+0000","last_undegraded":"2023-12-13T00:27:28.829499+0000","last_fullsized":"2023-12-13T00:27:28.829499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:05.770014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":10445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.166172+0000","last_change":"2023-12-13T00:00:30.009921+0000","last_active":"2023-12-13T00:27:57.166172+0000","last_peered":"2023-12-13T00:27:57.166172+0000","last_clean":"2023-12-13T00:27:57.166172+0000","last_became_active":"2023-12-13T00:00:30.009644+0000","last_became_peered":"2023-12-13T00:00:30.009644+0000","last_unstale":"2023-12-13T00:27:57.166172+0000","last_undegraded":"2023-12-13T00:27:57.166172+0000","last_fullsized":"2023-12-13T00:27:57.166172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:48:30.422214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'63","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.878581+0000","last_change":"2023-12-13T00:00:31.146801+0000","last_active":"2023-12-13T00:28:04.878581+0000","last_peered":"2023-12-13T00:28:04.878581+0000","last_clean":"2023-12-13T00:28:04.878581+0000","last_became_active":"2023-12-13T00:00:31.146516+0000","last_became_peered":"2023-12-13T00:00:31.146516+0000","last_unstale":"2023-12-13T00:28:04.878581+0000","last_undegraded":"2023-12-13T00:28:04.878581+0000","last_fullsized":"2023-12-13T00:28:04.878581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:44:23.442162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'175","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.590878+0000","last_change":"2023-12-13T00:00:35.668621+0000","last_active":"2023-12-13T00:27:29.590878+0000","last_peered":"2023-12-13T00:27:29.590878+0000","last_clean":"2023-12-13T00:27:29.590878+0000","last_became_active":"2023-12-13T00:00:35.668298+0000","last_became_peered":"2023-12-13T00:00:35.668298+0000","last_unstale":"2023-12-13T00:27:29.590878+0000","last_undegraded":"2023-12-13T00:27:29.590878+0000","last_fullsized":"2023-12-13T00:27:29.590878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:40:04.506084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'50","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.877283+0000","last_change":"2023-12-13T00:00:31.036347+0000","last_active":"2023-12-13T00:28:04.877283+0000","last_peered":"2023-12-13T00:28:04.877283+0000","last_clean":"2023-12-13T00:28:04.877283+0000","last_became_active":"2023-12-13T00:00:31.036062+0000","last_became_peered":"2023-12-13T00:00:31.036062+0000","last_unstale":"2023-12-13T00:28:04.877283+0000","last_undegraded":"2023-12-13T00:28:04.877283+0000","last_fullsized":"2023-12-13T00:28:04.877283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:15:29.783257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'849","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:40.229848+0000","last_change":"2023-12-13T00:00:30.001066+0000","last_active":"2023-12-13T00:27:40.229848+0000","last_peered":"2023-12-13T00:27:40.229848+0000","last_clean":"2023-12-13T00:27:40.229848+0000","last_became_active":"2023-12-13T00:00:30.000782+0000","last_became_peered":"2023-12-13T00:00:30.000782+0000","last_unstale":"2023-12-13T00:27:40.229848+0000","last_undegraded":"2023-12-13T00:27:40.229848+0000","last_fullsized":"2023-12-13T00:27:40.229848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:53.977921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":4547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'149","reported_seq":176,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:28.850150+0000","last_change":"2023-12-13T00:00:35.662038+0000","last_active":"2023-12-13T00:27:28.850150+0000","last_peered":"2023-12-13T00:27:28.850150+0000","last_clean":"2023-12-13T00:27:28.850150+0000","last_became_active":"2023-12-13T00:00:35.661458+0000","last_became_peered":"2023-12-13T00:00:35.661458+0000","last_unstale":"2023-12-13T00:27:28.850150+0000","last_undegraded":"2023-12-13T00:27:28.850150+0000","last_fullsized":"2023-12-13T00:27:28.850150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:12:27.307277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":11179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'55","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.754043+0000","last_change":"2023-12-13T00:00:31.119718+0000","last_active":"2023-12-13T00:28:04.754043+0000","last_peered":"2023-12-13T00:28:04.754043+0000","last_clean":"2023-12-13T00:28:04.754043+0000","last_became_active":"2023-12-13T00:00:31.119447+0000","last_became_peered":"2023-12-13T00:00:31.119447+0000","last_unstale":"2023-12-13T00:28:04.754043+0000","last_undegraded":"2023-12-13T00:28:04.754043+0000","last_fullsized":"2023-12-13T00:28:04.754043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:08.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'215","reported_seq":245,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:55.948505+0000","last_change":"2023-12-13T00:00:29.968425+0000","last_active":"2023-12-13T00:27:55.948505+0000","last_peered":"2023-12-13T00:27:55.948505+0000","last_clean":"2023-12-13T00:27:55.948505+0000","last_became_active":"2023-12-13T00:00:29.967929+0000","last_became_peered":"2023-12-13T00:00:29.967929+0000","last_unstale":"2023-12-13T00:27:55.948505+0000","last_undegraded":"2023-12-13T00:27:55.948505+0000","last_fullsized":"2023-12-13T00:27:55.948505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:53.977921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":581,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'167","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:26.447351+0000","last_change":"2023-12-13T00:00:35.662848+0000","last_active":"2023-12-13T00:27:26.447351+0000","last_peered":"2023-12-13T00:27:26.447351+0000","last_clean":"2023-12-13T00:27:26.447351+0000","last_became_active":"2023-12-13T00:00:35.662469+0000","last_became_peered":"2023-12-13T00:00:35.662469+0000","last_unstale":"2023-12-13T00:27:26.447351+0000","last_undegraded":"2023-12-13T00:27:26.447351+0000","last_fullsized":"2023-12-13T00:27:26.447351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:17:20.456996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":19086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'57","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.831523+0000","last_change":"2023-12-13T00:00:31.143108+0000","last_active":"2023-12-13T00:28:04.831523+0000","last_peered":"2023-12-13T00:28:04.831523+0000","last_clean":"2023-12-13T00:28:04.831523+0000","last_became_active":"2023-12-13T00:00:31.142847+0000","last_became_peered":"2023-12-13T00:00:31.142847+0000","last_unstale":"2023-12-13T00:28:04.831523+0000","last_undegraded":"2023-12-13T00:28:04.831523+0000","last_fullsized":"2023-12-13T00:28:04.831523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:20.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'374","reported_seq":404,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.166869+0000","last_change":"2023-12-13T00:00:30.004483+0000","last_active":"2023-12-13T00:27:57.166869+0000","last_peered":"2023-12-13T00:27:57.166869+0000","last_clean":"2023-12-13T00:27:57.166869+0000","last_became_active":"2023-12-13T00:00:30.004195+0000","last_became_peered":"2023-12-13T00:00:30.004195+0000","last_unstale":"2023-12-13T00:27:57.166869+0000","last_undegraded":"2023-12-13T00:27:57.166869+0000","last_fullsized":"2023-12-13T00:27:57.166869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:35.192132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":373,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'154","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:28.849973+0000","last_change":"2023-12-13T00:00:35.660024+0000","last_active":"2023-12-13T00:27:28.849973+0000","last_peered":"2023-12-13T00:27:28.849973+0000","last_clean":"2023-12-13T00:27:28.849973+0000","last_became_active":"2023-12-13T00:00:35.659637+0000","last_became_peered":"2023-12-13T00:00:35.659637+0000","last_unstale":"2023-12-13T00:27:28.849973+0000","last_undegraded":"2023-12-13T00:27:28.849973+0000","last_fullsized":"2023-12-13T00:27:28.849973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:19.752973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":10280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.870851+0000","last_change":"2023-12-13T00:00:31.143938+0000","last_active":"2023-12-13T00:28:04.870851+0000","last_peered":"2023-12-13T00:28:04.870851+0000","last_clean":"2023-12-13T00:28:04.870851+0000","last_became_active":"2023-12-13T00:00:31.143673+0000","last_became_peered":"2023-12-13T00:00:31.143673+0000","last_unstale":"2023-12-13T00:28:04.870851+0000","last_undegraded":"2023-12-13T00:28:04.870851+0000","last_fullsized":"2023-12-13T00:28:04.870851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:56:04.585998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:51.140407+0000","last_change":"2023-12-13T00:00:30.005987+0000","last_active":"2023-12-13T00:27:51.140407+0000","last_peered":"2023-12-13T00:27:51.140407+0000","last_clean":"2023-12-13T00:27:51.140407+0000","last_became_active":"2023-12-13T00:00:30.005740+0000","last_became_peered":"2023-12-13T00:00:30.005740+0000","last_unstale":"2023-12-13T00:27:51.140407+0000","last_undegraded":"2023-12-13T00:27:51.140407+0000","last_fullsized":"2023-12-13T00:27:51.140407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:03:55.109283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'170","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.827065+0000","last_change":"2023-12-13T00:00:35.666041+0000","last_active":"2023-12-13T00:27:29.827065+0000","last_peered":"2023-12-13T00:27:29.827065+0000","last_clean":"2023-12-13T00:27:29.827065+0000","last_became_active":"2023-12-13T00:00:35.665670+0000","last_became_peered":"2023-12-13T00:00:35.665670+0000","last_unstale":"2023-12-13T00:27:29.827065+0000","last_undegraded":"2023-12-13T00:27:29.827065+0000","last_fullsized":"2023-12-13T00:27:29.827065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:10.984025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'51","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.831801+0000","last_change":"2023-12-13T00:00:31.146677+0000","last_active":"2023-12-13T00:28:04.831801+0000","last_peered":"2023-12-13T00:28:04.831801+0000","last_clean":"2023-12-13T00:28:04.831801+0000","last_became_active":"2023-12-13T00:00:31.146435+0000","last_became_peered":"2023-12-13T00:00:31.146435+0000","last_unstale":"2023-12-13T00:28:04.831801+0000","last_undegraded":"2023-12-13T00:28:04.831801+0000","last_fullsized":"2023-12-13T00:28:04.831801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:32:52.059012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'8","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:53.927419+0000","last_change":"2023-12-13T00:00:30.006240+0000","last_active":"2023-12-13T00:27:53.927419+0000","last_peered":"2023-12-13T00:27:53.927419+0000","last_clean":"2023-12-13T00:27:53.927419+0000","last_became_active":"2023-12-13T00:00:30.005909+0000","last_became_peered":"2023-12-13T00:00:30.005909+0000","last_unstale":"2023-12-13T00:27:53.927419+0000","last_undegraded":"2023-12-13T00:27:53.927419+0000","last_fullsized":"2023-12-13T00:27:53.927419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:59:20.687032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'164","reported_seq":192,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:27.796815+0000","last_change":"2023-12-13T00:00:35.665918+0000","last_active":"2023-12-13T00:27:27.796815+0000","last_peered":"2023-12-13T00:27:27.796815+0000","last_clean":"2023-12-13T00:27:27.796815+0000","last_became_active":"2023-12-13T00:00:35.665521+0000","last_became_peered":"2023-12-13T00:00:35.665521+0000","last_unstale":"2023-12-13T00:27:27.796815+0000","last_undegraded":"2023-12-13T00:27:27.796815+0000","last_fullsized":"2023-12-13T00:27:27.796815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:05.461575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'57","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.832310+0000","last_change":"2023-12-13T00:00:31.145392+0000","last_active":"2023-12-13T00:28:04.832310+0000","last_peered":"2023-12-13T00:28:04.832310+0000","last_clean":"2023-12-13T00:28:04.832310+0000","last_became_active":"2023-12-13T00:00:31.145115+0000","last_became_peered":"2023-12-13T00:00:31.145115+0000","last_unstale":"2023-12-13T00:28:04.832310+0000","last_undegraded":"2023-12-13T00:28:04.832310+0000","last_fullsized":"2023-12-13T00:28:04.832310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:15.201991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'169","reported_seq":199,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:58.269876+0000","last_change":"2023-12-13T00:00:30.006295+0000","last_active":"2023-12-13T00:27:58.269876+0000","last_peered":"2023-12-13T00:27:58.269876+0000","last_clean":"2023-12-13T00:27:58.269876+0000","last_became_active":"2023-12-13T00:00:30.005988+0000","last_became_peered":"2023-12-13T00:00:30.005988+0000","last_unstale":"2023-12-13T00:27:58.269876+0000","last_undegraded":"2023-12-13T00:27:58.269876+0000","last_fullsized":"2023-12-13T00:27:58.269876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:15:15.243155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'165","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:26.980294+0000","last_change":"2023-12-13T00:00:35.662996+0000","last_active":"2023-12-13T00:27:26.980294+0000","last_peered":"2023-12-13T00:27:26.980294+0000","last_clean":"2023-12-13T00:27:26.980294+0000","last_became_active":"2023-12-13T00:00:35.662612+0000","last_became_peered":"2023-12-13T00:00:35.662612+0000","last_unstale":"2023-12-13T00:27:26.980294+0000","last_undegraded":"2023-12-13T00:27:26.980294+0000","last_fullsized":"2023-12-13T00:27:26.980294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:58.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":14176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.822535+0000","last_change":"2023-12-13T00:00:31.118054+0000","last_active":"2023-12-13T00:28:04.822535+0000","last_peered":"2023-12-13T00:28:04.822535+0000","last_clean":"2023-12-13T00:28:04.822535+0000","last_became_active":"2023-12-13T00:00:31.117814+0000","last_became_peered":"2023-12-13T00:00:31.117814+0000","last_unstale":"2023-12-13T00:28:04.822535+0000","last_undegraded":"2023-12-13T00:28:04.822535+0000","last_fullsized":"2023-12-13T00:28:04.822535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:15.201991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:46.081058+0000","last_change":"2023-12-13T00:00:30.001001+0000","last_active":"2023-12-13T00:27:46.081058+0000","last_peered":"2023-12-13T00:27:46.081058+0000","last_clean":"2023-12-13T00:27:46.081058+0000","last_became_active":"2023-12-13T00:00:30.000755+0000","last_became_peered":"2023-12-13T00:00:30.000755+0000","last_unstale":"2023-12-13T00:27:46.081058+0000","last_undegraded":"2023-12-13T00:27:46.081058+0000","last_fullsized":"2023-12-13T00:27:46.081058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:02:11.314721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'145","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.942343+0000","last_change":"2023-12-13T00:01:00.545340+0000","last_active":"2023-12-13T00:27:31.942343+0000","last_peered":"2023-12-13T00:27:31.942343+0000","last_clean":"2023-12-13T00:27:31.942343+0000","last_became_active":"2023-12-13T00:01:00.544906+0000","last_became_peered":"2023-12-13T00:01:00.544906+0000","last_unstale":"2023-12-13T00:27:31.942343+0000","last_undegraded":"2023-12-13T00:27:31.942343+0000","last_fullsized":"2023-12-13T00:27:31.942343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:44:27.993144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,5],"acting":[6,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.887652+0000","last_change":"2023-12-13T00:00:31.143429+0000","last_active":"2023-12-13T00:28:04.887652+0000","last_peered":"2023-12-13T00:28:04.887652+0000","last_clean":"2023-12-13T00:28:04.887652+0000","last_became_active":"2023-12-13T00:00:31.143182+0000","last_became_peered":"2023-12-13T00:00:31.143182+0000","last_unstale":"2023-12-13T00:28:04.887652+0000","last_undegraded":"2023-12-13T00:28:04.887652+0000","last_fullsized":"2023-12-13T00:28:04.887652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:09:34.339195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:36.956936+0000","last_change":"2023-12-13T00:00:29.969160+0000","last_active":"2023-12-13T00:27:36.956936+0000","last_peered":"2023-12-13T00:27:36.956936+0000","last_clean":"2023-12-13T00:27:36.956936+0000","last_became_active":"2023-12-13T00:00:29.968860+0000","last_became_peered":"2023-12-13T00:00:29.968860+0000","last_unstale":"2023-12-13T00:27:36.956936+0000","last_undegraded":"2023-12-13T00:27:36.956936+0000","last_fullsized":"2023-12-13T00:27:36.956936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:42:13.602889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'163","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.585490+0000","last_change":"2023-12-13T00:00:35.642597+0000","last_active":"2023-12-13T00:27:29.585490+0000","last_peered":"2023-12-13T00:27:29.585490+0000","last_clean":"2023-12-13T00:27:29.585490+0000","last_became_active":"2023-12-13T00:00:35.642215+0000","last_became_peered":"2023-12-13T00:00:35.642215+0000","last_unstale":"2023-12-13T00:27:29.585490+0000","last_undegraded":"2023-12-13T00:27:29.585490+0000","last_fullsized":"2023-12-13T00:27:29.585490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:54:48.007993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":6488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'62","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.867805+0000","last_change":"2023-12-13T00:00:31.149832+0000","last_active":"2023-12-13T00:28:04.867805+0000","last_peered":"2023-12-13T00:28:04.867805+0000","last_clean":"2023-12-13T00:28:04.867805+0000","last_became_active":"2023-12-13T00:00:31.149587+0000","last_became_peered":"2023-12-13T00:00:31.149587+0000","last_unstale":"2023-12-13T00:28:04.867805+0000","last_undegraded":"2023-12-13T00:28:04.867805+0000","last_fullsized":"2023-12-13T00:28:04.867805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:00.910594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'792","reported_seq":823,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:38.142347+0000","last_change":"2023-12-13T00:00:29.998103+0000","last_active":"2023-12-13T00:27:38.142347+0000","last_peered":"2023-12-13T00:27:38.142347+0000","last_clean":"2023-12-13T00:27:38.142347+0000","last_became_active":"2023-12-13T00:00:29.997848+0000","last_became_peered":"2023-12-13T00:00:29.997848+0000","last_unstale":"2023-12-13T00:27:38.142347+0000","last_undegraded":"2023-12-13T00:27:38.142347+0000","last_fullsized":"2023-12-13T00:27:38.142347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:52:58.951228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":4476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'121","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.942347+0000","last_change":"2023-12-13T00:00:35.652104+0000","last_active":"2023-12-13T00:27:31.942347+0000","last_peered":"2023-12-13T00:27:31.942347+0000","last_clean":"2023-12-13T00:27:31.942347+0000","last_became_active":"2023-12-13T00:00:35.651766+0000","last_became_peered":"2023-12-13T00:00:35.651766+0000","last_unstale":"2023-12-13T00:27:31.942347+0000","last_undegraded":"2023-12-13T00:27:31.942347+0000","last_fullsized":"2023-12-13T00:27:31.942347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:08:10.211533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":7468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'58","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.860786+0000","last_change":"2023-12-13T00:00:31.120580+0000","last_active":"2023-12-13T00:28:04.860786+0000","last_peered":"2023-12-13T00:28:04.860786+0000","last_clean":"2023-12-13T00:28:04.860786+0000","last_became_active":"2023-12-13T00:00:31.120330+0000","last_became_peered":"2023-12-13T00:00:31.120330+0000","last_unstale":"2023-12-13T00:28:04.860786+0000","last_undegraded":"2023-12-13T00:28:04.860786+0000","last_fullsized":"2023-12-13T00:28:04.860786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:04:30.356287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'411","reported_seq":748,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:59.442964+0000","last_change":"2023-12-13T00:00:30.000752+0000","last_active":"2023-12-13T00:27:59.442964+0000","last_peered":"2023-12-13T00:27:59.442964+0000","last_clean":"2023-12-13T00:27:59.442964+0000","last_became_active":"2023-12-13T00:00:30.000015+0000","last_became_peered":"2023-12-13T00:00:30.000015+0000","last_unstale":"2023-12-13T00:27:59.442964+0000","last_undegraded":"2023-12-13T00:27:59.442964+0000","last_fullsized":"2023-12-13T00:27:59.442964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:20:46.566684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58234,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":306,"num_read_kb":318,"num_write":408,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'147","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:30.828661+0000","last_change":"2023-12-13T00:00:35.667415+0000","last_active":"2023-12-13T00:27:30.828661+0000","last_peered":"2023-12-13T00:27:30.828661+0000","last_clean":"2023-12-13T00:27:30.828661+0000","last_became_active":"2023-12-13T00:00:35.667028+0000","last_became_peered":"2023-12-13T00:00:35.667028+0000","last_unstale":"2023-12-13T00:27:30.828661+0000","last_undegraded":"2023-12-13T00:27:30.828661+0000","last_fullsized":"2023-12-13T00:27:30.828661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:58.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":5383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'60","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.822616+0000","last_change":"2023-12-13T00:00:31.140853+0000","last_active":"2023-12-13T00:28:04.822616+0000","last_peered":"2023-12-13T00:28:04.822616+0000","last_clean":"2023-12-13T00:28:04.822616+0000","last_became_active":"2023-12-13T00:00:31.140597+0000","last_became_peered":"2023-12-13T00:00:31.140597+0000","last_unstale":"2023-12-13T00:28:04.822616+0000","last_undegraded":"2023-12-13T00:28:04.822616+0000","last_fullsized":"2023-12-13T00:28:04.822616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:13.923453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:44.241631+0000","last_change":"2023-12-13T00:00:29.998765+0000","last_active":"2023-12-13T00:27:44.241631+0000","last_peered":"2023-12-13T00:27:44.241631+0000","last_clean":"2023-12-13T00:27:44.241631+0000","last_became_active":"2023-12-13T00:00:29.998552+0000","last_became_peered":"2023-12-13T00:00:29.998552+0000","last_unstale":"2023-12-13T00:27:44.241631+0000","last_undegraded":"2023-12-13T00:27:44.241631+0000","last_fullsized":"2023-12-13T00:27:44.241631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:54:42.351946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'127","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:28.839739+0000","last_change":"2023-12-13T00:00:35.666575+0000","last_active":"2023-12-13T00:27:28.839739+0000","last_peered":"2023-12-13T00:27:28.839739+0000","last_clean":"2023-12-13T00:27:28.839739+0000","last_became_active":"2023-12-13T00:00:35.666135+0000","last_became_peered":"2023-12-13T00:00:35.666135+0000","last_unstale":"2023-12-13T00:27:28.839739+0000","last_undegraded":"2023-12-13T00:27:28.839739+0000","last_fullsized":"2023-12-13T00:27:28.839739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:02:03.031651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":7535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'49","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.832939+0000","last_change":"2023-12-13T00:00:31.148698+0000","last_active":"2023-12-13T00:28:04.832939+0000","last_peered":"2023-12-13T00:28:04.832939+0000","last_clean":"2023-12-13T00:28:04.832939+0000","last_became_active":"2023-12-13T00:00:31.148421+0000","last_became_peered":"2023-12-13T00:00:31.148421+0000","last_unstale":"2023-12-13T00:28:04.832939+0000","last_undegraded":"2023-12-13T00:28:04.832939+0000","last_fullsized":"2023-12-13T00:28:04.832939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:53:00.056294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:47.328629+0000","last_change":"2023-12-13T00:00:30.001220+0000","last_active":"2023-12-13T00:27:47.328629+0000","last_peered":"2023-12-13T00:27:47.328629+0000","last_clean":"2023-12-13T00:27:47.328629+0000","last_became_active":"2023-12-13T00:00:30.000854+0000","last_became_peered":"2023-12-13T00:00:30.000854+0000","last_unstale":"2023-12-13T00:27:47.328629+0000","last_undegraded":"2023-12-13T00:27:47.328629+0000","last_fullsized":"2023-12-13T00:27:47.328629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:50:11.243011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:24:12.872552+0000","last_change":"2023-12-13T00:00:08.575071+0000","last_active":"2023-12-13T00:24:12.872552+0000","last_peered":"2023-12-13T00:24:12.872552+0000","last_clean":"2023-12-13T00:24:12.872552+0000","last_became_active":"2023-12-13T00:00:08.574464+0000","last_became_peered":"2023-12-13T00:00:08.574464+0000","last_unstale":"2023-12-13T00:24:12.872552+0000","last_undegraded":"2023-12-13T00:24:12.872552+0000","last_fullsized":"2023-12-13T00:24:12.872552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:07.226606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:07.226606+0000","last_clean_scrub_stamp":"2023-12-13T00:00:07.226606+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:51:39.168480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'166","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.589507+0000","last_change":"2023-12-13T00:00:35.661806+0000","last_active":"2023-12-13T00:27:29.589507+0000","last_peered":"2023-12-13T00:27:29.589507+0000","last_clean":"2023-12-13T00:27:29.589507+0000","last_became_active":"2023-12-13T00:00:35.660976+0000","last_became_peered":"2023-12-13T00:00:35.660976+0000","last_unstale":"2023-12-13T00:27:29.589507+0000","last_undegraded":"2023-12-13T00:27:29.589507+0000","last_fullsized":"2023-12-13T00:27:29.589507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:04:57.617925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":12423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'58","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.876713+0000","last_change":"2023-12-13T00:00:31.036383+0000","last_active":"2023-12-13T00:28:04.876713+0000","last_peered":"2023-12-13T00:28:04.876713+0000","last_clean":"2023-12-13T00:28:04.876713+0000","last_became_active":"2023-12-13T00:00:31.036127+0000","last_became_peered":"2023-12-13T00:00:31.036127+0000","last_unstale":"2023-12-13T00:28:04.876713+0000","last_undegraded":"2023-12-13T00:28:04.876713+0000","last_fullsized":"2023-12-13T00:28:04.876713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:12:16.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'7","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:40.042854+0000","last_change":"2023-12-13T00:00:30.006258+0000","last_active":"2023-12-13T00:27:40.042854+0000","last_peered":"2023-12-13T00:27:40.042854+0000","last_clean":"2023-12-13T00:27:40.042854+0000","last_became_active":"2023-12-13T00:00:30.005943+0000","last_became_peered":"2023-12-13T00:00:30.005943+0000","last_unstale":"2023-12-13T00:27:40.042854+0000","last_undegraded":"2023-12-13T00:27:40.042854+0000","last_fullsized":"2023-12-13T00:27:40.042854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:52:45.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'164","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:24.019860+0000","last_change":"2023-12-13T00:00:35.665140+0000","last_active":"2023-12-13T00:27:24.019860+0000","last_peered":"2023-12-13T00:27:24.019860+0000","last_clean":"2023-12-13T00:27:24.019860+0000","last_became_active":"2023-12-13T00:00:35.664071+0000","last_became_peered":"2023-12-13T00:00:35.664071+0000","last_unstale":"2023-12-13T00:27:24.019860+0000","last_undegraded":"2023-12-13T00:27:24.019860+0000","last_fullsized":"2023-12-13T00:27:24.019860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:06:01.427574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":5432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'59","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.870090+0000","last_change":"2023-12-13T00:00:31.147760+0000","last_active":"2023-12-13T00:28:04.870090+0000","last_peered":"2023-12-13T00:28:04.870090+0000","last_clean":"2023-12-13T00:28:04.870090+0000","last_became_active":"2023-12-13T00:00:31.147523+0000","last_became_peered":"2023-12-13T00:00:31.147523+0000","last_unstale":"2023-12-13T00:28:04.870090+0000","last_undegraded":"2023-12-13T00:28:04.870090+0000","last_fullsized":"2023-12-13T00:28:04.870090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:56:28.188041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:32.947591+0000","last_change":"2023-12-13T00:00:30.002705+0000","last_active":"2023-12-13T00:27:32.947591+0000","last_peered":"2023-12-13T00:27:32.947591+0000","last_clean":"2023-12-13T00:27:32.947591+0000","last_became_active":"2023-12-13T00:00:30.002427+0000","last_became_peered":"2023-12-13T00:00:30.002427+0000","last_unstale":"2023-12-13T00:27:32.947591+0000","last_undegraded":"2023-12-13T00:27:32.947591+0000","last_fullsized":"2023-12-13T00:27:32.947591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:06:37.325239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'177","reported_seq":204,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.562109+0000","last_change":"2023-12-13T00:00:35.661309+0000","last_active":"2023-12-13T00:27:29.562109+0000","last_peered":"2023-12-13T00:27:29.562109+0000","last_clean":"2023-12-13T00:27:29.562109+0000","last_became_active":"2023-12-13T00:00:35.660939+0000","last_became_peered":"2023-12-13T00:00:35.660939+0000","last_unstale":"2023-12-13T00:27:29.562109+0000","last_undegraded":"2023-12-13T00:27:29.562109+0000","last_fullsized":"2023-12-13T00:27:29.562109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:49:19.372464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":11316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'64","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.871881+0000","last_change":"2023-12-13T00:00:31.146265+0000","last_active":"2023-12-13T00:28:04.871881+0000","last_peered":"2023-12-13T00:28:04.871881+0000","last_clean":"2023-12-13T00:28:04.871881+0000","last_became_active":"2023-12-13T00:00:31.145997+0000","last_became_peered":"2023-12-13T00:00:31.145997+0000","last_unstale":"2023-12-13T00:28:04.871881+0000","last_undegraded":"2023-12-13T00:28:04.871881+0000","last_fullsized":"2023-12-13T00:28:04.871881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:53:32.846210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:40.149153+0000","last_change":"2023-12-13T00:00:29.968222+0000","last_active":"2023-12-13T00:27:40.149153+0000","last_peered":"2023-12-13T00:27:40.149153+0000","last_clean":"2023-12-13T00:27:40.149153+0000","last_became_active":"2023-12-13T00:00:29.967916+0000","last_became_peered":"2023-12-13T00:00:29.967916+0000","last_unstale":"2023-12-13T00:27:40.149153+0000","last_undegraded":"2023-12-13T00:27:40.149153+0000","last_fullsized":"2023-12-13T00:27:40.149153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:12.818387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'137","reported_seq":164,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:27.462473+0000","last_change":"2023-12-13T00:00:35.667745+0000","last_active":"2023-12-13T00:27:27.462473+0000","last_peered":"2023-12-13T00:27:27.462473+0000","last_clean":"2023-12-13T00:27:27.462473+0000","last_became_active":"2023-12-13T00:00:35.666891+0000","last_became_peered":"2023-12-13T00:00:35.666891+0000","last_unstale":"2023-12-13T00:27:27.462473+0000","last_undegraded":"2023-12-13T00:27:27.462473+0000","last_fullsized":"2023-12-13T00:27:27.462473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:30:53.285154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":9622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'54","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.890957+0000","last_change":"2023-12-13T00:00:31.148279+0000","last_active":"2023-12-13T00:28:04.890957+0000","last_peered":"2023-12-13T00:28:04.890957+0000","last_clean":"2023-12-13T00:28:04.890957+0000","last_became_active":"2023-12-13T00:00:31.148016+0000","last_became_peered":"2023-12-13T00:00:31.148016+0000","last_unstale":"2023-12-13T00:28:04.890957+0000","last_undegraded":"2023-12-13T00:28:04.890957+0000","last_fullsized":"2023-12-13T00:28:04.890957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:37:40.762676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'289","reported_seq":319,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:52.762132+0000","last_change":"2023-12-13T00:00:30.008152+0000","last_active":"2023-12-13T00:27:52.762132+0000","last_peered":"2023-12-13T00:27:52.762132+0000","last_clean":"2023-12-13T00:27:52.762132+0000","last_became_active":"2023-12-13T00:00:30.007907+0000","last_became_peered":"2023-12-13T00:00:30.007907+0000","last_unstale":"2023-12-13T00:27:52.762132+0000","last_undegraded":"2023-12-13T00:27:52.762132+0000","last_fullsized":"2023-12-13T00:27:52.762132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:46:40.001298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'132","reported_seq":159,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:21.922520+0000","last_change":"2023-12-13T00:00:35.660971+0000","last_active":"2023-12-13T00:27:21.922520+0000","last_peered":"2023-12-13T00:27:21.922520+0000","last_clean":"2023-12-13T00:27:21.922520+0000","last_became_active":"2023-12-13T00:00:35.660627+0000","last_became_peered":"2023-12-13T00:00:35.660627+0000","last_unstale":"2023-12-13T00:27:21.922520+0000","last_undegraded":"2023-12-13T00:27:21.922520+0000","last_fullsized":"2023-12-13T00:27:21.922520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:18.474434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":10143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'55","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.870793+0000","last_change":"2023-12-13T00:00:31.142437+0000","last_active":"2023-12-13T00:28:04.870793+0000","last_peered":"2023-12-13T00:28:04.870793+0000","last_clean":"2023-12-13T00:28:04.870793+0000","last_became_active":"2023-12-13T00:00:31.142150+0000","last_became_peered":"2023-12-13T00:00:31.142150+0000","last_unstale":"2023-12-13T00:28:04.870793+0000","last_undegraded":"2023-12-13T00:28:04.870793+0000","last_fullsized":"2023-12-13T00:28:04.870793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:10:54.020587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'797","reported_seq":826,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.530963+0000","last_change":"2023-12-13T00:00:30.000646+0000","last_active":"2023-12-13T00:28:04.530963+0000","last_peered":"2023-12-13T00:28:04.530963+0000","last_clean":"2023-12-13T00:28:04.530963+0000","last_became_active":"2023-12-13T00:00:30.000388+0000","last_became_peered":"2023-12-13T00:00:30.000388+0000","last_unstale":"2023-12-13T00:28:04.530963+0000","last_undegraded":"2023-12-13T00:28:04.530963+0000","last_fullsized":"2023-12-13T00:28:04.530963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:07.704455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277997,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'170","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.589842+0000","last_change":"2023-12-13T00:00:35.666659+0000","last_active":"2023-12-13T00:27:29.589842+0000","last_peered":"2023-12-13T00:27:29.589842+0000","last_clean":"2023-12-13T00:27:29.589842+0000","last_became_active":"2023-12-13T00:00:35.666304+0000","last_became_peered":"2023-12-13T00:00:35.666304+0000","last_unstale":"2023-12-13T00:27:29.589842+0000","last_undegraded":"2023-12-13T00:27:29.589842+0000","last_fullsized":"2023-12-13T00:27:29.589842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:35:49.956369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":11255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'48","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.894217+0000","last_change":"2023-12-13T00:00:31.037568+0000","last_active":"2023-12-13T00:28:04.894217+0000","last_peered":"2023-12-13T00:28:04.894217+0000","last_clean":"2023-12-13T00:28:04.894217+0000","last_became_active":"2023-12-13T00:00:31.037398+0000","last_became_peered":"2023-12-13T00:00:31.037398+0000","last_unstale":"2023-12-13T00:28:04.894217+0000","last_undegraded":"2023-12-13T00:28:04.894217+0000","last_fullsized":"2023-12-13T00:28:04.894217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:08.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'1355","reported_seq":1384,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:53.446607+0000","last_change":"2023-12-13T00:00:30.006086+0000","last_active":"2023-12-13T00:27:53.446607+0000","last_peered":"2023-12-13T00:27:53.446607+0000","last_clean":"2023-12-13T00:27:53.446607+0000","last_became_active":"2023-12-13T00:00:30.005752+0000","last_became_peered":"2023-12-13T00:00:30.005752+0000","last_unstale":"2023-12-13T00:27:53.446607+0000","last_undegraded":"2023-12-13T00:27:53.446607+0000","last_fullsized":"2023-12-13T00:27:53.446607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1355,"log_dups_size":0,"ondisk_log_size":1355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:06:37.325239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1349,"num_write_kb":4734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'175","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.548973+0000","last_change":"2023-12-13T00:00:35.666467+0000","last_active":"2023-12-13T00:27:29.548973+0000","last_peered":"2023-12-13T00:27:29.548973+0000","last_clean":"2023-12-13T00:27:29.548973+0000","last_became_active":"2023-12-13T00:00:35.666061+0000","last_became_peered":"2023-12-13T00:00:35.666061+0000","last_unstale":"2023-12-13T00:27:29.548973+0000","last_undegraded":"2023-12-13T00:27:29.548973+0000","last_fullsized":"2023-12-13T00:27:29.548973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:19:16.858246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":9890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'68","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.869910+0000","last_change":"2023-12-13T00:01:00.702387+0000","last_active":"2023-12-13T00:28:04.869910+0000","last_peered":"2023-12-13T00:28:04.869910+0000","last_clean":"2023-12-13T00:28:04.869910+0000","last_became_active":"2023-12-13T00:01:00.702089+0000","last_became_peered":"2023-12-13T00:01:00.702089+0000","last_unstale":"2023-12-13T00:28:04.869910+0000","last_undegraded":"2023-12-13T00:28:04.869910+0000","last_fullsized":"2023-12-13T00:28:04.869910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:48:49.380742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'393","reported_seq":422,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.528820+0000","last_change":"2023-12-13T00:00:30.001171+0000","last_active":"2023-12-13T00:28:04.528820+0000","last_peered":"2023-12-13T00:28:04.528820+0000","last_clean":"2023-12-13T00:28:04.528820+0000","last_became_active":"2023-12-13T00:00:30.000803+0000","last_became_peered":"2023-12-13T00:00:30.000803+0000","last_unstale":"2023-12-13T00:28:04.528820+0000","last_undegraded":"2023-12-13T00:28:04.528820+0000","last_fullsized":"2023-12-13T00:28:04.528820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:19.012092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2931508,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":386,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'176","reported_seq":202,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.548618+0000","last_change":"2023-12-13T00:00:35.649561+0000","last_active":"2023-12-13T00:27:29.548618+0000","last_peered":"2023-12-13T00:27:29.548618+0000","last_clean":"2023-12-13T00:27:29.548618+0000","last_became_active":"2023-12-13T00:00:35.649151+0000","last_became_peered":"2023-12-13T00:00:35.649151+0000","last_unstale":"2023-12-13T00:27:29.548618+0000","last_undegraded":"2023-12-13T00:27:29.548618+0000","last_fullsized":"2023-12-13T00:27:29.548618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:06:34.023899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'60","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.821458+0000","last_change":"2023-12-13T00:00:31.116002+0000","last_active":"2023-12-13T00:28:04.821458+0000","last_peered":"2023-12-13T00:28:04.821458+0000","last_clean":"2023-12-13T00:28:04.821458+0000","last_became_active":"2023-12-13T00:00:31.115678+0000","last_became_peered":"2023-12-13T00:00:31.115678+0000","last_unstale":"2023-12-13T00:28:04.821458+0000","last_undegraded":"2023-12-13T00:28:04.821458+0000","last_fullsized":"2023-12-13T00:28:04.821458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:21:51.967408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'11","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:48.225267+0000","last_change":"2023-12-13T00:00:30.004329+0000","last_active":"2023-12-13T00:27:48.225267+0000","last_peered":"2023-12-13T00:27:48.225267+0000","last_clean":"2023-12-13T00:27:48.225267+0000","last_became_active":"2023-12-13T00:00:30.004089+0000","last_became_peered":"2023-12-13T00:00:30.004089+0000","last_unstale":"2023-12-13T00:27:48.225267+0000","last_undegraded":"2023-12-13T00:27:48.225267+0000","last_fullsized":"2023-12-13T00:27:48.225267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:05:04.403249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'148","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.520279+0000","last_change":"2023-12-13T00:00:35.652272+0000","last_active":"2023-12-13T00:27:29.520279+0000","last_peered":"2023-12-13T00:27:29.520279+0000","last_clean":"2023-12-13T00:27:29.520279+0000","last_became_active":"2023-12-13T00:00:35.651907+0000","last_became_peered":"2023-12-13T00:00:35.651907+0000","last_unstale":"2023-12-13T00:27:29.520279+0000","last_undegraded":"2023-12-13T00:27:29.520279+0000","last_fullsized":"2023-12-13T00:27:29.520279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:15:01.873129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":7909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'46","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.863565+0000","last_change":"2023-12-13T00:00:31.148754+0000","last_active":"2023-12-13T00:28:04.863565+0000","last_peered":"2023-12-13T00:28:04.863565+0000","last_clean":"2023-12-13T00:28:04.863565+0000","last_became_active":"2023-12-13T00:00:31.147846+0000","last_became_peered":"2023-12-13T00:00:31.147846+0000","last_unstale":"2023-12-13T00:28:04.863565+0000","last_undegraded":"2023-12-13T00:28:04.863565+0000","last_fullsized":"2023-12-13T00:28:04.863565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:39:59.955103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'1473","reported_seq":1502,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:48.433505+0000","last_change":"2023-12-13T00:00:30.001703+0000","last_active":"2023-12-13T00:27:48.433505+0000","last_peered":"2023-12-13T00:27:48.433505+0000","last_clean":"2023-12-13T00:27:48.433505+0000","last_became_active":"2023-12-13T00:00:30.001420+0000","last_became_peered":"2023-12-13T00:00:30.001420+0000","last_unstale":"2023-12-13T00:27:48.433505+0000","last_undegraded":"2023-12-13T00:27:48.433505+0000","last_fullsized":"2023-12-13T00:27:48.433505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1473,"log_dups_size":0,"ondisk_log_size":1473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:02:06.211723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1472,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'148","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:21.985391+0000","last_change":"2023-12-13T00:01:00.546607+0000","last_active":"2023-12-13T00:27:21.985391+0000","last_peered":"2023-12-13T00:27:21.985391+0000","last_clean":"2023-12-13T00:27:21.985391+0000","last_became_active":"2023-12-13T00:01:00.546264+0000","last_became_peered":"2023-12-13T00:01:00.546264+0000","last_unstale":"2023-12-13T00:27:21.985391+0000","last_undegraded":"2023-12-13T00:27:21.985391+0000","last_fullsized":"2023-12-13T00:27:21.985391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:12:57.696627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'60","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.870044+0000","last_change":"2023-12-13T00:00:31.138998+0000","last_active":"2023-12-13T00:28:04.870044+0000","last_peered":"2023-12-13T00:28:04.870044+0000","last_clean":"2023-12-13T00:28:04.870044+0000","last_became_active":"2023-12-13T00:00:31.138723+0000","last_became_peered":"2023-12-13T00:00:31.138723+0000","last_unstale":"2023-12-13T00:28:04.870044+0000","last_undegraded":"2023-12-13T00:28:04.870044+0000","last_fullsized":"2023-12-13T00:28:04.870044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:24:05.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'217","reported_seq":246,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.944367+0000","last_change":"2023-12-13T00:00:30.003079+0000","last_active":"2023-12-13T00:27:57.944367+0000","last_peered":"2023-12-13T00:27:57.944367+0000","last_clean":"2023-12-13T00:27:57.944367+0000","last_became_active":"2023-12-13T00:00:30.002823+0000","last_became_peered":"2023-12-13T00:00:30.002823+0000","last_unstale":"2023-12-13T00:27:57.944367+0000","last_undegraded":"2023-12-13T00:27:57.944367+0000","last_fullsized":"2023-12-13T00:27:57.944367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:07.829448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'219","reported_seq":254,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:26.979813+0000","last_change":"2023-12-13T00:01:00.697705+0000","last_active":"2023-12-13T00:27:26.979813+0000","last_peered":"2023-12-13T00:27:26.979813+0000","last_clean":"2023-12-13T00:27:26.979813+0000","last_became_active":"2023-12-13T00:01:00.697231+0000","last_became_peered":"2023-12-13T00:01:00.697231+0000","last_unstale":"2023-12-13T00:27:26.979813+0000","last_undegraded":"2023-12-13T00:27:26.979813+0000","last_fullsized":"2023-12-13T00:27:26.979813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:54:04.994059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":195,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'66","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.875139+0000","last_change":"2023-12-13T00:00:31.027503+0000","last_active":"2023-12-13T00:28:04.875139+0000","last_peered":"2023-12-13T00:28:04.875139+0000","last_clean":"2023-12-13T00:28:04.875139+0000","last_became_active":"2023-12-13T00:00:31.027239+0000","last_became_peered":"2023-12-13T00:00:31.027239+0000","last_unstale":"2023-12-13T00:28:04.875139+0000","last_undegraded":"2023-12-13T00:28:04.875139+0000","last_fullsized":"2023-12-13T00:28:04.875139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:50:58.339436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:32.953266+0000","last_change":"2023-12-13T00:00:30.009592+0000","last_active":"2023-12-13T00:27:32.953266+0000","last_peered":"2023-12-13T00:27:32.953266+0000","last_clean":"2023-12-13T00:27:32.953266+0000","last_became_active":"2023-12-13T00:00:30.009351+0000","last_became_peered":"2023-12-13T00:00:30.009351+0000","last_unstale":"2023-12-13T00:27:32.953266+0000","last_undegraded":"2023-12-13T00:27:32.953266+0000","last_fullsized":"2023-12-13T00:27:32.953266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:46:22.716022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'190","reported_seq":213,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.547065+0000","last_change":"2023-12-13T00:01:00.717446+0000","last_active":"2023-12-13T00:27:29.547065+0000","last_peered":"2023-12-13T00:27:29.547065+0000","last_clean":"2023-12-13T00:27:29.547065+0000","last_became_active":"2023-12-13T00:01:00.717019+0000","last_became_peered":"2023-12-13T00:01:00.717019+0000","last_unstale":"2023-12-13T00:27:29.547065+0000","last_undegraded":"2023-12-13T00:27:29.547065+0000","last_fullsized":"2023-12-13T00:27:29.547065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:22:05.566928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":9378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"27'64","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.889753+0000","last_change":"2023-12-13T00:00:31.139946+0000","last_active":"2023-12-13T00:28:04.889753+0000","last_peered":"2023-12-13T00:28:04.889753+0000","last_clean":"2023-12-13T00:28:04.889753+0000","last_became_active":"2023-12-13T00:00:31.139656+0000","last_became_peered":"2023-12-13T00:00:31.139656+0000","last_unstale":"2023-12-13T00:28:04.889753+0000","last_undegraded":"2023-12-13T00:28:04.889753+0000","last_fullsized":"2023-12-13T00:28:04.889753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:13:39.042325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'83","reported_seq":112,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:43.428733+0000","last_change":"2023-12-13T00:00:30.003511+0000","last_active":"2023-12-13T00:27:43.428733+0000","last_peered":"2023-12-13T00:27:43.428733+0000","last_clean":"2023-12-13T00:27:43.428733+0000","last_became_active":"2023-12-13T00:00:30.002630+0000","last_became_peered":"2023-12-13T00:00:30.002630+0000","last_unstale":"2023-12-13T00:27:43.428733+0000","last_undegraded":"2023-12-13T00:27:43.428733+0000","last_fullsized":"2023-12-13T00:27:43.428733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:58:21.724544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'123","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.543938+0000","last_change":"2023-12-13T00:00:35.649725+0000","last_active":"2023-12-13T00:27:29.543938+0000","last_peered":"2023-12-13T00:27:29.543938+0000","last_clean":"2023-12-13T00:27:29.543938+0000","last_became_active":"2023-12-13T00:00:35.649401+0000","last_became_peered":"2023-12-13T00:00:35.649401+0000","last_unstale":"2023-12-13T00:27:29.543938+0000","last_undegraded":"2023-12-13T00:27:29.543938+0000","last_fullsized":"2023-12-13T00:27:29.543938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:56:09.136979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":7272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'122","reported_seq":150,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.575066+0000","last_change":"2023-12-13T00:00:35.662790+0000","last_active":"2023-12-13T00:27:29.575066+0000","last_peered":"2023-12-13T00:27:29.575066+0000","last_clean":"2023-12-13T00:27:29.575066+0000","last_became_active":"2023-12-13T00:00:35.662406+0000","last_became_peered":"2023-12-13T00:00:35.662406+0000","last_unstale":"2023-12-13T00:27:29.575066+0000","last_undegraded":"2023-12-13T00:27:29.575066+0000","last_fullsized":"2023-12-13T00:27:29.575066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:10:58.571569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":7728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'66","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.834067+0000","last_change":"2023-12-13T00:00:31.143141+0000","last_active":"2023-12-13T00:28:04.834067+0000","last_peered":"2023-12-13T00:28:04.834067+0000","last_clean":"2023-12-13T00:28:04.834067+0000","last_became_active":"2023-12-13T00:00:31.142823+0000","last_became_peered":"2023-12-13T00:00:31.142823+0000","last_unstale":"2023-12-13T00:28:04.834067+0000","last_undegraded":"2023-12-13T00:28:04.834067+0000","last_fullsized":"2023-12-13T00:28:04.834067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:22:51.335464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'7","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:44.283017+0000","last_change":"2023-12-13T00:00:30.004773+0000","last_active":"2023-12-13T00:27:44.283017+0000","last_peered":"2023-12-13T00:27:44.283017+0000","last_clean":"2023-12-13T00:27:44.283017+0000","last_became_active":"2023-12-13T00:00:30.004496+0000","last_became_peered":"2023-12-13T00:00:30.004496+0000","last_unstale":"2023-12-13T00:27:44.283017+0000","last_undegraded":"2023-12-13T00:27:44.283017+0000","last_fullsized":"2023-12-13T00:27:44.283017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:51:20.708568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'188","reported_seq":216,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:30.822992+0000","last_change":"2023-12-13T00:00:35.666457+0000","last_active":"2023-12-13T00:27:30.822992+0000","last_peered":"2023-12-13T00:27:30.822992+0000","last_clean":"2023-12-13T00:27:30.822992+0000","last_became_active":"2023-12-13T00:00:35.666075+0000","last_became_peered":"2023-12-13T00:00:35.666075+0000","last_unstale":"2023-12-13T00:27:30.822992+0000","last_undegraded":"2023-12-13T00:27:30.822992+0000","last_fullsized":"2023-12-13T00:27:30.822992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:18:38.741479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":17531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'63","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.854672+0000","last_change":"2023-12-13T00:00:31.116511+0000","last_active":"2023-12-13T00:28:04.854672+0000","last_peered":"2023-12-13T00:28:04.854672+0000","last_clean":"2023-12-13T00:28:04.854672+0000","last_became_active":"2023-12-13T00:00:31.116209+0000","last_became_peered":"2023-12-13T00:00:31.116209+0000","last_unstale":"2023-12-13T00:28:04.854672+0000","last_undegraded":"2023-12-13T00:28:04.854672+0000","last_fullsized":"2023-12-13T00:28:04.854672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:06.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'484","reported_seq":991,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.156120+0000","last_change":"2023-12-13T00:00:30.006475+0000","last_active":"2023-12-13T00:27:57.156120+0000","last_peered":"2023-12-13T00:27:57.156120+0000","last_clean":"2023-12-13T00:27:57.156120+0000","last_became_active":"2023-12-13T00:00:30.006026+0000","last_became_peered":"2023-12-13T00:00:30.006026+0000","last_unstale":"2023-12-13T00:27:57.156120+0000","last_undegraded":"2023-12-13T00:27:57.156120+0000","last_fullsized":"2023-12-13T00:27:57.156120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:29.225167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92099,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":501,"num_write":481,"num_write_kb":501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'1030","reported_seq":1752,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.518326+0000","last_change":"2023-12-13T00:00:30.004483+0000","last_active":"2023-12-13T00:28:04.518326+0000","last_peered":"2023-12-13T00:28:04.518326+0000","last_clean":"2023-12-13T00:28:04.518326+0000","last_became_active":"2023-12-13T00:00:30.004214+0000","last_became_peered":"2023-12-13T00:00:30.004214+0000","last_unstale":"2023-12-13T00:28:04.518326+0000","last_undegraded":"2023-12-13T00:28:04.518326+0000","last_fullsized":"2023-12-13T00:28:04.518326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:14.096925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1792997,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":693,"num_read_kb":705,"num_write":1026,"num_write_kb":2509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'68","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.837208+0000","last_change":"2023-12-13T00:00:31.147121+0000","last_active":"2023-12-13T00:28:04.837208+0000","last_peered":"2023-12-13T00:28:04.837208+0000","last_clean":"2023-12-13T00:28:04.837208+0000","last_became_active":"2023-12-13T00:00:31.146818+0000","last_became_peered":"2023-12-13T00:00:31.146818+0000","last_unstale":"2023-12-13T00:28:04.837208+0000","last_undegraded":"2023-12-13T00:28:04.837208+0000","last_fullsized":"2023-12-13T00:28:04.837208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:12.753740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'150","reported_seq":176,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:26.446711+0000","last_change":"2023-12-13T00:00:35.642485+0000","last_active":"2023-12-13T00:27:26.446711+0000","last_peered":"2023-12-13T00:27:26.446711+0000","last_clean":"2023-12-13T00:27:26.446711+0000","last_became_active":"2023-12-13T00:00:35.642114+0000","last_became_peered":"2023-12-13T00:00:35.642114+0000","last_unstale":"2023-12-13T00:27:26.446711+0000","last_undegraded":"2023-12-13T00:27:26.446711+0000","last_fullsized":"2023-12-13T00:27:26.446711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:24:10.067039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":10646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'2837","reported_seq":2866,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:53.923570+0000","last_change":"2023-12-13T00:00:29.972296+0000","last_active":"2023-12-13T00:27:53.923570+0000","last_peered":"2023-12-13T00:27:53.923570+0000","last_clean":"2023-12-13T00:27:53.923570+0000","last_became_active":"2023-12-13T00:00:29.972018+0000","last_became_peered":"2023-12-13T00:00:29.972018+0000","last_unstale":"2023-12-13T00:27:53.923570+0000","last_undegraded":"2023-12-13T00:27:53.923570+0000","last_fullsized":"2023-12-13T00:27:53.923570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2837,"log_dups_size":0,"ondisk_log_size":2837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:30:26.126361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2827,"num_write_kb":13646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'70","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.898663+0000","last_change":"2023-12-13T00:00:31.037679+0000","last_active":"2023-12-13T00:28:04.898663+0000","last_peered":"2023-12-13T00:28:04.898663+0000","last_clean":"2023-12-13T00:28:04.898663+0000","last_became_active":"2023-12-13T00:00:31.037445+0000","last_became_peered":"2023-12-13T00:00:31.037445+0000","last_unstale":"2023-12-13T00:28:04.898663+0000","last_undegraded":"2023-12-13T00:28:04.898663+0000","last_fullsized":"2023-12-13T00:28:04.898663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:55.082987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'116","reported_seq":142,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.942392+0000","last_change":"2023-12-13T00:00:35.661405+0000","last_active":"2023-12-13T00:27:31.942392+0000","last_peered":"2023-12-13T00:27:31.942392+0000","last_clean":"2023-12-13T00:27:31.942392+0000","last_became_active":"2023-12-13T00:00:35.660984+0000","last_became_peered":"2023-12-13T00:00:35.660984+0000","last_unstale":"2023-12-13T00:27:31.942392+0000","last_undegraded":"2023-12-13T00:27:31.942392+0000","last_fullsized":"2023-12-13T00:27:31.942392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:24.668139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":9076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.885751+0000","last_change":"2023-12-13T00:00:31.147104+0000","last_active":"2023-12-13T00:28:04.885751+0000","last_peered":"2023-12-13T00:28:04.885751+0000","last_clean":"2023-12-13T00:28:04.885751+0000","last_became_active":"2023-12-13T00:00:31.145225+0000","last_became_peered":"2023-12-13T00:00:31.145225+0000","last_unstale":"2023-12-13T00:28:04.885751+0000","last_undegraded":"2023-12-13T00:28:04.885751+0000","last_fullsized":"2023-12-13T00:28:04.885751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:42:14.707955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'66","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.758045+0000","last_change":"2023-12-13T00:00:31.119735+0000","last_active":"2023-12-13T00:28:04.758045+0000","last_peered":"2023-12-13T00:28:04.758045+0000","last_clean":"2023-12-13T00:28:04.758045+0000","last_became_active":"2023-12-13T00:00:31.119474+0000","last_became_peered":"2023-12-13T00:00:31.119474+0000","last_unstale":"2023-12-13T00:28:04.758045+0000","last_undegraded":"2023-12-13T00:28:04.758045+0000","last_fullsized":"2023-12-13T00:28:04.758045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:30.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'62","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.877774+0000","last_change":"2023-12-13T00:00:31.027180+0000","last_active":"2023-12-13T00:28:04.877774+0000","last_peered":"2023-12-13T00:28:04.877774+0000","last_clean":"2023-12-13T00:28:04.877774+0000","last_became_active":"2023-12-13T00:00:31.026922+0000","last_became_peered":"2023-12-13T00:00:31.026922+0000","last_unstale":"2023-12-13T00:28:04.877774+0000","last_undegraded":"2023-12-13T00:28:04.877774+0000","last_fullsized":"2023-12-13T00:28:04.877774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:58:37.933386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'58","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.859144+0000","last_change":"2023-12-13T00:00:31.119937+0000","last_active":"2023-12-13T00:28:04.859144+0000","last_peered":"2023-12-13T00:28:04.859144+0000","last_clean":"2023-12-13T00:28:04.859144+0000","last_became_active":"2023-12-13T00:00:31.119685+0000","last_became_peered":"2023-12-13T00:00:31.119685+0000","last_unstale":"2023-12-13T00:28:04.859144+0000","last_undegraded":"2023-12-13T00:28:04.859144+0000","last_fullsized":"2023-12-13T00:28:04.859144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:00.910594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.818174+0000","last_change":"2023-12-13T00:00:31.150597+0000","last_active":"2023-12-13T00:28:04.818174+0000","last_peered":"2023-12-13T00:28:04.818174+0000","last_clean":"2023-12-13T00:28:04.818174+0000","last_became_active":"2023-12-13T00:00:31.150275+0000","last_became_peered":"2023-12-13T00:00:31.150275+0000","last_unstale":"2023-12-13T00:28:04.818174+0000","last_undegraded":"2023-12-13T00:28:04.818174+0000","last_fullsized":"2023-12-13T00:28:04.818174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:20.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'47","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.817976+0000","last_change":"2023-12-13T00:00:31.117688+0000","last_active":"2023-12-13T00:28:04.817976+0000","last_peered":"2023-12-13T00:28:04.817976+0000","last_clean":"2023-12-13T00:28:04.817976+0000","last_became_active":"2023-12-13T00:00:31.117409+0000","last_became_peered":"2023-12-13T00:00:31.117409+0000","last_unstale":"2023-12-13T00:28:04.817976+0000","last_undegraded":"2023-12-13T00:28:04.817976+0000","last_fullsized":"2023-12-13T00:28:04.817976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:12.753740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'59","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.891063+0000","last_change":"2023-12-13T00:00:31.142584+0000","last_active":"2023-12-13T00:28:04.891063+0000","last_peered":"2023-12-13T00:28:04.891063+0000","last_clean":"2023-12-13T00:28:04.891063+0000","last_became_active":"2023-12-13T00:00:31.141656+0000","last_became_peered":"2023-12-13T00:00:31.141656+0000","last_unstale":"2023-12-13T00:28:04.891063+0000","last_undegraded":"2023-12-13T00:28:04.891063+0000","last_fullsized":"2023-12-13T00:28:04.891063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:49:22.676243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'47","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.860118+0000","last_change":"2023-12-13T00:00:31.036263+0000","last_active":"2023-12-13T00:28:04.860118+0000","last_peered":"2023-12-13T00:28:04.860118+0000","last_clean":"2023-12-13T00:28:04.860118+0000","last_became_active":"2023-12-13T00:00:31.036113+0000","last_became_peered":"2023-12-13T00:00:31.036113+0000","last_unstale":"2023-12-13T00:28:04.860118+0000","last_undegraded":"2023-12-13T00:28:04.860118+0000","last_fullsized":"2023-12-13T00:28:04.860118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:01.219033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'57","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.872949+0000","last_change":"2023-12-13T00:00:31.027230+0000","last_active":"2023-12-13T00:28:04.872949+0000","last_peered":"2023-12-13T00:28:04.872949+0000","last_clean":"2023-12-13T00:28:04.872949+0000","last_became_active":"2023-12-13T00:00:31.026968+0000","last_became_peered":"2023-12-13T00:00:31.026968+0000","last_unstale":"2023-12-13T00:28:04.872949+0000","last_undegraded":"2023-12-13T00:28:04.872949+0000","last_fullsized":"2023-12-13T00:28:04.872949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:53.920022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'71","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.858163+0000","last_change":"2023-12-13T00:00:31.139140+0000","last_active":"2023-12-13T00:28:04.858163+0000","last_peered":"2023-12-13T00:28:04.858163+0000","last_clean":"2023-12-13T00:28:04.858163+0000","last_became_active":"2023-12-13T00:00:31.138869+0000","last_became_peered":"2023-12-13T00:00:31.138869+0000","last_unstale":"2023-12-13T00:28:04.858163+0000","last_undegraded":"2023-12-13T00:28:04.858163+0000","last_fullsized":"2023-12-13T00:28:04.858163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:03:13.913502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'64","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.902318+0000","last_change":"2023-12-13T00:00:31.146522+0000","last_active":"2023-12-13T00:28:04.902318+0000","last_peered":"2023-12-13T00:28:04.902318+0000","last_clean":"2023-12-13T00:28:04.902318+0000","last_became_active":"2023-12-13T00:00:31.146264+0000","last_became_peered":"2023-12-13T00:00:31.146264+0000","last_unstale":"2023-12-13T00:28:04.902318+0000","last_undegraded":"2023-12-13T00:28:04.902318+0000","last_fullsized":"2023-12-13T00:28:04.902318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:20:47.671750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'68","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.832827+0000","last_change":"2023-12-13T00:00:31.143709+0000","last_active":"2023-12-13T00:28:04.832827+0000","last_peered":"2023-12-13T00:28:04.832827+0000","last_clean":"2023-12-13T00:28:04.832827+0000","last_became_active":"2023-12-13T00:00:31.143472+0000","last_became_peered":"2023-12-13T00:00:31.143472+0000","last_unstale":"2023-12-13T00:28:04.832827+0000","last_undegraded":"2023-12-13T00:28:04.832827+0000","last_fullsized":"2023-12-13T00:28:04.832827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:21:51.967408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'52","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.878271+0000","last_change":"2023-12-13T00:00:31.146698+0000","last_active":"2023-12-13T00:28:04.878271+0000","last_peered":"2023-12-13T00:28:04.878271+0000","last_clean":"2023-12-13T00:28:04.878271+0000","last_became_active":"2023-12-13T00:00:31.146159+0000","last_became_peered":"2023-12-13T00:00:31.146159+0000","last_unstale":"2023-12-13T00:28:04.878271+0000","last_undegraded":"2023-12-13T00:28:04.878271+0000","last_fullsized":"2023-12-13T00:28:04.878271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:05:56.876593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'67","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.876344+0000","last_change":"2023-12-13T00:00:31.143946+0000","last_active":"2023-12-13T00:28:04.876344+0000","last_peered":"2023-12-13T00:28:04.876344+0000","last_clean":"2023-12-13T00:28:04.876344+0000","last_became_active":"2023-12-13T00:00:31.143663+0000","last_became_peered":"2023-12-13T00:00:31.143663+0000","last_unstale":"2023-12-13T00:28:04.876344+0000","last_undegraded":"2023-12-13T00:28:04.876344+0000","last_fullsized":"2023-12-13T00:28:04.876344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:27:24.026750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'69","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.756252+0000","last_change":"2023-12-13T00:00:31.142314+0000","last_active":"2023-12-13T00:28:04.756252+0000","last_peered":"2023-12-13T00:28:04.756252+0000","last_clean":"2023-12-13T00:28:04.756252+0000","last_became_active":"2023-12-13T00:00:31.142067+0000","last_became_peered":"2023-12-13T00:00:31.142067+0000","last_unstale":"2023-12-13T00:28:04.756252+0000","last_undegraded":"2023-12-13T00:28:04.756252+0000","last_fullsized":"2023-12-13T00:28:04.756252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:36.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'51","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.874287+0000","last_change":"2023-12-13T00:00:31.146764+0000","last_active":"2023-12-13T00:28:04.874287+0000","last_peered":"2023-12-13T00:28:04.874287+0000","last_clean":"2023-12-13T00:28:04.874287+0000","last_became_active":"2023-12-13T00:00:31.146501+0000","last_became_peered":"2023-12-13T00:00:31.146501+0000","last_unstale":"2023-12-13T00:28:04.874287+0000","last_undegraded":"2023-12-13T00:28:04.874287+0000","last_fullsized":"2023-12-13T00:28:04.874287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:20:36.334790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'67","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.871560+0000","last_change":"2023-12-13T00:00:31.138982+0000","last_active":"2023-12-13T00:28:04.871560+0000","last_peered":"2023-12-13T00:28:04.871560+0000","last_clean":"2023-12-13T00:28:04.871560+0000","last_became_active":"2023-12-13T00:00:31.138738+0000","last_became_peered":"2023-12-13T00:00:31.138738+0000","last_unstale":"2023-12-13T00:28:04.871560+0000","last_undegraded":"2023-12-13T00:28:04.871560+0000","last_fullsized":"2023-12-13T00:28:04.871560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:08:05.660552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'52","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.865407+0000","last_change":"2023-12-13T00:00:31.148499+0000","last_active":"2023-12-13T00:28:04.865407+0000","last_peered":"2023-12-13T00:28:04.865407+0000","last_clean":"2023-12-13T00:28:04.865407+0000","last_became_active":"2023-12-13T00:00:31.148251+0000","last_became_peered":"2023-12-13T00:00:31.148251+0000","last_unstale":"2023-12-13T00:28:04.865407+0000","last_undegraded":"2023-12-13T00:28:04.865407+0000","last_fullsized":"2023-12-13T00:28:04.865407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:46:41.106364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'58","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.817989+0000","last_change":"2023-12-13T00:00:31.117684+0000","last_active":"2023-12-13T00:28:04.817989+0000","last_peered":"2023-12-13T00:28:04.817989+0000","last_clean":"2023-12-13T00:28:04.817989+0000","last_became_active":"2023-12-13T00:00:31.117423+0000","last_became_peered":"2023-12-13T00:00:31.117423+0000","last_unstale":"2023-12-13T00:28:04.817989+0000","last_undegraded":"2023-12-13T00:28:04.817989+0000","last_fullsized":"2023-12-13T00:28:04.817989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:33:39.081529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'67","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.825415+0000","last_change":"2023-12-13T00:00:31.150615+0000","last_active":"2023-12-13T00:28:04.825415+0000","last_peered":"2023-12-13T00:28:04.825415+0000","last_clean":"2023-12-13T00:28:04.825415+0000","last_became_active":"2023-12-13T00:00:31.150324+0000","last_became_peered":"2023-12-13T00:00:31.150324+0000","last_unstale":"2023-12-13T00:28:04.825415+0000","last_undegraded":"2023-12-13T00:28:04.825415+0000","last_fullsized":"2023-12-13T00:28:04.825415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:15:16.348222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'63","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.873042+0000","last_change":"2023-12-13T00:00:31.147145+0000","last_active":"2023-12-13T00:28:04.873042+0000","last_peered":"2023-12-13T00:28:04.873042+0000","last_clean":"2023-12-13T00:28:04.873042+0000","last_became_active":"2023-12-13T00:00:31.146444+0000","last_became_peered":"2023-12-13T00:00:31.146444+0000","last_unstale":"2023-12-13T00:28:04.873042+0000","last_undegraded":"2023-12-13T00:28:04.873042+0000","last_fullsized":"2023-12-13T00:28:04.873042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:52:46.548248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'67","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.876556+0000","last_change":"2023-12-13T00:00:31.148920+0000","last_active":"2023-12-13T00:28:04.876556+0000","last_peered":"2023-12-13T00:28:04.876556+0000","last_clean":"2023-12-13T00:28:04.876556+0000","last_became_active":"2023-12-13T00:00:31.148529+0000","last_became_peered":"2023-12-13T00:00:31.148529+0000","last_unstale":"2023-12-13T00:28:04.876556+0000","last_undegraded":"2023-12-13T00:28:04.876556+0000","last_fullsized":"2023-12-13T00:28:04.876556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:51.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'59","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.866724+0000","last_change":"2023-12-13T00:00:31.149934+0000","last_active":"2023-12-13T00:28:04.866724+0000","last_peered":"2023-12-13T00:28:04.866724+0000","last_clean":"2023-12-13T00:28:04.866724+0000","last_became_active":"2023-12-13T00:00:31.149685+0000","last_became_peered":"2023-12-13T00:00:31.149685+0000","last_unstale":"2023-12-13T00:28:04.866724+0000","last_undegraded":"2023-12-13T00:28:04.866724+0000","last_fullsized":"2023-12-13T00:28:04.866724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:06.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'62","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.897060+0000","last_change":"2023-12-13T00:00:31.035879+0000","last_active":"2023-12-13T00:28:04.897060+0000","last_peered":"2023-12-13T00:28:04.897060+0000","last_clean":"2023-12-13T00:28:04.897060+0000","last_became_active":"2023-12-13T00:00:31.035672+0000","last_became_peered":"2023-12-13T00:00:31.035672+0000","last_unstale":"2023-12-13T00:28:04.897060+0000","last_undegraded":"2023-12-13T00:28:04.897060+0000","last_fullsized":"2023-12-13T00:28:04.897060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:30.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'65","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.864746+0000","last_change":"2023-12-13T00:00:31.146556+0000","last_active":"2023-12-13T00:28:04.864746+0000","last_peered":"2023-12-13T00:28:04.864746+0000","last_clean":"2023-12-13T00:28:04.864746+0000","last_became_active":"2023-12-13T00:00:31.146186+0000","last_became_peered":"2023-12-13T00:00:31.146186+0000","last_unstale":"2023-12-13T00:28:04.864746+0000","last_undegraded":"2023-12-13T00:28:04.864746+0000","last_fullsized":"2023-12-13T00:28:04.864746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:20:30.098687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'52","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.863441+0000","last_change":"2023-12-13T00:00:31.145365+0000","last_active":"2023-12-13T00:28:04.863441+0000","last_peered":"2023-12-13T00:28:04.863441+0000","last_clean":"2023-12-13T00:28:04.863441+0000","last_became_active":"2023-12-13T00:00:31.144458+0000","last_became_peered":"2023-12-13T00:00:31.144458+0000","last_unstale":"2023-12-13T00:28:04.863441+0000","last_undegraded":"2023-12-13T00:28:04.863441+0000","last_fullsized":"2023-12-13T00:28:04.863441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:03:13.913502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'57","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.886975+0000","last_change":"2023-12-13T00:00:31.145052+0000","last_active":"2023-12-13T00:28:04.886975+0000","last_peered":"2023-12-13T00:28:04.886975+0000","last_clean":"2023-12-13T00:28:04.886975+0000","last_became_active":"2023-12-13T00:00:31.144792+0000","last_became_peered":"2023-12-13T00:00:31.144792+0000","last_unstale":"2023-12-13T00:28:04.886975+0000","last_undegraded":"2023-12-13T00:28:04.886975+0000","last_fullsized":"2023-12-13T00:28:04.886975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:30:27.231427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'50","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.866189+0000","last_change":"2023-12-13T00:00:31.149527+0000","last_active":"2023-12-13T00:28:04.866189+0000","last_peered":"2023-12-13T00:28:04.866189+0000","last_clean":"2023-12-13T00:28:04.866189+0000","last_became_active":"2023-12-13T00:00:31.148875+0000","last_became_peered":"2023-12-13T00:00:31.148875+0000","last_unstale":"2023-12-13T00:28:04.866189+0000","last_undegraded":"2023-12-13T00:28:04.866189+0000","last_fullsized":"2023-12-13T00:28:04.866189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:01.219033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'66","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.887626+0000","last_change":"2023-12-13T00:00:31.144423+0000","last_active":"2023-12-13T00:28:04.887626+0000","last_peered":"2023-12-13T00:28:04.887626+0000","last_clean":"2023-12-13T00:28:04.887626+0000","last_became_active":"2023-12-13T00:00:31.144174+0000","last_became_peered":"2023-12-13T00:00:31.144174+0000","last_unstale":"2023-12-13T00:28:04.887626+0000","last_undegraded":"2023-12-13T00:28:04.887626+0000","last_fullsized":"2023-12-13T00:28:04.887626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:10:31.724460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.850484+0000","last_change":"2023-12-13T00:00:31.144074+0000","last_active":"2023-12-13T00:28:04.850484+0000","last_peered":"2023-12-13T00:28:04.850484+0000","last_clean":"2023-12-13T00:28:04.850484+0000","last_became_active":"2023-12-13T00:00:31.143809+0000","last_became_peered":"2023-12-13T00:00:31.143809+0000","last_unstale":"2023-12-13T00:28:04.850484+0000","last_undegraded":"2023-12-13T00:28:04.850484+0000","last_fullsized":"2023-12-13T00:28:04.850484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:51.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'47","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.856227+0000","last_change":"2023-12-13T00:00:31.116522+0000","last_active":"2023-12-13T00:28:04.856227+0000","last_peered":"2023-12-13T00:28:04.856227+0000","last_clean":"2023-12-13T00:28:04.856227+0000","last_became_active":"2023-12-13T00:00:31.116230+0000","last_became_peered":"2023-12-13T00:00:31.116230+0000","last_unstale":"2023-12-13T00:28:04.856227+0000","last_undegraded":"2023-12-13T00:28:04.856227+0000","last_fullsized":"2023-12-13T00:28:04.856227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:52:46.548248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'66","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.877641+0000","last_change":"2023-12-13T00:00:31.149691+0000","last_active":"2023-12-13T00:28:04.877641+0000","last_peered":"2023-12-13T00:28:04.877641+0000","last_clean":"2023-12-13T00:28:04.877641+0000","last_became_active":"2023-12-13T00:00:31.149410+0000","last_became_peered":"2023-12-13T00:00:31.149410+0000","last_unstale":"2023-12-13T00:28:04.877641+0000","last_undegraded":"2023-12-13T00:28:04.877641+0000","last_fullsized":"2023-12-13T00:28:04.877641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:50:58.339436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":248,"num_write":4193,"num_write_kb":331487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5031,"ondisk_log_size":5031,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3759,"ondisk_log_size":3759,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":43904475,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":1477,"num_read_kb":1524,"num_write":14609,"num_write_kb":50682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87957504,"data_stored":87808950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13591,"ondisk_log_size":13591,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509781,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53632,"kb_used_data":8568,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318208,"statfs":{"total":96636764160,"available":96581844992,"internally_reserved":0,"allocated":8773632,"data_stored":8578223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39700000000000002,"15min":0.40000000000000002},"min":{"1min":0.27700000000000002,"5min":0.25800000000000001,"15min":0.23699999999999999},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.65800000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42299999999999999,"15min":0.42899999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.58699999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.45400000000000001}]},{"osd":1,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.441,"15min":0.437},"min":{"1min":0.309,"5min":0.30499999999999999,"15min":0.24299999999999999},"max":{"1min":0.60599999999999998,"5min":0.63500000000000001,"15min":0.68200000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41099999999999998,"15min":0.41899999999999998},"min":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.26000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.61699999999999999},"last":0.47699999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.27100000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.442},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.33000000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.57399999999999995,"5min":0.65100000000000002,"15min":0.65200000000000002},"last":0.39600000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.436,"15min":0.438},"min":{"1min":0.36899999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55800000000000005,"5min":0.623,"15min":0.623},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.309},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.372,"15min":0.375},"min":{"1min":0.249,"5min":0.246,"15min":0.24199999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.39200000000000002,"15min":0.39500000000000002},"min":{"1min":0.28799999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.60099999999999998,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.31}]},{"osd":5,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40799999999999997,"15min":0.40100000000000002},"min":{"1min":0.28299999999999997,"5min":0.26300000000000001,"15min":0.22900000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.45100000000000001,"15min":0.438},"min":{"1min":0.314,"5min":0.29799999999999999,"15min":0.23100000000000001},"max":{"1min":0.68400000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.42699999999999999}]},{"osd":6,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.45700000000000002},"min":{"1min":0.34499999999999997,"5min":0.28899999999999998,"15min":0.23999999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.307,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67900000000000005,"15min":0.71799999999999997},"last":0.35299999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509780,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88192,"kb_used_data":16760,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94283648,"statfs":{"total":96636764160,"available":96546455552,"internally_reserved":0,"allocated":17162240,"data_stored":16985405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.34100000000000003,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.42799999999999999},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.23100000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.70099999999999996}]},{"osd":1,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.30399999999999999,"5min":0.28599999999999998,"15min":0.252},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.41899999999999998,"15min":0.41699999999999998},"min":{"1min":0.34599999999999997,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.58599999999999997}]},{"osd":2,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.42299999999999999,"15min":0.41099999999999998},"min":{"1min":0.35799999999999998,"5min":0.30099999999999999,"15min":0.247},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.627},{"interface":"front","average":{"1min":0.505,"5min":0.437,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.26500000000000001},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.78000000000000003}]},{"osd":3,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.28999999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32300000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.60699999999999998}]},{"osd":4,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.38,"15min":0.379},"min":{"1min":0.254,"5min":0.215,"15min":0.215},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.46600000000000003}]},{"osd":5,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.378},"min":{"1min":0.24399999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.502},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44500000000000001,"15min":0.436},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.249},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.441,"15min":0.44},"min":{"1min":0.32200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.433,"15min":0.439},"min":{"1min":0.29499999999999998,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.56100000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509782,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58980,"kb_used_data":9756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312860,"statfs":{"total":96636764160,"available":96576368640,"internally_reserved":0,"allocated":9990144,"data_stored":9784207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.41999999999999998},"min":{"1min":0.33500000000000002,"5min":0.216,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40400000000000003,"15min":0.40999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.49399999999999999}]},{"osd":1,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.41199999999999998},"min":{"1min":0.373,"5min":0.248,"15min":0.224},"max":{"1min":0.55700000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.432,"15min":0.435},"min":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.251},"max":{"1min":0.53000000000000003,"5min":0.57699999999999996,"15min":0.59999999999999998},"last":0.46200000000000002}]},{"osd":2,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.43099999999999999,"15min":0.432},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27100000000000002},"max":{"1min":0.54800000000000004,"5min":0.60099999999999998,"15min":0.60699999999999998},"last":0.438},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.65500000000000003},"last":0.48499999999999999}]},{"osd":3,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54300000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.378,"5min":0.33200000000000002,"15min":0.28699999999999998},"max":{"1min":0.63100000000000001,"5min":0.65500000000000003,"15min":0.66800000000000004},"last":0.47199999999999998}]},{"osd":5,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38300000000000001,"15min":0.38200000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.221},"max":{"1min":0.61299999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.65100000000000002},"last":0.36199999999999999}]},{"osd":6,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.378,"15min":0.38500000000000001},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.247},"max":{"1min":0.624,"5min":0.63100000000000001,"15min":0.71999999999999997},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.30099999999999999,"5min":0.27300000000000002,"15min":0.23899999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.71899999999999997},"last":0.41999999999999998}]},{"osd":7,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.42999999999999999,"15min":0.42699999999999999},"min":{"1min":0.32500000000000001,"5min":0.26300000000000001,"15min":0.25600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.70299999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47099999999999997,"15min":0.46200000000000002},"min":{"1min":0.34799999999999998,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.38500000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509782,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96880,"kb_used_data":21288,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94274960,"statfs":{"total":96636764160,"available":96537559040,"internally_reserved":0,"allocated":21798912,"data_stored":21617833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.317,"15min":0.316},"min":{"1min":0.22600000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.42699999999999999,"5min":0.53200000000000003,"15min":0.64000000000000001},"last":0.313},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.312,"15min":0.312},"min":{"1min":0.246,"5min":0.19600000000000001,"15min":0.192},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.57899999999999996},"last":0.32700000000000001}]},{"osd":1,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34000000000000002,"15min":0.33000000000000002},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.20200000000000001},"max":{"1min":0.41299999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.28499999999999998,"5min":0.27400000000000002,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.35999999999999999}]},{"osd":2,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.26600000000000001,"5min":0.249,"15min":0.22800000000000001},"max":{"1min":0.47799999999999998,"5min":0.59899999999999998,"15min":0.69399999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39800000000000002,"15min":0.39600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.23799999999999999},"max":{"1min":0.51400000000000001,"5min":0.59699999999999998,"15min":0.66300000000000003},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.311},"max":{"1min":0.72199999999999998,"5min":0.80100000000000005,"15min":0.90700000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.38500000000000001,"5min":0.34100000000000003,"15min":0.316},"max":{"1min":0.64500000000000002,"5min":0.76700000000000002,"15min":0.84199999999999997},"last":0.63200000000000001}]},{"osd":5,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.83199999999999996},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50700000000000001,"15min":0.5},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.30599999999999999},"max":{"1min":0.72799999999999998,"5min":0.76000000000000001,"15min":0.81999999999999995},"last":0.47399999999999998}]},{"osd":6,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.67600000000000005,"5min":0.78600000000000003,"15min":0.80600000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54600000000000004,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.79300000000000004},"last":0.72199999999999998}]},{"osd":7,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.78800000000000003},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.39500000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.85799999999999998},"last":0.51200000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509780,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36200,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335640,"statfs":{"total":96636764160,"available":96599695360,"internally_reserved":0,"allocated":884736,"data_stored":706002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.308,"15min":0.29899999999999999},"min":{"1min":0.20399999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.49299999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.308,"5min":0.32000000000000001,"15min":0.32800000000000001},"min":{"1min":0.251,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.41199999999999998,"5min":0.57599999999999996,"15min":0.63600000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33100000000000002,"15min":0.32500000000000001},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.44500000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.372},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35599999999999998,"15min":0.35199999999999998},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.23100000000000001},"max":{"1min":0.501,"5min":0.53800000000000003,"15min":0.55000000000000004},"last":0.44700000000000001}]},{"osd":3,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38100000000000001,"15min":0.375},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.5,"5min":0.60599999999999998,"15min":0.60799999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.39200000000000002,"15min":0.38400000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.52100000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.42199999999999999}]},{"osd":4,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59199999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.371,"5min":0.316,"15min":0.316},"max":{"1min":0.747,"5min":0.79800000000000004,"15min":0.84699999999999998},"last":0.57099999999999995}]},{"osd":5,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.69099999999999995,"5min":0.78500000000000003,"15min":0.81999999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51000000000000001,"15min":0.48999999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.32000000000000001},"max":{"1min":0.71899999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54400000000000004}]},{"osd":6,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.29099999999999998},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":0.89300000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.35999999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66700000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.622}]},{"osd":7,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.38800000000000001,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":0.67500000000000004,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.34999999999999998},"max":{"1min":0.68999999999999995,"5min":0.82699999999999996,"15min":0.85799999999999998},"last":0.58299999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542484,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70184,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94301656,"statfs":{"total":96636764160,"available":96564895744,"internally_reserved":0,"allocated":8683520,"data_stored":8504788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.313,"15min":0.308},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.38400000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.32200000000000001,"15min":0.32700000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.19},"max":{"1min":0.42799999999999999,"5min":0.53200000000000003,"15min":0.60299999999999998},"last":0.27100000000000002}]},{"osd":1,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.33000000000000002,"15min":0.33100000000000002},"min":{"1min":0.23599999999999999,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.38200000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.746},"last":0.437}]},{"osd":3,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35899999999999999,"15min":0.36799999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46800000000000003,"5min":0.57399999999999995,"15min":1.03},"last":0.313},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.376,"15min":0.38500000000000001},"min":{"1min":0.26000000000000001,"5min":0.247,"15min":0.23499999999999999},"max":{"1min":0.41799999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.33600000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46899999999999997,"15min":0.46600000000000003},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.85399999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.496,"15min":0.48699999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.28499999999999998},"max":{"1min":0.65700000000000003,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.65700000000000003}]},{"osd":5,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.47899999999999998,"15min":0.46899999999999997},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.317},"max":{"1min":0.56899999999999995,"5min":0.70799999999999996,"15min":0.82099999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51600000000000001,"15min":0.496},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.316},"max":{"1min":0.76100000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.76100000000000001}]},{"osd":6,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.36799999999999999,"5min":0.36199999999999999,"15min":0.34499999999999997},"max":{"1min":0.61799999999999999,"5min":0.74399999999999999,"15min":0.79800000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.498,"15min":0.503},"min":{"1min":0.377,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.52500000000000002,"5min":0.75800000000000001,"15min":0.78200000000000003},"last":0.501}]},{"osd":7,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53500000000000003,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35499999999999998},"max":{"1min":0.63800000000000001,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.48699999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542484,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67936,"kb_used_data":6232,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94303904,"statfs":{"total":96636764160,"available":96567197696,"internally_reserved":0,"allocated":6381568,"data_stored":6195602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.32900000000000001,"15min":0.32000000000000001},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.19400000000000001},"max":{"1min":0.56599999999999995,"5min":0.627,"15min":0.66900000000000004},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33000000000000002,"15min":0.316},"min":{"1min":0.22700000000000001,"5min":0.221,"15min":0.19900000000000001},"max":{"1min":0.47299999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.35699999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32600000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57999999999999996,"5min":0.60699999999999998,"15min":0.64600000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.37,"15min":0.35399999999999998},"min":{"1min":0.246,"5min":0.24299999999999999,"15min":0.23000000000000001},"max":{"1min":0.52800000000000002,"5min":0.61299999999999999,"15min":0.72299999999999998},"last":0.27100000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36199999999999999,"15min":0.35499999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.22900000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.36799999999999999},"min":{"1min":0.28999999999999998,"5min":0.26300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.65400000000000003},"last":0.34499999999999997}]},{"osd":4,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.33500000000000002,"5min":0.30499999999999999,"15min":0.25800000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51500000000000001,"15min":0.47899999999999998},"min":{"1min":0.36499999999999999,"5min":0.35899999999999999,"15min":0.27200000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.40899999999999997}]},{"osd":5,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52500000000000002,"15min":0.48499999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.505},"min":{"1min":0.40000000000000002,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.39900000000000002}]},{"osd":6,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52000000000000002},"min":{"1min":0.40200000000000002,"5min":0.33800000000000002,"15min":0.33600000000000002},"max":{"1min":0.71699999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.51900000000000002},"min":{"1min":0.41999999999999998,"5min":0.377,"15min":0.34499999999999997},"max":{"1min":0.81699999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.41999999999999998}]},{"osd":7,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69399999999999995,"5min":0.746,"15min":0.79500000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":0.54100000000000004},"min":{"1min":0.371,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.371}]}]},{"osd":5,"up_from":13,"seq":55834575189,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88748,"kb_used_data":17316,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94283092,"statfs":{"total":96636764160,"available":96545886208,"internally_reserved":0,"allocated":17731584,"data_stored":17541418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.307,"5min":0.255,"15min":0.20200000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.70399999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41399999999999998,"15min":0.40699999999999997},"min":{"1min":0.30099999999999999,"5min":0.28000000000000003,"15min":0.23999999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.67300000000000004},"last":0.48999999999999999}]},{"osd":1,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.434,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.249},"max":{"1min":0.61499999999999999,"5min":0.625,"15min":0.67300000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.33300000000000002,"5min":0.28999999999999998,"15min":0.247},"max":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.73399999999999999},"last":0.60299999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.42999999999999999,"15min":0.42299999999999999},"min":{"1min":0.317,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.628,"5min":0.628,"15min":0.68700000000000006},"last":0.503},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41599999999999998,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.65900000000000003},"last":0.53500000000000003}]},{"osd":3,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44600000000000001,"15min":0.436},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.27300000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.68999999999999995},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.44800000000000001},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.69099999999999995},"last":0.52100000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38800000000000001,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.215},"max":{"1min":0.58599999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40100000000000002,"15min":0.38600000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.22900000000000001},"max":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.65000000000000002},"last":0.41999999999999998}]},{"osd":6,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.374,"15min":0.36499999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.22500000000000001},"max":{"1min":0.48299999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.42299999999999999,"15min":0.41799999999999998},"min":{"1min":0.26100000000000001,"5min":0.25800000000000001,"15min":0.24399999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.77400000000000002},"last":0.39900000000000002}]},{"osd":7,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.41899999999999998},"min":{"1min":0.29999999999999999,"5min":0.27400000000000002,"15min":0.22900000000000001},"max":{"1min":0.60099999999999998,"5min":0.61099999999999999,"15min":0.68899999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.433},"min":{"1min":0.36699999999999999,"5min":0.27000000000000002,"15min":0.26700000000000002},"max":{"1min":0.64500000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.436}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6098944,"data_stored":6080128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21516288,"data_stored":21502359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9707520,"data_stored":9668733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16855040,"data_stored":16835576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16879616,"data_stored":16869931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8491008,"data_stored":8462749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T00:28:12.030 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-13T00:28:12.031 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T00:28:12.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.161+0000 7f8f67656640 1 Processor -- start 2023-12-13T00:28:12.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.161+0000 7f8f67656640 1 -- start start 2023-12-13T00:28:12.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.162+0000 7f8f67656640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8f60151520 0x7f8f600c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:12.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.162+0000 7f8f67656640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8f6015a8e0 0x7f8f6015ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:12.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.162+0000 7f8f67656640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f600713b0 con 0x7f8f60151900 2023-12-13T00:28:12.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.162+0000 7f8f67656640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6006dbc0 con 0x7f8f60151520 2023-12-13T00:28:12.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.162+0000 7f8f67656640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f60071f50 con 0x7f8f6015a8e0 2023-12-13T00:28:12.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.162+0000 7f8f653f2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8f60151520 0x7f8f600c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:12.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.162+0000 7f8f653f2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8f60151520 0x7f8f600c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51442/0 (socket says 172.21.15.72:51442) 2023-12-13T00:28:12.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.162+0000 7f8f653f2640 1 -- 172.21.15.72:0/3452010639 learned_addr learned my addr 172.21.15.72:0/3452010639 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:12.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.163+0000 7f8f65bf3640 1 --2- 172.21.15.72:0/3452010639 >> v2:172.21.15.176:3300/0 conn(0x7f8f6015a8e0 0x7f8f6015ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.165+0000 7f8f653f2640 1 -- 172.21.15.72:0/3452010639 >> v2:172.21.15.176:3300/0 conn(0x7f8f6015a8e0 msgr2=0x7f8f6015ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.165+0000 7f8f653f2640 1 --2- 172.21.15.72:0/3452010639 >> v2:172.21.15.176:3300/0 conn(0x7f8f6015a8e0 0x7f8f6015ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.165+0000 7f8f653f2640 1 -- 172.21.15.72:0/3452010639 >> v1:172.21.15.176:6789/0 conn(0x7f8f60151900 legacy=0x7f8f60071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.165+0000 7f8f653f2640 1 -- 172.21.15.72:0/3452010639 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f600c8840 con 0x7f8f60151520 2023-12-13T00:28:12.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.169+0000 7f8f653f2640 1 --2- 172.21.15.72:0/3452010639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f60151520 0x7f8f600c5cb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8f6006e7d0 tx=0x7f8f5c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394fd33cea2c04b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:12.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.172+0000 7f8f57fff640 1 -- 172.21.15.72:0/3452010639 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c030860 con 0x7f8f60151520 2023-12-13T00:28:12.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.172+0000 7f8f57fff640 1 -- 172.21.15.72:0/3452010639 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c0309c0 con 0x7f8f60151520 2023-12-13T00:28:12.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.172+0000 7f8f57fff640 1 -- 172.21.15.72:0/3452010639 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c030d50 con 0x7f8f60151520 2023-12-13T00:28:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.173+0000 7f8f67656640 1 -- 172.21.15.72:0/3452010639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f60151520 msgr2=0x7f8f600c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.173+0000 7f8f67656640 1 --2- 172.21.15.72:0/3452010639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f60151520 0x7f8f600c5cb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8f6006e7d0 tx=0x7f8f5c02b9a0 comp rx=0 tx=0).stop 2023-12-13T00:28:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.173+0000 7f8f67656640 1 -- 172.21.15.72:0/3452010639 shutdown_connections 2023-12-13T00:28:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.173+0000 7f8f67656640 1 --2- 172.21.15.72:0/3452010639 >> v2:172.21.15.176:3300/0 conn(0x7f8f6015a8e0 0x7f8f6015ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.173+0000 7f8f67656640 1 --2- 172.21.15.72:0/3452010639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f60151520 0x7f8f600c5cb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.173+0000 7f8f67656640 1 -- 172.21.15.72:0/3452010639 >> 172.21.15.72:0/3452010639 conn(0x7f8f600c79a0 msgr2=0x7f8f600c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.173+0000 7f8f67656640 1 -- 172.21.15.72:0/3452010639 shutdown_connections 2023-12-13T00:28:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.173+0000 7f8f67656640 1 -- 172.21.15.72:0/3452010639 wait complete. 2023-12-13T00:28:12.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.174+0000 7f8f67656640 1 Processor -- start 2023-12-13T00:28:12.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.174+0000 7f8f67656640 1 -- start start 2023-12-13T00:28:12.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.175+0000 7f8f67656640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f60151520 0x7f8f600c0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:12.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.175+0000 7f8f67656640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f60151900 0x7f8f60146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:12.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.175+0000 7f8f67656640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f6015a8e0 0x7f8f60141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:12.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.175+0000 7f8f67656640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f60159bb0 con 0x7f8f60151520 2023-12-13T00:28:12.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.175+0000 7f8f67656640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f600c04f0 con 0x7f8f6015a8e0 2023-12-13T00:28:12.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.175+0000 7f8f67656640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f600bfec0 con 0x7f8f60151900 2023-12-13T00:28:12.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.176+0000 7f8f653f2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f60151520 0x7f8f600c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:12.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.176+0000 7f8f653f2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f60151520 0x7f8f600c0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51458/0 (socket says 172.21.15.72:51458) 2023-12-13T00:28:12.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.176+0000 7f8f653f2640 1 -- 172.21.15.72:0/1649692005 learned_addr learned my addr 172.21.15.72:0/1649692005 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:12.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.176+0000 7f8f65bf3640 1 --2- 172.21.15.72:0/1649692005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f6015a8e0 0x7f8f60141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:12.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.176+0000 7f8f64bf1640 1 --2- 172.21.15.72:0/1649692005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f60151900 0x7f8f60146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:12.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.179+0000 7f8f653f2640 1 -- 172.21.15.72:0/1649692005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f60151900 msgr2=0x7f8f60146000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:12.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.179+0000 7f8f653f2640 1 --2- 172.21.15.72:0/1649692005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f60151900 0x7f8f60146000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:12.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.179+0000 7f8f653f2640 1 -- 172.21.15.72:0/1649692005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f6015a8e0 msgr2=0x7f8f60141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:12.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.179+0000 7f8f653f2640 1 --2- 172.21.15.72:0/1649692005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f6015a8e0 0x7f8f60141540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:12.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.179+0000 7f8f653f2640 1 -- 172.21.15.72:0/1649692005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c0094d0 con 0x7f8f60151520 2023-12-13T00:28:12.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.181+0000 7f8f653f2640 1 --2- 172.21.15.72:0/1649692005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f60151520 0x7f8f600c0910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c000c00 tx=0x7f8f5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.185+0000 7f8f55ffb640 1 -- 172.21.15.72:0/1649692005 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c030810 con 0x7f8f60151520 2023-12-13T00:28:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.185+0000 7f8f55ffb640 1 -- 172.21.15.72:0/1649692005 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c039d90 con 0x7f8f60151520 2023-12-13T00:28:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.185+0000 7f8f67656640 1 -- 172.21.15.72:0/1649692005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f600c0e50 con 0x7f8f60151520 2023-12-13T00:28:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.185+0000 7f8f55ffb640 1 -- 172.21.15.72:0/1649692005 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c043650 con 0x7f8f60151520 2023-12-13T00:28:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.185+0000 7f8f67656640 1 -- 172.21.15.72:0/1649692005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f601589a0 con 0x7f8f60151520 2023-12-13T00:28:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.186+0000 7f8f67656640 1 -- 172.21.15.72:0/1649692005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f60067470 con 0x7f8f60151520 2023-12-13T00:28:12.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.427+0000 7f8f55ffb640 1 -- 172.21.15.72:0/1649692005 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8f5c04c3b0 con 0x7f8f60151520 2023-12-13T00:28:12.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.428+0000 7f8f55ffb640 1 --2- 172.21.15.72:0/1649692005 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f8f4406b240 0x7f8f4406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:12.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.428+0000 7f8f64bf1640 1 --2- 172.21.15.72:0/1649692005 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f8f4406b240 0x7f8f4406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:12.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.428+0000 7f8f64bf1640 1 --2- 172.21.15.72:0/1649692005 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f8f4406b240 0x7f8f4406d700 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8f601e29d0 tx=0x7f8f50009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:12.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.442+0000 7f8f55ffb640 1 -- 172.21.15.72:0/1649692005 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f8f5c07b220 con 0x7f8f60151520 2023-12-13T00:28:12.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.442+0000 7f8f55ffb640 1 -- 172.21.15.72:0/1649692005 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8f5c077560 con 0x7f8f60151520 2023-12-13T00:28:12.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.613+0000 7f8f67656640 1 -- 172.21.15.72:0/1649692005 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8f600c5f60 con 0x7f8f4406b240 2023-12-13T00:28:12.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.621+0000 7f8f55ffb640 1 -- 172.21.15.72:0/1649692005 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370978 (secure 0 0 0) 0x7f8f600c5f60 con 0x7f8f4406b240 2023-12-13T00:28:12.625 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:28:12.627 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-12-13T00:28:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.625+0000 7f8f67656640 1 -- 172.21.15.72:0/1649692005 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f8f4406b240 msgr2=0x7f8f4406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.625+0000 7f8f67656640 1 --2- 172.21.15.72:0/1649692005 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f8f4406b240 0x7f8f4406d700 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8f601e29d0 tx=0x7f8f50009040 comp rx=0 tx=0).stop 2023-12-13T00:28:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.625+0000 7f8f67656640 1 -- 172.21.15.72:0/1649692005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f60151520 msgr2=0x7f8f600c0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.625+0000 7f8f67656640 1 --2- 172.21.15.72:0/1649692005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f60151520 0x7f8f600c0910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c000c00 tx=0x7f8f5c004730 comp rx=0 tx=0).stop 2023-12-13T00:28:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.625+0000 7f8f67656640 1 -- 172.21.15.72:0/1649692005 shutdown_connections 2023-12-13T00:28:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.625+0000 7f8f67656640 1 --2- 172.21.15.72:0/1649692005 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f8f4406b240 0x7f8f4406d700 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.625+0000 7f8f67656640 1 --2- 172.21.15.72:0/1649692005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f6015a8e0 0x7f8f60141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.625+0000 7f8f67656640 1 --2- 172.21.15.72:0/1649692005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f60151900 0x7f8f60146000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.625+0000 7f8f67656640 1 --2- 172.21.15.72:0/1649692005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f60151520 0x7f8f600c0910 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.625+0000 7f8f67656640 1 -- 172.21.15.72:0/1649692005 >> 172.21.15.72:0/1649692005 conn(0x7f8f600c79a0 msgr2=0x7f8f60146c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.625+0000 7f8f67656640 1 -- 172.21.15.72:0/1649692005 shutdown_connections 2023-12-13T00:28:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.625+0000 7f8f67656640 1 -- 172.21.15.72:0/1649692005 wait complete. 2023-12-13T00:28:12.636 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":863,"stamp":"2023-12-13T00:28:10.907487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44494843,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1597,"num_read_kb":1872,"num_write":18961,"num_write_kb":384585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22498,"ondisk_log_size":22498,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":560752,"kb_used_data":89264,"kb_used_omap":12,"kb_used_meta":471411,"kb_avail":754413968,"statfs":{"total":773094113280,"available":772519903232,"internally_reserved":0,"allocated":91406336,"data_stored":89913478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":482725426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":84915,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":57,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003257"},"pg_stats":[{"pgid":"2.1f","version":"27'888","reported_seq":919,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:33.949039+0000","last_change":"2023-12-13T00:00:29.997631+0000","last_active":"2023-12-13T00:27:33.949039+0000","last_peered":"2023-12-13T00:27:33.949039+0000","last_clean":"2023-12-13T00:27:33.949039+0000","last_became_active":"2023-12-13T00:00:29.997381+0000","last_became_peered":"2023-12-13T00:00:29.997381+0000","last_unstale":"2023-12-13T00:27:33.949039+0000","last_undegraded":"2023-12-13T00:27:33.949039+0000","last_fullsized":"2023-12-13T00:27:33.949039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:33:37.976462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":4535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'54","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.857641+0000","last_change":"2023-12-13T00:00:31.138533+0000","last_active":"2023-12-13T00:28:04.857641+0000","last_peered":"2023-12-13T00:28:04.857641+0000","last_clean":"2023-12-13T00:28:04.857641+0000","last_became_active":"2023-12-13T00:00:31.138242+0000","last_became_peered":"2023-12-13T00:00:31.138242+0000","last_unstale":"2023-12-13T00:28:04.857641+0000","last_undegraded":"2023-12-13T00:28:04.857641+0000","last_fullsized":"2023-12-13T00:28:04.857641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:39:59.955103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'155","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:25.503482+0000","last_change":"2023-12-13T00:00:35.667840+0000","last_active":"2023-12-13T00:27:25.503482+0000","last_peered":"2023-12-13T00:27:25.503482+0000","last_clean":"2023-12-13T00:27:25.503482+0000","last_became_active":"2023-12-13T00:00:35.667498+0000","last_became_peered":"2023-12-13T00:00:35.667498+0000","last_unstale":"2023-12-13T00:27:25.503482+0000","last_undegraded":"2023-12-13T00:27:25.503482+0000","last_fullsized":"2023-12-13T00:27:25.503482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:17.304722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'846","reported_seq":877,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:35.941673+0000","last_change":"2023-12-13T00:00:30.001888+0000","last_active":"2023-12-13T00:27:35.941673+0000","last_peered":"2023-12-13T00:27:35.941673+0000","last_clean":"2023-12-13T00:27:35.941673+0000","last_became_active":"2023-12-13T00:00:30.001628+0000","last_became_peered":"2023-12-13T00:00:30.001628+0000","last_unstale":"2023-12-13T00:27:35.941673+0000","last_undegraded":"2023-12-13T00:27:35.941673+0000","last_fullsized":"2023-12-13T00:27:35.941673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:48:30.422214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'62","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.860247+0000","last_change":"2023-12-13T00:00:31.036420+0000","last_active":"2023-12-13T00:28:04.860247+0000","last_peered":"2023-12-13T00:28:04.860247+0000","last_clean":"2023-12-13T00:28:04.860247+0000","last_became_active":"2023-12-13T00:00:31.036197+0000","last_became_peered":"2023-12-13T00:00:31.036197+0000","last_unstale":"2023-12-13T00:28:04.860247+0000","last_undegraded":"2023-12-13T00:28:04.860247+0000","last_fullsized":"2023-12-13T00:28:04.860247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:05:56.876593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'165","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.828080+0000","last_change":"2023-12-13T00:00:35.665348+0000","last_active":"2023-12-13T00:27:29.828080+0000","last_peered":"2023-12-13T00:27:29.828080+0000","last_clean":"2023-12-13T00:27:29.828080+0000","last_became_active":"2023-12-13T00:00:35.664981+0000","last_became_peered":"2023-12-13T00:00:35.664981+0000","last_unstale":"2023-12-13T00:27:29.828080+0000","last_undegraded":"2023-12-13T00:27:29.828080+0000","last_fullsized":"2023-12-13T00:27:29.828080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:55.759392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":248,"num_write":136,"num_write_kb":7125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'11","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:53.927716+0000","last_change":"2023-12-13T00:00:30.009983+0000","last_active":"2023-12-13T00:27:53.927716+0000","last_peered":"2023-12-13T00:27:53.927716+0000","last_clean":"2023-12-13T00:27:53.927716+0000","last_became_active":"2023-12-13T00:00:30.009724+0000","last_became_peered":"2023-12-13T00:00:30.009724+0000","last_unstale":"2023-12-13T00:27:53.927716+0000","last_undegraded":"2023-12-13T00:27:53.927716+0000","last_fullsized":"2023-12-13T00:27:53.927716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:20:28.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'58","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.897710+0000","last_change":"2023-12-13T00:00:31.151042+0000","last_active":"2023-12-13T00:28:04.897710+0000","last_peered":"2023-12-13T00:28:04.897710+0000","last_clean":"2023-12-13T00:28:04.897710+0000","last_became_active":"2023-12-13T00:00:31.150735+0000","last_became_peered":"2023-12-13T00:00:31.150735+0000","last_unstale":"2023-12-13T00:28:04.897710+0000","last_undegraded":"2023-12-13T00:28:04.897710+0000","last_fullsized":"2023-12-13T00:28:04.897710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:36.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'163","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:28.829499+0000","last_change":"2023-12-13T00:00:35.668759+0000","last_active":"2023-12-13T00:27:28.829499+0000","last_peered":"2023-12-13T00:27:28.829499+0000","last_clean":"2023-12-13T00:27:28.829499+0000","last_became_active":"2023-12-13T00:00:35.668361+0000","last_became_peered":"2023-12-13T00:00:35.668361+0000","last_unstale":"2023-12-13T00:27:28.829499+0000","last_undegraded":"2023-12-13T00:27:28.829499+0000","last_fullsized":"2023-12-13T00:27:28.829499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:05.770014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":10445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.166172+0000","last_change":"2023-12-13T00:00:30.009921+0000","last_active":"2023-12-13T00:27:57.166172+0000","last_peered":"2023-12-13T00:27:57.166172+0000","last_clean":"2023-12-13T00:27:57.166172+0000","last_became_active":"2023-12-13T00:00:30.009644+0000","last_became_peered":"2023-12-13T00:00:30.009644+0000","last_unstale":"2023-12-13T00:27:57.166172+0000","last_undegraded":"2023-12-13T00:27:57.166172+0000","last_fullsized":"2023-12-13T00:27:57.166172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:48:30.422214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'63","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.878581+0000","last_change":"2023-12-13T00:00:31.146801+0000","last_active":"2023-12-13T00:28:04.878581+0000","last_peered":"2023-12-13T00:28:04.878581+0000","last_clean":"2023-12-13T00:28:04.878581+0000","last_became_active":"2023-12-13T00:00:31.146516+0000","last_became_peered":"2023-12-13T00:00:31.146516+0000","last_unstale":"2023-12-13T00:28:04.878581+0000","last_undegraded":"2023-12-13T00:28:04.878581+0000","last_fullsized":"2023-12-13T00:28:04.878581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:44:23.442162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'175","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.590878+0000","last_change":"2023-12-13T00:00:35.668621+0000","last_active":"2023-12-13T00:27:29.590878+0000","last_peered":"2023-12-13T00:27:29.590878+0000","last_clean":"2023-12-13T00:27:29.590878+0000","last_became_active":"2023-12-13T00:00:35.668298+0000","last_became_peered":"2023-12-13T00:00:35.668298+0000","last_unstale":"2023-12-13T00:27:29.590878+0000","last_undegraded":"2023-12-13T00:27:29.590878+0000","last_fullsized":"2023-12-13T00:27:29.590878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:40:04.506084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'50","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.877283+0000","last_change":"2023-12-13T00:00:31.036347+0000","last_active":"2023-12-13T00:28:04.877283+0000","last_peered":"2023-12-13T00:28:04.877283+0000","last_clean":"2023-12-13T00:28:04.877283+0000","last_became_active":"2023-12-13T00:00:31.036062+0000","last_became_peered":"2023-12-13T00:00:31.036062+0000","last_unstale":"2023-12-13T00:28:04.877283+0000","last_undegraded":"2023-12-13T00:28:04.877283+0000","last_fullsized":"2023-12-13T00:28:04.877283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:15:29.783257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'849","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:40.229848+0000","last_change":"2023-12-13T00:00:30.001066+0000","last_active":"2023-12-13T00:27:40.229848+0000","last_peered":"2023-12-13T00:27:40.229848+0000","last_clean":"2023-12-13T00:27:40.229848+0000","last_became_active":"2023-12-13T00:00:30.000782+0000","last_became_peered":"2023-12-13T00:00:30.000782+0000","last_unstale":"2023-12-13T00:27:40.229848+0000","last_undegraded":"2023-12-13T00:27:40.229848+0000","last_fullsized":"2023-12-13T00:27:40.229848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:53.977921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":4547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'149","reported_seq":176,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:28.850150+0000","last_change":"2023-12-13T00:00:35.662038+0000","last_active":"2023-12-13T00:27:28.850150+0000","last_peered":"2023-12-13T00:27:28.850150+0000","last_clean":"2023-12-13T00:27:28.850150+0000","last_became_active":"2023-12-13T00:00:35.661458+0000","last_became_peered":"2023-12-13T00:00:35.661458+0000","last_unstale":"2023-12-13T00:27:28.850150+0000","last_undegraded":"2023-12-13T00:27:28.850150+0000","last_fullsized":"2023-12-13T00:27:28.850150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:12:27.307277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":11179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'55","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.754043+0000","last_change":"2023-12-13T00:00:31.119718+0000","last_active":"2023-12-13T00:28:04.754043+0000","last_peered":"2023-12-13T00:28:04.754043+0000","last_clean":"2023-12-13T00:28:04.754043+0000","last_became_active":"2023-12-13T00:00:31.119447+0000","last_became_peered":"2023-12-13T00:00:31.119447+0000","last_unstale":"2023-12-13T00:28:04.754043+0000","last_undegraded":"2023-12-13T00:28:04.754043+0000","last_fullsized":"2023-12-13T00:28:04.754043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:08.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'215","reported_seq":245,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:55.948505+0000","last_change":"2023-12-13T00:00:29.968425+0000","last_active":"2023-12-13T00:27:55.948505+0000","last_peered":"2023-12-13T00:27:55.948505+0000","last_clean":"2023-12-13T00:27:55.948505+0000","last_became_active":"2023-12-13T00:00:29.967929+0000","last_became_peered":"2023-12-13T00:00:29.967929+0000","last_unstale":"2023-12-13T00:27:55.948505+0000","last_undegraded":"2023-12-13T00:27:55.948505+0000","last_fullsized":"2023-12-13T00:27:55.948505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:53.977921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":581,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'167","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:26.447351+0000","last_change":"2023-12-13T00:00:35.662848+0000","last_active":"2023-12-13T00:27:26.447351+0000","last_peered":"2023-12-13T00:27:26.447351+0000","last_clean":"2023-12-13T00:27:26.447351+0000","last_became_active":"2023-12-13T00:00:35.662469+0000","last_became_peered":"2023-12-13T00:00:35.662469+0000","last_unstale":"2023-12-13T00:27:26.447351+0000","last_undegraded":"2023-12-13T00:27:26.447351+0000","last_fullsized":"2023-12-13T00:27:26.447351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:17:20.456996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":19086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'57","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.831523+0000","last_change":"2023-12-13T00:00:31.143108+0000","last_active":"2023-12-13T00:28:04.831523+0000","last_peered":"2023-12-13T00:28:04.831523+0000","last_clean":"2023-12-13T00:28:04.831523+0000","last_became_active":"2023-12-13T00:00:31.142847+0000","last_became_peered":"2023-12-13T00:00:31.142847+0000","last_unstale":"2023-12-13T00:28:04.831523+0000","last_undegraded":"2023-12-13T00:28:04.831523+0000","last_fullsized":"2023-12-13T00:28:04.831523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:20.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'374","reported_seq":404,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.166869+0000","last_change":"2023-12-13T00:00:30.004483+0000","last_active":"2023-12-13T00:27:57.166869+0000","last_peered":"2023-12-13T00:27:57.166869+0000","last_clean":"2023-12-13T00:27:57.166869+0000","last_became_active":"2023-12-13T00:00:30.004195+0000","last_became_peered":"2023-12-13T00:00:30.004195+0000","last_unstale":"2023-12-13T00:27:57.166869+0000","last_undegraded":"2023-12-13T00:27:57.166869+0000","last_fullsized":"2023-12-13T00:27:57.166869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:35.192132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":373,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'154","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:28.849973+0000","last_change":"2023-12-13T00:00:35.660024+0000","last_active":"2023-12-13T00:27:28.849973+0000","last_peered":"2023-12-13T00:27:28.849973+0000","last_clean":"2023-12-13T00:27:28.849973+0000","last_became_active":"2023-12-13T00:00:35.659637+0000","last_became_peered":"2023-12-13T00:00:35.659637+0000","last_unstale":"2023-12-13T00:27:28.849973+0000","last_undegraded":"2023-12-13T00:27:28.849973+0000","last_fullsized":"2023-12-13T00:27:28.849973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:19.752973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":10280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.870851+0000","last_change":"2023-12-13T00:00:31.143938+0000","last_active":"2023-12-13T00:28:04.870851+0000","last_peered":"2023-12-13T00:28:04.870851+0000","last_clean":"2023-12-13T00:28:04.870851+0000","last_became_active":"2023-12-13T00:00:31.143673+0000","last_became_peered":"2023-12-13T00:00:31.143673+0000","last_unstale":"2023-12-13T00:28:04.870851+0000","last_undegraded":"2023-12-13T00:28:04.870851+0000","last_fullsized":"2023-12-13T00:28:04.870851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:56:04.585998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:51.140407+0000","last_change":"2023-12-13T00:00:30.005987+0000","last_active":"2023-12-13T00:27:51.140407+0000","last_peered":"2023-12-13T00:27:51.140407+0000","last_clean":"2023-12-13T00:27:51.140407+0000","last_became_active":"2023-12-13T00:00:30.005740+0000","last_became_peered":"2023-12-13T00:00:30.005740+0000","last_unstale":"2023-12-13T00:27:51.140407+0000","last_undegraded":"2023-12-13T00:27:51.140407+0000","last_fullsized":"2023-12-13T00:27:51.140407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:03:55.109283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'170","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.827065+0000","last_change":"2023-12-13T00:00:35.666041+0000","last_active":"2023-12-13T00:27:29.827065+0000","last_peered":"2023-12-13T00:27:29.827065+0000","last_clean":"2023-12-13T00:27:29.827065+0000","last_became_active":"2023-12-13T00:00:35.665670+0000","last_became_peered":"2023-12-13T00:00:35.665670+0000","last_unstale":"2023-12-13T00:27:29.827065+0000","last_undegraded":"2023-12-13T00:27:29.827065+0000","last_fullsized":"2023-12-13T00:27:29.827065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:10.984025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'51","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.831801+0000","last_change":"2023-12-13T00:00:31.146677+0000","last_active":"2023-12-13T00:28:04.831801+0000","last_peered":"2023-12-13T00:28:04.831801+0000","last_clean":"2023-12-13T00:28:04.831801+0000","last_became_active":"2023-12-13T00:00:31.146435+0000","last_became_peered":"2023-12-13T00:00:31.146435+0000","last_unstale":"2023-12-13T00:28:04.831801+0000","last_undegraded":"2023-12-13T00:28:04.831801+0000","last_fullsized":"2023-12-13T00:28:04.831801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:32:52.059012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'8","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:53.927419+0000","last_change":"2023-12-13T00:00:30.006240+0000","last_active":"2023-12-13T00:27:53.927419+0000","last_peered":"2023-12-13T00:27:53.927419+0000","last_clean":"2023-12-13T00:27:53.927419+0000","last_became_active":"2023-12-13T00:00:30.005909+0000","last_became_peered":"2023-12-13T00:00:30.005909+0000","last_unstale":"2023-12-13T00:27:53.927419+0000","last_undegraded":"2023-12-13T00:27:53.927419+0000","last_fullsized":"2023-12-13T00:27:53.927419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:59:20.687032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'164","reported_seq":192,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:27.796815+0000","last_change":"2023-12-13T00:00:35.665918+0000","last_active":"2023-12-13T00:27:27.796815+0000","last_peered":"2023-12-13T00:27:27.796815+0000","last_clean":"2023-12-13T00:27:27.796815+0000","last_became_active":"2023-12-13T00:00:35.665521+0000","last_became_peered":"2023-12-13T00:00:35.665521+0000","last_unstale":"2023-12-13T00:27:27.796815+0000","last_undegraded":"2023-12-13T00:27:27.796815+0000","last_fullsized":"2023-12-13T00:27:27.796815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:05.461575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'57","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.832310+0000","last_change":"2023-12-13T00:00:31.145392+0000","last_active":"2023-12-13T00:28:04.832310+0000","last_peered":"2023-12-13T00:28:04.832310+0000","last_clean":"2023-12-13T00:28:04.832310+0000","last_became_active":"2023-12-13T00:00:31.145115+0000","last_became_peered":"2023-12-13T00:00:31.145115+0000","last_unstale":"2023-12-13T00:28:04.832310+0000","last_undegraded":"2023-12-13T00:28:04.832310+0000","last_fullsized":"2023-12-13T00:28:04.832310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:15.201991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'169","reported_seq":199,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:58.269876+0000","last_change":"2023-12-13T00:00:30.006295+0000","last_active":"2023-12-13T00:27:58.269876+0000","last_peered":"2023-12-13T00:27:58.269876+0000","last_clean":"2023-12-13T00:27:58.269876+0000","last_became_active":"2023-12-13T00:00:30.005988+0000","last_became_peered":"2023-12-13T00:00:30.005988+0000","last_unstale":"2023-12-13T00:27:58.269876+0000","last_undegraded":"2023-12-13T00:27:58.269876+0000","last_fullsized":"2023-12-13T00:27:58.269876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:15:15.243155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'165","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:26.980294+0000","last_change":"2023-12-13T00:00:35.662996+0000","last_active":"2023-12-13T00:27:26.980294+0000","last_peered":"2023-12-13T00:27:26.980294+0000","last_clean":"2023-12-13T00:27:26.980294+0000","last_became_active":"2023-12-13T00:00:35.662612+0000","last_became_peered":"2023-12-13T00:00:35.662612+0000","last_unstale":"2023-12-13T00:27:26.980294+0000","last_undegraded":"2023-12-13T00:27:26.980294+0000","last_fullsized":"2023-12-13T00:27:26.980294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:58.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":14176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.822535+0000","last_change":"2023-12-13T00:00:31.118054+0000","last_active":"2023-12-13T00:28:04.822535+0000","last_peered":"2023-12-13T00:28:04.822535+0000","last_clean":"2023-12-13T00:28:04.822535+0000","last_became_active":"2023-12-13T00:00:31.117814+0000","last_became_peered":"2023-12-13T00:00:31.117814+0000","last_unstale":"2023-12-13T00:28:04.822535+0000","last_undegraded":"2023-12-13T00:28:04.822535+0000","last_fullsized":"2023-12-13T00:28:04.822535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:15.201991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:46.081058+0000","last_change":"2023-12-13T00:00:30.001001+0000","last_active":"2023-12-13T00:27:46.081058+0000","last_peered":"2023-12-13T00:27:46.081058+0000","last_clean":"2023-12-13T00:27:46.081058+0000","last_became_active":"2023-12-13T00:00:30.000755+0000","last_became_peered":"2023-12-13T00:00:30.000755+0000","last_unstale":"2023-12-13T00:27:46.081058+0000","last_undegraded":"2023-12-13T00:27:46.081058+0000","last_fullsized":"2023-12-13T00:27:46.081058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:02:11.314721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'145","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.942343+0000","last_change":"2023-12-13T00:01:00.545340+0000","last_active":"2023-12-13T00:27:31.942343+0000","last_peered":"2023-12-13T00:27:31.942343+0000","last_clean":"2023-12-13T00:27:31.942343+0000","last_became_active":"2023-12-13T00:01:00.544906+0000","last_became_peered":"2023-12-13T00:01:00.544906+0000","last_unstale":"2023-12-13T00:27:31.942343+0000","last_undegraded":"2023-12-13T00:27:31.942343+0000","last_fullsized":"2023-12-13T00:27:31.942343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:44:27.993144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,5],"acting":[6,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.887652+0000","last_change":"2023-12-13T00:00:31.143429+0000","last_active":"2023-12-13T00:28:04.887652+0000","last_peered":"2023-12-13T00:28:04.887652+0000","last_clean":"2023-12-13T00:28:04.887652+0000","last_became_active":"2023-12-13T00:00:31.143182+0000","last_became_peered":"2023-12-13T00:00:31.143182+0000","last_unstale":"2023-12-13T00:28:04.887652+0000","last_undegraded":"2023-12-13T00:28:04.887652+0000","last_fullsized":"2023-12-13T00:28:04.887652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:09:34.339195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:36.956936+0000","last_change":"2023-12-13T00:00:29.969160+0000","last_active":"2023-12-13T00:27:36.956936+0000","last_peered":"2023-12-13T00:27:36.956936+0000","last_clean":"2023-12-13T00:27:36.956936+0000","last_became_active":"2023-12-13T00:00:29.968860+0000","last_became_peered":"2023-12-13T00:00:29.968860+0000","last_unstale":"2023-12-13T00:27:36.956936+0000","last_undegraded":"2023-12-13T00:27:36.956936+0000","last_fullsized":"2023-12-13T00:27:36.956936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:42:13.602889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'163","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.585490+0000","last_change":"2023-12-13T00:00:35.642597+0000","last_active":"2023-12-13T00:27:29.585490+0000","last_peered":"2023-12-13T00:27:29.585490+0000","last_clean":"2023-12-13T00:27:29.585490+0000","last_became_active":"2023-12-13T00:00:35.642215+0000","last_became_peered":"2023-12-13T00:00:35.642215+0000","last_unstale":"2023-12-13T00:27:29.585490+0000","last_undegraded":"2023-12-13T00:27:29.585490+0000","last_fullsized":"2023-12-13T00:27:29.585490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:54:48.007993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":6488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'62","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.867805+0000","last_change":"2023-12-13T00:00:31.149832+0000","last_active":"2023-12-13T00:28:04.867805+0000","last_peered":"2023-12-13T00:28:04.867805+0000","last_clean":"2023-12-13T00:28:04.867805+0000","last_became_active":"2023-12-13T00:00:31.149587+0000","last_became_peered":"2023-12-13T00:00:31.149587+0000","last_unstale":"2023-12-13T00:28:04.867805+0000","last_undegraded":"2023-12-13T00:28:04.867805+0000","last_fullsized":"2023-12-13T00:28:04.867805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:00.910594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'792","reported_seq":823,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:38.142347+0000","last_change":"2023-12-13T00:00:29.998103+0000","last_active":"2023-12-13T00:27:38.142347+0000","last_peered":"2023-12-13T00:27:38.142347+0000","last_clean":"2023-12-13T00:27:38.142347+0000","last_became_active":"2023-12-13T00:00:29.997848+0000","last_became_peered":"2023-12-13T00:00:29.997848+0000","last_unstale":"2023-12-13T00:27:38.142347+0000","last_undegraded":"2023-12-13T00:27:38.142347+0000","last_fullsized":"2023-12-13T00:27:38.142347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:52:58.951228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":4476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'121","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.942347+0000","last_change":"2023-12-13T00:00:35.652104+0000","last_active":"2023-12-13T00:27:31.942347+0000","last_peered":"2023-12-13T00:27:31.942347+0000","last_clean":"2023-12-13T00:27:31.942347+0000","last_became_active":"2023-12-13T00:00:35.651766+0000","last_became_peered":"2023-12-13T00:00:35.651766+0000","last_unstale":"2023-12-13T00:27:31.942347+0000","last_undegraded":"2023-12-13T00:27:31.942347+0000","last_fullsized":"2023-12-13T00:27:31.942347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:08:10.211533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":7468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'58","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.860786+0000","last_change":"2023-12-13T00:00:31.120580+0000","last_active":"2023-12-13T00:28:04.860786+0000","last_peered":"2023-12-13T00:28:04.860786+0000","last_clean":"2023-12-13T00:28:04.860786+0000","last_became_active":"2023-12-13T00:00:31.120330+0000","last_became_peered":"2023-12-13T00:00:31.120330+0000","last_unstale":"2023-12-13T00:28:04.860786+0000","last_undegraded":"2023-12-13T00:28:04.860786+0000","last_fullsized":"2023-12-13T00:28:04.860786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:04:30.356287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'411","reported_seq":748,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:59.442964+0000","last_change":"2023-12-13T00:00:30.000752+0000","last_active":"2023-12-13T00:27:59.442964+0000","last_peered":"2023-12-13T00:27:59.442964+0000","last_clean":"2023-12-13T00:27:59.442964+0000","last_became_active":"2023-12-13T00:00:30.000015+0000","last_became_peered":"2023-12-13T00:00:30.000015+0000","last_unstale":"2023-12-13T00:27:59.442964+0000","last_undegraded":"2023-12-13T00:27:59.442964+0000","last_fullsized":"2023-12-13T00:27:59.442964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:20:46.566684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58234,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":306,"num_read_kb":318,"num_write":408,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'147","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:30.828661+0000","last_change":"2023-12-13T00:00:35.667415+0000","last_active":"2023-12-13T00:27:30.828661+0000","last_peered":"2023-12-13T00:27:30.828661+0000","last_clean":"2023-12-13T00:27:30.828661+0000","last_became_active":"2023-12-13T00:00:35.667028+0000","last_became_peered":"2023-12-13T00:00:35.667028+0000","last_unstale":"2023-12-13T00:27:30.828661+0000","last_undegraded":"2023-12-13T00:27:30.828661+0000","last_fullsized":"2023-12-13T00:27:30.828661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:58.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":5383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'60","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.822616+0000","last_change":"2023-12-13T00:00:31.140853+0000","last_active":"2023-12-13T00:28:04.822616+0000","last_peered":"2023-12-13T00:28:04.822616+0000","last_clean":"2023-12-13T00:28:04.822616+0000","last_became_active":"2023-12-13T00:00:31.140597+0000","last_became_peered":"2023-12-13T00:00:31.140597+0000","last_unstale":"2023-12-13T00:28:04.822616+0000","last_undegraded":"2023-12-13T00:28:04.822616+0000","last_fullsized":"2023-12-13T00:28:04.822616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:13.923453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:44.241631+0000","last_change":"2023-12-13T00:00:29.998765+0000","last_active":"2023-12-13T00:27:44.241631+0000","last_peered":"2023-12-13T00:27:44.241631+0000","last_clean":"2023-12-13T00:27:44.241631+0000","last_became_active":"2023-12-13T00:00:29.998552+0000","last_became_peered":"2023-12-13T00:00:29.998552+0000","last_unstale":"2023-12-13T00:27:44.241631+0000","last_undegraded":"2023-12-13T00:27:44.241631+0000","last_fullsized":"2023-12-13T00:27:44.241631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:54:42.351946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'127","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:28.839739+0000","last_change":"2023-12-13T00:00:35.666575+0000","last_active":"2023-12-13T00:27:28.839739+0000","last_peered":"2023-12-13T00:27:28.839739+0000","last_clean":"2023-12-13T00:27:28.839739+0000","last_became_active":"2023-12-13T00:00:35.666135+0000","last_became_peered":"2023-12-13T00:00:35.666135+0000","last_unstale":"2023-12-13T00:27:28.839739+0000","last_undegraded":"2023-12-13T00:27:28.839739+0000","last_fullsized":"2023-12-13T00:27:28.839739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:02:03.031651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":7535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'49","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.832939+0000","last_change":"2023-12-13T00:00:31.148698+0000","last_active":"2023-12-13T00:28:04.832939+0000","last_peered":"2023-12-13T00:28:04.832939+0000","last_clean":"2023-12-13T00:28:04.832939+0000","last_became_active":"2023-12-13T00:00:31.148421+0000","last_became_peered":"2023-12-13T00:00:31.148421+0000","last_unstale":"2023-12-13T00:28:04.832939+0000","last_undegraded":"2023-12-13T00:28:04.832939+0000","last_fullsized":"2023-12-13T00:28:04.832939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:53:00.056294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:47.328629+0000","last_change":"2023-12-13T00:00:30.001220+0000","last_active":"2023-12-13T00:27:47.328629+0000","last_peered":"2023-12-13T00:27:47.328629+0000","last_clean":"2023-12-13T00:27:47.328629+0000","last_became_active":"2023-12-13T00:00:30.000854+0000","last_became_peered":"2023-12-13T00:00:30.000854+0000","last_unstale":"2023-12-13T00:27:47.328629+0000","last_undegraded":"2023-12-13T00:27:47.328629+0000","last_fullsized":"2023-12-13T00:27:47.328629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:50:11.243011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:24:12.872552+0000","last_change":"2023-12-13T00:00:08.575071+0000","last_active":"2023-12-13T00:24:12.872552+0000","last_peered":"2023-12-13T00:24:12.872552+0000","last_clean":"2023-12-13T00:24:12.872552+0000","last_became_active":"2023-12-13T00:00:08.574464+0000","last_became_peered":"2023-12-13T00:00:08.574464+0000","last_unstale":"2023-12-13T00:24:12.872552+0000","last_undegraded":"2023-12-13T00:24:12.872552+0000","last_fullsized":"2023-12-13T00:24:12.872552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:07.226606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:07.226606+0000","last_clean_scrub_stamp":"2023-12-13T00:00:07.226606+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:51:39.168480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'166","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.589507+0000","last_change":"2023-12-13T00:00:35.661806+0000","last_active":"2023-12-13T00:27:29.589507+0000","last_peered":"2023-12-13T00:27:29.589507+0000","last_clean":"2023-12-13T00:27:29.589507+0000","last_became_active":"2023-12-13T00:00:35.660976+0000","last_became_peered":"2023-12-13T00:00:35.660976+0000","last_unstale":"2023-12-13T00:27:29.589507+0000","last_undegraded":"2023-12-13T00:27:29.589507+0000","last_fullsized":"2023-12-13T00:27:29.589507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:04:57.617925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":12423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'58","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.876713+0000","last_change":"2023-12-13T00:00:31.036383+0000","last_active":"2023-12-13T00:28:04.876713+0000","last_peered":"2023-12-13T00:28:04.876713+0000","last_clean":"2023-12-13T00:28:04.876713+0000","last_became_active":"2023-12-13T00:00:31.036127+0000","last_became_peered":"2023-12-13T00:00:31.036127+0000","last_unstale":"2023-12-13T00:28:04.876713+0000","last_undegraded":"2023-12-13T00:28:04.876713+0000","last_fullsized":"2023-12-13T00:28:04.876713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:12:16.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'7","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:40.042854+0000","last_change":"2023-12-13T00:00:30.006258+0000","last_active":"2023-12-13T00:27:40.042854+0000","last_peered":"2023-12-13T00:27:40.042854+0000","last_clean":"2023-12-13T00:27:40.042854+0000","last_became_active":"2023-12-13T00:00:30.005943+0000","last_became_peered":"2023-12-13T00:00:30.005943+0000","last_unstale":"2023-12-13T00:27:40.042854+0000","last_undegraded":"2023-12-13T00:27:40.042854+0000","last_fullsized":"2023-12-13T00:27:40.042854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:52:45.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'164","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:24.019860+0000","last_change":"2023-12-13T00:00:35.665140+0000","last_active":"2023-12-13T00:27:24.019860+0000","last_peered":"2023-12-13T00:27:24.019860+0000","last_clean":"2023-12-13T00:27:24.019860+0000","last_became_active":"2023-12-13T00:00:35.664071+0000","last_became_peered":"2023-12-13T00:00:35.664071+0000","last_unstale":"2023-12-13T00:27:24.019860+0000","last_undegraded":"2023-12-13T00:27:24.019860+0000","last_fullsized":"2023-12-13T00:27:24.019860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:06:01.427574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":5432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'59","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.870090+0000","last_change":"2023-12-13T00:00:31.147760+0000","last_active":"2023-12-13T00:28:04.870090+0000","last_peered":"2023-12-13T00:28:04.870090+0000","last_clean":"2023-12-13T00:28:04.870090+0000","last_became_active":"2023-12-13T00:00:31.147523+0000","last_became_peered":"2023-12-13T00:00:31.147523+0000","last_unstale":"2023-12-13T00:28:04.870090+0000","last_undegraded":"2023-12-13T00:28:04.870090+0000","last_fullsized":"2023-12-13T00:28:04.870090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:56:28.188041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:32.947591+0000","last_change":"2023-12-13T00:00:30.002705+0000","last_active":"2023-12-13T00:27:32.947591+0000","last_peered":"2023-12-13T00:27:32.947591+0000","last_clean":"2023-12-13T00:27:32.947591+0000","last_became_active":"2023-12-13T00:00:30.002427+0000","last_became_peered":"2023-12-13T00:00:30.002427+0000","last_unstale":"2023-12-13T00:27:32.947591+0000","last_undegraded":"2023-12-13T00:27:32.947591+0000","last_fullsized":"2023-12-13T00:27:32.947591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:06:37.325239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'177","reported_seq":204,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.562109+0000","last_change":"2023-12-13T00:00:35.661309+0000","last_active":"2023-12-13T00:27:29.562109+0000","last_peered":"2023-12-13T00:27:29.562109+0000","last_clean":"2023-12-13T00:27:29.562109+0000","last_became_active":"2023-12-13T00:00:35.660939+0000","last_became_peered":"2023-12-13T00:00:35.660939+0000","last_unstale":"2023-12-13T00:27:29.562109+0000","last_undegraded":"2023-12-13T00:27:29.562109+0000","last_fullsized":"2023-12-13T00:27:29.562109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:49:19.372464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":11316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'64","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.871881+0000","last_change":"2023-12-13T00:00:31.146265+0000","last_active":"2023-12-13T00:28:04.871881+0000","last_peered":"2023-12-13T00:28:04.871881+0000","last_clean":"2023-12-13T00:28:04.871881+0000","last_became_active":"2023-12-13T00:00:31.145997+0000","last_became_peered":"2023-12-13T00:00:31.145997+0000","last_unstale":"2023-12-13T00:28:04.871881+0000","last_undegraded":"2023-12-13T00:28:04.871881+0000","last_fullsized":"2023-12-13T00:28:04.871881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:53:32.846210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:40.149153+0000","last_change":"2023-12-13T00:00:29.968222+0000","last_active":"2023-12-13T00:27:40.149153+0000","last_peered":"2023-12-13T00:27:40.149153+0000","last_clean":"2023-12-13T00:27:40.149153+0000","last_became_active":"2023-12-13T00:00:29.967916+0000","last_became_peered":"2023-12-13T00:00:29.967916+0000","last_unstale":"2023-12-13T00:27:40.149153+0000","last_undegraded":"2023-12-13T00:27:40.149153+0000","last_fullsized":"2023-12-13T00:27:40.149153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:12.818387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'137","reported_seq":164,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:27.462473+0000","last_change":"2023-12-13T00:00:35.667745+0000","last_active":"2023-12-13T00:27:27.462473+0000","last_peered":"2023-12-13T00:27:27.462473+0000","last_clean":"2023-12-13T00:27:27.462473+0000","last_became_active":"2023-12-13T00:00:35.666891+0000","last_became_peered":"2023-12-13T00:00:35.666891+0000","last_unstale":"2023-12-13T00:27:27.462473+0000","last_undegraded":"2023-12-13T00:27:27.462473+0000","last_fullsized":"2023-12-13T00:27:27.462473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:30:53.285154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":9622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'54","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.890957+0000","last_change":"2023-12-13T00:00:31.148279+0000","last_active":"2023-12-13T00:28:04.890957+0000","last_peered":"2023-12-13T00:28:04.890957+0000","last_clean":"2023-12-13T00:28:04.890957+0000","last_became_active":"2023-12-13T00:00:31.148016+0000","last_became_peered":"2023-12-13T00:00:31.148016+0000","last_unstale":"2023-12-13T00:28:04.890957+0000","last_undegraded":"2023-12-13T00:28:04.890957+0000","last_fullsized":"2023-12-13T00:28:04.890957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:37:40.762676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'289","reported_seq":319,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:52.762132+0000","last_change":"2023-12-13T00:00:30.008152+0000","last_active":"2023-12-13T00:27:52.762132+0000","last_peered":"2023-12-13T00:27:52.762132+0000","last_clean":"2023-12-13T00:27:52.762132+0000","last_became_active":"2023-12-13T00:00:30.007907+0000","last_became_peered":"2023-12-13T00:00:30.007907+0000","last_unstale":"2023-12-13T00:27:52.762132+0000","last_undegraded":"2023-12-13T00:27:52.762132+0000","last_fullsized":"2023-12-13T00:27:52.762132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:46:40.001298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'132","reported_seq":159,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:21.922520+0000","last_change":"2023-12-13T00:00:35.660971+0000","last_active":"2023-12-13T00:27:21.922520+0000","last_peered":"2023-12-13T00:27:21.922520+0000","last_clean":"2023-12-13T00:27:21.922520+0000","last_became_active":"2023-12-13T00:00:35.660627+0000","last_became_peered":"2023-12-13T00:00:35.660627+0000","last_unstale":"2023-12-13T00:27:21.922520+0000","last_undegraded":"2023-12-13T00:27:21.922520+0000","last_fullsized":"2023-12-13T00:27:21.922520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:18.474434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":10143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'55","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.870793+0000","last_change":"2023-12-13T00:00:31.142437+0000","last_active":"2023-12-13T00:28:04.870793+0000","last_peered":"2023-12-13T00:28:04.870793+0000","last_clean":"2023-12-13T00:28:04.870793+0000","last_became_active":"2023-12-13T00:00:31.142150+0000","last_became_peered":"2023-12-13T00:00:31.142150+0000","last_unstale":"2023-12-13T00:28:04.870793+0000","last_undegraded":"2023-12-13T00:28:04.870793+0000","last_fullsized":"2023-12-13T00:28:04.870793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:10:54.020587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'797","reported_seq":826,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.530963+0000","last_change":"2023-12-13T00:00:30.000646+0000","last_active":"2023-12-13T00:28:04.530963+0000","last_peered":"2023-12-13T00:28:04.530963+0000","last_clean":"2023-12-13T00:28:04.530963+0000","last_became_active":"2023-12-13T00:00:30.000388+0000","last_became_peered":"2023-12-13T00:00:30.000388+0000","last_unstale":"2023-12-13T00:28:04.530963+0000","last_undegraded":"2023-12-13T00:28:04.530963+0000","last_fullsized":"2023-12-13T00:28:04.530963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:07.704455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277997,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'170","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.589842+0000","last_change":"2023-12-13T00:00:35.666659+0000","last_active":"2023-12-13T00:27:29.589842+0000","last_peered":"2023-12-13T00:27:29.589842+0000","last_clean":"2023-12-13T00:27:29.589842+0000","last_became_active":"2023-12-13T00:00:35.666304+0000","last_became_peered":"2023-12-13T00:00:35.666304+0000","last_unstale":"2023-12-13T00:27:29.589842+0000","last_undegraded":"2023-12-13T00:27:29.589842+0000","last_fullsized":"2023-12-13T00:27:29.589842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:35:49.956369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":11255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'48","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.894217+0000","last_change":"2023-12-13T00:00:31.037568+0000","last_active":"2023-12-13T00:28:04.894217+0000","last_peered":"2023-12-13T00:28:04.894217+0000","last_clean":"2023-12-13T00:28:04.894217+0000","last_became_active":"2023-12-13T00:00:31.037398+0000","last_became_peered":"2023-12-13T00:00:31.037398+0000","last_unstale":"2023-12-13T00:28:04.894217+0000","last_undegraded":"2023-12-13T00:28:04.894217+0000","last_fullsized":"2023-12-13T00:28:04.894217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:08.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'1355","reported_seq":1384,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:53.446607+0000","last_change":"2023-12-13T00:00:30.006086+0000","last_active":"2023-12-13T00:27:53.446607+0000","last_peered":"2023-12-13T00:27:53.446607+0000","last_clean":"2023-12-13T00:27:53.446607+0000","last_became_active":"2023-12-13T00:00:30.005752+0000","last_became_peered":"2023-12-13T00:00:30.005752+0000","last_unstale":"2023-12-13T00:27:53.446607+0000","last_undegraded":"2023-12-13T00:27:53.446607+0000","last_fullsized":"2023-12-13T00:27:53.446607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1355,"log_dups_size":0,"ondisk_log_size":1355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:06:37.325239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1349,"num_write_kb":4734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'175","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.548973+0000","last_change":"2023-12-13T00:00:35.666467+0000","last_active":"2023-12-13T00:27:29.548973+0000","last_peered":"2023-12-13T00:27:29.548973+0000","last_clean":"2023-12-13T00:27:29.548973+0000","last_became_active":"2023-12-13T00:00:35.666061+0000","last_became_peered":"2023-12-13T00:00:35.666061+0000","last_unstale":"2023-12-13T00:27:29.548973+0000","last_undegraded":"2023-12-13T00:27:29.548973+0000","last_fullsized":"2023-12-13T00:27:29.548973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:19:16.858246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":9890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'68","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.869910+0000","last_change":"2023-12-13T00:01:00.702387+0000","last_active":"2023-12-13T00:28:04.869910+0000","last_peered":"2023-12-13T00:28:04.869910+0000","last_clean":"2023-12-13T00:28:04.869910+0000","last_became_active":"2023-12-13T00:01:00.702089+0000","last_became_peered":"2023-12-13T00:01:00.702089+0000","last_unstale":"2023-12-13T00:28:04.869910+0000","last_undegraded":"2023-12-13T00:28:04.869910+0000","last_fullsized":"2023-12-13T00:28:04.869910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:48:49.380742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'393","reported_seq":422,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.528820+0000","last_change":"2023-12-13T00:00:30.001171+0000","last_active":"2023-12-13T00:28:04.528820+0000","last_peered":"2023-12-13T00:28:04.528820+0000","last_clean":"2023-12-13T00:28:04.528820+0000","last_became_active":"2023-12-13T00:00:30.000803+0000","last_became_peered":"2023-12-13T00:00:30.000803+0000","last_unstale":"2023-12-13T00:28:04.528820+0000","last_undegraded":"2023-12-13T00:28:04.528820+0000","last_fullsized":"2023-12-13T00:28:04.528820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:19.012092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2931508,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":386,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'176","reported_seq":202,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.548618+0000","last_change":"2023-12-13T00:00:35.649561+0000","last_active":"2023-12-13T00:27:29.548618+0000","last_peered":"2023-12-13T00:27:29.548618+0000","last_clean":"2023-12-13T00:27:29.548618+0000","last_became_active":"2023-12-13T00:00:35.649151+0000","last_became_peered":"2023-12-13T00:00:35.649151+0000","last_unstale":"2023-12-13T00:27:29.548618+0000","last_undegraded":"2023-12-13T00:27:29.548618+0000","last_fullsized":"2023-12-13T00:27:29.548618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:06:34.023899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'60","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.821458+0000","last_change":"2023-12-13T00:00:31.116002+0000","last_active":"2023-12-13T00:28:04.821458+0000","last_peered":"2023-12-13T00:28:04.821458+0000","last_clean":"2023-12-13T00:28:04.821458+0000","last_became_active":"2023-12-13T00:00:31.115678+0000","last_became_peered":"2023-12-13T00:00:31.115678+0000","last_unstale":"2023-12-13T00:28:04.821458+0000","last_undegraded":"2023-12-13T00:28:04.821458+0000","last_fullsized":"2023-12-13T00:28:04.821458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:21:51.967408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'11","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:48.225267+0000","last_change":"2023-12-13T00:00:30.004329+0000","last_active":"2023-12-13T00:27:48.225267+0000","last_peered":"2023-12-13T00:27:48.225267+0000","last_clean":"2023-12-13T00:27:48.225267+0000","last_became_active":"2023-12-13T00:00:30.004089+0000","last_became_peered":"2023-12-13T00:00:30.004089+0000","last_unstale":"2023-12-13T00:27:48.225267+0000","last_undegraded":"2023-12-13T00:27:48.225267+0000","last_fullsized":"2023-12-13T00:27:48.225267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:05:04.403249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'148","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.520279+0000","last_change":"2023-12-13T00:00:35.652272+0000","last_active":"2023-12-13T00:27:29.520279+0000","last_peered":"2023-12-13T00:27:29.520279+0000","last_clean":"2023-12-13T00:27:29.520279+0000","last_became_active":"2023-12-13T00:00:35.651907+0000","last_became_peered":"2023-12-13T00:00:35.651907+0000","last_unstale":"2023-12-13T00:27:29.520279+0000","last_undegraded":"2023-12-13T00:27:29.520279+0000","last_fullsized":"2023-12-13T00:27:29.520279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:15:01.873129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":7909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'46","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.863565+0000","last_change":"2023-12-13T00:00:31.148754+0000","last_active":"2023-12-13T00:28:04.863565+0000","last_peered":"2023-12-13T00:28:04.863565+0000","last_clean":"2023-12-13T00:28:04.863565+0000","last_became_active":"2023-12-13T00:00:31.147846+0000","last_became_peered":"2023-12-13T00:00:31.147846+0000","last_unstale":"2023-12-13T00:28:04.863565+0000","last_undegraded":"2023-12-13T00:28:04.863565+0000","last_fullsized":"2023-12-13T00:28:04.863565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:39:59.955103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'1473","reported_seq":1502,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:48.433505+0000","last_change":"2023-12-13T00:00:30.001703+0000","last_active":"2023-12-13T00:27:48.433505+0000","last_peered":"2023-12-13T00:27:48.433505+0000","last_clean":"2023-12-13T00:27:48.433505+0000","last_became_active":"2023-12-13T00:00:30.001420+0000","last_became_peered":"2023-12-13T00:00:30.001420+0000","last_unstale":"2023-12-13T00:27:48.433505+0000","last_undegraded":"2023-12-13T00:27:48.433505+0000","last_fullsized":"2023-12-13T00:27:48.433505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1473,"log_dups_size":0,"ondisk_log_size":1473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:02:06.211723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1472,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'148","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:21.985391+0000","last_change":"2023-12-13T00:01:00.546607+0000","last_active":"2023-12-13T00:27:21.985391+0000","last_peered":"2023-12-13T00:27:21.985391+0000","last_clean":"2023-12-13T00:27:21.985391+0000","last_became_active":"2023-12-13T00:01:00.546264+0000","last_became_peered":"2023-12-13T00:01:00.546264+0000","last_unstale":"2023-12-13T00:27:21.985391+0000","last_undegraded":"2023-12-13T00:27:21.985391+0000","last_fullsized":"2023-12-13T00:27:21.985391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:12:57.696627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'60","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.870044+0000","last_change":"2023-12-13T00:00:31.138998+0000","last_active":"2023-12-13T00:28:04.870044+0000","last_peered":"2023-12-13T00:28:04.870044+0000","last_clean":"2023-12-13T00:28:04.870044+0000","last_became_active":"2023-12-13T00:00:31.138723+0000","last_became_peered":"2023-12-13T00:00:31.138723+0000","last_unstale":"2023-12-13T00:28:04.870044+0000","last_undegraded":"2023-12-13T00:28:04.870044+0000","last_fullsized":"2023-12-13T00:28:04.870044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:24:05.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'217","reported_seq":246,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.944367+0000","last_change":"2023-12-13T00:00:30.003079+0000","last_active":"2023-12-13T00:27:57.944367+0000","last_peered":"2023-12-13T00:27:57.944367+0000","last_clean":"2023-12-13T00:27:57.944367+0000","last_became_active":"2023-12-13T00:00:30.002823+0000","last_became_peered":"2023-12-13T00:00:30.002823+0000","last_unstale":"2023-12-13T00:27:57.944367+0000","last_undegraded":"2023-12-13T00:27:57.944367+0000","last_fullsized":"2023-12-13T00:27:57.944367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:07.829448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'219","reported_seq":254,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:26.979813+0000","last_change":"2023-12-13T00:01:00.697705+0000","last_active":"2023-12-13T00:27:26.979813+0000","last_peered":"2023-12-13T00:27:26.979813+0000","last_clean":"2023-12-13T00:27:26.979813+0000","last_became_active":"2023-12-13T00:01:00.697231+0000","last_became_peered":"2023-12-13T00:01:00.697231+0000","last_unstale":"2023-12-13T00:27:26.979813+0000","last_undegraded":"2023-12-13T00:27:26.979813+0000","last_fullsized":"2023-12-13T00:27:26.979813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:54:04.994059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":195,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'66","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.875139+0000","last_change":"2023-12-13T00:00:31.027503+0000","last_active":"2023-12-13T00:28:04.875139+0000","last_peered":"2023-12-13T00:28:04.875139+0000","last_clean":"2023-12-13T00:28:04.875139+0000","last_became_active":"2023-12-13T00:00:31.027239+0000","last_became_peered":"2023-12-13T00:00:31.027239+0000","last_unstale":"2023-12-13T00:28:04.875139+0000","last_undegraded":"2023-12-13T00:28:04.875139+0000","last_fullsized":"2023-12-13T00:28:04.875139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:50:58.339436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:32.953266+0000","last_change":"2023-12-13T00:00:30.009592+0000","last_active":"2023-12-13T00:27:32.953266+0000","last_peered":"2023-12-13T00:27:32.953266+0000","last_clean":"2023-12-13T00:27:32.953266+0000","last_became_active":"2023-12-13T00:00:30.009351+0000","last_became_peered":"2023-12-13T00:00:30.009351+0000","last_unstale":"2023-12-13T00:27:32.953266+0000","last_undegraded":"2023-12-13T00:27:32.953266+0000","last_fullsized":"2023-12-13T00:27:32.953266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:46:22.716022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'190","reported_seq":213,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.547065+0000","last_change":"2023-12-13T00:01:00.717446+0000","last_active":"2023-12-13T00:27:29.547065+0000","last_peered":"2023-12-13T00:27:29.547065+0000","last_clean":"2023-12-13T00:27:29.547065+0000","last_became_active":"2023-12-13T00:01:00.717019+0000","last_became_peered":"2023-12-13T00:01:00.717019+0000","last_unstale":"2023-12-13T00:27:29.547065+0000","last_undegraded":"2023-12-13T00:27:29.547065+0000","last_fullsized":"2023-12-13T00:27:29.547065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:22:05.566928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":9378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"27'64","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.889753+0000","last_change":"2023-12-13T00:00:31.139946+0000","last_active":"2023-12-13T00:28:04.889753+0000","last_peered":"2023-12-13T00:28:04.889753+0000","last_clean":"2023-12-13T00:28:04.889753+0000","last_became_active":"2023-12-13T00:00:31.139656+0000","last_became_peered":"2023-12-13T00:00:31.139656+0000","last_unstale":"2023-12-13T00:28:04.889753+0000","last_undegraded":"2023-12-13T00:28:04.889753+0000","last_fullsized":"2023-12-13T00:28:04.889753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:13:39.042325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'83","reported_seq":112,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:43.428733+0000","last_change":"2023-12-13T00:00:30.003511+0000","last_active":"2023-12-13T00:27:43.428733+0000","last_peered":"2023-12-13T00:27:43.428733+0000","last_clean":"2023-12-13T00:27:43.428733+0000","last_became_active":"2023-12-13T00:00:30.002630+0000","last_became_peered":"2023-12-13T00:00:30.002630+0000","last_unstale":"2023-12-13T00:27:43.428733+0000","last_undegraded":"2023-12-13T00:27:43.428733+0000","last_fullsized":"2023-12-13T00:27:43.428733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:58:21.724544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'123","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.543938+0000","last_change":"2023-12-13T00:00:35.649725+0000","last_active":"2023-12-13T00:27:29.543938+0000","last_peered":"2023-12-13T00:27:29.543938+0000","last_clean":"2023-12-13T00:27:29.543938+0000","last_became_active":"2023-12-13T00:00:35.649401+0000","last_became_peered":"2023-12-13T00:00:35.649401+0000","last_unstale":"2023-12-13T00:27:29.543938+0000","last_undegraded":"2023-12-13T00:27:29.543938+0000","last_fullsized":"2023-12-13T00:27:29.543938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:56:09.136979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":7272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'122","reported_seq":150,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.575066+0000","last_change":"2023-12-13T00:00:35.662790+0000","last_active":"2023-12-13T00:27:29.575066+0000","last_peered":"2023-12-13T00:27:29.575066+0000","last_clean":"2023-12-13T00:27:29.575066+0000","last_became_active":"2023-12-13T00:00:35.662406+0000","last_became_peered":"2023-12-13T00:00:35.662406+0000","last_unstale":"2023-12-13T00:27:29.575066+0000","last_undegraded":"2023-12-13T00:27:29.575066+0000","last_fullsized":"2023-12-13T00:27:29.575066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:10:58.571569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":7728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'66","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.834067+0000","last_change":"2023-12-13T00:00:31.143141+0000","last_active":"2023-12-13T00:28:04.834067+0000","last_peered":"2023-12-13T00:28:04.834067+0000","last_clean":"2023-12-13T00:28:04.834067+0000","last_became_active":"2023-12-13T00:00:31.142823+0000","last_became_peered":"2023-12-13T00:00:31.142823+0000","last_unstale":"2023-12-13T00:28:04.834067+0000","last_undegraded":"2023-12-13T00:28:04.834067+0000","last_fullsized":"2023-12-13T00:28:04.834067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:22:51.335464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'7","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:44.283017+0000","last_change":"2023-12-13T00:00:30.004773+0000","last_active":"2023-12-13T00:27:44.283017+0000","last_peered":"2023-12-13T00:27:44.283017+0000","last_clean":"2023-12-13T00:27:44.283017+0000","last_became_active":"2023-12-13T00:00:30.004496+0000","last_became_peered":"2023-12-13T00:00:30.004496+0000","last_unstale":"2023-12-13T00:27:44.283017+0000","last_undegraded":"2023-12-13T00:27:44.283017+0000","last_fullsized":"2023-12-13T00:27:44.283017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:51:20.708568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'188","reported_seq":216,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:30.822992+0000","last_change":"2023-12-13T00:00:35.666457+0000","last_active":"2023-12-13T00:27:30.822992+0000","last_peered":"2023-12-13T00:27:30.822992+0000","last_clean":"2023-12-13T00:27:30.822992+0000","last_became_active":"2023-12-13T00:00:35.666075+0000","last_became_peered":"2023-12-13T00:00:35.666075+0000","last_unstale":"2023-12-13T00:27:30.822992+0000","last_undegraded":"2023-12-13T00:27:30.822992+0000","last_fullsized":"2023-12-13T00:27:30.822992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:18:38.741479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":17531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'63","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.854672+0000","last_change":"2023-12-13T00:00:31.116511+0000","last_active":"2023-12-13T00:28:04.854672+0000","last_peered":"2023-12-13T00:28:04.854672+0000","last_clean":"2023-12-13T00:28:04.854672+0000","last_became_active":"2023-12-13T00:00:31.116209+0000","last_became_peered":"2023-12-13T00:00:31.116209+0000","last_unstale":"2023-12-13T00:28:04.854672+0000","last_undegraded":"2023-12-13T00:28:04.854672+0000","last_fullsized":"2023-12-13T00:28:04.854672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:06.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'484","reported_seq":991,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.156120+0000","last_change":"2023-12-13T00:00:30.006475+0000","last_active":"2023-12-13T00:27:57.156120+0000","last_peered":"2023-12-13T00:27:57.156120+0000","last_clean":"2023-12-13T00:27:57.156120+0000","last_became_active":"2023-12-13T00:00:30.006026+0000","last_became_peered":"2023-12-13T00:00:30.006026+0000","last_unstale":"2023-12-13T00:27:57.156120+0000","last_undegraded":"2023-12-13T00:27:57.156120+0000","last_fullsized":"2023-12-13T00:27:57.156120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:29.225167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92099,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":501,"num_write":481,"num_write_kb":501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'1030","reported_seq":1752,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.518326+0000","last_change":"2023-12-13T00:00:30.004483+0000","last_active":"2023-12-13T00:28:04.518326+0000","last_peered":"2023-12-13T00:28:04.518326+0000","last_clean":"2023-12-13T00:28:04.518326+0000","last_became_active":"2023-12-13T00:00:30.004214+0000","last_became_peered":"2023-12-13T00:00:30.004214+0000","last_unstale":"2023-12-13T00:28:04.518326+0000","last_undegraded":"2023-12-13T00:28:04.518326+0000","last_fullsized":"2023-12-13T00:28:04.518326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:14.096925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1792997,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":693,"num_read_kb":705,"num_write":1026,"num_write_kb":2509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'68","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.837208+0000","last_change":"2023-12-13T00:00:31.147121+0000","last_active":"2023-12-13T00:28:04.837208+0000","last_peered":"2023-12-13T00:28:04.837208+0000","last_clean":"2023-12-13T00:28:04.837208+0000","last_became_active":"2023-12-13T00:00:31.146818+0000","last_became_peered":"2023-12-13T00:00:31.146818+0000","last_unstale":"2023-12-13T00:28:04.837208+0000","last_undegraded":"2023-12-13T00:28:04.837208+0000","last_fullsized":"2023-12-13T00:28:04.837208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:12.753740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'150","reported_seq":176,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:26.446711+0000","last_change":"2023-12-13T00:00:35.642485+0000","last_active":"2023-12-13T00:27:26.446711+0000","last_peered":"2023-12-13T00:27:26.446711+0000","last_clean":"2023-12-13T00:27:26.446711+0000","last_became_active":"2023-12-13T00:00:35.642114+0000","last_became_peered":"2023-12-13T00:00:35.642114+0000","last_unstale":"2023-12-13T00:27:26.446711+0000","last_undegraded":"2023-12-13T00:27:26.446711+0000","last_fullsized":"2023-12-13T00:27:26.446711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:24:10.067039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":10646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'2837","reported_seq":2866,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:53.923570+0000","last_change":"2023-12-13T00:00:29.972296+0000","last_active":"2023-12-13T00:27:53.923570+0000","last_peered":"2023-12-13T00:27:53.923570+0000","last_clean":"2023-12-13T00:27:53.923570+0000","last_became_active":"2023-12-13T00:00:29.972018+0000","last_became_peered":"2023-12-13T00:00:29.972018+0000","last_unstale":"2023-12-13T00:27:53.923570+0000","last_undegraded":"2023-12-13T00:27:53.923570+0000","last_fullsized":"2023-12-13T00:27:53.923570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2837,"log_dups_size":0,"ondisk_log_size":2837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:30:26.126361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2827,"num_write_kb":13646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'70","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.898663+0000","last_change":"2023-12-13T00:00:31.037679+0000","last_active":"2023-12-13T00:28:04.898663+0000","last_peered":"2023-12-13T00:28:04.898663+0000","last_clean":"2023-12-13T00:28:04.898663+0000","last_became_active":"2023-12-13T00:00:31.037445+0000","last_became_peered":"2023-12-13T00:00:31.037445+0000","last_unstale":"2023-12-13T00:28:04.898663+0000","last_undegraded":"2023-12-13T00:28:04.898663+0000","last_fullsized":"2023-12-13T00:28:04.898663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:55.082987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'116","reported_seq":142,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.942392+0000","last_change":"2023-12-13T00:00:35.661405+0000","last_active":"2023-12-13T00:27:31.942392+0000","last_peered":"2023-12-13T00:27:31.942392+0000","last_clean":"2023-12-13T00:27:31.942392+0000","last_became_active":"2023-12-13T00:00:35.660984+0000","last_became_peered":"2023-12-13T00:00:35.660984+0000","last_unstale":"2023-12-13T00:27:31.942392+0000","last_undegraded":"2023-12-13T00:27:31.942392+0000","last_fullsized":"2023-12-13T00:27:31.942392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:24.668139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":9076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.885751+0000","last_change":"2023-12-13T00:00:31.147104+0000","last_active":"2023-12-13T00:28:04.885751+0000","last_peered":"2023-12-13T00:28:04.885751+0000","last_clean":"2023-12-13T00:28:04.885751+0000","last_became_active":"2023-12-13T00:00:31.145225+0000","last_became_peered":"2023-12-13T00:00:31.145225+0000","last_unstale":"2023-12-13T00:28:04.885751+0000","last_undegraded":"2023-12-13T00:28:04.885751+0000","last_fullsized":"2023-12-13T00:28:04.885751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:42:14.707955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'66","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.758045+0000","last_change":"2023-12-13T00:00:31.119735+0000","last_active":"2023-12-13T00:28:04.758045+0000","last_peered":"2023-12-13T00:28:04.758045+0000","last_clean":"2023-12-13T00:28:04.758045+0000","last_became_active":"2023-12-13T00:00:31.119474+0000","last_became_peered":"2023-12-13T00:00:31.119474+0000","last_unstale":"2023-12-13T00:28:04.758045+0000","last_undegraded":"2023-12-13T00:28:04.758045+0000","last_fullsized":"2023-12-13T00:28:04.758045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:30.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'62","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.877774+0000","last_change":"2023-12-13T00:00:31.027180+0000","last_active":"2023-12-13T00:28:04.877774+0000","last_peered":"2023-12-13T00:28:04.877774+0000","last_clean":"2023-12-13T00:28:04.877774+0000","last_became_active":"2023-12-13T00:00:31.026922+0000","last_became_peered":"2023-12-13T00:00:31.026922+0000","last_unstale":"2023-12-13T00:28:04.877774+0000","last_undegraded":"2023-12-13T00:28:04.877774+0000","last_fullsized":"2023-12-13T00:28:04.877774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:58:37.933386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'58","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.859144+0000","last_change":"2023-12-13T00:00:31.119937+0000","last_active":"2023-12-13T00:28:04.859144+0000","last_peered":"2023-12-13T00:28:04.859144+0000","last_clean":"2023-12-13T00:28:04.859144+0000","last_became_active":"2023-12-13T00:00:31.119685+0000","last_became_peered":"2023-12-13T00:00:31.119685+0000","last_unstale":"2023-12-13T00:28:04.859144+0000","last_undegraded":"2023-12-13T00:28:04.859144+0000","last_fullsized":"2023-12-13T00:28:04.859144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:35:00.910594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.818174+0000","last_change":"2023-12-13T00:00:31.150597+0000","last_active":"2023-12-13T00:28:04.818174+0000","last_peered":"2023-12-13T00:28:04.818174+0000","last_clean":"2023-12-13T00:28:04.818174+0000","last_became_active":"2023-12-13T00:00:31.150275+0000","last_became_peered":"2023-12-13T00:00:31.150275+0000","last_unstale":"2023-12-13T00:28:04.818174+0000","last_undegraded":"2023-12-13T00:28:04.818174+0000","last_fullsized":"2023-12-13T00:28:04.818174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:20.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'47","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.817976+0000","last_change":"2023-12-13T00:00:31.117688+0000","last_active":"2023-12-13T00:28:04.817976+0000","last_peered":"2023-12-13T00:28:04.817976+0000","last_clean":"2023-12-13T00:28:04.817976+0000","last_became_active":"2023-12-13T00:00:31.117409+0000","last_became_peered":"2023-12-13T00:00:31.117409+0000","last_unstale":"2023-12-13T00:28:04.817976+0000","last_undegraded":"2023-12-13T00:28:04.817976+0000","last_fullsized":"2023-12-13T00:28:04.817976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:12.753740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'59","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.891063+0000","last_change":"2023-12-13T00:00:31.142584+0000","last_active":"2023-12-13T00:28:04.891063+0000","last_peered":"2023-12-13T00:28:04.891063+0000","last_clean":"2023-12-13T00:28:04.891063+0000","last_became_active":"2023-12-13T00:00:31.141656+0000","last_became_peered":"2023-12-13T00:00:31.141656+0000","last_unstale":"2023-12-13T00:28:04.891063+0000","last_undegraded":"2023-12-13T00:28:04.891063+0000","last_fullsized":"2023-12-13T00:28:04.891063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:49:22.676243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'47","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.860118+0000","last_change":"2023-12-13T00:00:31.036263+0000","last_active":"2023-12-13T00:28:04.860118+0000","last_peered":"2023-12-13T00:28:04.860118+0000","last_clean":"2023-12-13T00:28:04.860118+0000","last_became_active":"2023-12-13T00:00:31.036113+0000","last_became_peered":"2023-12-13T00:00:31.036113+0000","last_unstale":"2023-12-13T00:28:04.860118+0000","last_undegraded":"2023-12-13T00:28:04.860118+0000","last_fullsized":"2023-12-13T00:28:04.860118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:01.219033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'57","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.872949+0000","last_change":"2023-12-13T00:00:31.027230+0000","last_active":"2023-12-13T00:28:04.872949+0000","last_peered":"2023-12-13T00:28:04.872949+0000","last_clean":"2023-12-13T00:28:04.872949+0000","last_became_active":"2023-12-13T00:00:31.026968+0000","last_became_peered":"2023-12-13T00:00:31.026968+0000","last_unstale":"2023-12-13T00:28:04.872949+0000","last_undegraded":"2023-12-13T00:28:04.872949+0000","last_fullsized":"2023-12-13T00:28:04.872949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:53.920022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'71","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.858163+0000","last_change":"2023-12-13T00:00:31.139140+0000","last_active":"2023-12-13T00:28:04.858163+0000","last_peered":"2023-12-13T00:28:04.858163+0000","last_clean":"2023-12-13T00:28:04.858163+0000","last_became_active":"2023-12-13T00:00:31.138869+0000","last_became_peered":"2023-12-13T00:00:31.138869+0000","last_unstale":"2023-12-13T00:28:04.858163+0000","last_undegraded":"2023-12-13T00:28:04.858163+0000","last_fullsized":"2023-12-13T00:28:04.858163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:03:13.913502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'64","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.902318+0000","last_change":"2023-12-13T00:00:31.146522+0000","last_active":"2023-12-13T00:28:04.902318+0000","last_peered":"2023-12-13T00:28:04.902318+0000","last_clean":"2023-12-13T00:28:04.902318+0000","last_became_active":"2023-12-13T00:00:31.146264+0000","last_became_peered":"2023-12-13T00:00:31.146264+0000","last_unstale":"2023-12-13T00:28:04.902318+0000","last_undegraded":"2023-12-13T00:28:04.902318+0000","last_fullsized":"2023-12-13T00:28:04.902318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:20:47.671750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'68","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.832827+0000","last_change":"2023-12-13T00:00:31.143709+0000","last_active":"2023-12-13T00:28:04.832827+0000","last_peered":"2023-12-13T00:28:04.832827+0000","last_clean":"2023-12-13T00:28:04.832827+0000","last_became_active":"2023-12-13T00:00:31.143472+0000","last_became_peered":"2023-12-13T00:00:31.143472+0000","last_unstale":"2023-12-13T00:28:04.832827+0000","last_undegraded":"2023-12-13T00:28:04.832827+0000","last_fullsized":"2023-12-13T00:28:04.832827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:21:51.967408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'52","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.878271+0000","last_change":"2023-12-13T00:00:31.146698+0000","last_active":"2023-12-13T00:28:04.878271+0000","last_peered":"2023-12-13T00:28:04.878271+0000","last_clean":"2023-12-13T00:28:04.878271+0000","last_became_active":"2023-12-13T00:00:31.146159+0000","last_became_peered":"2023-12-13T00:00:31.146159+0000","last_unstale":"2023-12-13T00:28:04.878271+0000","last_undegraded":"2023-12-13T00:28:04.878271+0000","last_fullsized":"2023-12-13T00:28:04.878271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:05:56.876593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'67","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.876344+0000","last_change":"2023-12-13T00:00:31.143946+0000","last_active":"2023-12-13T00:28:04.876344+0000","last_peered":"2023-12-13T00:28:04.876344+0000","last_clean":"2023-12-13T00:28:04.876344+0000","last_became_active":"2023-12-13T00:00:31.143663+0000","last_became_peered":"2023-12-13T00:00:31.143663+0000","last_unstale":"2023-12-13T00:28:04.876344+0000","last_undegraded":"2023-12-13T00:28:04.876344+0000","last_fullsized":"2023-12-13T00:28:04.876344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:27:24.026750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'69","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.756252+0000","last_change":"2023-12-13T00:00:31.142314+0000","last_active":"2023-12-13T00:28:04.756252+0000","last_peered":"2023-12-13T00:28:04.756252+0000","last_clean":"2023-12-13T00:28:04.756252+0000","last_became_active":"2023-12-13T00:00:31.142067+0000","last_became_peered":"2023-12-13T00:00:31.142067+0000","last_unstale":"2023-12-13T00:28:04.756252+0000","last_undegraded":"2023-12-13T00:28:04.756252+0000","last_fullsized":"2023-12-13T00:28:04.756252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:36.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'51","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.874287+0000","last_change":"2023-12-13T00:00:31.146764+0000","last_active":"2023-12-13T00:28:04.874287+0000","last_peered":"2023-12-13T00:28:04.874287+0000","last_clean":"2023-12-13T00:28:04.874287+0000","last_became_active":"2023-12-13T00:00:31.146501+0000","last_became_peered":"2023-12-13T00:00:31.146501+0000","last_unstale":"2023-12-13T00:28:04.874287+0000","last_undegraded":"2023-12-13T00:28:04.874287+0000","last_fullsized":"2023-12-13T00:28:04.874287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:20:36.334790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'67","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.871560+0000","last_change":"2023-12-13T00:00:31.138982+0000","last_active":"2023-12-13T00:28:04.871560+0000","last_peered":"2023-12-13T00:28:04.871560+0000","last_clean":"2023-12-13T00:28:04.871560+0000","last_became_active":"2023-12-13T00:00:31.138738+0000","last_became_peered":"2023-12-13T00:00:31.138738+0000","last_unstale":"2023-12-13T00:28:04.871560+0000","last_undegraded":"2023-12-13T00:28:04.871560+0000","last_fullsized":"2023-12-13T00:28:04.871560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:08:05.660552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'52","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.865407+0000","last_change":"2023-12-13T00:00:31.148499+0000","last_active":"2023-12-13T00:28:04.865407+0000","last_peered":"2023-12-13T00:28:04.865407+0000","last_clean":"2023-12-13T00:28:04.865407+0000","last_became_active":"2023-12-13T00:00:31.148251+0000","last_became_peered":"2023-12-13T00:00:31.148251+0000","last_unstale":"2023-12-13T00:28:04.865407+0000","last_undegraded":"2023-12-13T00:28:04.865407+0000","last_fullsized":"2023-12-13T00:28:04.865407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:46:41.106364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'58","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.817989+0000","last_change":"2023-12-13T00:00:31.117684+0000","last_active":"2023-12-13T00:28:04.817989+0000","last_peered":"2023-12-13T00:28:04.817989+0000","last_clean":"2023-12-13T00:28:04.817989+0000","last_became_active":"2023-12-13T00:00:31.117423+0000","last_became_peered":"2023-12-13T00:00:31.117423+0000","last_unstale":"2023-12-13T00:28:04.817989+0000","last_undegraded":"2023-12-13T00:28:04.817989+0000","last_fullsized":"2023-12-13T00:28:04.817989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:33:39.081529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'67","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.825415+0000","last_change":"2023-12-13T00:00:31.150615+0000","last_active":"2023-12-13T00:28:04.825415+0000","last_peered":"2023-12-13T00:28:04.825415+0000","last_clean":"2023-12-13T00:28:04.825415+0000","last_became_active":"2023-12-13T00:00:31.150324+0000","last_became_peered":"2023-12-13T00:00:31.150324+0000","last_unstale":"2023-12-13T00:28:04.825415+0000","last_undegraded":"2023-12-13T00:28:04.825415+0000","last_fullsized":"2023-12-13T00:28:04.825415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:15:16.348222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'63","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.873042+0000","last_change":"2023-12-13T00:00:31.147145+0000","last_active":"2023-12-13T00:28:04.873042+0000","last_peered":"2023-12-13T00:28:04.873042+0000","last_clean":"2023-12-13T00:28:04.873042+0000","last_became_active":"2023-12-13T00:00:31.146444+0000","last_became_peered":"2023-12-13T00:00:31.146444+0000","last_unstale":"2023-12-13T00:28:04.873042+0000","last_undegraded":"2023-12-13T00:28:04.873042+0000","last_fullsized":"2023-12-13T00:28:04.873042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:52:46.548248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'67","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.876556+0000","last_change":"2023-12-13T00:00:31.148920+0000","last_active":"2023-12-13T00:28:04.876556+0000","last_peered":"2023-12-13T00:28:04.876556+0000","last_clean":"2023-12-13T00:28:04.876556+0000","last_became_active":"2023-12-13T00:00:31.148529+0000","last_became_peered":"2023-12-13T00:00:31.148529+0000","last_unstale":"2023-12-13T00:28:04.876556+0000","last_undegraded":"2023-12-13T00:28:04.876556+0000","last_fullsized":"2023-12-13T00:28:04.876556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:51.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'59","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.866724+0000","last_change":"2023-12-13T00:00:31.149934+0000","last_active":"2023-12-13T00:28:04.866724+0000","last_peered":"2023-12-13T00:28:04.866724+0000","last_clean":"2023-12-13T00:28:04.866724+0000","last_became_active":"2023-12-13T00:00:31.149685+0000","last_became_peered":"2023-12-13T00:00:31.149685+0000","last_unstale":"2023-12-13T00:28:04.866724+0000","last_undegraded":"2023-12-13T00:28:04.866724+0000","last_fullsized":"2023-12-13T00:28:04.866724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:58:06.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'62","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.897060+0000","last_change":"2023-12-13T00:00:31.035879+0000","last_active":"2023-12-13T00:28:04.897060+0000","last_peered":"2023-12-13T00:28:04.897060+0000","last_clean":"2023-12-13T00:28:04.897060+0000","last_became_active":"2023-12-13T00:00:31.035672+0000","last_became_peered":"2023-12-13T00:00:31.035672+0000","last_unstale":"2023-12-13T00:28:04.897060+0000","last_undegraded":"2023-12-13T00:28:04.897060+0000","last_fullsized":"2023-12-13T00:28:04.897060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:30.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'65","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.864746+0000","last_change":"2023-12-13T00:00:31.146556+0000","last_active":"2023-12-13T00:28:04.864746+0000","last_peered":"2023-12-13T00:28:04.864746+0000","last_clean":"2023-12-13T00:28:04.864746+0000","last_became_active":"2023-12-13T00:00:31.146186+0000","last_became_peered":"2023-12-13T00:00:31.146186+0000","last_unstale":"2023-12-13T00:28:04.864746+0000","last_undegraded":"2023-12-13T00:28:04.864746+0000","last_fullsized":"2023-12-13T00:28:04.864746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:20:30.098687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'52","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.863441+0000","last_change":"2023-12-13T00:00:31.145365+0000","last_active":"2023-12-13T00:28:04.863441+0000","last_peered":"2023-12-13T00:28:04.863441+0000","last_clean":"2023-12-13T00:28:04.863441+0000","last_became_active":"2023-12-13T00:00:31.144458+0000","last_became_peered":"2023-12-13T00:00:31.144458+0000","last_unstale":"2023-12-13T00:28:04.863441+0000","last_undegraded":"2023-12-13T00:28:04.863441+0000","last_fullsized":"2023-12-13T00:28:04.863441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:03:13.913502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'57","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.886975+0000","last_change":"2023-12-13T00:00:31.145052+0000","last_active":"2023-12-13T00:28:04.886975+0000","last_peered":"2023-12-13T00:28:04.886975+0000","last_clean":"2023-12-13T00:28:04.886975+0000","last_became_active":"2023-12-13T00:00:31.144792+0000","last_became_peered":"2023-12-13T00:00:31.144792+0000","last_unstale":"2023-12-13T00:28:04.886975+0000","last_undegraded":"2023-12-13T00:28:04.886975+0000","last_fullsized":"2023-12-13T00:28:04.886975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:30:27.231427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'50","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.866189+0000","last_change":"2023-12-13T00:00:31.149527+0000","last_active":"2023-12-13T00:28:04.866189+0000","last_peered":"2023-12-13T00:28:04.866189+0000","last_clean":"2023-12-13T00:28:04.866189+0000","last_became_active":"2023-12-13T00:00:31.148875+0000","last_became_peered":"2023-12-13T00:00:31.148875+0000","last_unstale":"2023-12-13T00:28:04.866189+0000","last_undegraded":"2023-12-13T00:28:04.866189+0000","last_fullsized":"2023-12-13T00:28:04.866189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:04:01.219033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'66","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.887626+0000","last_change":"2023-12-13T00:00:31.144423+0000","last_active":"2023-12-13T00:28:04.887626+0000","last_peered":"2023-12-13T00:28:04.887626+0000","last_clean":"2023-12-13T00:28:04.887626+0000","last_became_active":"2023-12-13T00:00:31.144174+0000","last_became_peered":"2023-12-13T00:00:31.144174+0000","last_unstale":"2023-12-13T00:28:04.887626+0000","last_undegraded":"2023-12-13T00:28:04.887626+0000","last_fullsized":"2023-12-13T00:28:04.887626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:10:31.724460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.850484+0000","last_change":"2023-12-13T00:00:31.144074+0000","last_active":"2023-12-13T00:28:04.850484+0000","last_peered":"2023-12-13T00:28:04.850484+0000","last_clean":"2023-12-13T00:28:04.850484+0000","last_became_active":"2023-12-13T00:00:31.143809+0000","last_became_peered":"2023-12-13T00:00:31.143809+0000","last_unstale":"2023-12-13T00:28:04.850484+0000","last_undegraded":"2023-12-13T00:28:04.850484+0000","last_fullsized":"2023-12-13T00:28:04.850484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:16:51.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'47","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.856227+0000","last_change":"2023-12-13T00:00:31.116522+0000","last_active":"2023-12-13T00:28:04.856227+0000","last_peered":"2023-12-13T00:28:04.856227+0000","last_clean":"2023-12-13T00:28:04.856227+0000","last_became_active":"2023-12-13T00:00:31.116230+0000","last_became_peered":"2023-12-13T00:00:31.116230+0000","last_unstale":"2023-12-13T00:28:04.856227+0000","last_undegraded":"2023-12-13T00:28:04.856227+0000","last_fullsized":"2023-12-13T00:28:04.856227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:52:46.548248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'66","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.877641+0000","last_change":"2023-12-13T00:00:31.149691+0000","last_active":"2023-12-13T00:28:04.877641+0000","last_peered":"2023-12-13T00:28:04.877641+0000","last_clean":"2023-12-13T00:28:04.877641+0000","last_became_active":"2023-12-13T00:00:31.149410+0000","last_became_peered":"2023-12-13T00:00:31.149410+0000","last_unstale":"2023-12-13T00:28:04.877641+0000","last_undegraded":"2023-12-13T00:28:04.877641+0000","last_fullsized":"2023-12-13T00:28:04.877641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:50:58.339436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":248,"num_write":4193,"num_write_kb":331487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5031,"ondisk_log_size":5031,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3759,"ondisk_log_size":3759,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":43904475,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":1477,"num_read_kb":1524,"num_write":14609,"num_write_kb":50682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87957504,"data_stored":87808950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13591,"ondisk_log_size":13591,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509781,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53632,"kb_used_data":8568,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318208,"statfs":{"total":96636764160,"available":96581844992,"internally_reserved":0,"allocated":8773632,"data_stored":8578223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39700000000000002,"15min":0.40000000000000002},"min":{"1min":0.27700000000000002,"5min":0.25800000000000001,"15min":0.23699999999999999},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.65800000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42299999999999999,"15min":0.42899999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.58699999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.45400000000000001}]},{"osd":1,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.441,"15min":0.437},"min":{"1min":0.309,"5min":0.30499999999999999,"15min":0.24299999999999999},"max":{"1min":0.60599999999999998,"5min":0.63500000000000001,"15min":0.68200000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41099999999999998,"15min":0.41899999999999998},"min":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.26000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.61699999999999999},"last":0.47699999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.27100000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.442},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.33000000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.57399999999999995,"5min":0.65100000000000002,"15min":0.65200000000000002},"last":0.39600000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.436,"15min":0.438},"min":{"1min":0.36899999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55800000000000005,"5min":0.623,"15min":0.623},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.309},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.372,"15min":0.375},"min":{"1min":0.249,"5min":0.246,"15min":0.24199999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.39200000000000002,"15min":0.39500000000000002},"min":{"1min":0.28799999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.60099999999999998,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.31}]},{"osd":5,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40799999999999997,"15min":0.40100000000000002},"min":{"1min":0.28299999999999997,"5min":0.26300000000000001,"15min":0.22900000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.45100000000000001,"15min":0.438},"min":{"1min":0.314,"5min":0.29799999999999999,"15min":0.23100000000000001},"max":{"1min":0.68400000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.42699999999999999}]},{"osd":6,"last update":"Wed Dec 13 00:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.45700000000000002},"min":{"1min":0.34499999999999997,"5min":0.28899999999999998,"15min":0.23999999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.307,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67900000000000005,"15min":0.71799999999999997},"last":0.35299999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509780,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88192,"kb_used_data":16760,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94283648,"statfs":{"total":96636764160,"available":96546455552,"internally_reserved":0,"allocated":17162240,"data_stored":16985405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.34100000000000003,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.42799999999999999},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.23100000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.70099999999999996}]},{"osd":1,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.30399999999999999,"5min":0.28599999999999998,"15min":0.252},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.41899999999999998,"15min":0.41699999999999998},"min":{"1min":0.34599999999999997,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.58599999999999997}]},{"osd":2,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.42299999999999999,"15min":0.41099999999999998},"min":{"1min":0.35799999999999998,"5min":0.30099999999999999,"15min":0.247},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.627},{"interface":"front","average":{"1min":0.505,"5min":0.437,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.26500000000000001},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.78000000000000003}]},{"osd":3,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.28999999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32300000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.60699999999999998}]},{"osd":4,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.38,"15min":0.379},"min":{"1min":0.254,"5min":0.215,"15min":0.215},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.46600000000000003}]},{"osd":5,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.378},"min":{"1min":0.24399999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.502},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44500000000000001,"15min":0.436},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.249},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.441,"15min":0.44},"min":{"1min":0.32200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.433,"15min":0.439},"min":{"1min":0.29499999999999998,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.56100000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509782,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58980,"kb_used_data":9756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312860,"statfs":{"total":96636764160,"available":96576368640,"internally_reserved":0,"allocated":9990144,"data_stored":9784207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.41999999999999998},"min":{"1min":0.33500000000000002,"5min":0.216,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40400000000000003,"15min":0.40999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.49399999999999999}]},{"osd":1,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.41199999999999998},"min":{"1min":0.373,"5min":0.248,"15min":0.224},"max":{"1min":0.55700000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.432,"15min":0.435},"min":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.251},"max":{"1min":0.53000000000000003,"5min":0.57699999999999996,"15min":0.59999999999999998},"last":0.46200000000000002}]},{"osd":2,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.43099999999999999,"15min":0.432},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27100000000000002},"max":{"1min":0.54800000000000004,"5min":0.60099999999999998,"15min":0.60699999999999998},"last":0.438},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.65500000000000003},"last":0.48499999999999999}]},{"osd":3,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54300000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.378,"5min":0.33200000000000002,"15min":0.28699999999999998},"max":{"1min":0.63100000000000001,"5min":0.65500000000000003,"15min":0.66800000000000004},"last":0.47199999999999998}]},{"osd":5,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38300000000000001,"15min":0.38200000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.221},"max":{"1min":0.61299999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.65100000000000002},"last":0.36199999999999999}]},{"osd":6,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.378,"15min":0.38500000000000001},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.247},"max":{"1min":0.624,"5min":0.63100000000000001,"15min":0.71999999999999997},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.30099999999999999,"5min":0.27300000000000002,"15min":0.23899999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.71899999999999997},"last":0.41999999999999998}]},{"osd":7,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.42999999999999999,"15min":0.42699999999999999},"min":{"1min":0.32500000000000001,"5min":0.26300000000000001,"15min":0.25600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.70299999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47099999999999997,"15min":0.46200000000000002},"min":{"1min":0.34799999999999998,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.38500000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509782,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96880,"kb_used_data":21288,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94274960,"statfs":{"total":96636764160,"available":96537559040,"internally_reserved":0,"allocated":21798912,"data_stored":21617833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.317,"15min":0.316},"min":{"1min":0.22600000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.42699999999999999,"5min":0.53200000000000003,"15min":0.64000000000000001},"last":0.313},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.312,"15min":0.312},"min":{"1min":0.246,"5min":0.19600000000000001,"15min":0.192},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.57899999999999996},"last":0.32700000000000001}]},{"osd":1,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34000000000000002,"15min":0.33000000000000002},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.20200000000000001},"max":{"1min":0.41299999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.28499999999999998,"5min":0.27400000000000002,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.35999999999999999}]},{"osd":2,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.26600000000000001,"5min":0.249,"15min":0.22800000000000001},"max":{"1min":0.47799999999999998,"5min":0.59899999999999998,"15min":0.69399999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39800000000000002,"15min":0.39600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.23799999999999999},"max":{"1min":0.51400000000000001,"5min":0.59699999999999998,"15min":0.66300000000000003},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.311},"max":{"1min":0.72199999999999998,"5min":0.80100000000000005,"15min":0.90700000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.38500000000000001,"5min":0.34100000000000003,"15min":0.316},"max":{"1min":0.64500000000000002,"5min":0.76700000000000002,"15min":0.84199999999999997},"last":0.63200000000000001}]},{"osd":5,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.83199999999999996},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50700000000000001,"15min":0.5},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.30599999999999999},"max":{"1min":0.72799999999999998,"5min":0.76000000000000001,"15min":0.81999999999999995},"last":0.47399999999999998}]},{"osd":6,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.67600000000000005,"5min":0.78600000000000003,"15min":0.80600000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54600000000000004,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.79300000000000004},"last":0.72199999999999998}]},{"osd":7,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.78800000000000003},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.39500000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.85799999999999998},"last":0.51200000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509780,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36200,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335640,"statfs":{"total":96636764160,"available":96599695360,"internally_reserved":0,"allocated":884736,"data_stored":706002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.308,"15min":0.29899999999999999},"min":{"1min":0.20399999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.49299999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.308,"5min":0.32000000000000001,"15min":0.32800000000000001},"min":{"1min":0.251,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.41199999999999998,"5min":0.57599999999999996,"15min":0.63600000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33100000000000002,"15min":0.32500000000000001},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.44500000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.372},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35599999999999998,"15min":0.35199999999999998},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.23100000000000001},"max":{"1min":0.501,"5min":0.53800000000000003,"15min":0.55000000000000004},"last":0.44700000000000001}]},{"osd":3,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38100000000000001,"15min":0.375},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.5,"5min":0.60599999999999998,"15min":0.60799999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.39200000000000002,"15min":0.38400000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.52100000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.42199999999999999}]},{"osd":4,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59199999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.371,"5min":0.316,"15min":0.316},"max":{"1min":0.747,"5min":0.79800000000000004,"15min":0.84699999999999998},"last":0.57099999999999995}]},{"osd":5,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.69099999999999995,"5min":0.78500000000000003,"15min":0.81999999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51000000000000001,"15min":0.48999999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.32000000000000001},"max":{"1min":0.71899999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54400000000000004}]},{"osd":6,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.29099999999999998},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":0.89300000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.35999999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66700000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.622}]},{"osd":7,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.38800000000000001,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":0.67500000000000004,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.34999999999999998},"max":{"1min":0.68999999999999995,"5min":0.82699999999999996,"15min":0.85799999999999998},"last":0.58299999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542484,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70184,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94301656,"statfs":{"total":96636764160,"available":96564895744,"internally_reserved":0,"allocated":8683520,"data_stored":8504788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.313,"15min":0.308},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.38400000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.32200000000000001,"15min":0.32700000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.19},"max":{"1min":0.42799999999999999,"5min":0.53200000000000003,"15min":0.60299999999999998},"last":0.27100000000000002}]},{"osd":1,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.33000000000000002,"15min":0.33100000000000002},"min":{"1min":0.23599999999999999,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.38200000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.746},"last":0.437}]},{"osd":3,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35899999999999999,"15min":0.36799999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46800000000000003,"5min":0.57399999999999995,"15min":1.03},"last":0.313},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.376,"15min":0.38500000000000001},"min":{"1min":0.26000000000000001,"5min":0.247,"15min":0.23499999999999999},"max":{"1min":0.41799999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.33600000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46899999999999997,"15min":0.46600000000000003},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.85399999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.496,"15min":0.48699999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.28499999999999998},"max":{"1min":0.65700000000000003,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.65700000000000003}]},{"osd":5,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.47899999999999998,"15min":0.46899999999999997},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.317},"max":{"1min":0.56899999999999995,"5min":0.70799999999999996,"15min":0.82099999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51600000000000001,"15min":0.496},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.316},"max":{"1min":0.76100000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.76100000000000001}]},{"osd":6,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.36799999999999999,"5min":0.36199999999999999,"15min":0.34499999999999997},"max":{"1min":0.61799999999999999,"5min":0.74399999999999999,"15min":0.79800000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.498,"15min":0.503},"min":{"1min":0.377,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.52500000000000002,"5min":0.75800000000000001,"15min":0.78200000000000003},"last":0.501}]},{"osd":7,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53500000000000003,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35499999999999998},"max":{"1min":0.63800000000000001,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.48699999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542484,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67936,"kb_used_data":6232,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94303904,"statfs":{"total":96636764160,"available":96567197696,"internally_reserved":0,"allocated":6381568,"data_stored":6195602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.32900000000000001,"15min":0.32000000000000001},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.19400000000000001},"max":{"1min":0.56599999999999995,"5min":0.627,"15min":0.66900000000000004},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33000000000000002,"15min":0.316},"min":{"1min":0.22700000000000001,"5min":0.221,"15min":0.19900000000000001},"max":{"1min":0.47299999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.35699999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32600000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57999999999999996,"5min":0.60699999999999998,"15min":0.64600000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.37,"15min":0.35399999999999998},"min":{"1min":0.246,"5min":0.24299999999999999,"15min":0.23000000000000001},"max":{"1min":0.52800000000000002,"5min":0.61299999999999999,"15min":0.72299999999999998},"last":0.27100000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36199999999999999,"15min":0.35499999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.22900000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.36799999999999999},"min":{"1min":0.28999999999999998,"5min":0.26300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.65400000000000003},"last":0.34499999999999997}]},{"osd":4,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.33500000000000002,"5min":0.30499999999999999,"15min":0.25800000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51500000000000001,"15min":0.47899999999999998},"min":{"1min":0.36499999999999999,"5min":0.35899999999999999,"15min":0.27200000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.40899999999999997}]},{"osd":5,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52500000000000002,"15min":0.48499999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.505},"min":{"1min":0.40000000000000002,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.39900000000000002}]},{"osd":6,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52000000000000002},"min":{"1min":0.40200000000000002,"5min":0.33800000000000002,"15min":0.33600000000000002},"max":{"1min":0.71699999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.51900000000000002},"min":{"1min":0.41999999999999998,"5min":0.377,"15min":0.34499999999999997},"max":{"1min":0.81699999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.41999999999999998}]},{"osd":7,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69399999999999995,"5min":0.746,"15min":0.79500000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":0.54100000000000004},"min":{"1min":0.371,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.371}]}]},{"osd":5,"up_from":13,"seq":55834575189,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88748,"kb_used_data":17316,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94283092,"statfs":{"total":96636764160,"available":96545886208,"internally_reserved":0,"allocated":17731584,"data_stored":17541418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.307,"5min":0.255,"15min":0.20200000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.70399999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41399999999999998,"15min":0.40699999999999997},"min":{"1min":0.30099999999999999,"5min":0.28000000000000003,"15min":0.23999999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.67300000000000004},"last":0.48999999999999999}]},{"osd":1,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.434,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.249},"max":{"1min":0.61499999999999999,"5min":0.625,"15min":0.67300000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.33300000000000002,"5min":0.28999999999999998,"15min":0.247},"max":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.73399999999999999},"last":0.60299999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.42999999999999999,"15min":0.42299999999999999},"min":{"1min":0.317,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.628,"5min":0.628,"15min":0.68700000000000006},"last":0.503},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41599999999999998,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.65900000000000003},"last":0.53500000000000003}]},{"osd":3,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44600000000000001,"15min":0.436},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.27300000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.68999999999999995},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.44800000000000001},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.69099999999999995},"last":0.52100000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38800000000000001,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.215},"max":{"1min":0.58599999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40100000000000002,"15min":0.38600000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.22900000000000001},"max":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.65000000000000002},"last":0.41999999999999998}]},{"osd":6,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.374,"15min":0.36499999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.22500000000000001},"max":{"1min":0.48299999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.42299999999999999,"15min":0.41799999999999998},"min":{"1min":0.26100000000000001,"5min":0.25800000000000001,"15min":0.24399999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.77400000000000002},"last":0.39900000000000002}]},{"osd":7,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.41899999999999998},"min":{"1min":0.29999999999999999,"5min":0.27400000000000002,"15min":0.22900000000000001},"max":{"1min":0.60099999999999998,"5min":0.61099999999999999,"15min":0.68899999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.433},"min":{"1min":0.36699999999999999,"5min":0.27000000000000002,"15min":0.26700000000000002},"max":{"1min":0.64500000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.436}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6098944,"data_stored":6080128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21516288,"data_stored":21502359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9707520,"data_stored":9668733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16855040,"data_stored":16835576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16879616,"data_stored":16869931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8491008,"data_stored":8462749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T00:28:12.642 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:28:12.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.779+0000 7fb194bb6640 1 Processor -- start 2023-12-13T00:28:12.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.779+0000 7fb194bb6640 1 -- start start 2023-12-13T00:28:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.780+0000 7fb194bb6640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb190157a40 0x7fb1900ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.780+0000 7fb194bb6640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb190158340 con 0x7fb1901514a0 2023-12-13T00:28:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.780+0000 7fb194bb6640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb190157e50 con 0x7fb1900ccb60 2023-12-13T00:28:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.780+0000 7fb194bb6640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1901580a0 con 0x7fb190157a40 2023-12-13T00:28:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.781+0000 7fb18e59c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb1901514a0 0x7fb1900c3110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:32970/0 (socket says 172.21.15.72:32970) 2023-12-13T00:28:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.781+0000 7fb18e59c640 1 -- 172.21.15.72:0/1801038858 learned_addr learned my addr 172.21.15.72:0/1801038858 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:28:12.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.781+0000 7fb18ed9d640 1 --2- 172.21.15.72:0/1801038858 >> v2:172.21.15.176:3300/0 conn(0x7fb190157a40 0x7fb1900ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:12.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.783+0000 7fb18d59a640 1 -- 172.21.15.72:0/1801038858 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149611118 0 0) 0x7fb190158340 con 0x7fb1901514a0 2023-12-13T00:28:12.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.783+0000 7fb18d59a640 1 -- 172.21.15.72:0/1801038858 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb178003520 con 0x7fb1901514a0 2023-12-13T00:28:12.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.785+0000 7fb18ed9d640 1 -- 172.21.15.72:0/1801038858 >> v1:172.21.15.176:6789/0 conn(0x7fb1900ccb60 legacy=0x7fb190157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:12.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.785+0000 7fb18ed9d640 1 -- 172.21.15.72:0/1801038858 >> v1:172.21.15.72:6789/0 conn(0x7fb1901514a0 legacy=0x7fb1900c3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:12.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.785+0000 7fb18ed9d640 1 -- 172.21.15.72:0/1801038858 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1900c2370 con 0x7fb190157a40 2023-12-13T00:28:12.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.788+0000 7fb18ed9d640 1 --2- 172.21.15.72:0/1801038858 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb190157a40 0x7fb1900ccf90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb180009d90 tx=0x7fb18002bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc6a49427a3996e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:12.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.793+0000 7fb18d59a640 1 -- 172.21.15.72:0/1801038858 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18002cd00 con 0x7fb190157a40 2023-12-13T00:28:12.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.793+0000 7fb18d59a640 1 -- 172.21.15.72:0/1801038858 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18002ce60 con 0x7fb190157a40 2023-12-13T00:28:12.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.793+0000 7fb18d59a640 1 -- 172.21.15.72:0/1801038858 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180034660 con 0x7fb190157a40 2023-12-13T00:28:12.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.793+0000 7fb194bb6640 1 -- 172.21.15.72:0/1801038858 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb190157a40 msgr2=0x7fb1900ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:12.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.793+0000 7fb194bb6640 1 --2- 172.21.15.72:0/1801038858 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb190157a40 0x7fb1900ccf90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb180009d90 tx=0x7fb18002bf50 comp rx=0 tx=0).stop 2023-12-13T00:28:12.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.793+0000 7fb194bb6640 1 -- 172.21.15.72:0/1801038858 shutdown_connections 2023-12-13T00:28:12.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.793+0000 7fb194bb6640 1 --2- 172.21.15.72:0/1801038858 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb190157a40 0x7fb1900ccf90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:12.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.793+0000 7fb194bb6640 1 -- 172.21.15.72:0/1801038858 >> 172.21.15.72:0/1801038858 conn(0x7fb190070790 msgr2=0x7fb190070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:12.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.794+0000 7fb194bb6640 1 -- 172.21.15.72:0/1801038858 shutdown_connections 2023-12-13T00:28:12.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.794+0000 7fb194bb6640 1 -- 172.21.15.72:0/1801038858 wait complete. 2023-12-13T00:28:12.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.795+0000 7fb194bb6640 1 Processor -- start 2023-12-13T00:28:12.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.795+0000 7fb194bb6640 1 -- start start 2023-12-13T00:28:12.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.795+0000 7fb194bb6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1900ccb60 0x7fb19006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:12.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.796+0000 7fb194bb6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1901514a0 0x7fb19006c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:12.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.796+0000 7fb194bb6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb190157a40 0x7fb1901f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:12.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.796+0000 7fb194bb6640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1900ad040 con 0x7fb1900ccb60 2023-12-13T00:28:12.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.796+0000 7fb194bb6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1900adbc0 con 0x7fb1901514a0 2023-12-13T00:28:12.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.796+0000 7fb194bb6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1901f0280 con 0x7fb190157a40 2023-12-13T00:28:12.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.796+0000 7fb18e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1900ccb60 0x7fb19006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:12.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.796+0000 7fb18e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1900ccb60 0x7fb19006d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51460/0 (socket says 172.21.15.72:51460) 2023-12-13T00:28:12.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.796+0000 7fb18e59c640 1 -- 172.21.15.72:0/586705759 learned_addr learned my addr 172.21.15.72:0/586705759 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:12.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.796+0000 7fb18dd9b640 1 --2- 172.21.15.72:0/586705759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1901514a0 0x7fb19006c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:12.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.796+0000 7fb18ed9d640 1 --2- 172.21.15.72:0/586705759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb190157a40 0x7fb1901f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:12.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.800+0000 7fb18e59c640 1 -- 172.21.15.72:0/586705759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb190157a40 msgr2=0x7fb1901f25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:12.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.800+0000 7fb18e59c640 1 --2- 172.21.15.72:0/586705759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb190157a40 0x7fb1901f25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:12.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.800+0000 7fb18e59c640 1 -- 172.21.15.72:0/586705759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1901514a0 msgr2=0x7fb19006c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:12.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.800+0000 7fb18e59c640 1 --2- 172.21.15.72:0/586705759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1901514a0 0x7fb19006c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:12.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.800+0000 7fb18e59c640 1 -- 172.21.15.72:0/586705759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb180009a70 con 0x7fb1900ccb60 2023-12-13T00:28:12.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.802+0000 7fb18e59c640 1 --2- 172.21.15.72:0/586705759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1900ccb60 0x7fb19006d180 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb18800c500 tx=0x7fb18800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:12.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.806+0000 7fb17effd640 1 -- 172.21.15.72:0/586705759 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188005ce0 con 0x7fb1900ccb60 2023-12-13T00:28:12.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.806+0000 7fb17effd640 1 -- 172.21.15.72:0/586705759 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb188005e40 con 0x7fb1900ccb60 2023-12-13T00:28:12.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.806+0000 7fb17effd640 1 -- 172.21.15.72:0/586705759 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188007330 con 0x7fb1900ccb60 2023-12-13T00:28:12.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.806+0000 7fb194bb6640 1 -- 172.21.15.72:0/586705759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1901f30d0 con 0x7fb1900ccb60 2023-12-13T00:28:12.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.806+0000 7fb194bb6640 1 -- 172.21.15.72:0/586705759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1900af420 con 0x7fb1900ccb60 2023-12-13T00:28:12.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:12.807+0000 7fb194bb6640 1 -- 172.21.15.72:0/586705759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb190067470 con 0x7fb1900ccb60 2023-12-13T00:28:13.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.047+0000 7fb17effd640 1 -- 172.21.15.72:0/586705759 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb188007490 con 0x7fb1900ccb60 2023-12-13T00:28:13.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.047+0000 7fb17effd640 1 --2- 172.21.15.72:0/586705759 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb17006b210 0x7fb17006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:13.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.048+0000 7fb18dd9b640 1 --2- 172.21.15.72:0/586705759 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb17006b210 0x7fb17006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:13.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.048+0000 7fb18dd9b640 1 --2- 172.21.15.72:0/586705759 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb17006b210 0x7fb17006d6d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb1900c8300 tx=0x7fb184009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:13.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.062+0000 7fb17effd640 1 -- 172.21.15.72:0/586705759 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fb188007740 con 0x7fb1900ccb60 2023-12-13T00:28:13.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.062+0000 7fb17effd640 1 -- 172.21.15.72:0/586705759 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb188054340 con 0x7fb1900ccb60 2023-12-13T00:28:13.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.238+0000 7fb194bb6640 1 -- 172.21.15.72:0/586705759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb190154d50 con 0x7fb1900ccb60 2023-12-13T00:28:13.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.277+0000 7fb17effd640 1 -- 172.21.15.72:0/586705759 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18563 (secure 0 0 0) 0x7fb188057960 con 0x7fb1900ccb60 2023-12-13T00:28:13.277 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:28:13.277 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:01:00.435991+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T00:00:27.701252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T00:00:29.324356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T00:00:33.363089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.3","mappings":[{"from":7,"to":5}]},{"pgid":"4.10","mappings":[{"from":7,"to":0}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:28:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.279+0000 7fb194bb6640 1 -- 172.21.15.72:0/586705759 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb17006b210 msgr2=0x7fb17006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.279+0000 7fb194bb6640 1 --2- 172.21.15.72:0/586705759 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb17006b210 0x7fb17006d6d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb1900c8300 tx=0x7fb184009040 comp rx=0 tx=0).stop 2023-12-13T00:28:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.279+0000 7fb194bb6640 1 -- 172.21.15.72:0/586705759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1900ccb60 msgr2=0x7fb19006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.279+0000 7fb194bb6640 1 --2- 172.21.15.72:0/586705759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1900ccb60 0x7fb19006d180 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb18800c500 tx=0x7fb18800c9c0 comp rx=0 tx=0).stop 2023-12-13T00:28:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.279+0000 7fb194bb6640 1 -- 172.21.15.72:0/586705759 shutdown_connections 2023-12-13T00:28:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.279+0000 7fb194bb6640 1 --2- 172.21.15.72:0/586705759 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb17006b210 0x7fb17006d6d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.279+0000 7fb194bb6640 1 --2- 172.21.15.72:0/586705759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb190157a40 0x7fb1901f25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:13.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.279+0000 7fb194bb6640 1 --2- 172.21.15.72:0/586705759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1901514a0 0x7fb19006c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:13.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.279+0000 7fb194bb6640 1 --2- 172.21.15.72:0/586705759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1900ccb60 0x7fb19006d180 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:13.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.279+0000 7fb194bb6640 1 -- 172.21.15.72:0/586705759 >> 172.21.15.72:0/586705759 conn(0x7fb190070790 msgr2=0x7fb1900ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:13.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.279+0000 7fb194bb6640 1 -- 172.21.15.72:0/586705759 shutdown_connections 2023-12-13T00:28:13.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:13.279+0000 7fb194bb6640 1 -- 172.21.15.72:0/586705759 wait complete. 2023-12-13T00:28:14.291 INFO:tasks.ceph:Scrubbing osd.0 2023-12-13T00:28:14.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-13T00:28:14.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.398+0000 7faa8b2b4640 1 Processor -- start 2023-12-13T00:28:14.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.398+0000 7faa8b2b4640 1 -- start start 2023-12-13T00:28:14.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.399+0000 7faa8b2b4640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faa840c8ee0 0x7faa8406e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:14.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.399+0000 7faa8b2b4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa8406ed80 0x7faa8406ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:14.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.399+0000 7faa8b2b4640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa840c7640 con 0x7faa841538d0 2023-12-13T00:28:14.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.399+0000 7faa8b2b4640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8406d130 con 0x7faa840c8ee0 2023-12-13T00:28:14.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.399+0000 7faa8b2b4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8406b5c0 con 0x7faa8406ed80 2023-12-13T00:28:14.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.400+0000 7faa89851640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa8406ed80 0x7faa8406ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:14.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.400+0000 7faa8884f640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faa840c8ee0 0x7faa8406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:14.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.400+0000 7faa89851640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa8406ed80 0x7faa8406ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:34910/0 (socket says 172.21.15.72:34910) 2023-12-13T00:28:14.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.400+0000 7faa89851640 1 -- 172.21.15.72:0/2578506904 learned_addr learned my addr 172.21.15.72:0/2578506904 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:14.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.402+0000 7faa89851640 1 -- 172.21.15.72:0/2578506904 >> v2:172.21.15.176:3300/0 conn(0x7faa840c8ee0 msgr2=0x7faa8406e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:14.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.403+0000 7faa89851640 1 --2- 172.21.15.72:0/2578506904 >> v2:172.21.15.176:3300/0 conn(0x7faa840c8ee0 0x7faa8406e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:14.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.403+0000 7faa89851640 1 -- 172.21.15.72:0/2578506904 >> v1:172.21.15.176:6789/0 conn(0x7faa841538d0 legacy=0x7faa8415a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:14.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.403+0000 7faa89851640 1 -- 172.21.15.72:0/2578506904 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa840cd750 con 0x7faa8406ed80 2023-12-13T00:28:14.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.405+0000 7faa89851640 1 --2- 172.21.15.72:0/2578506904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa8406ed80 0x7faa8406ba50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009e50 tx=0x7faa7c02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e2d219a913fd17a server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.409+0000 7faa7bfff640 1 -- 172.21.15.72:0/2578506904 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c02ca70 con 0x7faa8406ed80 2023-12-13T00:28:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.409+0000 7faa7bfff640 1 -- 172.21.15.72:0/2578506904 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7c02cbd0 con 0x7faa8406ed80 2023-12-13T00:28:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.409+0000 7faa7bfff640 1 -- 172.21.15.72:0/2578506904 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c0343f0 con 0x7faa8406ed80 2023-12-13T00:28:14.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.410+0000 7faa8b2b4640 1 -- 172.21.15.72:0/2578506904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa8406ed80 msgr2=0x7faa8406ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:14.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.410+0000 7faa8b2b4640 1 --2- 172.21.15.72:0/2578506904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa8406ed80 0x7faa8406ba50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009e50 tx=0x7faa7c02bed0 comp rx=0 tx=0).stop 2023-12-13T00:28:14.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.410+0000 7faa8b2b4640 1 -- 172.21.15.72:0/2578506904 shutdown_connections 2023-12-13T00:28:14.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.410+0000 7faa8b2b4640 1 --2- 172.21.15.72:0/2578506904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa8406ed80 0x7faa8406ba50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:14.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.410+0000 7faa8b2b4640 1 --2- 172.21.15.72:0/2578506904 >> v2:172.21.15.176:3300/0 conn(0x7faa840c8ee0 0x7faa8406e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:14.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.410+0000 7faa8b2b4640 1 -- 172.21.15.72:0/2578506904 >> 172.21.15.72:0/2578506904 conn(0x7faa84060f20 msgr2=0x7faa84061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:14.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.410+0000 7faa8b2b4640 1 -- 172.21.15.72:0/2578506904 shutdown_connections 2023-12-13T00:28:14.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.410+0000 7faa8b2b4640 1 -- 172.21.15.72:0/2578506904 wait complete. 2023-12-13T00:28:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.411+0000 7faa8b2b4640 1 Processor -- start 2023-12-13T00:28:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.411+0000 7faa8b2b4640 1 -- start start 2023-12-13T00:28:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.412+0000 7faa8b2b4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa8406ed80 0x7faa8414a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.412+0000 7faa8b2b4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa840c8ee0 0x7faa840b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.412+0000 7faa8b2b4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa841538d0 0x7faa8414c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.412+0000 7faa8b2b4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa84152e50 con 0x7faa8406ed80 2023-12-13T00:28:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.412+0000 7faa8b2b4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8414f920 con 0x7faa841538d0 2023-12-13T00:28:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.412+0000 7faa8b2b4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8414bb10 con 0x7faa840c8ee0 2023-12-13T00:28:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.413+0000 7faa89050640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa8406ed80 0x7faa8414a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.413+0000 7faa89851640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa841538d0 0x7faa8414c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.413+0000 7faa8884f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa840c8ee0 0x7faa840b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.413+0000 7faa89050640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa8406ed80 0x7faa8414a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51462/0 (socket says 172.21.15.72:51462) 2023-12-13T00:28:14.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.413+0000 7faa89050640 1 -- 172.21.15.72:0/908352072 learned_addr learned my addr 172.21.15.72:0/908352072 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:14.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.416+0000 7faa89050640 1 -- 172.21.15.72:0/908352072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa840c8ee0 msgr2=0x7faa840b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:14.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.416+0000 7faa89050640 1 --2- 172.21.15.72:0/908352072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa840c8ee0 0x7faa840b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:14.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.416+0000 7faa89050640 1 -- 172.21.15.72:0/908352072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa841538d0 msgr2=0x7faa8414c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:14.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.416+0000 7faa89050640 1 --2- 172.21.15.72:0/908352072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa841538d0 0x7faa8414c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:14.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.416+0000 7faa89050640 1 -- 172.21.15.72:0/908352072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c009b30 con 0x7faa8406ed80 2023-12-13T00:28:14.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.418+0000 7faa89050640 1 --2- 172.21.15.72:0/908352072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa8406ed80 0x7faa8414a7e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faa8000c400 tx=0x7faa8000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:14.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.422+0000 7faa79ffb640 1 -- 172.21.15.72:0/908352072 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa800052d0 con 0x7faa8406ed80 2023-12-13T00:28:14.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.422+0000 7faa79ffb640 1 -- 172.21.15.72:0/908352072 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa80005450 con 0x7faa8406ed80 2023-12-13T00:28:14.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.422+0000 7faa8b2b4640 1 -- 172.21.15.72:0/908352072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8414c0d0 con 0x7faa8406ed80 2023-12-13T00:28:14.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.422+0000 7faa79ffb640 1 -- 172.21.15.72:0/908352072 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa80007260 con 0x7faa8406ed80 2023-12-13T00:28:14.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.422+0000 7faa8b2b4640 1 -- 172.21.15.72:0/908352072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8414fbe0 con 0x7faa8406ed80 2023-12-13T00:28:14.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.423+0000 7faa8b2b4640 1 -- 172.21.15.72:0/908352072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa840c7b70 con 0x7faa8406ed80 2023-12-13T00:28:14.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.442+0000 7faa79ffb640 1 -- 172.21.15.72:0/908352072 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7faa800073c0 con 0x7faa8406ed80 2023-12-13T00:28:14.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.442+0000 7faa79ffb640 1 --2- 172.21.15.72:0/908352072 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faa6806b210 0x7faa6806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:14.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.443+0000 7faa8884f640 1 --2- 172.21.15.72:0/908352072 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faa6806b210 0x7faa6806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:14.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.443+0000 7faa8884f640 1 --2- 172.21.15.72:0/908352072 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faa6806b210 0x7faa6806d6d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa8415a4b0 tx=0x7faa74009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:14.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.445+0000 7faa79ffb640 1 -- 172.21.15.72:0/908352072 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7faa80007670 con 0x7faa8406ed80 2023-12-13T00:28:14.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.445+0000 7faa79ffb640 1 --2- 172.21.15.72:0/908352072 >> [v2:172.21.15.72:6818/46778518,v1:172.21.15.72:6819/46778518] conn(0x7faa680749f0 0x7faa68076e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:14.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.445+0000 7faa79ffb640 1 -- 172.21.15.72:0/908352072 --> [v2:172.21.15.72:6818/46778518,v1:172.21.15.72:6819/46778518] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa68077560 con 0x7faa680749f0 2023-12-13T00:28:14.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.445+0000 7faa79ffb640 1 -- 172.21.15.72:0/908352072 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa80054690 con 0x7faa8406ed80 2023-12-13T00:28:14.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.445+0000 7faa89851640 1 --2- 172.21.15.72:0/908352072 >> [v2:172.21.15.72:6818/46778518,v1:172.21.15.72:6819/46778518] conn(0x7faa680749f0 0x7faa68076e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:14.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.446+0000 7faa89851640 1 --2- 172.21.15.72:0/908352072 >> [v2:172.21.15.72:6818/46778518,v1:172.21.15.72:6819/46778518] conn(0x7faa680749f0 0x7faa68076e90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:14.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.446+0000 7faa79ffb640 1 -- 172.21.15.72:0/908352072 <== osd.0 v2:172.21.15.72:6818/46778518 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7faa68077560 con 0x7faa680749f0 2023-12-13T00:28:14.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.460+0000 7faa8b2b4640 1 -- 172.21.15.72:0/908352072 --> [v2:172.21.15.72:6818/46778518,v1:172.21.15.72:6819/46778518] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faa840c7890 con 0x7faa680749f0 2023-12-13T00:28:14.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.460+0000 7faa79ffb640 1 -- 172.21.15.72:0/908352072 <== osd.0 v2:172.21.15.72:6818/46778518 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7faa7c02c990 con 0x7faa680749f0 2023-12-13T00:28:14.461 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-12-13T00:28:14.461 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-13T00:28:14.461 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-12-13T00:28:14.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.461+0000 7faa8b2b4640 1 -- 172.21.15.72:0/908352072 >> [v2:172.21.15.72:6818/46778518,v1:172.21.15.72:6819/46778518] conn(0x7faa680749f0 msgr2=0x7faa68076e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:14.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.461+0000 7faa8b2b4640 1 --2- 172.21.15.72:0/908352072 >> [v2:172.21.15.72:6818/46778518,v1:172.21.15.72:6819/46778518] conn(0x7faa680749f0 0x7faa68076e90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:14.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.461+0000 7faa8b2b4640 1 -- 172.21.15.72:0/908352072 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faa6806b210 msgr2=0x7faa6806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:14.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.461+0000 7faa8b2b4640 1 --2- 172.21.15.72:0/908352072 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faa6806b210 0x7faa6806d6d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa8415a4b0 tx=0x7faa74009190 comp rx=0 tx=0).stop 2023-12-13T00:28:14.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.461+0000 7faa8b2b4640 1 -- 172.21.15.72:0/908352072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa8406ed80 msgr2=0x7faa8414a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:14.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.461+0000 7faa8b2b4640 1 --2- 172.21.15.72:0/908352072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa8406ed80 0x7faa8414a7e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faa8000c400 tx=0x7faa8000c8c0 comp rx=0 tx=0).stop 2023-12-13T00:28:14.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.461+0000 7faa89851640 1 -- 172.21.15.72:0/908352072 reap_dead start 2023-12-13T00:28:14.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.461+0000 7faa8b2b4640 1 -- 172.21.15.72:0/908352072 shutdown_connections 2023-12-13T00:28:14.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.461+0000 7faa8b2b4640 1 -- 172.21.15.72:0/908352072 >> 172.21.15.72:0/908352072 conn(0x7faa84060f20 msgr2=0x7faa840c9300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:14.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.461+0000 7faa8b2b4640 1 -- 172.21.15.72:0/908352072 shutdown_connections 2023-12-13T00:28:14.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.461+0000 7faa8b2b4640 1 -- 172.21.15.72:0/908352072 wait complete. 2023-12-13T00:28:14.471 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-13T00:28:14.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.573+0000 7f10c0e9b640 1 Processor -- start 2023-12-13T00:28:14.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.573+0000 7f10c0e9b640 1 -- start start 2023-12-13T00:28:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.574+0000 7f10c0e9b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f10bc0c46c0 0x7f10bc0c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.574+0000 7f10c0e9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10bc150460 0x7f10bc0c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.574+0000 7f10c0e9b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10bc0c76f0 con 0x7f10bc0c4aa0 2023-12-13T00:28:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.574+0000 7f10c0e9b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc0c2bc0 con 0x7f10bc150460 2023-12-13T00:28:14.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.574+0000 7f10c0e9b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc0c6dc0 con 0x7f10bc0c46c0 2023-12-13T00:28:14.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.574+0000 7f10bad9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10bc150460 0x7f10bc0c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:14.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.575+0000 7f10bad9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10bc150460 0x7f10bc0c1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51474/0 (socket says 172.21.15.72:51474) 2023-12-13T00:28:14.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.575+0000 7f10bad9d640 1 -- 172.21.15.72:0/1835453480 learned_addr learned my addr 172.21.15.72:0/1835453480 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:14.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.575+0000 7f10ba59c640 1 --2- 172.21.15.72:0/1835453480 >> v2:172.21.15.176:3300/0 conn(0x7f10bc0c46c0 0x7f10bc0c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:14.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.577+0000 7f10bad9d640 1 -- 172.21.15.72:0/1835453480 >> v2:172.21.15.176:3300/0 conn(0x7f10bc0c46c0 msgr2=0x7f10bc0c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:14.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.577+0000 7f10bad9d640 1 --2- 172.21.15.72:0/1835453480 >> v2:172.21.15.176:3300/0 conn(0x7f10bc0c46c0 0x7f10bc0c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:14.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.577+0000 7f10bad9d640 1 -- 172.21.15.72:0/1835453480 >> v1:172.21.15.176:6789/0 conn(0x7f10bc0c4aa0 legacy=0x7f10bc14fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:14.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.577+0000 7f10bad9d640 1 -- 172.21.15.72:0/1835453480 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc0c70a0 con 0x7f10bc150460 2023-12-13T00:28:14.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.579+0000 7f10bad9d640 1 --2- 172.21.15.72:0/1835453480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10bc150460 0x7f10bc0c1ec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0c5080 tx=0x7f10b402e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b997b0a248f5a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:14.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.582+0000 7f10b9d9b640 1 -- 172.21.15.72:0/1835453480 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b400b0d0 con 0x7f10bc150460 2023-12-13T00:28:14.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.582+0000 7f10b9d9b640 1 -- 172.21.15.72:0/1835453480 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b400b230 con 0x7f10bc150460 2023-12-13T00:28:14.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.582+0000 7f10b9d9b640 1 -- 172.21.15.72:0/1835453480 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4009600 con 0x7f10bc150460 2023-12-13T00:28:14.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.583+0000 7f10c0e9b640 1 -- 172.21.15.72:0/1835453480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10bc150460 msgr2=0x7f10bc0c1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:14.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.583+0000 7f10c0e9b640 1 --2- 172.21.15.72:0/1835453480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10bc150460 0x7f10bc0c1ec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0c5080 tx=0x7f10b402e180 comp rx=0 tx=0).stop 2023-12-13T00:28:14.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.583+0000 7f10c0e9b640 1 -- 172.21.15.72:0/1835453480 shutdown_connections 2023-12-13T00:28:14.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.583+0000 7f10c0e9b640 1 --2- 172.21.15.72:0/1835453480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10bc150460 0x7f10bc0c1ec0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:14.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.583+0000 7f10c0e9b640 1 --2- 172.21.15.72:0/1835453480 >> v2:172.21.15.176:3300/0 conn(0x7f10bc0c46c0 0x7f10bc0c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:14.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.583+0000 7f10c0e9b640 1 -- 172.21.15.72:0/1835453480 >> 172.21.15.72:0/1835453480 conn(0x7f10bc06c5f0 msgr2=0x7f10bc06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:14.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.583+0000 7f10c0e9b640 1 -- 172.21.15.72:0/1835453480 shutdown_connections 2023-12-13T00:28:14.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.583+0000 7f10c0e9b640 1 -- 172.21.15.72:0/1835453480 wait complete. 2023-12-13T00:28:14.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.585+0000 7f10c0e9b640 1 Processor -- start 2023-12-13T00:28:14.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.585+0000 7f10c0e9b640 1 -- start start 2023-12-13T00:28:14.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.585+0000 7f10c0e9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10bc0c46c0 0x7f10bc1df500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:14.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.585+0000 7f10c0e9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10bc0c4aa0 0x7f10bc1ee120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:14.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.585+0000 7f10c0e9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10bc150460 0x7f10bc1ee660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:14.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.585+0000 7f10c0e9b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc1e0b10 con 0x7f10bc150460 2023-12-13T00:28:14.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.585+0000 7f10c0e9b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc154310 con 0x7f10bc0c46c0 2023-12-13T00:28:14.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.585+0000 7f10c0e9b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc1dfa40 con 0x7f10bc0c4aa0 2023-12-13T00:28:14.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.586+0000 7f10b3fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10bc0c4aa0 0x7f10bc1ee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:14.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.586+0000 7f10ba59c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10bc0c46c0 0x7f10bc1df500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:14.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.587+0000 7f10bad9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10bc150460 0x7f10bc1ee660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:14.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.587+0000 7f10b3fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10bc0c4aa0 0x7f10bc1ee120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:34930/0 (socket says 172.21.15.72:34930) 2023-12-13T00:28:14.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.587+0000 7f10b3fff640 1 -- 172.21.15.72:0/3951708615 learned_addr learned my addr 172.21.15.72:0/3951708615 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:14.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.590+0000 7f10bad9d640 1 -- 172.21.15.72:0/3951708615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10bc0c4aa0 msgr2=0x7f10bc1ee120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:14.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.590+0000 7f10bad9d640 1 --2- 172.21.15.72:0/3951708615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10bc0c4aa0 0x7f10bc1ee120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:14.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.590+0000 7f10bad9d640 1 -- 172.21.15.72:0/3951708615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10bc0c46c0 msgr2=0x7f10bc1df500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:14.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.590+0000 7f10bad9d640 1 --2- 172.21.15.72:0/3951708615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10bc0c46c0 0x7f10bc1df500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:14.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.590+0000 7f10bad9d640 1 -- 172.21.15.72:0/3951708615 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b400bd40 con 0x7f10bc150460 2023-12-13T00:28:14.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.593+0000 7f10bad9d640 1 --2- 172.21.15.72:0/3951708615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10bc150460 0x7f10bc1ee660 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0c8040 tx=0x7f10b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:14.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.596+0000 7f10b2ffd640 1 -- 172.21.15.72:0/3951708615 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4009e70 con 0x7f10bc150460 2023-12-13T00:28:14.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.596+0000 7f10b2ffd640 1 -- 172.21.15.72:0/3951708615 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b400b720 con 0x7f10bc150460 2023-12-13T00:28:14.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.596+0000 7f10b2ffd640 1 -- 172.21.15.72:0/3951708615 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b40408a0 con 0x7f10bc150460 2023-12-13T00:28:14.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.596+0000 7f10c0e9b640 1 -- 172.21.15.72:0/3951708615 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc1547a0 con 0x7f10bc150460 2023-12-13T00:28:14.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.596+0000 7f10c0e9b640 1 -- 172.21.15.72:0/3951708615 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc1eefc0 con 0x7f10bc150460 2023-12-13T00:28:14.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.597+0000 7f10c0e9b640 1 -- 172.21.15.72:0/3951708615 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10bc067470 con 0x7f10bc150460 2023-12-13T00:28:14.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.618+0000 7f10b2ffd640 1 -- 172.21.15.72:0/3951708615 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f10b4040ac0 con 0x7f10bc150460 2023-12-13T00:28:14.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.619+0000 7f10b2ffd640 1 --2- 172.21.15.72:0/3951708615 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f109c06b210 0x7f109c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:14.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.619+0000 7f10ba59c640 1 --2- 172.21.15.72:0/3951708615 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f109c06b210 0x7f109c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:14.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.619+0000 7f10ba59c640 1 --2- 172.21.15.72:0/3951708615 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f109c06b210 0x7f109c06d6d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009b40 tx=0x7f10ac009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:14.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.622+0000 7f10b2ffd640 1 -- 172.21.15.72:0/3951708615 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f10b407d940 con 0x7f10bc150460 2023-12-13T00:28:14.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:14.856+0000 7f10b2ffd640 1 -- 172.21.15.72:0/3951708615 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f10b4079c80 con 0x7f10bc150460 2023-12-13T00:28:15.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.033+0000 7f10c0e9b640 1 -- 172.21.15.72:0/3951708615 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f10bc0c5900 con 0x7f109c06b210 2023-12-13T00:28:15.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.033+0000 7f10b2ffd640 1 -- 172.21.15.72:0/3951708615 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f10ac011a60 con 0x7f109c06b210 2023-12-13T00:28:15.033 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 0 to deep-scrub 2023-12-13T00:28:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.035+0000 7f10c0e9b640 1 -- 172.21.15.72:0/3951708615 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f109c06b210 msgr2=0x7f109c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.035+0000 7f10c0e9b640 1 --2- 172.21.15.72:0/3951708615 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f109c06b210 0x7f109c06d6d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009b40 tx=0x7f10ac009190 comp rx=0 tx=0).stop 2023-12-13T00:28:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.035+0000 7f10c0e9b640 1 -- 172.21.15.72:0/3951708615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10bc150460 msgr2=0x7f10bc1ee660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.035+0000 7f10c0e9b640 1 --2- 172.21.15.72:0/3951708615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10bc150460 0x7f10bc1ee660 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0c8040 tx=0x7f10b4004a40 comp rx=0 tx=0).stop 2023-12-13T00:28:15.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.035+0000 7f10c0e9b640 1 -- 172.21.15.72:0/3951708615 shutdown_connections 2023-12-13T00:28:15.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.035+0000 7f10c0e9b640 1 --2- 172.21.15.72:0/3951708615 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f109c06b210 0x7f109c06d6d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.035+0000 7f10c0e9b640 1 --2- 172.21.15.72:0/3951708615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10bc150460 0x7f10bc1ee660 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.035+0000 7f10c0e9b640 1 --2- 172.21.15.72:0/3951708615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10bc0c4aa0 0x7f10bc1ee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.035+0000 7f10c0e9b640 1 --2- 172.21.15.72:0/3951708615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10bc0c46c0 0x7f10bc1df500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.035+0000 7f10c0e9b640 1 -- 172.21.15.72:0/3951708615 >> 172.21.15.72:0/3951708615 conn(0x7f10bc06c5f0 msgr2=0x7f10bc0c50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:15.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.035+0000 7f10c0e9b640 1 -- 172.21.15.72:0/3951708615 shutdown_connections 2023-12-13T00:28:15.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.035+0000 7f10c0e9b640 1 -- 172.21.15.72:0/3951708615 wait complete. 2023-12-13T00:28:15.046 INFO:tasks.ceph:Scrubbing osd.1 2023-12-13T00:28:15.047 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-13T00:28:15.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.151+0000 7f0babb4c640 1 Processor -- start 2023-12-13T00:28:15.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.151+0000 7f0babb4c640 1 -- start start 2023-12-13T00:28:15.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.152+0000 7f0babb4c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ba40cb520 0x7f0ba4159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.152+0000 7f0babb4c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0ba40c8270 0x7f0ba40c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.152+0000 7f0babb4c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba40c8c00 con 0x7f0ba40cb900 2023-12-13T00:28:15.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.152+0000 7f0babb4c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba40c6e40 con 0x7f0ba40c8270 2023-12-13T00:28:15.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.152+0000 7f0babb4c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba415d430 con 0x7f0ba40cb520 2023-12-13T00:28:15.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.152+0000 7f0ba90e7640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0ba40cb900 0x7f0ba415cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:32986/0 (socket says 172.21.15.72:32986) 2023-12-13T00:28:15.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.152+0000 7f0ba90e7640 1 -- 172.21.15.72:0/3180206571 learned_addr learned my addr 172.21.15.72:0/3180206571 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:28:15.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.152+0000 7f0baa0e9640 1 --2- 172.21.15.72:0/3180206571 >> v2:172.21.15.176:3300/0 conn(0x7f0ba40c8270 0x7f0ba40c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.152+0000 7f0ba98e8640 1 --2- 172.21.15.72:0/3180206571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ba40cb520 0x7f0ba4159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.154+0000 7f0ba88e6640 1 -- 172.21.15.72:0/3180206571 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598522912 0 0) 0x7f0ba40c8c00 con 0x7f0ba40cb900 2023-12-13T00:28:15.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.154+0000 7f0ba88e6640 1 -- 172.21.15.72:0/3180206571 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b90003520 con 0x7f0ba40cb900 2023-12-13T00:28:15.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.155+0000 7f0baa0e9640 1 -- 172.21.15.72:0/3180206571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ba40cb520 msgr2=0x7f0ba4159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:15.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.155+0000 7f0baa0e9640 1 --2- 172.21.15.72:0/3180206571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ba40cb520 0x7f0ba4159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.155+0000 7f0baa0e9640 1 -- 172.21.15.72:0/3180206571 >> v1:172.21.15.72:6789/0 conn(0x7f0ba40cb900 legacy=0x7f0ba415cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.155+0000 7f0baa0e9640 1 -- 172.21.15.72:0/3180206571 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba415d710 con 0x7f0ba40c8270 2023-12-13T00:28:15.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.157+0000 7f0baa0e9640 1 --2- 172.21.15.72:0/3180206571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ba40c8270 0x7f0ba40c86c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009d90 tx=0x7f0b9c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cab536d15389c38 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.161+0000 7f0ba88e6640 1 -- 172.21.15.72:0/3180206571 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c02cbc0 con 0x7f0ba40c8270 2023-12-13T00:28:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.161+0000 7f0ba88e6640 1 -- 172.21.15.72:0/3180206571 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9c02cd20 con 0x7f0ba40c8270 2023-12-13T00:28:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.161+0000 7f0ba88e6640 1 -- 172.21.15.72:0/3180206571 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c034660 con 0x7f0ba40c8270 2023-12-13T00:28:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.161+0000 7f0babb4c640 1 -- 172.21.15.72:0/3180206571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ba40c8270 msgr2=0x7f0ba40c86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.161+0000 7f0babb4c640 1 --2- 172.21.15.72:0/3180206571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ba40c8270 0x7f0ba40c86c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009d90 tx=0x7f0b9c02be10 comp rx=0 tx=0).stop 2023-12-13T00:28:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.161+0000 7f0babb4c640 1 -- 172.21.15.72:0/3180206571 shutdown_connections 2023-12-13T00:28:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.161+0000 7f0babb4c640 1 --2- 172.21.15.72:0/3180206571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ba40c8270 0x7f0ba40c86c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.161+0000 7f0babb4c640 1 --2- 172.21.15.72:0/3180206571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ba40cb520 0x7f0ba4159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.161+0000 7f0babb4c640 1 -- 172.21.15.72:0/3180206571 >> 172.21.15.72:0/3180206571 conn(0x7f0ba406d170 msgr2=0x7f0ba406d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.162+0000 7f0babb4c640 1 -- 172.21.15.72:0/3180206571 shutdown_connections 2023-12-13T00:28:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.162+0000 7f0babb4c640 1 -- 172.21.15.72:0/3180206571 wait complete. 2023-12-13T00:28:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.163+0000 7f0babb4c640 1 Processor -- start 2023-12-13T00:28:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.163+0000 7f0babb4c640 1 -- start start 2023-12-13T00:28:15.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.163+0000 7f0babb4c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ba40c8270 0x7f0ba4157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.163+0000 7f0babb4c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ba40cb520 0x7f0ba414d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.163+0000 7f0babb4c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba40cb900 0x7f0ba414d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.163+0000 7f0babb4c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba414cfb0 con 0x7f0ba40cb900 2023-12-13T00:28:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.163+0000 7f0babb4c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba4158860 con 0x7f0ba40cb520 2023-12-13T00:28:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.163+0000 7f0babb4c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba414c680 con 0x7f0ba40c8270 2023-12-13T00:28:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.164+0000 7f0baa0e9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba40cb900 0x7f0ba414d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.164+0000 7f0ba90e7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ba40cb520 0x7f0ba414d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.164+0000 7f0ba98e8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ba40c8270 0x7f0ba4157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.164+0000 7f0baa0e9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba40cb900 0x7f0ba414d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51482/0 (socket says 172.21.15.72:51482) 2023-12-13T00:28:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.164+0000 7f0baa0e9640 1 -- 172.21.15.72:0/216098375 learned_addr learned my addr 172.21.15.72:0/216098375 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.167+0000 7f0baa0e9640 1 -- 172.21.15.72:0/216098375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ba40c8270 msgr2=0x7f0ba4157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.167+0000 7f0baa0e9640 1 --2- 172.21.15.72:0/216098375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ba40c8270 0x7f0ba4157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.167+0000 7f0baa0e9640 1 -- 172.21.15.72:0/216098375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ba40cb520 msgr2=0x7f0ba414d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.167+0000 7f0baa0e9640 1 --2- 172.21.15.72:0/216098375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ba40cb520 0x7f0ba414d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.167+0000 7f0baa0e9640 1 -- 172.21.15.72:0/216098375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c009a70 con 0x7f0ba40cb900 2023-12-13T00:28:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.170+0000 7f0baa0e9640 1 --2- 172.21.15.72:0/216098375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba40cb900 0x7f0ba414d980 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009d90 tx=0x7f0b9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.172+0000 7f0b9a7fc640 1 -- 172.21.15.72:0/216098375 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c040650 con 0x7f0ba40cb900 2023-12-13T00:28:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.172+0000 7f0babb4c640 1 -- 172.21.15.72:0/216098375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba414c960 con 0x7f0ba40cb900 2023-12-13T00:28:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.172+0000 7f0babb4c640 1 -- 172.21.15.72:0/216098375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba4158b40 con 0x7f0ba40cb900 2023-12-13T00:28:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.172+0000 7f0babb4c640 1 -- 172.21.15.72:0/216098375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ba414ce20 con 0x7f0ba40cb900 2023-12-13T00:28:15.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.173+0000 7f0b9a7fc640 1 -- 172.21.15.72:0/216098375 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba414ce20 con 0x7f0ba40cb900 2023-12-13T00:28:15.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.173+0000 7f0b9a7fc640 1 -- 172.21.15.72:0/216098375 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c0409b0 con 0x7f0ba40cb900 2023-12-13T00:28:15.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.194+0000 7f0b9a7fc640 1 -- 172.21.15.72:0/216098375 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0b9c040b10 con 0x7f0ba40cb900 2023-12-13T00:28:15.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.194+0000 7f0b9a7fc640 1 --2- 172.21.15.72:0/216098375 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0b8806b1f0 0x7f0b8806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.194+0000 7f0ba98e8640 1 --2- 172.21.15.72:0/216098375 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0b8806b1f0 0x7f0b8806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.195+0000 7f0ba98e8640 1 --2- 172.21.15.72:0/216098375 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0b8806b1f0 0x7f0b8806d6b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009b40 tx=0x7f0ba0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:15.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.197+0000 7f0b9a7fc640 1 -- 172.21.15.72:0/216098375 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f0b9c07b4a0 con 0x7f0ba40cb900 2023-12-13T00:28:15.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.197+0000 7f0b9a7fc640 1 --2- 172.21.15.72:0/216098375 >> [v2:172.21.15.72:6826/602713131,v1:172.21.15.72:6827/602713131] conn(0x7f0b880748d0 0x7f0b88076d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.197+0000 7f0b9a7fc640 1 -- 172.21.15.72:0/216098375 --> [v2:172.21.15.72:6826/602713131,v1:172.21.15.72:6827/602713131] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0b88077440 con 0x7f0b880748d0 2023-12-13T00:28:15.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.197+0000 7f0b9a7fc640 1 -- 172.21.15.72:0/216098375 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b9c0777e0 con 0x7f0ba40cb900 2023-12-13T00:28:15.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.198+0000 7f0ba90e7640 1 --2- 172.21.15.72:0/216098375 >> [v2:172.21.15.72:6826/602713131,v1:172.21.15.72:6827/602713131] conn(0x7f0b880748d0 0x7f0b88076d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.198+0000 7f0ba90e7640 1 --2- 172.21.15.72:0/216098375 >> [v2:172.21.15.72:6826/602713131,v1:172.21.15.72:6827/602713131] conn(0x7f0b880748d0 0x7f0b88076d70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:15.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.198+0000 7f0b9a7fc640 1 -- 172.21.15.72:0/216098375 <== osd.1 v2:172.21.15.72:6826/602713131 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0b88077440 con 0x7f0b880748d0 2023-12-13T00:28:15.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.211+0000 7f0babb4c640 1 -- 172.21.15.72:0/216098375 --> [v2:172.21.15.72:6826/602713131,v1:172.21.15.72:6827/602713131] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0ba40c6a60 con 0x7f0b880748d0 2023-12-13T00:28:15.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.212+0000 7f0b9a7fc640 1 -- 172.21.15.72:0/216098375 <== osd.1 v2:172.21.15.72:6826/602713131 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0b940014b0 con 0x7f0b880748d0 2023-12-13T00:28:15.212 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-12-13T00:28:15.212 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-13T00:28:15.212 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-12-13T00:28:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.212+0000 7f0babb4c640 1 -- 172.21.15.72:0/216098375 >> [v2:172.21.15.72:6826/602713131,v1:172.21.15.72:6827/602713131] conn(0x7f0b880748d0 msgr2=0x7f0b88076d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.212+0000 7f0babb4c640 1 --2- 172.21.15.72:0/216098375 >> [v2:172.21.15.72:6826/602713131,v1:172.21.15.72:6827/602713131] conn(0x7f0b880748d0 0x7f0b88076d70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.212+0000 7f0babb4c640 1 -- 172.21.15.72:0/216098375 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0b8806b1f0 msgr2=0x7f0b8806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.212+0000 7f0babb4c640 1 --2- 172.21.15.72:0/216098375 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f0b8806b1f0 0x7f0b8806d6b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009b40 tx=0x7f0ba0009190 comp rx=0 tx=0).stop 2023-12-13T00:28:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.212+0000 7f0babb4c640 1 -- 172.21.15.72:0/216098375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba40cb900 msgr2=0x7f0ba414d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.212+0000 7f0babb4c640 1 --2- 172.21.15.72:0/216098375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba40cb900 0x7f0ba414d980 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009d90 tx=0x7f0b9c004a40 comp rx=0 tx=0).stop 2023-12-13T00:28:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.212+0000 7f0baa0e9640 1 -- 172.21.15.72:0/216098375 reap_dead start 2023-12-13T00:28:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.212+0000 7f0babb4c640 1 -- 172.21.15.72:0/216098375 shutdown_connections 2023-12-13T00:28:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.212+0000 7f0babb4c640 1 -- 172.21.15.72:0/216098375 >> 172.21.15.72:0/216098375 conn(0x7f0ba406d170 msgr2=0x7f0ba406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.212+0000 7f0babb4c640 1 -- 172.21.15.72:0/216098375 shutdown_connections 2023-12-13T00:28:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.212+0000 7f0babb4c640 1 -- 172.21.15.72:0/216098375 wait complete. 2023-12-13T00:28:15.222 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-13T00:28:15.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.322+0000 7fab0d41e640 1 Processor -- start 2023-12-13T00:28:15.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.323+0000 7fab0d41e640 1 -- start start 2023-12-13T00:28:15.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.323+0000 7fab0d41e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab080cda70 0x7fab080ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.323+0000 7fab0d41e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fab080cc420 0x7fab08159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.323+0000 7fab0d41e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fab08159b50 0x7fab080c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.323+0000 7fab0d41e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab080cc230 con 0x7fab080cc420 2023-12-13T00:28:15.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.323+0000 7fab0d41e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab080cbda0 con 0x7fab08159b50 2023-12-13T00:28:15.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.323+0000 7fab0d41e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab080cb4e0 con 0x7fab080cda70 2023-12-13T00:28:15.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.324+0000 7fab067fc640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fab080cc420 0x7fab08159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.324+0000 7fab077fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fab08159b50 0x7fab080c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.324+0000 7fab06ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab080cda70 0x7fab080ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.324+0000 7fab077fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fab08159b50 0x7fab080c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:45204/0 (socket says 172.21.15.72:45204) 2023-12-13T00:28:15.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.324+0000 7fab077fe640 1 -- 172.21.15.72:0/2619202154 learned_addr learned my addr 172.21.15.72:0/2619202154 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:15.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.326+0000 7fab077fe640 1 -- 172.21.15.72:0/2619202154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab080cda70 msgr2=0x7fab080ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:15.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.326+0000 7fab077fe640 1 --2- 172.21.15.72:0/2619202154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab080cda70 0x7fab080ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.326+0000 7fab077fe640 1 -- 172.21.15.72:0/2619202154 >> v2:172.21.15.72:3300/0 conn(0x7fab080cc420 msgr2=0x7fab08159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:15.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.326+0000 7fab077fe640 1 --2- 172.21.15.72:0/2619202154 >> v2:172.21.15.72:3300/0 conn(0x7fab080cc420 0x7fab08159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.326+0000 7fab077fe640 1 -- 172.21.15.72:0/2619202154 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab080cce00 con 0x7fab08159b50 2023-12-13T00:28:15.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.328+0000 7fab077fe640 1 --2- 172.21.15.72:0/2619202154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab08159b50 0x7fab080c9620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fab0806a7f0 tx=0x7fab0002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66c7fdf58cc5bb23 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:15.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.332+0000 7fab05ffb640 1 -- 172.21.15.72:0/2619202154 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab00030860 con 0x7fab08159b50 2023-12-13T00:28:15.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.332+0000 7fab05ffb640 1 -- 172.21.15.72:0/2619202154 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab000309c0 con 0x7fab08159b50 2023-12-13T00:28:15.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.332+0000 7fab05ffb640 1 -- 172.21.15.72:0/2619202154 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab00030d50 con 0x7fab08159b50 2023-12-13T00:28:15.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.333+0000 7fab0d41e640 1 -- 172.21.15.72:0/2619202154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab08159b50 msgr2=0x7fab080c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.333+0000 7fab0d41e640 1 --2- 172.21.15.72:0/2619202154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab08159b50 0x7fab080c9620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fab0806a7f0 tx=0x7fab0002b9a0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.333+0000 7fab0d41e640 1 -- 172.21.15.72:0/2619202154 shutdown_connections 2023-12-13T00:28:15.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.333+0000 7fab0d41e640 1 --2- 172.21.15.72:0/2619202154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab08159b50 0x7fab080c9620 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.333+0000 7fab0d41e640 1 --2- 172.21.15.72:0/2619202154 >> v2:172.21.15.72:3300/0 conn(0x7fab080cc420 0x7fab08159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.333+0000 7fab0d41e640 1 --2- 172.21.15.72:0/2619202154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab080cda70 0x7fab080ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.333+0000 7fab0d41e640 1 -- 172.21.15.72:0/2619202154 >> 172.21.15.72:0/2619202154 conn(0x7fab080b07b0 msgr2=0x7fab080b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:15.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.333+0000 7fab0d41e640 1 -- 172.21.15.72:0/2619202154 shutdown_connections 2023-12-13T00:28:15.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.333+0000 7fab0d41e640 1 -- 172.21.15.72:0/2619202154 wait complete. 2023-12-13T00:28:15.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.334+0000 7fab0d41e640 1 Processor -- start 2023-12-13T00:28:15.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.335+0000 7fab0d41e640 1 -- start start 2023-12-13T00:28:15.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.335+0000 7fab0d41e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab080cc420 0x7fab081e5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.335+0000 7fab0d41e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab080cda70 0x7fab081f07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.335+0000 7fab0d41e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab08159b50 0x7fab081f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.335+0000 7fab0d41e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab080b1e00 con 0x7fab080cc420 2023-12-13T00:28:15.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.335+0000 7fab0d41e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab08158990 con 0x7fab08159b50 2023-12-13T00:28:15.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.335+0000 7fab0d41e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab081f25c0 con 0x7fab080cda70 2023-12-13T00:28:15.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.336+0000 7fab06ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab080cc420 0x7fab081e5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.336+0000 7fab077fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab08159b50 0x7fab081f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.336+0000 7fab067fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab080cda70 0x7fab081f07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.336+0000 7fab06ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab080cc420 0x7fab081e5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51508/0 (socket says 172.21.15.72:51508) 2023-12-13T00:28:15.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.336+0000 7fab06ffd640 1 -- 172.21.15.72:0/755574278 learned_addr learned my addr 172.21.15.72:0/755574278 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:15.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.340+0000 7fab077fe640 1 -- 172.21.15.72:0/755574278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab080cda70 msgr2=0x7fab081f07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.340+0000 7fab077fe640 1 --2- 172.21.15.72:0/755574278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab080cda70 0x7fab081f07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.340+0000 7fab077fe640 1 -- 172.21.15.72:0/755574278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab080cc420 msgr2=0x7fab081e5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.340+0000 7fab077fe640 1 --2- 172.21.15.72:0/755574278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab080cc420 0x7fab081e5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.340+0000 7fab077fe640 1 -- 172.21.15.72:0/755574278 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab000094d0 con 0x7fab08159b50 2023-12-13T00:28:15.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.340+0000 7fab06ffd640 1 --2- 172.21.15.72:0/755574278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab080cc420 0x7fab081e5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T00:28:15.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.342+0000 7fab077fe640 1 --2- 172.21.15.72:0/755574278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab08159b50 0x7fab081f0cf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fab00033000 tx=0x7fab00004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:15.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.345+0000 7faaef7fe640 1 -- 172.21.15.72:0/755574278 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab00039a10 con 0x7fab08159b50 2023-12-13T00:28:15.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.345+0000 7faaef7fe640 1 -- 172.21.15.72:0/755574278 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab00039b90 con 0x7fab08159b50 2023-12-13T00:28:15.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.345+0000 7faaef7fe640 1 -- 172.21.15.72:0/755574278 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab00043410 con 0x7fab08159b50 2023-12-13T00:28:15.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.345+0000 7fab0d41e640 1 -- 172.21.15.72:0/755574278 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab081f28a0 con 0x7fab08159b50 2023-12-13T00:28:15.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.346+0000 7fab0d41e640 1 -- 172.21.15.72:0/755574278 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab081f2e60 con 0x7fab08159b50 2023-12-13T00:28:15.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.346+0000 7fab0d41e640 1 -- 172.21.15.72:0/755574278 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab08067470 con 0x7fab08159b50 2023-12-13T00:28:15.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.591+0000 7faaef7fe640 1 -- 172.21.15.72:0/755574278 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fab0002f3b0 con 0x7fab08159b50 2023-12-13T00:28:15.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.591+0000 7faaef7fe640 1 --2- 172.21.15.72:0/755574278 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faaf406b1f0 0x7faaf406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.592+0000 7fab06ffd640 1 --2- 172.21.15.72:0/755574278 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faaf406b1f0 0x7faaf406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.592+0000 7fab06ffd640 1 --2- 172.21.15.72:0/755574278 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faaf406b1f0 0x7faaf406d6b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009a40 tx=0x7faaf800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:15.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.595+0000 7faaef7fe640 1 -- 172.21.15.72:0/755574278 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fab0007a7d0 con 0x7fab08159b50 2023-12-13T00:28:15.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.606+0000 7faaef7fe640 1 -- 172.21.15.72:0/755574278 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fab00076b10 con 0x7fab08159b50 2023-12-13T00:28:15.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.775+0000 7fab0d41e640 1 -- 172.21.15.72:0/755574278 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fab080cba30 con 0x7faaf406b1f0 2023-12-13T00:28:15.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.776+0000 7faaef7fe640 1 -- 172.21.15.72:0/755574278 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faaf800f040 con 0x7faaf406b1f0 2023-12-13T00:28:15.775 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 1 to deep-scrub 2023-12-13T00:28:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.777+0000 7fab0d41e640 1 -- 172.21.15.72:0/755574278 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faaf406b1f0 msgr2=0x7faaf406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.777+0000 7fab0d41e640 1 --2- 172.21.15.72:0/755574278 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faaf406b1f0 0x7faaf406d6b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009a40 tx=0x7faaf800b040 comp rx=0 tx=0).stop 2023-12-13T00:28:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.777+0000 7fab0d41e640 1 -- 172.21.15.72:0/755574278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab08159b50 msgr2=0x7fab081f0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.777+0000 7fab0d41e640 1 --2- 172.21.15.72:0/755574278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab08159b50 0x7fab081f0cf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fab00033000 tx=0x7fab00004730 comp rx=0 tx=0).stop 2023-12-13T00:28:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.778+0000 7fab0d41e640 1 -- 172.21.15.72:0/755574278 shutdown_connections 2023-12-13T00:28:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.778+0000 7fab0d41e640 1 --2- 172.21.15.72:0/755574278 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faaf406b1f0 0x7faaf406d6b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.778+0000 7fab0d41e640 1 --2- 172.21.15.72:0/755574278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab08159b50 0x7fab081f0cf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.778+0000 7fab0d41e640 1 --2- 172.21.15.72:0/755574278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab080cda70 0x7fab081f07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.778+0000 7fab0d41e640 1 --2- 172.21.15.72:0/755574278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab080cc420 0x7fab081e5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.778+0000 7fab0d41e640 1 -- 172.21.15.72:0/755574278 >> 172.21.15.72:0/755574278 conn(0x7fab080b07b0 msgr2=0x7fab080c6030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.778+0000 7fab0d41e640 1 -- 172.21.15.72:0/755574278 shutdown_connections 2023-12-13T00:28:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.778+0000 7fab0d41e640 1 -- 172.21.15.72:0/755574278 wait complete. 2023-12-13T00:28:15.789 INFO:tasks.ceph:Scrubbing osd.2 2023-12-13T00:28:15.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-13T00:28:15.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.895+0000 7f4410856640 1 Processor -- start 2023-12-13T00:28:15.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.895+0000 7f4410856640 1 -- start start 2023-12-13T00:28:15.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.896+0000 7f4410856640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f440c153730 0x7f440c06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.896+0000 7f4410856640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440c06f090 con 0x7f440c0c91d0 2023-12-13T00:28:15.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.896+0000 7f4410856640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440c153b10 con 0x7f440c15a0c0 2023-12-13T00:28:15.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.896+0000 7f4410856640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440c0c38f0 con 0x7f440c153730 2023-12-13T00:28:15.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.896+0000 7f440ad9d640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f440c15a0c0 0x7f440c0ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:43732/0 (socket says 172.21.15.72:43732) 2023-12-13T00:28:15.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.896+0000 7f440ad9d640 1 -- 172.21.15.72:0/3891687214 learned_addr learned my addr 172.21.15.72:0/3891687214 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:28:15.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.897+0000 7f440a59c640 1 --2- 172.21.15.72:0/3891687214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f440c153730 0x7f440c06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.899+0000 7f440a59c640 1 -- 172.21.15.72:0/3891687214 >> v1:172.21.15.176:6789/0 conn(0x7f440c15a0c0 legacy=0x7f440c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.899+0000 7f440a59c640 1 -- 172.21.15.72:0/3891687214 >> v1:172.21.15.72:6789/0 conn(0x7f440c0c91d0 legacy=0x7f440c0c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:15.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.899+0000 7f440a59c640 1 -- 172.21.15.72:0/3891687214 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440c0c3330 con 0x7f440c153730 2023-12-13T00:28:15.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.901+0000 7f440a59c640 1 --2- 172.21.15.72:0/3891687214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f440c153730 0x7f440c06eb50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0097d0 tx=0x7f43fc02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f35799fcab22843b server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:15.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.905+0000 7f4409d9b640 1 -- 172.21.15.72:0/3891687214 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc031890 con 0x7f440c153730 2023-12-13T00:28:15.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.905+0000 7f4409d9b640 1 -- 172.21.15.72:0/3891687214 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43fc0319f0 con 0x7f440c153730 2023-12-13T00:28:15.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.905+0000 7f4409d9b640 1 -- 172.21.15.72:0/3891687214 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc031d80 con 0x7f440c153730 2023-12-13T00:28:15.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.906+0000 7f4410856640 1 -- 172.21.15.72:0/3891687214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f440c153730 msgr2=0x7f440c06eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.906+0000 7f4410856640 1 --2- 172.21.15.72:0/3891687214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f440c153730 0x7f440c06eb50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0097d0 tx=0x7f43fc02b930 comp rx=0 tx=0).stop 2023-12-13T00:28:15.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.906+0000 7f4410856640 1 -- 172.21.15.72:0/3891687214 shutdown_connections 2023-12-13T00:28:15.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.906+0000 7f4410856640 1 --2- 172.21.15.72:0/3891687214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f440c153730 0x7f440c06eb50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.906+0000 7f4410856640 1 -- 172.21.15.72:0/3891687214 >> 172.21.15.72:0/3891687214 conn(0x7f440c0707f0 msgr2=0x7f440c070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:15.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.906+0000 7f4410856640 1 -- 172.21.15.72:0/3891687214 shutdown_connections 2023-12-13T00:28:15.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.906+0000 7f4410856640 1 -- 172.21.15.72:0/3891687214 wait complete. 2023-12-13T00:28:15.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.907+0000 7f4410856640 1 Processor -- start 2023-12-13T00:28:15.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.907+0000 7f4410856640 1 -- start start 2023-12-13T00:28:15.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.908+0000 7f4410856640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f440c0c91d0 0x7f440c14c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.908+0000 7f4410856640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f440c153730 0x7f440c14c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.908+0000 7f4410856640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f440c15a0c0 0x7f440c14f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.908+0000 7f4410856640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c153cc0 con 0x7f440c153730 2023-12-13T00:28:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.908+0000 7f4410856640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c1593a0 con 0x7f440c0c91d0 2023-12-13T00:28:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.908+0000 7f4410856640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440c1efbe0 con 0x7f440c15a0c0 2023-12-13T00:28:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.908+0000 7f440ad9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f440c15a0c0 0x7f440c14f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.908+0000 7f440a59c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f440c0c91d0 0x7f440c14c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.909+0000 7f440a59c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f440c0c91d0 0x7f440c14c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:45222/0 (socket says 172.21.15.72:45222) 2023-12-13T00:28:15.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.909+0000 7f440a59c640 1 -- 172.21.15.72:0/1418859645 learned_addr learned my addr 172.21.15.72:0/1418859645 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:15.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.912+0000 7f440a59c640 1 -- 172.21.15.72:0/1418859645 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f440c15a0c0 msgr2=0x7f440c14f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.912+0000 7f440a59c640 1 --2- 172.21.15.72:0/1418859645 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f440c15a0c0 0x7f440c14f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.912+0000 7f440a59c640 1 -- 172.21.15.72:0/1418859645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f440c153730 msgr2=0x7f440c14c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.912+0000 7f440a59c640 1 --2- 172.21.15.72:0/1418859645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f440c153730 0x7f440c14c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.912+0000 7f440a59c640 1 -- 172.21.15.72:0/1418859645 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc009400 con 0x7f440c0c91d0 2023-12-13T00:28:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.915+0000 7f440a59c640 1 --2- 172.21.15.72:0/1418859645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f440c0c91d0 0x7f440c14c1a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0098f0 tx=0x7f43fc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:15.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.917+0000 7f4402ffd640 1 -- 172.21.15.72:0/1418859645 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc031830 con 0x7f440c0c91d0 2023-12-13T00:28:15.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.917+0000 7f4410856640 1 -- 172.21.15.72:0/1418859645 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f440c153f10 con 0x7f440c0c91d0 2023-12-13T00:28:15.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.917+0000 7f4410856640 1 -- 172.21.15.72:0/1418859645 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440c154a70 con 0x7f440c0c91d0 2023-12-13T00:28:15.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.918+0000 7f4410856640 1 -- 172.21.15.72:0/1418859645 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f440c1598c0 con 0x7f440c0c91d0 2023-12-13T00:28:15.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.918+0000 7f4402ffd640 1 -- 172.21.15.72:0/1418859645 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43fc04e450 con 0x7f440c0c91d0 2023-12-13T00:28:15.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.919+0000 7f4402ffd640 1 -- 172.21.15.72:0/1418859645 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc04e7c0 con 0x7f440c0c91d0 2023-12-13T00:28:15.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.950+0000 7f4402ffd640 1 -- 172.21.15.72:0/1418859645 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f43fc04e920 con 0x7f440c0c91d0 2023-12-13T00:28:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.950+0000 7f4402ffd640 1 --2- 172.21.15.72:0/1418859645 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f43ec06b1f0 0x7f43ec06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.951+0000 7f4403fff640 1 --2- 172.21.15.72:0/1418859645 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f43ec06b1f0 0x7f43ec06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.951+0000 7f4403fff640 1 --2- 172.21.15.72:0/1418859645 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f43ec06b1f0 0x7f43ec06d6b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f440c0c3b20 tx=0x7f43f4007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.958+0000 7f4402ffd640 1 -- 172.21.15.72:0/1418859645 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f43fc07b8b0 con 0x7f440c0c91d0 2023-12-13T00:28:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.958+0000 7f4402ffd640 1 --2- 172.21.15.72:0/1418859645 >> [v2:172.21.15.72:6802/1644978744,v1:172.21.15.72:6803/1644978744] conn(0x7f43ec0748d0 0x7f43ec076d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:15.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.958+0000 7f4402ffd640 1 -- 172.21.15.72:0/1418859645 --> [v2:172.21.15.72:6802/1644978744,v1:172.21.15.72:6803/1644978744] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f43ec077440 con 0x7f43ec0748d0 2023-12-13T00:28:15.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.958+0000 7f440ad9d640 1 --2- 172.21.15.72:0/1418859645 >> [v2:172.21.15.72:6802/1644978744,v1:172.21.15.72:6803/1644978744] conn(0x7f43ec0748d0 0x7f43ec076d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:15.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.958+0000 7f440ad9d640 1 --2- 172.21.15.72:0/1418859645 >> [v2:172.21.15.72:6802/1644978744,v1:172.21.15.72:6803/1644978744] conn(0x7f43ec0748d0 0x7f43ec076d70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:15.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.959+0000 7f4402ffd640 1 -- 172.21.15.72:0/1418859645 <== osd.2 v2:172.21.15.72:6802/1644978744 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f43ec077440 con 0x7f43ec0748d0 2023-12-13T00:28:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.971+0000 7f4410856640 1 -- 172.21.15.72:0/1418859645 --> [v2:172.21.15.72:6802/1644978744,v1:172.21.15.72:6803/1644978744] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f440c1595e0 con 0x7f43ec0748d0 2023-12-13T00:28:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.972+0000 7f4402ffd640 1 -- 172.21.15.72:0/1418859645 <== osd.2 v2:172.21.15.72:6802/1644978744 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4404001e60 con 0x7f43ec0748d0 2023-12-13T00:28:15.972 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-12-13T00:28:15.972 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-13T00:28:15.972 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-12-13T00:28:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.972+0000 7f4410856640 1 -- 172.21.15.72:0/1418859645 >> [v2:172.21.15.72:6802/1644978744,v1:172.21.15.72:6803/1644978744] conn(0x7f43ec0748d0 msgr2=0x7f43ec076d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.972+0000 7f4410856640 1 --2- 172.21.15.72:0/1418859645 >> [v2:172.21.15.72:6802/1644978744,v1:172.21.15.72:6803/1644978744] conn(0x7f43ec0748d0 0x7f43ec076d70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.972+0000 7f4410856640 1 -- 172.21.15.72:0/1418859645 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f43ec06b1f0 msgr2=0x7f43ec06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.972+0000 7f4410856640 1 --2- 172.21.15.72:0/1418859645 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f43ec06b1f0 0x7f43ec06d6b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f440c0c3b20 tx=0x7f43f4007990 comp rx=0 tx=0).stop 2023-12-13T00:28:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.972+0000 7f4410856640 1 -- 172.21.15.72:0/1418859645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f440c0c91d0 msgr2=0x7f440c14c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.972+0000 7f4410856640 1 --2- 172.21.15.72:0/1418859645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f440c0c91d0 0x7f440c14c1a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0098f0 tx=0x7f43fc0046c0 comp rx=0 tx=0).stop 2023-12-13T00:28:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.972+0000 7f440ad9d640 1 -- 172.21.15.72:0/1418859645 reap_dead start 2023-12-13T00:28:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.972+0000 7f4410856640 1 -- 172.21.15.72:0/1418859645 shutdown_connections 2023-12-13T00:28:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.972+0000 7f4410856640 1 -- 172.21.15.72:0/1418859645 >> 172.21.15.72:0/1418859645 conn(0x7f440c0707f0 msgr2=0x7f440c150ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.972+0000 7f4410856640 1 -- 172.21.15.72:0/1418859645 shutdown_connections 2023-12-13T00:28:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:15.972+0000 7f4410856640 1 -- 172.21.15.72:0/1418859645 wait complete. 2023-12-13T00:28:15.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-13T00:28:16.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.088+0000 7fe30867c640 1 Processor -- start 2023-12-13T00:28:16.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.088+0000 7fe30867c640 1 -- start start 2023-12-13T00:28:16.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.089+0000 7fe30867c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe300153620 0x7fe3000723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.089+0000 7fe30867c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe30006f1d0 0x7fe300159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.089+0000 7fe30867c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30006fe60 con 0x7fe3000c8370 2023-12-13T00:28:16.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.089+0000 7fe30867c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3000c2e00 con 0x7fe30006f1d0 2023-12-13T00:28:16.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.089+0000 7fe30867c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3001597d0 con 0x7fe300153620 2023-12-13T00:28:16.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.090+0000 7fe305c17640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe30006f1d0 0x7fe300159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.090+0000 7fe306c19640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe3000c8370 0x7fe30006a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:32994/0 (socket says 172.21.15.72:32994) 2023-12-13T00:28:16.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.090+0000 7fe306c19640 1 -- 172.21.15.72:0/1290750118 learned_addr learned my addr 172.21.15.72:0/1290750118 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:28:16.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.090+0000 7fe306418640 1 --2- 172.21.15.72:0/1290750118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe300153620 0x7fe3000723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.093+0000 7fe306418640 1 -- 172.21.15.72:0/1290750118 >> v2:172.21.15.72:3300/0 conn(0x7fe30006f1d0 msgr2=0x7fe300159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:16.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.093+0000 7fe306418640 1 --2- 172.21.15.72:0/1290750118 >> v2:172.21.15.72:3300/0 conn(0x7fe30006f1d0 0x7fe300159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.093+0000 7fe306418640 1 -- 172.21.15.72:0/1290750118 >> v1:172.21.15.72:6789/0 conn(0x7fe3000c8370 legacy=0x7fe30006a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.093+0000 7fe306418640 1 -- 172.21.15.72:0/1290750118 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3000c6a00 con 0x7fe300153620 2023-12-13T00:28:16.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.095+0000 7fe306418640 1 --2- 172.21.15.72:0/1290750118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe300153620 0x7fe3000723f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0097a0 tx=0x7fe2fc02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88ec5e9288baa5d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:16.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.098+0000 7fe305416640 1 -- 172.21.15.72:0/1290750118 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc02e070 con 0x7fe300153620 2023-12-13T00:28:16.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.098+0000 7fe305416640 1 -- 172.21.15.72:0/1290750118 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc0315a0 con 0x7fe300153620 2023-12-13T00:28:16.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.098+0000 7fe305416640 1 -- 172.21.15.72:0/1290750118 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc031930 con 0x7fe300153620 2023-12-13T00:28:16.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.099+0000 7fe30867c640 1 -- 172.21.15.72:0/1290750118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe300153620 msgr2=0x7fe3000723f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.099+0000 7fe30867c640 1 --2- 172.21.15.72:0/1290750118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe300153620 0x7fe3000723f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0097a0 tx=0x7fe2fc02b840 comp rx=0 tx=0).stop 2023-12-13T00:28:16.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.099+0000 7fe30867c640 1 -- 172.21.15.72:0/1290750118 shutdown_connections 2023-12-13T00:28:16.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.099+0000 7fe30867c640 1 --2- 172.21.15.72:0/1290750118 >> v2:172.21.15.72:3300/0 conn(0x7fe30006f1d0 0x7fe300159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.099+0000 7fe30867c640 1 --2- 172.21.15.72:0/1290750118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe300153620 0x7fe3000723f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.099+0000 7fe30867c640 1 -- 172.21.15.72:0/1290750118 >> 172.21.15.72:0/1290750118 conn(0x7fe30006b5c0 msgr2=0x7fe30006b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:16.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.099+0000 7fe30867c640 1 -- 172.21.15.72:0/1290750118 shutdown_connections 2023-12-13T00:28:16.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.099+0000 7fe30867c640 1 -- 172.21.15.72:0/1290750118 wait complete. 2023-12-13T00:28:16.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.100+0000 7fe30867c640 1 Processor -- start 2023-12-13T00:28:16.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.100+0000 7fe30867c640 1 -- start start 2023-12-13T00:28:16.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.101+0000 7fe30867c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe30006f1d0 0x7fe300148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.101+0000 7fe30867c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3000c8370 0x7fe3001507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.101+0000 7fe30867c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe300153620 0x7fe300150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.101+0000 7fe30867c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3000ca350 con 0x7fe30006f1d0 2023-12-13T00:28:16.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.101+0000 7fe30867c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe300150360 con 0x7fe3000c8370 2023-12-13T00:28:16.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.101+0000 7fe30867c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe300159210 con 0x7fe300153620 2023-12-13T00:28:16.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.102+0000 7fe306418640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe30006f1d0 0x7fe300148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.102+0000 7fe305c17640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3000c8370 0x7fe3001507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.102+0000 7fe306c19640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe300153620 0x7fe300150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.102+0000 7fe306418640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe30006f1d0 0x7fe300148b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51526/0 (socket says 172.21.15.72:51526) 2023-12-13T00:28:16.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.102+0000 7fe306418640 1 -- 172.21.15.72:0/539094043 learned_addr learned my addr 172.21.15.72:0/539094043 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.105+0000 7fe306418640 1 -- 172.21.15.72:0/539094043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe300153620 msgr2=0x7fe300150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.105+0000 7fe306418640 1 --2- 172.21.15.72:0/539094043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe300153620 0x7fe300150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.105+0000 7fe306418640 1 -- 172.21.15.72:0/539094043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3000c8370 msgr2=0x7fe3001507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.105+0000 7fe306418640 1 --2- 172.21.15.72:0/539094043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3000c8370 0x7fe3001507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.105+0000 7fe306418640 1 -- 172.21.15.72:0/539094043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2fc009400 con 0x7fe30006f1d0 2023-12-13T00:28:16.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.107+0000 7fe306418640 1 --2- 172.21.15.72:0/539094043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe30006f1d0 0x7fe300148b30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc034040 tx=0x7fe2fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.111+0000 7fe2f6ffd640 1 -- 172.21.15.72:0/539094043 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc032840 con 0x7fe30006f1d0 2023-12-13T00:28:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.111+0000 7fe2f6ffd640 1 -- 172.21.15.72:0/539094043 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc0329c0 con 0x7fe30006f1d0 2023-12-13T00:28:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.111+0000 7fe2f6ffd640 1 -- 172.21.15.72:0/539094043 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc032d70 con 0x7fe30006f1d0 2023-12-13T00:28:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.111+0000 7fe30867c640 1 -- 172.21.15.72:0/539094043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30014f510 con 0x7fe30006f1d0 2023-12-13T00:28:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.111+0000 7fe30867c640 1 -- 172.21.15.72:0/539094043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30014fad0 con 0x7fe30006f1d0 2023-12-13T00:28:16.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.112+0000 7fe30867c640 1 -- 172.21.15.72:0/539094043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe300073dc0 con 0x7fe30006f1d0 2023-12-13T00:28:16.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.357+0000 7fe2f6ffd640 1 -- 172.21.15.72:0/539094043 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe2fc04e430 con 0x7fe30006f1d0 2023-12-13T00:28:16.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.357+0000 7fe2f6ffd640 1 --2- 172.21.15.72:0/539094043 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe2e406b210 0x7fe2e406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.357+0000 7fe305c17640 1 --2- 172.21.15.72:0/539094043 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe2e406b210 0x7fe2e406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.358+0000 7fe305c17640 1 --2- 172.21.15.72:0/539094043 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe2e406b210 0x7fe2e406d6d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe3000c14e0 tx=0x7fe2f0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:16.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.387+0000 7fe2f6ffd640 1 -- 172.21.15.72:0/539094043 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fe2fc03ce20 con 0x7fe30006f1d0 2023-12-13T00:28:16.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.387+0000 7fe2f6ffd640 1 -- 172.21.15.72:0/539094043 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe2fc076a10 con 0x7fe30006f1d0 2023-12-13T00:28:16.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.560+0000 7fe30867c640 1 -- 172.21.15.72:0/539094043 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fe300159460 con 0x7fe2e406b210 2023-12-13T00:28:16.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.560+0000 7fe2f6ffd640 1 -- 172.21.15.72:0/539094043 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe2f0011a00 con 0x7fe2e406b210 2023-12-13T00:28:16.560 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 2 to deep-scrub 2023-12-13T00:28:16.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.562+0000 7fe30867c640 1 -- 172.21.15.72:0/539094043 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe2e406b210 msgr2=0x7fe2e406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.562+0000 7fe30867c640 1 --2- 172.21.15.72:0/539094043 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe2e406b210 0x7fe2e406d6d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe3000c14e0 tx=0x7fe2f0009190 comp rx=0 tx=0).stop 2023-12-13T00:28:16.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.562+0000 7fe30867c640 1 -- 172.21.15.72:0/539094043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe30006f1d0 msgr2=0x7fe300148b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.562+0000 7fe30867c640 1 --2- 172.21.15.72:0/539094043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe30006f1d0 0x7fe300148b30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc034040 tx=0x7fe2fc0046c0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.562+0000 7fe30867c640 1 -- 172.21.15.72:0/539094043 shutdown_connections 2023-12-13T00:28:16.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.562+0000 7fe30867c640 1 --2- 172.21.15.72:0/539094043 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fe2e406b210 0x7fe2e406d6d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.562+0000 7fe30867c640 1 --2- 172.21.15.72:0/539094043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe300153620 0x7fe300150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.562+0000 7fe30867c640 1 --2- 172.21.15.72:0/539094043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3000c8370 0x7fe3001507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.562+0000 7fe30867c640 1 --2- 172.21.15.72:0/539094043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe30006f1d0 0x7fe300148b30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.562+0000 7fe30867c640 1 -- 172.21.15.72:0/539094043 >> 172.21.15.72:0/539094043 conn(0x7fe30006b5c0 msgr2=0x7fe30006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:16.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.562+0000 7fe30867c640 1 -- 172.21.15.72:0/539094043 shutdown_connections 2023-12-13T00:28:16.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.562+0000 7fe30867c640 1 -- 172.21.15.72:0/539094043 wait complete. 2023-12-13T00:28:16.573 INFO:tasks.ceph:Scrubbing osd.3 2023-12-13T00:28:16.573 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-13T00:28:16.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.677+0000 7f1ff8725640 1 Processor -- start 2023-12-13T00:28:16.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.677+0000 7f1ff8725640 1 -- start start 2023-12-13T00:28:16.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.678+0000 7f1ff8725640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1ff014fba0 0x7f1ff00c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.678+0000 7f1ff8725640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff006e480 0x7f1ff006e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.678+0000 7f1ff8725640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff00c1ba0 con 0x7f1ff014ff80 2023-12-13T00:28:16.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.678+0000 7f1ff8725640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff00c3c20 con 0x7f1ff014fba0 2023-12-13T00:28:16.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.678+0000 7f1ff8725640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff00c3f00 con 0x7f1ff006e480 2023-12-13T00:28:16.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.679+0000 7f1ff6cc2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff006e480 0x7f1ff006e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.679+0000 7f1ff5cc0640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f1ff014ff80 0x7f1ff00c12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:41030/0 (socket says 172.21.15.72:41030) 2023-12-13T00:28:16.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.679+0000 7f1ff5cc0640 1 -- 172.21.15.72:0/1772754665 learned_addr learned my addr 172.21.15.72:0/1772754665 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:28:16.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.679+0000 7f1ff64c1640 1 --2- 172.21.15.72:0/1772754665 >> v2:172.21.15.176:3300/0 conn(0x7f1ff014fba0 0x7f1ff00c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.681+0000 7f1ff6cc2640 1 -- 172.21.15.72:0/1772754665 >> v2:172.21.15.176:3300/0 conn(0x7f1ff014fba0 msgr2=0x7f1ff00c1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:16.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.681+0000 7f1ff6cc2640 1 --2- 172.21.15.72:0/1772754665 >> v2:172.21.15.176:3300/0 conn(0x7f1ff014fba0 0x7f1ff00c1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.681+0000 7f1ff6cc2640 1 -- 172.21.15.72:0/1772754665 >> v1:172.21.15.176:6789/0 conn(0x7f1ff014ff80 legacy=0x7f1ff00c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.681+0000 7f1ff6cc2640 1 -- 172.21.15.72:0/1772754665 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff00c41e0 con 0x7f1ff006e480 2023-12-13T00:28:16.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.683+0000 7f1ff6cc2640 1 --2- 172.21.15.72:0/1772754665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff006e480 0x7f1ff006e8f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80097a0 tx=0x7f1fe802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af551d3d3c936bab server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:16.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.687+0000 7f1ff54bf640 1 -- 172.21.15.72:0/1772754665 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8030610 con 0x7f1ff006e480 2023-12-13T00:28:16.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.687+0000 7f1ff54bf640 1 -- 172.21.15.72:0/1772754665 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe8030770 con 0x7f1ff006e480 2023-12-13T00:28:16.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.687+0000 7f1ff54bf640 1 -- 172.21.15.72:0/1772754665 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8030b00 con 0x7f1ff006e480 2023-12-13T00:28:16.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.688+0000 7f1ff8725640 1 -- 172.21.15.72:0/1772754665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff006e480 msgr2=0x7f1ff006e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.688+0000 7f1ff8725640 1 --2- 172.21.15.72:0/1772754665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff006e480 0x7f1ff006e8f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80097a0 tx=0x7f1fe802b960 comp rx=0 tx=0).stop 2023-12-13T00:28:16.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.688+0000 7f1ff8725640 1 -- 172.21.15.72:0/1772754665 shutdown_connections 2023-12-13T00:28:16.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.688+0000 7f1ff8725640 1 --2- 172.21.15.72:0/1772754665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff006e480 0x7f1ff006e8f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.688+0000 7f1ff8725640 1 --2- 172.21.15.72:0/1772754665 >> v2:172.21.15.176:3300/0 conn(0x7f1ff014fba0 0x7f1ff00c1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.688+0000 7f1ff8725640 1 -- 172.21.15.72:0/1772754665 >> 172.21.15.72:0/1772754665 conn(0x7f1ff006c5f0 msgr2=0x7f1ff006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.688+0000 7f1ff8725640 1 -- 172.21.15.72:0/1772754665 shutdown_connections 2023-12-13T00:28:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.688+0000 7f1ff8725640 1 -- 172.21.15.72:0/1772754665 wait complete. 2023-12-13T00:28:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.689+0000 7f1ff8725640 1 Processor -- start 2023-12-13T00:28:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.689+0000 7f1ff8725640 1 -- start start 2023-12-13T00:28:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.690+0000 7f1ff8725640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff006e480 0x7f1ff0161520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.690+0000 7f1ff8725640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ff014fba0 0x7f1ff0138520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.690+0000 7f1ff8725640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff0071b50 0x7f1ff0138a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.690+0000 7f1ff8725640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff00723a0 con 0x7f1ff006e480 2023-12-13T00:28:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.690+0000 7f1ff8725640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff01ef500 con 0x7f1ff014fba0 2023-12-13T00:28:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.690+0000 7f1ff8725640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff01f3380 con 0x7f1ff0071b50 2023-12-13T00:28:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.690+0000 7f1ff64c1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff006e480 0x7f1ff0161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.690+0000 7f1ff5cc0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ff014fba0 0x7f1ff0138520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.691+0000 7f1ff64c1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff006e480 0x7f1ff0161520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57856/0 (socket says 172.21.15.72:57856) 2023-12-13T00:28:16.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.691+0000 7f1ff6cc2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff0071b50 0x7f1ff0138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.691+0000 7f1ff64c1640 1 -- 172.21.15.72:0/3239295800 learned_addr learned my addr 172.21.15.72:0/3239295800 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:16.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.694+0000 7f1ff64c1640 1 -- 172.21.15.72:0/3239295800 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff0071b50 msgr2=0x7f1ff0138a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.694+0000 7f1ff64c1640 1 --2- 172.21.15.72:0/3239295800 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ff0071b50 0x7f1ff0138a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.694+0000 7f1ff64c1640 1 -- 172.21.15.72:0/3239295800 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ff014fba0 msgr2=0x7f1ff0138520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.694+0000 7f1ff64c1640 1 --2- 172.21.15.72:0/3239295800 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ff014fba0 0x7f1ff0138520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.694+0000 7f1ff64c1640 1 -- 172.21.15.72:0/3239295800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe8009400 con 0x7f1ff006e480 2023-12-13T00:28:16.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.696+0000 7f1ff64c1640 1 --2- 172.21.15.72:0/3239295800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff006e480 0x7f1ff0161520 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009db0 tx=0x7f1fec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.700+0000 7f1fe6ffd640 1 -- 172.21.15.72:0/3239295800 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec014480 con 0x7f1ff006e480 2023-12-13T00:28:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.700+0000 7f1fe6ffd640 1 -- 172.21.15.72:0/3239295800 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fec00f040 con 0x7f1ff006e480 2023-12-13T00:28:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.700+0000 7f1fe6ffd640 1 -- 172.21.15.72:0/3239295800 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec014800 con 0x7f1ff006e480 2023-12-13T00:28:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.700+0000 7f1ff8725640 1 -- 172.21.15.72:0/3239295800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff01f35f0 con 0x7f1ff006e480 2023-12-13T00:28:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.700+0000 7f1ff8725640 1 -- 172.21.15.72:0/3239295800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff00728d0 con 0x7f1ff006e480 2023-12-13T00:28:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.701+0000 7f1ff8725640 1 -- 172.21.15.72:0/3239295800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1ff006f2c0 con 0x7f1ff006e480 2023-12-13T00:28:16.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.721+0000 7f1fe6ffd640 1 -- 172.21.15.72:0/3239295800 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1fec014960 con 0x7f1ff006e480 2023-12-13T00:28:16.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.721+0000 7f1fe6ffd640 1 --2- 172.21.15.72:0/3239295800 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f1fd406b240 0x7f1fd406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.721+0000 7f1ff5cc0640 1 --2- 172.21.15.72:0/3239295800 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f1fd406b240 0x7f1fd406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.721+0000 7f1ff5cc0640 1 --2- 172.21.15.72:0/3239295800 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f1fd406b240 0x7f1fd406d700 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0072b60 tx=0x7f1fe0007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:16.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.723+0000 7f1fe6ffd640 1 -- 172.21.15.72:0/3239295800 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f1fec059b10 con 0x7f1ff006e480 2023-12-13T00:28:16.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.723+0000 7f1fe6ffd640 1 --2- 172.21.15.72:0/3239295800 >> [v2:172.21.15.72:6810/1022561321,v1:172.21.15.72:6811/1022561321] conn(0x7f1fd40749a0 0x7f1fd4076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.723+0000 7f1fe6ffd640 1 -- 172.21.15.72:0/3239295800 --> [v2:172.21.15.72:6810/1022561321,v1:172.21.15.72:6811/1022561321] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fd4077510 con 0x7f1fd40749a0 2023-12-13T00:28:16.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.723+0000 7f1fe6ffd640 1 -- 172.21.15.72:0/3239295800 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fec028e70 con 0x7f1ff006e480 2023-12-13T00:28:16.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.724+0000 7f1ff6cc2640 1 --2- 172.21.15.72:0/3239295800 >> [v2:172.21.15.72:6810/1022561321,v1:172.21.15.72:6811/1022561321] conn(0x7f1fd40749a0 0x7f1fd4076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.724+0000 7f1ff6cc2640 1 --2- 172.21.15.72:0/3239295800 >> [v2:172.21.15.72:6810/1022561321,v1:172.21.15.72:6811/1022561321] conn(0x7f1fd40749a0 0x7f1fd4076e40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:16.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.724+0000 7f1fe6ffd640 1 -- 172.21.15.72:0/3239295800 <== osd.3 v2:172.21.15.72:6810/1022561321 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1fd4077510 con 0x7f1fd40749a0 2023-12-13T00:28:16.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.737+0000 7f1ff8725640 1 -- 172.21.15.72:0/3239295800 --> [v2:172.21.15.72:6810/1022561321,v1:172.21.15.72:6811/1022561321] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1ff00c2470 con 0x7f1fd40749a0 2023-12-13T00:28:16.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.738+0000 7f1fe6ffd640 1 -- 172.21.15.72:0/3239295800 <== osd.3 v2:172.21.15.72:6810/1022561321 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1fe80308e0 con 0x7f1fd40749a0 2023-12-13T00:28:16.737 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-12-13T00:28:16.738 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-13T00:28:16.738 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-12-13T00:28:16.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.738+0000 7f1ff8725640 1 -- 172.21.15.72:0/3239295800 >> [v2:172.21.15.72:6810/1022561321,v1:172.21.15.72:6811/1022561321] conn(0x7f1fd40749a0 msgr2=0x7f1fd4076e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.738+0000 7f1ff8725640 1 --2- 172.21.15.72:0/3239295800 >> [v2:172.21.15.72:6810/1022561321,v1:172.21.15.72:6811/1022561321] conn(0x7f1fd40749a0 0x7f1fd4076e40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.738+0000 7f1ff8725640 1 -- 172.21.15.72:0/3239295800 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f1fd406b240 msgr2=0x7f1fd406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.738+0000 7f1ff8725640 1 --2- 172.21.15.72:0/3239295800 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f1fd406b240 0x7f1fd406d700 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0072b60 tx=0x7f1fe0007e80 comp rx=0 tx=0).stop 2023-12-13T00:28:16.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.738+0000 7f1ff8725640 1 -- 172.21.15.72:0/3239295800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff006e480 msgr2=0x7f1ff0161520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.738+0000 7f1ff8725640 1 --2- 172.21.15.72:0/3239295800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff006e480 0x7f1ff0161520 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009db0 tx=0x7f1fec00c490 comp rx=0 tx=0).stop 2023-12-13T00:28:16.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.738+0000 7f1ff6cc2640 1 -- 172.21.15.72:0/3239295800 reap_dead start 2023-12-13T00:28:16.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.738+0000 7f1ff8725640 1 -- 172.21.15.72:0/3239295800 shutdown_connections 2023-12-13T00:28:16.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.738+0000 7f1ff8725640 1 -- 172.21.15.72:0/3239295800 >> 172.21.15.72:0/3239295800 conn(0x7f1ff006c5f0 msgr2=0x7f1ff00c50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:16.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.738+0000 7f1ff8725640 1 -- 172.21.15.72:0/3239295800 shutdown_connections 2023-12-13T00:28:16.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.738+0000 7f1ff8725640 1 -- 172.21.15.72:0/3239295800 wait complete. 2023-12-13T00:28:16.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-13T00:28:16.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.848+0000 7f280893c640 1 Processor -- start 2023-12-13T00:28:16.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.848+0000 7f280893c640 1 -- start start 2023-12-13T00:28:16.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.849+0000 7f280893c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28040ccb60 0x7f28040ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.849+0000 7f280893c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2804157e70 con 0x7f2804157330 2023-12-13T00:28:16.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.849+0000 7f280893c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2804158340 con 0x7f28041514a0 2023-12-13T00:28:16.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.849+0000 7f280893c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28040cd4a0 con 0x7f28040ccb60 2023-12-13T00:28:16.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.850+0000 7f2802d9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2804157330 0x7f2804157760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46270/0 (socket says 172.21.15.72:46270) 2023-12-13T00:28:16.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.850+0000 7f2802d9d640 1 -- 172.21.15.72:0/2145304427 learned_addr learned my addr 172.21.15.72:0/2145304427 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:28:16.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.850+0000 7f2801d9b640 1 --2- 172.21.15.72:0/2145304427 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28040ccb60 0x7f28040ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.852+0000 7f280159a640 1 -- 172.21.15.72:0/2145304427 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474756526 0 0) 0x7f2804157e70 con 0x7f2804157330 2023-12-13T00:28:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.852+0000 7f280159a640 1 -- 172.21.15.72:0/2145304427 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27ec003520 con 0x7f2804157330 2023-12-13T00:28:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.852+0000 7f280159a640 1 -- 172.21.15.72:0/2145304427 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712878086 0 0) 0x7f2804158340 con 0x7f28041514a0 2023-12-13T00:28:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.852+0000 7f280159a640 1 -- 172.21.15.72:0/2145304427 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2804157e70 con 0x7f28041514a0 2023-12-13T00:28:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.853+0000 7f2801d9b640 1 -- 172.21.15.72:0/2145304427 >> v1:172.21.15.176:6789/0 conn(0x7f28041514a0 legacy=0x7f28040c3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.853+0000 7f2801d9b640 1 -- 172.21.15.72:0/2145304427 >> v1:172.21.15.72:6789/0 conn(0x7f2804157330 legacy=0x7f2804157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.853+0000 7f2801d9b640 1 -- 172.21.15.72:0/2145304427 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28041580a0 con 0x7f28040ccb60 2023-12-13T00:28:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.855+0000 7f2801d9b640 1 --2- 172.21.15.72:0/2145304427 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28040ccb60 0x7f28040ccf60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f27f80097d0 tx=0x7f27f802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b2a977fe5d70afd server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:16.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.859+0000 7f280159a640 1 -- 172.21.15.72:0/2145304427 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f8031890 con 0x7f28040ccb60 2023-12-13T00:28:16.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.859+0000 7f280159a640 1 -- 172.21.15.72:0/2145304427 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f80319f0 con 0x7f28040ccb60 2023-12-13T00:28:16.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.859+0000 7f280159a640 1 -- 172.21.15.72:0/2145304427 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f8031d80 con 0x7f28040ccb60 2023-12-13T00:28:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.859+0000 7f280893c640 1 -- 172.21.15.72:0/2145304427 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28040ccb60 msgr2=0x7f28040ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.859+0000 7f280893c640 1 --2- 172.21.15.72:0/2145304427 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28040ccb60 0x7f28040ccf60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f27f80097d0 tx=0x7f27f802b930 comp rx=0 tx=0).stop 2023-12-13T00:28:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.860+0000 7f280893c640 1 -- 172.21.15.72:0/2145304427 shutdown_connections 2023-12-13T00:28:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.860+0000 7f280893c640 1 --2- 172.21.15.72:0/2145304427 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28040ccb60 0x7f28040ccf60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.860+0000 7f280893c640 1 -- 172.21.15.72:0/2145304427 >> 172.21.15.72:0/2145304427 conn(0x7f2804070790 msgr2=0x7f2804070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.860+0000 7f280893c640 1 -- 172.21.15.72:0/2145304427 shutdown_connections 2023-12-13T00:28:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.860+0000 7f280893c640 1 -- 172.21.15.72:0/2145304427 wait complete. 2023-12-13T00:28:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.861+0000 7f280893c640 1 Processor -- start 2023-12-13T00:28:16.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.861+0000 7f280893c640 1 -- start start 2023-12-13T00:28:16.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.862+0000 7f280893c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28040ccb60 0x7f28041ef7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.862+0000 7f280893c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28041514a0 0x7f2804148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.862+0000 7f280893c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2804157330 0x7f28041f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.862+0000 7f280893c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2804159070 con 0x7f28040ccb60 2023-12-13T00:28:16.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.862+0000 7f280893c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28041eedd0 con 0x7f2804157330 2023-12-13T00:28:16.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.862+0000 7f280893c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280406c2c0 con 0x7f28041514a0 2023-12-13T00:28:16.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.862+0000 7f280259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28040ccb60 0x7f28041ef7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.862+0000 7f280259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28040ccb60 0x7f28041ef7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57864/0 (socket says 172.21.15.72:57864) 2023-12-13T00:28:16.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.862+0000 7f280259c640 1 -- 172.21.15.72:0/2558279307 learned_addr learned my addr 172.21.15.72:0/2558279307 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:16.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.862+0000 7f2802d9d640 1 --2- 172.21.15.72:0/2558279307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2804157330 0x7f28041f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.863+0000 7f2801d9b640 1 --2- 172.21.15.72:0/2558279307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28041514a0 0x7f2804148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.866+0000 7f280259c640 1 -- 172.21.15.72:0/2558279307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28041514a0 msgr2=0x7f2804148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.866+0000 7f280259c640 1 --2- 172.21.15.72:0/2558279307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28041514a0 0x7f2804148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.866+0000 7f280259c640 1 -- 172.21.15.72:0/2558279307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2804157330 msgr2=0x7f28041f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:16.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.866+0000 7f280259c640 1 --2- 172.21.15.72:0/2558279307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2804157330 0x7f28041f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:16.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.866+0000 7f280259c640 1 -- 172.21.15.72:0/2558279307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f8009400 con 0x7f28040ccb60 2023-12-13T00:28:16.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.868+0000 7f280259c640 1 --2- 172.21.15.72:0/2558279307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28040ccb60 0x7f28041ef7a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f27f400c830 tx=0x7f27f400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:16.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.872+0000 7f27f2ffd640 1 -- 172.21.15.72:0/2558279307 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f4003b70 con 0x7f28040ccb60 2023-12-13T00:28:16.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.872+0000 7f27f2ffd640 1 -- 172.21.15.72:0/2558279307 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f4003cd0 con 0x7f28040ccb60 2023-12-13T00:28:16.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.872+0000 7f27f2ffd640 1 -- 172.21.15.72:0/2558279307 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f400aa30 con 0x7f28040ccb60 2023-12-13T00:28:16.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.872+0000 7f280893c640 1 -- 172.21.15.72:0/2558279307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280406baa0 con 0x7f28040ccb60 2023-12-13T00:28:16.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.872+0000 7f280893c640 1 -- 172.21.15.72:0/2558279307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280406bfe0 con 0x7f28040ccb60 2023-12-13T00:28:16.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.873+0000 7f280893c640 1 -- 172.21.15.72:0/2558279307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2804067470 con 0x7f28040ccb60 2023-12-13T00:28:16.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.891+0000 7f27f2ffd640 1 -- 172.21.15.72:0/2558279307 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f27f400ab90 con 0x7f28040ccb60 2023-12-13T00:28:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.891+0000 7f27f2ffd640 1 --2- 172.21.15.72:0/2558279307 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f27e406b1c0 0x7f27e406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.891+0000 7f2801d9b640 1 --2- 172.21.15.72:0/2558279307 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f27e406b1c0 0x7f27e406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.892+0000 7f2801d9b640 1 --2- 172.21.15.72:0/2558279307 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f27e406b1c0 0x7f27e406d680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f27f8036000 tx=0x7f27f803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:16.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:16.893+0000 7f27f2ffd640 1 -- 172.21.15.72:0/2558279307 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f27f400ae40 con 0x7f28040ccb60 2023-12-13T00:28:17.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.128+0000 7f27f2ffd640 1 -- 172.21.15.72:0/2558279307 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f27f4055130 con 0x7f28040ccb60 2023-12-13T00:28:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.322+0000 7f280893c640 1 -- 172.21.15.72:0/2558279307 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f28040c2910 con 0x7f27e406b1c0 2023-12-13T00:28:17.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.322+0000 7f27f2ffd640 1 -- 172.21.15.72:0/2558279307 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f27f8031b60 con 0x7f27e406b1c0 2023-12-13T00:28:17.322 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 3 to deep-scrub 2023-12-13T00:28:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.324+0000 7f280893c640 1 -- 172.21.15.72:0/2558279307 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f27e406b1c0 msgr2=0x7f27e406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.324+0000 7f280893c640 1 --2- 172.21.15.72:0/2558279307 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f27e406b1c0 0x7f27e406d680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f27f8036000 tx=0x7f27f803c040 comp rx=0 tx=0).stop 2023-12-13T00:28:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.324+0000 7f280893c640 1 -- 172.21.15.72:0/2558279307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28040ccb60 msgr2=0x7f28041ef7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.324+0000 7f280893c640 1 --2- 172.21.15.72:0/2558279307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28040ccb60 0x7f28041ef7a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f27f400c830 tx=0x7f27f400ccf0 comp rx=0 tx=0).stop 2023-12-13T00:28:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.324+0000 7f280893c640 1 -- 172.21.15.72:0/2558279307 shutdown_connections 2023-12-13T00:28:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.324+0000 7f280893c640 1 --2- 172.21.15.72:0/2558279307 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f27e406b1c0 0x7f27e406d680 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.324+0000 7f280893c640 1 --2- 172.21.15.72:0/2558279307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2804157330 0x7f28041f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.324+0000 7f280893c640 1 --2- 172.21.15.72:0/2558279307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28041514a0 0x7f2804148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.324+0000 7f280893c640 1 --2- 172.21.15.72:0/2558279307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28040ccb60 0x7f28041ef7a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.324+0000 7f280893c640 1 -- 172.21.15.72:0/2558279307 >> 172.21.15.72:0/2558279307 conn(0x7f2804070790 msgr2=0x7f2804157740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.324+0000 7f280893c640 1 -- 172.21.15.72:0/2558279307 shutdown_connections 2023-12-13T00:28:17.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.324+0000 7f280893c640 1 -- 172.21.15.72:0/2558279307 wait complete. 2023-12-13T00:28:17.335 INFO:tasks.ceph:Scrubbing osd.4 2023-12-13T00:28:17.335 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-13T00:28:17.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.439+0000 7f9356705640 1 Processor -- start 2023-12-13T00:28:17.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.439+0000 7f9356705640 1 -- start start 2023-12-13T00:28:17.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.440+0000 7f9356705640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f935014ff80 0x7f93500c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:17.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.440+0000 7f9356705640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f935006e480 0x7f935006e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:17.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.440+0000 7f9356705640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93500c1ba0 con 0x7f935014fba0 2023-12-13T00:28:17.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.440+0000 7f9356705640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93500c3c20 con 0x7f935006e480 2023-12-13T00:28:17.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.440+0000 7f9356705640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93500c3f00 con 0x7f935014ff80 2023-12-13T00:28:17.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.440+0000 7f9354ca2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f935006e480 0x7f935006e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:17.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.441+0000 7f9354ca2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f935006e480 0x7f935006e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57866/0 (socket says 172.21.15.72:57866) 2023-12-13T00:28:17.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.441+0000 7f9354ca2640 1 -- 172.21.15.72:0/1283935304 learned_addr learned my addr 172.21.15.72:0/1283935304 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:17.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.441+0000 7f934f7fe640 1 --2- 172.21.15.72:0/1283935304 >> v2:172.21.15.176:3300/0 conn(0x7f935014ff80 0x7f93500c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:17.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.443+0000 7f9354ca2640 1 -- 172.21.15.72:0/1283935304 >> v2:172.21.15.176:3300/0 conn(0x7f935014ff80 msgr2=0x7f93500c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:17.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.443+0000 7f9354ca2640 1 --2- 172.21.15.72:0/1283935304 >> v2:172.21.15.176:3300/0 conn(0x7f935014ff80 0x7f93500c12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:17.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.443+0000 7f9354ca2640 1 -- 172.21.15.72:0/1283935304 >> v1:172.21.15.176:6789/0 conn(0x7f935014fba0 legacy=0x7f93500c1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:17.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.443+0000 7f9354ca2640 1 -- 172.21.15.72:0/1283935304 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93500c41e0 con 0x7f935006e480 2023-12-13T00:28:17.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.445+0000 7f9354ca2640 1 --2- 172.21.15.72:0/1283935304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935006e480 0x7f935006e8b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f935006f550 tx=0x7f934802e210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8666132d1553e769 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:17.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.449+0000 7f934effd640 1 -- 172.21.15.72:0/1283935304 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934800b0d0 con 0x7f935006e480 2023-12-13T00:28:17.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.449+0000 7f934effd640 1 -- 172.21.15.72:0/1283935304 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934800b230 con 0x7f935006e480 2023-12-13T00:28:17.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.449+0000 7f934effd640 1 -- 172.21.15.72:0/1283935304 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348009600 con 0x7f935006e480 2023-12-13T00:28:17.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.450+0000 7f9356705640 1 -- 172.21.15.72:0/1283935304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935006e480 msgr2=0x7f935006e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:17.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.450+0000 7f9356705640 1 --2- 172.21.15.72:0/1283935304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935006e480 0x7f935006e8b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f935006f550 tx=0x7f934802e210 comp rx=0 tx=0).stop 2023-12-13T00:28:17.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.450+0000 7f9356705640 1 -- 172.21.15.72:0/1283935304 shutdown_connections 2023-12-13T00:28:17.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.450+0000 7f9356705640 1 --2- 172.21.15.72:0/1283935304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935006e480 0x7f935006e8b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:17.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.450+0000 7f9356705640 1 --2- 172.21.15.72:0/1283935304 >> v2:172.21.15.176:3300/0 conn(0x7f935014ff80 0x7f93500c12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:17.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.450+0000 7f9356705640 1 -- 172.21.15.72:0/1283935304 >> 172.21.15.72:0/1283935304 conn(0x7f935006c5f0 msgr2=0x7f935006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:17.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.450+0000 7f9356705640 1 -- 172.21.15.72:0/1283935304 shutdown_connections 2023-12-13T00:28:17.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.450+0000 7f9356705640 1 -- 172.21.15.72:0/1283935304 wait complete. 2023-12-13T00:28:17.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.451+0000 7f9356705640 1 Processor -- start 2023-12-13T00:28:17.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.451+0000 7f9356705640 1 -- start start 2023-12-13T00:28:17.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.452+0000 7f9356705640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935006e480 0x7f9350147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:17.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.452+0000 7f9356705640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f935014fba0 0x7f9350142270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:17.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.452+0000 7f9356705640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f935014ec90 0x7f93501427b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:17.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.452+0000 7f9356705640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93501eec10 con 0x7f935006e480 2023-12-13T00:28:17.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.452+0000 7f9356705640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93501ee320 con 0x7f935014ec90 2023-12-13T00:28:17.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.452+0000 7f9356705640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93501ef0a0 con 0x7f935014fba0 2023-12-13T00:28:17.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.453+0000 7f9354ca2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f935014ec90 0x7f93501427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:17.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.453+0000 7f934f7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f935014fba0 0x7f9350142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:17.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.453+0000 7f934ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935006e480 0x7f9350147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:17.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.453+0000 7f9354ca2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f935014ec90 0x7f93501427b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:57336/0 (socket says 172.21.15.72:57336) 2023-12-13T00:28:17.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.453+0000 7f9354ca2640 1 -- 172.21.15.72:0/1551381069 learned_addr learned my addr 172.21.15.72:0/1551381069 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:17.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.456+0000 7f9354ca2640 1 -- 172.21.15.72:0/1551381069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f935014fba0 msgr2=0x7f9350142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:17.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.456+0000 7f9354ca2640 1 --2- 172.21.15.72:0/1551381069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f935014fba0 0x7f9350142270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:17.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.456+0000 7f9354ca2640 1 -- 172.21.15.72:0/1551381069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935006e480 msgr2=0x7f9350147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:17.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.456+0000 7f9354ca2640 1 --2- 172.21.15.72:0/1551381069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935006e480 0x7f9350147dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:17.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.456+0000 7f9354ca2640 1 -- 172.21.15.72:0/1551381069 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934800bd40 con 0x7f935014ec90 2023-12-13T00:28:17.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.459+0000 7f9354ca2640 1 --2- 172.21.15.72:0/1551381069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f935014ec90 0x7f93501427b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9348038040 tx=0x7f9348004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:17.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.462+0000 7f934cff9640 1 -- 172.21.15.72:0/1551381069 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934800b720 con 0x7f935014ec90 2023-12-13T00:28:17.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.463+0000 7f934cff9640 1 -- 172.21.15.72:0/1551381069 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9348009e30 con 0x7f935014ec90 2023-12-13T00:28:17.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.463+0000 7f934cff9640 1 -- 172.21.15.72:0/1551381069 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93480408a0 con 0x7f935014ec90 2023-12-13T00:28:17.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.463+0000 7f9356705640 1 -- 172.21.15.72:0/1551381069 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93501ebb20 con 0x7f935014ec90 2023-12-13T00:28:17.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.463+0000 7f9356705640 1 -- 172.21.15.72:0/1551381069 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93501ee5c0 con 0x7f935014ec90 2023-12-13T00:28:17.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.464+0000 7f9356705640 1 -- 172.21.15.72:0/1551381069 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93500c1830 con 0x7f935014ec90 2023-12-13T00:28:17.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.482+0000 7f934cff9640 1 -- 172.21.15.72:0/1551381069 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9348040a00 con 0x7f935014ec90 2023-12-13T00:28:17.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.482+0000 7f934cff9640 1 --2- 172.21.15.72:0/1551381069 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f933c06b240 0x7f933c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:17.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.483+0000 7f934ffff640 1 --2- 172.21.15.72:0/1551381069 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f933c06b240 0x7f933c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:17.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.483+0000 7f934ffff640 1 --2- 172.21.15.72:0/1551381069 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f933c06b240 0x7f933c06d700 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9340000f60 tx=0x7f9340009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:17.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.486+0000 7f934cff9640 1 -- 172.21.15.72:0/1551381069 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f934804be40 con 0x7f935014ec90 2023-12-13T00:28:17.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.486+0000 7f934cff9640 1 --2- 172.21.15.72:0/1551381069 >> [v2:172.21.15.176:6808/1197403965,v1:172.21.15.176:6809/1197403965] conn(0x7f933c0749a0 0x7f933c076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:17.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.486+0000 7f934cff9640 1 -- 172.21.15.72:0/1551381069 --> [v2:172.21.15.176:6808/1197403965,v1:172.21.15.176:6809/1197403965] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f933c077510 con 0x7f933c0749a0 2023-12-13T00:28:17.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.486+0000 7f934cff9640 1 -- 172.21.15.72:0/1551381069 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9348079d60 con 0x7f935014ec90 2023-12-13T00:28:17.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.486+0000 7f934f7fe640 1 --2- 172.21.15.72:0/1551381069 >> [v2:172.21.15.176:6808/1197403965,v1:172.21.15.176:6809/1197403965] conn(0x7f933c0749a0 0x7f933c076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:17.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.486+0000 7f934f7fe640 1 --2- 172.21.15.72:0/1551381069 >> [v2:172.21.15.176:6808/1197403965,v1:172.21.15.176:6809/1197403965] conn(0x7f933c0749a0 0x7f933c076e40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:17.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.487+0000 7f934cff9640 1 -- 172.21.15.72:0/1551381069 <== osd.4 v2:172.21.15.176:6808/1197403965 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f933c077510 con 0x7f933c0749a0 2023-12-13T00:28:17.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.501+0000 7f9356705640 1 -- 172.21.15.72:0/1551381069 --> [v2:172.21.15.176:6808/1197403965,v1:172.21.15.176:6809/1197403965] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f93500c47a0 con 0x7f933c0749a0 2023-12-13T00:28:17.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.501+0000 7f934cff9640 1 -- 172.21.15.72:0/1551381069 <== osd.4 v2:172.21.15.176:6808/1197403965 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9344009bd0 con 0x7f933c0749a0 2023-12-13T00:28:17.501 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-12-13T00:28:17.501 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-13T00:28:17.501 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-12-13T00:28:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.501+0000 7f9356705640 1 -- 172.21.15.72:0/1551381069 >> [v2:172.21.15.176:6808/1197403965,v1:172.21.15.176:6809/1197403965] conn(0x7f933c0749a0 msgr2=0x7f933c076e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.501+0000 7f9356705640 1 --2- 172.21.15.72:0/1551381069 >> [v2:172.21.15.176:6808/1197403965,v1:172.21.15.176:6809/1197403965] conn(0x7f933c0749a0 0x7f933c076e40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.502+0000 7f9356705640 1 -- 172.21.15.72:0/1551381069 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f933c06b240 msgr2=0x7f933c06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.502+0000 7f9356705640 1 --2- 172.21.15.72:0/1551381069 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f933c06b240 0x7f933c06d700 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9340000f60 tx=0x7f9340009040 comp rx=0 tx=0).stop 2023-12-13T00:28:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.502+0000 7f9356705640 1 -- 172.21.15.72:0/1551381069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f935014ec90 msgr2=0x7f93501427b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.502+0000 7f9356705640 1 --2- 172.21.15.72:0/1551381069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f935014ec90 0x7f93501427b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9348038040 tx=0x7f9348004a40 comp rx=0 tx=0).stop 2023-12-13T00:28:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.502+0000 7f9354ca2640 1 -- 172.21.15.72:0/1551381069 reap_dead start 2023-12-13T00:28:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.502+0000 7f9356705640 1 -- 172.21.15.72:0/1551381069 shutdown_connections 2023-12-13T00:28:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.502+0000 7f9356705640 1 -- 172.21.15.72:0/1551381069 >> 172.21.15.72:0/1551381069 conn(0x7f935006c5f0 msgr2=0x7f935014b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.502+0000 7f9356705640 1 -- 172.21.15.72:0/1551381069 shutdown_connections 2023-12-13T00:28:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.502+0000 7f9356705640 1 -- 172.21.15.72:0/1551381069 wait complete. 2023-12-13T00:28:17.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-13T00:28:17.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.614+0000 7fa201a7c640 1 Processor -- start 2023-12-13T00:28:17.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.614+0000 7fa201a7c640 1 -- start start 2023-12-13T00:28:17.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.615+0000 7fa201a7c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa1fc14fba0 0x7fa1fc0c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:17.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.615+0000 7fa201a7c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc06e480 0x7fa1fc06e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:17.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.615+0000 7fa201a7c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1fc0c1ba0 con 0x7fa1fc14ff80 2023-12-13T00:28:17.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.615+0000 7fa201a7c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1fc0c3c20 con 0x7fa1fc14fba0 2023-12-13T00:28:17.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.615+0000 7fa201a7c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc0c3f00 con 0x7fa1fc06e480 2023-12-13T00:28:17.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.616+0000 7fa1fbfff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc06e480 0x7fa1fc06e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:17.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.616+0000 7fa1fb7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa1fc14fba0 0x7fa1fc0c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:17.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.616+0000 7fa1faffd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa1fc14ff80 0x7fa1fc0c12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46278/0 (socket says 172.21.15.72:46278) 2023-12-13T00:28:17.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.616+0000 7fa1faffd640 1 -- 172.21.15.72:0/2360640114 learned_addr learned my addr 172.21.15.72:0/2360640114 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:28:17.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.618+0000 7fa1fbfff640 1 -- 172.21.15.72:0/2360640114 >> v2:172.21.15.72:3300/0 conn(0x7fa1fc14fba0 msgr2=0x7fa1fc0c1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:17.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.618+0000 7fa1fbfff640 1 --2- 172.21.15.72:0/2360640114 >> v2:172.21.15.72:3300/0 conn(0x7fa1fc14fba0 0x7fa1fc0c1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:17.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.618+0000 7fa1fbfff640 1 -- 172.21.15.72:0/2360640114 >> v1:172.21.15.72:6789/0 conn(0x7fa1fc14ff80 legacy=0x7fa1fc0c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:17.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.618+0000 7fa1fbfff640 1 -- 172.21.15.72:0/2360640114 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc0c41e0 con 0x7fa1fc06e480 2023-12-13T00:28:17.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.620+0000 7fa1fbfff640 1 --2- 172.21.15.72:0/2360640114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc06e480 0x7fa1fc06e8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400aea0 tx=0x7fa1f402d030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6533798e981a55e server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:17.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.624+0000 7fa1fa7fc640 1 -- 172.21.15.72:0/2360640114 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f402dbd0 con 0x7fa1fc06e480 2023-12-13T00:28:17.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.624+0000 7fa1fa7fc640 1 -- 172.21.15.72:0/2360640114 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f402dd30 con 0x7fa1fc06e480 2023-12-13T00:28:17.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.624+0000 7fa1fa7fc640 1 -- 172.21.15.72:0/2360640114 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f402dea0 con 0x7fa1fc06e480 2023-12-13T00:28:17.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.624+0000 7fa201a7c640 1 -- 172.21.15.72:0/2360640114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc06e480 msgr2=0x7fa1fc06e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:17.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.624+0000 7fa201a7c640 1 --2- 172.21.15.72:0/2360640114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc06e480 0x7fa1fc06e8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400aea0 tx=0x7fa1f402d030 comp rx=0 tx=0).stop 2023-12-13T00:28:17.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.625+0000 7fa201a7c640 1 -- 172.21.15.72:0/2360640114 shutdown_connections 2023-12-13T00:28:17.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.625+0000 7fa201a7c640 1 --2- 172.21.15.72:0/2360640114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc06e480 0x7fa1fc06e8f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:17.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.625+0000 7fa201a7c640 1 --2- 172.21.15.72:0/2360640114 >> v2:172.21.15.72:3300/0 conn(0x7fa1fc14fba0 0x7fa1fc0c1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:17.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.625+0000 7fa201a7c640 1 -- 172.21.15.72:0/2360640114 >> 172.21.15.72:0/2360640114 conn(0x7fa1fc06c5f0 msgr2=0x7fa1fc06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:17.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.625+0000 7fa201a7c640 1 -- 172.21.15.72:0/2360640114 shutdown_connections 2023-12-13T00:28:17.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.625+0000 7fa201a7c640 1 -- 172.21.15.72:0/2360640114 wait complete. 2023-12-13T00:28:17.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.626+0000 7fa201a7c640 1 Processor -- start 2023-12-13T00:28:17.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.626+0000 7fa201a7c640 1 -- start start 2023-12-13T00:28:17.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.627+0000 7fa201a7c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1fc06e480 0x7fa1fc071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:17.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.627+0000 7fa201a7c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1fc14fba0 0x7fa1fc13f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:17.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.627+0000 7fa201a7c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc14e500 0x7fa1fc13f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:17.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.627+0000 7fa201a7c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc149900 con 0x7fa1fc14fba0 2023-12-13T00:28:17.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.627+0000 7fa201a7c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc146a60 con 0x7fa1fc06e480 2023-12-13T00:28:17.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.627+0000 7fa201a7c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc146d40 con 0x7fa1fc14e500 2023-12-13T00:28:17.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.627+0000 7fa1faffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1fc14fba0 0x7fa1fc13f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:17.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.627+0000 7fa1fbfff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc14e500 0x7fa1fc13f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:17.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.627+0000 7fa1fb7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1fc06e480 0x7fa1fc071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:17.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.627+0000 7fa1faffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1fc14fba0 0x7fa1fc13f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57892/0 (socket says 172.21.15.72:57892) 2023-12-13T00:28:17.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.627+0000 7fa1faffd640 1 -- 172.21.15.72:0/1318192945 learned_addr learned my addr 172.21.15.72:0/1318192945 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:17.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.630+0000 7fa1faffd640 1 -- 172.21.15.72:0/1318192945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc14e500 msgr2=0x7fa1fc13f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:17.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.630+0000 7fa1faffd640 1 --2- 172.21.15.72:0/1318192945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc14e500 0x7fa1fc13f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:17.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.630+0000 7fa1faffd640 1 -- 172.21.15.72:0/1318192945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1fc06e480 msgr2=0x7fa1fc071df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:17.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.630+0000 7fa1faffd640 1 --2- 172.21.15.72:0/1318192945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1fc06e480 0x7fa1fc071df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:17.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.630+0000 7fa1faffd640 1 -- 172.21.15.72:0/1318192945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f400ab80 con 0x7fa1fc14fba0 2023-12-13T00:28:17.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.632+0000 7fa1faffd640 1 --2- 172.21.15.72:0/1318192945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1fc14fba0 0x7fa1fc13f1d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000c3c0 tx=0x7fa1f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:17.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.636+0000 7fa1e3fff640 1 -- 172.21.15.72:0/1318192945 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0005ce0 con 0x7fa1fc14fba0 2023-12-13T00:28:17.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.636+0000 7fa1e3fff640 1 -- 172.21.15.72:0/1318192945 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f0005e40 con 0x7fa1fc14fba0 2023-12-13T00:28:17.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.636+0000 7fa1e3fff640 1 -- 172.21.15.72:0/1318192945 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f00072f0 con 0x7fa1fc14fba0 2023-12-13T00:28:17.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.636+0000 7fa201a7c640 1 -- 172.21.15.72:0/1318192945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1fc147020 con 0x7fa1fc14fba0 2023-12-13T00:28:17.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.636+0000 7fa201a7c640 1 -- 172.21.15.72:0/1318192945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1fc1475e0 con 0x7fa1fc14fba0 2023-12-13T00:28:17.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.637+0000 7fa201a7c640 1 -- 172.21.15.72:0/1318192945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1fc1467b0 con 0x7fa1fc14fba0 2023-12-13T00:28:17.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.655+0000 7fa1e3fff640 1 -- 172.21.15.72:0/1318192945 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa1f0007450 con 0x7fa1fc14fba0 2023-12-13T00:28:17.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.655+0000 7fa1e3fff640 1 --2- 172.21.15.72:0/1318192945 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa1e806b240 0x7fa1e806d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:17.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.655+0000 7fa1fb7fe640 1 --2- 172.21.15.72:0/1318192945 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa1e806b240 0x7fa1e806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:17.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.656+0000 7fa1fb7fe640 1 --2- 172.21.15.72:0/1318192945 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa1e806b240 0x7fa1e806d700 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009b40 tx=0x7fa1ec009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:17.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.658+0000 7fa1e3fff640 1 -- 172.21.15.72:0/1318192945 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fa1f0057dc0 con 0x7fa1fc14fba0 2023-12-13T00:28:17.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:17.889+0000 7fa1e3fff640 1 -- 172.21.15.72:0/1318192945 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa1f0054100 con 0x7fa1fc14fba0 2023-12-13T00:28:18.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.057+0000 7fa201a7c640 1 -- 172.21.15.72:0/1318192945 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1fc0c83c0 con 0x7fa1e806b240 2023-12-13T00:28:18.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.057+0000 7fa1e3fff640 1 -- 172.21.15.72:0/1318192945 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa1fc0c83c0 con 0x7fa1e806b240 2023-12-13T00:28:18.059 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 4 to deep-scrub 2023-12-13T00:28:18.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.059+0000 7fa201a7c640 1 -- 172.21.15.72:0/1318192945 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa1e806b240 msgr2=0x7fa1e806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.059+0000 7fa201a7c640 1 --2- 172.21.15.72:0/1318192945 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa1e806b240 0x7fa1e806d700 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009b40 tx=0x7fa1ec009190 comp rx=0 tx=0).stop 2023-12-13T00:28:18.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.059+0000 7fa201a7c640 1 -- 172.21.15.72:0/1318192945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1fc14fba0 msgr2=0x7fa1fc13f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.059+0000 7fa201a7c640 1 --2- 172.21.15.72:0/1318192945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1fc14fba0 0x7fa1fc13f1d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000c3c0 tx=0x7fa1f000c880 comp rx=0 tx=0).stop 2023-12-13T00:28:18.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.059+0000 7fa201a7c640 1 -- 172.21.15.72:0/1318192945 shutdown_connections 2023-12-13T00:28:18.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.059+0000 7fa201a7c640 1 --2- 172.21.15.72:0/1318192945 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa1e806b240 0x7fa1e806d700 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.059+0000 7fa201a7c640 1 --2- 172.21.15.72:0/1318192945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc14e500 0x7fa1fc13f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.059+0000 7fa201a7c640 1 --2- 172.21.15.72:0/1318192945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1fc14fba0 0x7fa1fc13f1d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.059+0000 7fa201a7c640 1 --2- 172.21.15.72:0/1318192945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1fc06e480 0x7fa1fc071df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.059+0000 7fa201a7c640 1 -- 172.21.15.72:0/1318192945 >> 172.21.15.72:0/1318192945 conn(0x7fa1fc06c5f0 msgr2=0x7fa1fc14aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:18.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.059+0000 7fa201a7c640 1 -- 172.21.15.72:0/1318192945 shutdown_connections 2023-12-13T00:28:18.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.059+0000 7fa201a7c640 1 -- 172.21.15.72:0/1318192945 wait complete. 2023-12-13T00:28:18.072 INFO:tasks.ceph:Scrubbing osd.5 2023-12-13T00:28:18.072 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-13T00:28:18.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.176+0000 7f224ffff640 1 Processor -- start 2023-12-13T00:28:18.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.176+0000 7f224ffff640 1 -- start start 2023-12-13T00:28:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.177+0000 7f224ffff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2250153830 0x7f22500cb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.177+0000 7f224ffff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f22500cb270 0x7f22500cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.177+0000 7f224ffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f225006d320 0x7f2250159440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.177+0000 7f224ffff640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2250153c10 con 0x7f225006d320 2023-12-13T00:28:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.177+0000 7f224ffff640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22500c9d50 con 0x7f22500cb270 2023-12-13T00:28:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.177+0000 7f224ffff640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22500cdee0 con 0x7f2250153830 2023-12-13T00:28:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.177+0000 7f224f7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f225006d320 0x7f2250159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.178+0000 7f224f7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f225006d320 0x7f2250159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57902/0 (socket says 172.21.15.72:57902) 2023-12-13T00:28:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.178+0000 7f224f7fe640 1 -- 172.21.15.72:0/3921080123 learned_addr learned my addr 172.21.15.72:0/3921080123 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.178+0000 7f224e7fc640 1 --2- 172.21.15.72:0/3921080123 >> v2:172.21.15.176:3300/0 conn(0x7f22500cb270 0x7f22500cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.178+0000 7f224effd640 1 --2- 172.21.15.72:0/3921080123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2250153830 0x7f22500cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.180+0000 7f224f7fe640 1 -- 172.21.15.72:0/3921080123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2250153830 msgr2=0x7f22500cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:18.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.180+0000 7f224f7fe640 1 --2- 172.21.15.72:0/3921080123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2250153830 0x7f22500cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.180+0000 7f224f7fe640 1 -- 172.21.15.72:0/3921080123 >> v2:172.21.15.176:3300/0 conn(0x7f22500cb270 msgr2=0x7f22500cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:18.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.180+0000 7f224f7fe640 1 --2- 172.21.15.72:0/3921080123 >> v2:172.21.15.176:3300/0 conn(0x7f22500cb270 0x7f22500cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.180+0000 7f224f7fe640 1 -- 172.21.15.72:0/3921080123 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22500c9a70 con 0x7f225006d320 2023-12-13T00:28:18.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.182+0000 7f224f7fe640 1 --2- 172.21.15.72:0/3921080123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f225006d320 0x7f2250159440 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f22500b1910 tx=0x7f224802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643765a151067294 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:18.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.186+0000 7f224dffb640 1 -- 172.21.15.72:0/3921080123 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248030860 con 0x7f225006d320 2023-12-13T00:28:18.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.186+0000 7f224dffb640 1 -- 172.21.15.72:0/3921080123 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22480309c0 con 0x7f225006d320 2023-12-13T00:28:18.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.186+0000 7f224dffb640 1 -- 172.21.15.72:0/3921080123 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248030d50 con 0x7f225006d320 2023-12-13T00:28:18.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.187+0000 7f224ffff640 1 -- 172.21.15.72:0/3921080123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f225006d320 msgr2=0x7f2250159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.187+0000 7f224ffff640 1 --2- 172.21.15.72:0/3921080123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f225006d320 0x7f2250159440 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f22500b1910 tx=0x7f224802b9a0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.187+0000 7f224ffff640 1 -- 172.21.15.72:0/3921080123 shutdown_connections 2023-12-13T00:28:18.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.187+0000 7f224ffff640 1 --2- 172.21.15.72:0/3921080123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f225006d320 0x7f2250159440 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.187+0000 7f224ffff640 1 --2- 172.21.15.72:0/3921080123 >> v2:172.21.15.176:3300/0 conn(0x7f22500cb270 0x7f22500cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.187+0000 7f224ffff640 1 --2- 172.21.15.72:0/3921080123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2250153830 0x7f22500cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.187+0000 7f224ffff640 1 -- 172.21.15.72:0/3921080123 >> 172.21.15.72:0/3921080123 conn(0x7f22500b0830 msgr2=0x7f22500b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:18.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.187+0000 7f224ffff640 1 -- 172.21.15.72:0/3921080123 shutdown_connections 2023-12-13T00:28:18.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.187+0000 7f224ffff640 1 -- 172.21.15.72:0/3921080123 wait complete. 2023-12-13T00:28:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.188+0000 7f224ffff640 1 Processor -- start 2023-12-13T00:28:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.188+0000 7f224ffff640 1 -- start start 2023-12-13T00:28:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.189+0000 7f224ffff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f225006d320 0x7f22501f0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.189+0000 7f224ffff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22500cb270 0x7f2250155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.189+0000 7f224ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2250153830 0x7f225014c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.189+0000 7f224ffff640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22501555a0 con 0x7f2250153830 2023-12-13T00:28:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.189+0000 7f224ffff640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22501eec90 con 0x7f22500cb270 2023-12-13T00:28:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.189+0000 7f224ffff640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2250154bd0 con 0x7f225006d320 2023-12-13T00:28:18.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.190+0000 7f224e7fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22500cb270 0x7f2250155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.190+0000 7f224f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2250153830 0x7f225014c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.190+0000 7f224effd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f225006d320 0x7f22501f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.190+0000 7f224e7fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22500cb270 0x7f2250155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:57370/0 (socket says 172.21.15.72:57370) 2023-12-13T00:28:18.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.190+0000 7f224e7fc640 1 -- 172.21.15.72:0/3168618031 learned_addr learned my addr 172.21.15.72:0/3168618031 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:18.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.190+0000 7f224f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2250153830 0x7f225014c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57918/0 (socket says 172.21.15.72:57918) 2023-12-13T00:28:18.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.193+0000 7f224f7fe640 1 -- 172.21.15.72:0/3168618031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f225006d320 msgr2=0x7f22501f0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.193+0000 7f224f7fe640 1 --2- 172.21.15.72:0/3168618031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f225006d320 0x7f22501f0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.193+0000 7f224f7fe640 1 -- 172.21.15.72:0/3168618031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22500cb270 msgr2=0x7f2250155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.193+0000 7f224f7fe640 1 --2- 172.21.15.72:0/3168618031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22500cb270 0x7f2250155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.193+0000 7f224f7fe640 1 -- 172.21.15.72:0/3168618031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22480094d0 con 0x7f2250153830 2023-12-13T00:28:18.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.196+0000 7f224f7fe640 1 --2- 172.21.15.72:0/3168618031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2250153830 0x7f225014c320 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2248033000 tx=0x7f2248004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:18.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.199+0000 7f22377fe640 1 -- 172.21.15.72:0/3168618031 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248039c90 con 0x7f2250153830 2023-12-13T00:28:18.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.199+0000 7f22377fe640 1 -- 172.21.15.72:0/3168618031 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2248039e10 con 0x7f2250153830 2023-12-13T00:28:18.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.199+0000 7f22377fe640 1 -- 172.21.15.72:0/3168618031 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248043640 con 0x7f2250153830 2023-12-13T00:28:18.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.199+0000 7f224ffff640 1 -- 172.21.15.72:0/3168618031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2250067470 con 0x7f2250153830 2023-12-13T00:28:18.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.200+0000 7f224ffff640 1 -- 172.21.15.72:0/3168618031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2250153fc0 con 0x7f2250153830 2023-12-13T00:28:18.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.200+0000 7f224ffff640 1 -- 172.21.15.72:0/3168618031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22500ce760 con 0x7f2250153830 2023-12-13T00:28:18.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.220+0000 7f22377fe640 1 -- 172.21.15.72:0/3168618031 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f22480437a0 con 0x7f2250153830 2023-12-13T00:28:18.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.220+0000 7f22377fe640 1 --2- 172.21.15.72:0/3168618031 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f223c06b210 0x7f223c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.220+0000 7f224effd640 1 --2- 172.21.15.72:0/3168618031 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f223c06b210 0x7f223c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.221+0000 7f224effd640 1 --2- 172.21.15.72:0/3168618031 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f223c06b210 0x7f223c06d6d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2240011340 tx=0x7f224000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.224+0000 7f22377fe640 1 -- 172.21.15.72:0/3168618031 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f224803e070 con 0x7f2250153830 2023-12-13T00:28:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.224+0000 7f22377fe640 1 --2- 172.21.15.72:0/3168618031 >> [v2:172.21.15.176:6800/3937462058,v1:172.21.15.176:6801/3937462058] conn(0x7f223c074970 0x7f223c076e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.224+0000 7f22377fe640 1 -- 172.21.15.72:0/3168618031 --> [v2:172.21.15.176:6800/3937462058,v1:172.21.15.176:6801/3937462058] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f223c0774e0 con 0x7f223c074970 2023-12-13T00:28:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.224+0000 7f22377fe640 1 -- 172.21.15.72:0/3168618031 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22480780e0 con 0x7f2250153830 2023-12-13T00:28:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.224+0000 7f224e7fc640 1 --2- 172.21.15.72:0/3168618031 >> [v2:172.21.15.176:6800/3937462058,v1:172.21.15.176:6801/3937462058] conn(0x7f223c074970 0x7f223c076e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.225+0000 7f224e7fc640 1 --2- 172.21.15.72:0/3168618031 >> [v2:172.21.15.176:6800/3937462058,v1:172.21.15.176:6801/3937462058] conn(0x7f223c074970 0x7f223c076e10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.226+0000 7f22377fe640 1 -- 172.21.15.72:0/3168618031 <== osd.5 v2:172.21.15.176:6800/3937462058 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f223c0774e0 con 0x7f223c074970 2023-12-13T00:28:18.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.239+0000 7f224ffff640 1 -- 172.21.15.72:0/3168618031 --> [v2:172.21.15.176:6800/3937462058,v1:172.21.15.176:6801/3937462058] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f22500ce480 con 0x7f223c074970 2023-12-13T00:28:18.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.240+0000 7f22377fe640 1 -- 172.21.15.72:0/3168618031 <== osd.5 v2:172.21.15.176:6800/3937462058 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f22440098b0 con 0x7f223c074970 2023-12-13T00:28:18.241 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-12-13T00:28:18.241 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-13T00:28:18.241 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-12-13T00:28:18.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.240+0000 7f224ffff640 1 -- 172.21.15.72:0/3168618031 >> [v2:172.21.15.176:6800/3937462058,v1:172.21.15.176:6801/3937462058] conn(0x7f223c074970 msgr2=0x7f223c076e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.240+0000 7f224ffff640 1 --2- 172.21.15.72:0/3168618031 >> [v2:172.21.15.176:6800/3937462058,v1:172.21.15.176:6801/3937462058] conn(0x7f223c074970 0x7f223c076e10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.240+0000 7f224ffff640 1 -- 172.21.15.72:0/3168618031 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f223c06b210 msgr2=0x7f223c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.240+0000 7f224ffff640 1 --2- 172.21.15.72:0/3168618031 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f223c06b210 0x7f223c06d6d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2240011340 tx=0x7f224000b040 comp rx=0 tx=0).stop 2023-12-13T00:28:18.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.241+0000 7f224ffff640 1 -- 172.21.15.72:0/3168618031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2250153830 msgr2=0x7f225014c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.241+0000 7f224ffff640 1 --2- 172.21.15.72:0/3168618031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2250153830 0x7f225014c320 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2248033000 tx=0x7f2248004730 comp rx=0 tx=0).stop 2023-12-13T00:28:18.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.241+0000 7f224f7fe640 1 -- 172.21.15.72:0/3168618031 reap_dead start 2023-12-13T00:28:18.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.241+0000 7f224ffff640 1 -- 172.21.15.72:0/3168618031 shutdown_connections 2023-12-13T00:28:18.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.241+0000 7f224ffff640 1 -- 172.21.15.72:0/3168618031 >> 172.21.15.72:0/3168618031 conn(0x7f22500b0830 msgr2=0x7f225014da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:18.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.241+0000 7f224ffff640 1 -- 172.21.15.72:0/3168618031 shutdown_connections 2023-12-13T00:28:18.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.241+0000 7f224ffff640 1 -- 172.21.15.72:0/3168618031 wait complete. 2023-12-13T00:28:18.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-13T00:28:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.356+0000 7f43da5ec640 1 Processor -- start 2023-12-13T00:28:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.356+0000 7f43da5ec640 1 -- start start 2023-12-13T00:28:18.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.357+0000 7f43da5ec640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f43d4151040 0x7f43d4151420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.357+0000 7f43da5ec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43d40c5dd0 0x7f43d406ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.357+0000 7f43da5ec640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d4070a00 con 0x7f43d40c40d0 2023-12-13T00:28:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.357+0000 7f43da5ec640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d40c6210 con 0x7f43d4151040 2023-12-13T00:28:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.357+0000 7f43da5ec640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d406f230 con 0x7f43d40c5dd0 2023-12-13T00:28:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.357+0000 7f43d8b89640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f43d40c40d0 0x7f43d4070e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46294/0 (socket says 172.21.15.72:46294) 2023-12-13T00:28:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.357+0000 7f43d8b89640 1 -- 172.21.15.72:0/3047841806 learned_addr learned my addr 172.21.15.72:0/3047841806 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:28:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.357+0000 7f43d3fff640 1 --2- 172.21.15.72:0/3047841806 >> v2:172.21.15.176:3300/0 conn(0x7f43d4151040 0x7f43d4151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.360+0000 7f43d2ffd640 1 -- 172.21.15.72:0/3047841806 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371485932 0 0) 0x7f43d4070a00 con 0x7f43d40c40d0 2023-12-13T00:28:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.360+0000 7f43d2ffd640 1 -- 172.21.15.72:0/3047841806 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43bc003520 con 0x7f43d40c40d0 2023-12-13T00:28:18.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.360+0000 7f43d3fff640 1 -- 172.21.15.72:0/3047841806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43d40c5dd0 msgr2=0x7f43d406ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:18.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.360+0000 7f43d3fff640 1 --2- 172.21.15.72:0/3047841806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43d40c5dd0 0x7f43d406ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.360+0000 7f43d3fff640 1 -- 172.21.15.72:0/3047841806 >> v1:172.21.15.72:6789/0 conn(0x7f43d40c40d0 legacy=0x7f43d4070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.360+0000 7f43d3fff640 1 -- 172.21.15.72:0/3047841806 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d41572d0 con 0x7f43d4151040 2023-12-13T00:28:18.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.362+0000 7f43d3fff640 1 --2- 172.21.15.72:0/3047841806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43d4151040 0x7f43d4151420 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f43c40097a0 tx=0x7f43c402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0775027f08413b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:18.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.365+0000 7f43d2ffd640 1 -- 172.21.15.72:0/3047841806 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4030610 con 0x7f43d4151040 2023-12-13T00:28:18.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.365+0000 7f43d2ffd640 1 -- 172.21.15.72:0/3047841806 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c4030770 con 0x7f43d4151040 2023-12-13T00:28:18.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.365+0000 7f43d2ffd640 1 -- 172.21.15.72:0/3047841806 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4030b00 con 0x7f43d4151040 2023-12-13T00:28:18.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.366+0000 7f43da5ec640 1 -- 172.21.15.72:0/3047841806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43d4151040 msgr2=0x7f43d4151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.366+0000 7f43da5ec640 1 --2- 172.21.15.72:0/3047841806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43d4151040 0x7f43d4151420 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f43c40097a0 tx=0x7f43c402b960 comp rx=0 tx=0).stop 2023-12-13T00:28:18.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.366+0000 7f43da5ec640 1 -- 172.21.15.72:0/3047841806 shutdown_connections 2023-12-13T00:28:18.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.366+0000 7f43da5ec640 1 --2- 172.21.15.72:0/3047841806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43d40c5dd0 0x7f43d406ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.366+0000 7f43da5ec640 1 --2- 172.21.15.72:0/3047841806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43d4151040 0x7f43d4151420 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.366+0000 7f43da5ec640 1 -- 172.21.15.72:0/3047841806 >> 172.21.15.72:0/3047841806 conn(0x7f43d406c5f0 msgr2=0x7f43d406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:18.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.366+0000 7f43da5ec640 1 -- 172.21.15.72:0/3047841806 shutdown_connections 2023-12-13T00:28:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.366+0000 7f43da5ec640 1 -- 172.21.15.72:0/3047841806 wait complete. 2023-12-13T00:28:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.367+0000 7f43da5ec640 1 Processor -- start 2023-12-13T00:28:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.367+0000 7f43da5ec640 1 -- start start 2023-12-13T00:28:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.368+0000 7f43da5ec640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43d40c40d0 0x7f43d4155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.368+0000 7f43da5ec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43d40c5dd0 0x7f43d40c3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.368+0000 7f43da5ec640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43d4151040 0x7f43d40c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.368+0000 7f43da5ec640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40c3100 con 0x7f43d4151040 2023-12-13T00:28:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.368+0000 7f43da5ec640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d41f3290 con 0x7f43d40c40d0 2023-12-13T00:28:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.368+0000 7f43da5ec640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40c27d0 con 0x7f43d40c5dd0 2023-12-13T00:28:18.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.369+0000 7f43d3fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43d40c40d0 0x7f43d4155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.369+0000 7f43d37fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43d40c5dd0 0x7f43d40c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.369+0000 7f43d3fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43d40c40d0 0x7f43d4155a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:57390/0 (socket says 172.21.15.72:57390) 2023-12-13T00:28:18.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.369+0000 7f43d3fff640 1 -- 172.21.15.72:0/4265766104 learned_addr learned my addr 172.21.15.72:0/4265766104 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:18.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.372+0000 7f43d3fff640 1 -- 172.21.15.72:0/4265766104 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43d40c5dd0 msgr2=0x7f43d40c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.372+0000 7f43d3fff640 1 --2- 172.21.15.72:0/4265766104 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43d40c5dd0 0x7f43d40c3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.372+0000 7f43d3fff640 1 -- 172.21.15.72:0/4265766104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43d4151040 msgr2=0x7f43d40c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.372+0000 7f43d3fff640 1 --2- 172.21.15.72:0/4265766104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43d4151040 0x7f43d40c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.372+0000 7f43d3fff640 1 -- 172.21.15.72:0/4265766104 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c4009400 con 0x7f43d40c40d0 2023-12-13T00:28:18.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.374+0000 7f43d3fff640 1 --2- 172.21.15.72:0/4265766104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43d40c40d0 0x7f43d4155a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f43c40098c0 tx=0x7f43c40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:18.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.378+0000 7f43d0ff9640 1 -- 172.21.15.72:0/4265766104 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c403e070 con 0x7f43d40c40d0 2023-12-13T00:28:18.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.378+0000 7f43d0ff9640 1 -- 172.21.15.72:0/4265766104 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c4030e10 con 0x7f43d40c40d0 2023-12-13T00:28:18.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.378+0000 7f43d0ff9640 1 -- 172.21.15.72:0/4265766104 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4039c30 con 0x7f43d40c40d0 2023-12-13T00:28:18.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.378+0000 7f43da5ec640 1 -- 172.21.15.72:0/4265766104 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d40c2ab0 con 0x7f43d40c40d0 2023-12-13T00:28:18.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.378+0000 7f43da5ec640 1 -- 172.21.15.72:0/4265766104 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d406cb80 con 0x7f43d40c40d0 2023-12-13T00:28:18.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.379+0000 7f43da5ec640 1 -- 172.21.15.72:0/4265766104 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d4067470 con 0x7f43d40c40d0 2023-12-13T00:28:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.397+0000 7f43d0ff9640 1 -- 172.21.15.72:0/4265766104 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f43c40423f0 con 0x7f43d40c40d0 2023-12-13T00:28:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.397+0000 7f43d0ff9640 1 --2- 172.21.15.72:0/4265766104 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f43c006b210 0x7f43c006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.398+0000 7f43d37fe640 1 --2- 172.21.15.72:0/4265766104 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f43c006b210 0x7f43c006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.398+0000 7f43d37fe640 1 --2- 172.21.15.72:0/4265766104 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f43c006b210 0x7f43c006d6d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f43d41f0b70 tx=0x7f43c8009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.400+0000 7f43d0ff9640 1 -- 172.21.15.72:0/4265766104 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f43c407a600 con 0x7f43d40c40d0 2023-12-13T00:28:18.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.634+0000 7f43d0ff9640 1 -- 172.21.15.72:0/4265766104 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f43c4076940 con 0x7f43d40c40d0 2023-12-13T00:28:18.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.801+0000 7f43da5ec640 1 -- 172.21.15.72:0/4265766104 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f43d41509a0 con 0x7f43c006b210 2023-12-13T00:28:18.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.802+0000 7f43d0ff9640 1 -- 172.21.15.72:0/4265766104 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f43d41509a0 con 0x7f43c006b210 2023-12-13T00:28:18.803 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 5 to deep-scrub 2023-12-13T00:28:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.804+0000 7f43da5ec640 1 -- 172.21.15.72:0/4265766104 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f43c006b210 msgr2=0x7f43c006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.804+0000 7f43da5ec640 1 --2- 172.21.15.72:0/4265766104 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f43c006b210 0x7f43c006d6d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f43d41f0b70 tx=0x7f43c8009060 comp rx=0 tx=0).stop 2023-12-13T00:28:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.804+0000 7f43da5ec640 1 -- 172.21.15.72:0/4265766104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43d40c40d0 msgr2=0x7f43d4155a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.804+0000 7f43da5ec640 1 --2- 172.21.15.72:0/4265766104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43d40c40d0 0x7f43d4155a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f43c40098c0 tx=0x7f43c40046c0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.804+0000 7f43da5ec640 1 -- 172.21.15.72:0/4265766104 shutdown_connections 2023-12-13T00:28:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.804+0000 7f43da5ec640 1 --2- 172.21.15.72:0/4265766104 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f43c006b210 0x7f43c006d6d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.804+0000 7f43da5ec640 1 --2- 172.21.15.72:0/4265766104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43d4151040 0x7f43d40c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.804+0000 7f43da5ec640 1 --2- 172.21.15.72:0/4265766104 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43d40c5dd0 0x7f43d40c3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.804+0000 7f43da5ec640 1 --2- 172.21.15.72:0/4265766104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43d40c40d0 0x7f43d4155a50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.804+0000 7f43da5ec640 1 -- 172.21.15.72:0/4265766104 >> 172.21.15.72:0/4265766104 conn(0x7f43d406c5f0 msgr2=0x7f43d4073530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.804+0000 7f43da5ec640 1 -- 172.21.15.72:0/4265766104 shutdown_connections 2023-12-13T00:28:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.804+0000 7f43da5ec640 1 -- 172.21.15.72:0/4265766104 wait complete. 2023-12-13T00:28:18.815 INFO:tasks.ceph:Scrubbing osd.6 2023-12-13T00:28:18.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-13T00:28:18.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.919+0000 7fad2dbb6640 1 Processor -- start 2023-12-13T00:28:18.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.919+0000 7fad2dbb6640 1 -- start start 2023-12-13T00:28:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.920+0000 7fad2dbb6640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fad2815d0d0 0x7fad2806a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.920+0000 7fad2dbb6640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad28159f80 con 0x7fad2806a4b0 2023-12-13T00:28:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.920+0000 7fad2dbb6640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad281593d0 con 0x7fad280c59e0 2023-12-13T00:28:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.920+0000 7fad2dbb6640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad28072650 con 0x7fad2815d0d0 2023-12-13T00:28:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.920+0000 7fad277fe640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fad280c59e0 0x7fad2806d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:41064/0 (socket says 172.21.15.72:41064) 2023-12-13T00:28:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.920+0000 7fad277fe640 1 -- 172.21.15.72:0/528768357 learned_addr learned my addr 172.21.15.72:0/528768357 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:28:18.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.923+0000 7fad26ffd640 1 -- 172.21.15.72:0/528768357 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861934809 0 0) 0x7fad281593d0 con 0x7fad280c59e0 2023-12-13T00:28:18.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.923+0000 7fad26ffd640 1 -- 172.21.15.72:0/528768357 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad14003520 con 0x7fad280c59e0 2023-12-13T00:28:18.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.926+0000 7fad26ffd640 1 -- 172.21.15.72:0/528768357 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4129826659 0 0) 0x7fad14003520 con 0x7fad280c59e0 2023-12-13T00:28:18.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.926+0000 7fad26ffd640 1 -- 172.21.15.72:0/528768357 >> v2:172.21.15.72:3300/0 conn(0x7fad2815d0d0 msgr2=0x7fad2806a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:18.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.926+0000 7fad26ffd640 1 --2- 172.21.15.72:0/528768357 >> v2:172.21.15.72:3300/0 conn(0x7fad2815d0d0 0x7fad2806a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.926+0000 7fad26ffd640 1 -- 172.21.15.72:0/528768357 >> v1:172.21.15.72:6789/0 conn(0x7fad2806a4b0 legacy=0x7fad2815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:18.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.926+0000 7fad26ffd640 1 -- 172.21.15.72:0/528768357 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad280728f0 con 0x7fad280c59e0 2023-12-13T00:28:18.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.926+0000 7fad26ffd640 1 -- 172.21.15.72:0/528768357 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1233568696 0 0) 0x7fad18001670 con 0x7fad280c59e0 2023-12-13T00:28:18.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.926+0000 7fad26ffd640 1 -- 172.21.15.72:0/528768357 >> v1:172.21.15.176:6789/0 conn(0x7fad280c59e0 legacy=0x7fad2806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.926+0000 7fad26ffd640 1 --2- 172.21.15.72:0/528768357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad14003a30 0x7fad14003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.926+0000 7fad26ffd640 1 --2- 172.21.15.72:0/528768357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad140047c0 0x7fad14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.926+0000 7fad26ffd640 1 --2- 172.21.15.72:0/528768357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14005380 0x7fad1400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.926+0000 7fad26ffd640 1 -- 172.21.15.72:0/528768357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad28072650 con 0x7fad14003a30 2023-12-13T00:28:18.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.926+0000 7fad26ffd640 1 -- 172.21.15.72:0/528768357 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1400c230 con 0x7fad140047c0 2023-12-13T00:28:18.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.926+0000 7fad26ffd640 1 -- 172.21.15.72:0/528768357 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1400c3f0 con 0x7fad14005380 2023-12-13T00:28:18.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.926+0000 7fad27fff640 1 --2- 172.21.15.72:0/528768357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14005380 0x7fad1400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.929+0000 7fad1effd640 1 --2- 172.21.15.72:0/528768357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad140047c0 0x7fad14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.929+0000 7fad27fff640 1 -- 172.21.15.72:0/528768357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad140047c0 msgr2=0x7fad14004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:18.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.929+0000 7fad27fff640 1 --2- 172.21.15.72:0/528768357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad140047c0 0x7fad14004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.929+0000 7fad27fff640 1 -- 172.21.15.72:0/528768357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad14003a30 msgr2=0x7fad14003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:18.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.929+0000 7fad27fff640 1 --2- 172.21.15.72:0/528768357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad14003a30 0x7fad14003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.929+0000 7fad27fff640 1 -- 172.21.15.72:0/528768357 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad14003520 con 0x7fad14005380 2023-12-13T00:28:18.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.930+0000 7fad27fff640 1 -- 172.21.15.72:0/528768357 reap_dead start 2023-12-13T00:28:18.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.931+0000 7fad27fff640 1 --2- 172.21.15.72:0/528768357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14005380 0x7fad1400b980 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fad20009e40 tx=0x7fad140057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=243a0b70aca2887a server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:18.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.935+0000 7fad26ffd640 1 -- 172.21.15.72:0/528768357 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2002cd90 con 0x7fad14005380 2023-12-13T00:28:18.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.935+0000 7fad26ffd640 1 -- 172.21.15.72:0/528768357 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad20003990 con 0x7fad14005380 2023-12-13T00:28:18.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.935+0000 7fad26ffd640 1 -- 172.21.15.72:0/528768357 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20003d40 con 0x7fad14005380 2023-12-13T00:28:18.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.935+0000 7fad2dbb6640 1 -- 172.21.15.72:0/528768357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14005380 msgr2=0x7fad1400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.935+0000 7fad2dbb6640 1 --2- 172.21.15.72:0/528768357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14005380 0x7fad1400b980 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fad20009e40 tx=0x7fad140057f0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.936+0000 7fad2dbb6640 1 -- 172.21.15.72:0/528768357 shutdown_connections 2023-12-13T00:28:18.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.936+0000 7fad2dbb6640 1 --2- 172.21.15.72:0/528768357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14005380 0x7fad1400b980 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.936+0000 7fad2dbb6640 1 -- 172.21.15.72:0/528768357 >> 172.21.15.72:0/528768357 conn(0x7fad2806f6d0 msgr2=0x7fad2806fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:18.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.936+0000 7fad2dbb6640 1 -- 172.21.15.72:0/528768357 shutdown_connections 2023-12-13T00:28:18.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.936+0000 7fad2dbb6640 1 -- 172.21.15.72:0/528768357 wait complete. 2023-12-13T00:28:18.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.937+0000 7fad2dbb6640 1 Processor -- start 2023-12-13T00:28:18.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.937+0000 7fad2dbb6640 1 -- start start 2023-12-13T00:28:18.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.937+0000 7fad2dbb6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad14005380 0x7fad2814f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.938+0000 7fad2dbb6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad28150b90 0x7fad28152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.938+0000 7fad2dbb6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad2815c520 0x7fad281529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.938+0000 7fad2dbb6640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2815ca60 con 0x7fad14005380 2023-12-13T00:28:18.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.938+0000 7fad2dbb6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad281516d0 con 0x7fad2815c520 2023-12-13T00:28:18.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.938+0000 7fad2dbb6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad281519b0 con 0x7fad28150b90 2023-12-13T00:28:18.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.938+0000 7fad27fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad2815c520 0x7fad281529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.938+0000 7fad277fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad14005380 0x7fad2814f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.938+0000 7fad1effd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad28150b90 0x7fad28152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.938+0000 7fad27fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad2815c520 0x7fad281529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:57412/0 (socket says 172.21.15.72:57412) 2023-12-13T00:28:18.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.938+0000 7fad27fff640 1 -- 172.21.15.72:0/4250936895 learned_addr learned my addr 172.21.15.72:0/4250936895 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:18.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.942+0000 7fad277fe640 1 -- 172.21.15.72:0/4250936895 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad28150b90 msgr2=0x7fad28152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.942+0000 7fad277fe640 1 --2- 172.21.15.72:0/4250936895 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad28150b90 0x7fad28152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.942+0000 7fad277fe640 1 -- 172.21.15.72:0/4250936895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad2815c520 msgr2=0x7fad281529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.942+0000 7fad277fe640 1 --2- 172.21.15.72:0/4250936895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad2815c520 0x7fad281529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.942+0000 7fad277fe640 1 -- 172.21.15.72:0/4250936895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad28151c90 con 0x7fad14005380 2023-12-13T00:28:18.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.944+0000 7fad277fe640 1 --2- 172.21.15.72:0/4250936895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad14005380 0x7fad2814f150 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fad1800c730 tx=0x7fad1800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:18.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.947+0000 7fad24ff9640 1 -- 172.21.15.72:0/4250936895 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad180072d0 con 0x7fad14005380 2023-12-13T00:28:18.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.947+0000 7fad24ff9640 1 -- 172.21.15.72:0/4250936895 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad18007430 con 0x7fad14005380 2023-12-13T00:28:18.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.947+0000 7fad2dbb6640 1 -- 172.21.15.72:0/4250936895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2815d7c0 con 0x7fad14005380 2023-12-13T00:28:18.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.947+0000 7fad24ff9640 1 -- 172.21.15.72:0/4250936895 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad180047e0 con 0x7fad14005380 2023-12-13T00:28:18.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.947+0000 7fad2dbb6640 1 -- 172.21.15.72:0/4250936895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2806d9d0 con 0x7fad14005380 2023-12-13T00:28:18.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.948+0000 7fad2dbb6640 1 -- 172.21.15.72:0/4250936895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fad28151840 con 0x7fad14005380 2023-12-13T00:28:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.967+0000 7fad24ff9640 1 -- 172.21.15.72:0/4250936895 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fad1800a5e0 con 0x7fad14005380 2023-12-13T00:28:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.968+0000 7fad24ff9640 1 --2- 172.21.15.72:0/4250936895 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fad0806b240 0x7fad0806d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.968+0000 7fad1effd640 1 --2- 172.21.15.72:0/4250936895 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fad0806b240 0x7fad0806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.968+0000 7fad1effd640 1 --2- 172.21.15.72:0/4250936895 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fad0806b240 0x7fad0806d700 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fad10007fd0 tx=0x7fad10009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:18.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.972+0000 7fad24ff9640 1 -- 172.21.15.72:0/4250936895 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fad1801ee70 con 0x7fad14005380 2023-12-13T00:28:18.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.972+0000 7fad24ff9640 1 --2- 172.21.15.72:0/4250936895 >> [v2:172.21.15.176:6824/2380480963,v1:172.21.15.176:6825/2380480963] conn(0x7fad08074a20 0x7fad08076ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:18.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.972+0000 7fad24ff9640 1 -- 172.21.15.72:0/4250936895 --> [v2:172.21.15.176:6824/2380480963,v1:172.21.15.176:6825/2380480963] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad08077590 con 0x7fad08074a20 2023-12-13T00:28:18.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.972+0000 7fad24ff9640 1 -- 172.21.15.72:0/4250936895 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad18054800 con 0x7fad14005380 2023-12-13T00:28:18.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.973+0000 7fad27fff640 1 --2- 172.21.15.72:0/4250936895 >> [v2:172.21.15.176:6824/2380480963,v1:172.21.15.176:6825/2380480963] conn(0x7fad08074a20 0x7fad08076ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:18.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.973+0000 7fad27fff640 1 --2- 172.21.15.72:0/4250936895 >> [v2:172.21.15.176:6824/2380480963,v1:172.21.15.176:6825/2380480963] conn(0x7fad08074a20 0x7fad08076ec0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:18.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.974+0000 7fad24ff9640 1 -- 172.21.15.72:0/4250936895 <== osd.6 v2:172.21.15.176:6824/2380480963 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fad08077590 con 0x7fad08074a20 2023-12-13T00:28:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.987+0000 7fad2dbb6640 1 -- 172.21.15.72:0/4250936895 --> [v2:172.21.15.176:6824/2380480963,v1:172.21.15.176:6825/2380480963] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fad28159c10 con 0x7fad08074a20 2023-12-13T00:28:18.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.987+0000 7fad24ff9640 1 -- 172.21.15.72:0/4250936895 <== osd.6 v2:172.21.15.176:6824/2380480963 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fad2002cdd0 con 0x7fad08074a20 2023-12-13T00:28:18.988 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-12-13T00:28:18.988 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-13T00:28:18.988 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-12-13T00:28:18.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.988+0000 7fad2dbb6640 1 -- 172.21.15.72:0/4250936895 >> [v2:172.21.15.176:6824/2380480963,v1:172.21.15.176:6825/2380480963] conn(0x7fad08074a20 msgr2=0x7fad08076ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.988+0000 7fad2dbb6640 1 --2- 172.21.15.72:0/4250936895 >> [v2:172.21.15.176:6824/2380480963,v1:172.21.15.176:6825/2380480963] conn(0x7fad08074a20 0x7fad08076ec0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.988+0000 7fad2dbb6640 1 -- 172.21.15.72:0/4250936895 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fad0806b240 msgr2=0x7fad0806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.988+0000 7fad2dbb6640 1 --2- 172.21.15.72:0/4250936895 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fad0806b240 0x7fad0806d700 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fad10007fd0 tx=0x7fad10009040 comp rx=0 tx=0).stop 2023-12-13T00:28:18.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.988+0000 7fad2dbb6640 1 -- 172.21.15.72:0/4250936895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad14005380 msgr2=0x7fad2814f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:18.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.988+0000 7fad2dbb6640 1 --2- 172.21.15.72:0/4250936895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad14005380 0x7fad2814f150 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fad1800c730 tx=0x7fad1800cbf0 comp rx=0 tx=0).stop 2023-12-13T00:28:18.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.988+0000 7fad27fff640 1 -- 172.21.15.72:0/4250936895 reap_dead start 2023-12-13T00:28:18.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.988+0000 7fad2dbb6640 1 -- 172.21.15.72:0/4250936895 shutdown_connections 2023-12-13T00:28:18.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.988+0000 7fad2dbb6640 1 -- 172.21.15.72:0/4250936895 >> 172.21.15.72:0/4250936895 conn(0x7fad2806f6d0 msgr2=0x7fad2806fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:18.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.988+0000 7fad2dbb6640 1 -- 172.21.15.72:0/4250936895 shutdown_connections 2023-12-13T00:28:18.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:18.988+0000 7fad2dbb6640 1 -- 172.21.15.72:0/4250936895 wait complete. 2023-12-13T00:28:18.999 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-13T00:28:19.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.100+0000 7f439f59e640 1 Processor -- start 2023-12-13T00:28:19.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.100+0000 7f439f59e640 1 -- start start 2023-12-13T00:28:19.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.101+0000 7f439f59e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43a00cb270 0x7f43a0159440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.101+0000 7f439f59e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f43a006d320 0x7f43a0159980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.101+0000 7f439f59e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a0153c10 con 0x7f43a0153830 2023-12-13T00:28:19.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.101+0000 7f439f59e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a00c9d50 con 0x7f43a006d320 2023-12-13T00:28:19.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.101+0000 7f439f59e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a00cdee0 con 0x7f43a00cb270 2023-12-13T00:28:19.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.101+0000 7f4397fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43a00cb270 0x7f43a0159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.102+0000 7f439ed9d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f43a006d320 0x7f43a0159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.102+0000 7f439e59c640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f43a0153830 0x7f43a00cb730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:41078/0 (socket says 172.21.15.72:41078) 2023-12-13T00:28:19.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.102+0000 7f439e59c640 1 -- 172.21.15.72:0/2434395291 learned_addr learned my addr 172.21.15.72:0/2434395291 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:28:19.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.104+0000 7f4397fff640 1 -- 172.21.15.72:0/2434395291 >> v2:172.21.15.176:3300/0 conn(0x7f43a006d320 msgr2=0x7f43a0159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:19.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.104+0000 7f4397fff640 1 --2- 172.21.15.72:0/2434395291 >> v2:172.21.15.176:3300/0 conn(0x7f43a006d320 0x7f43a0159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.104+0000 7f4397fff640 1 -- 172.21.15.72:0/2434395291 >> v1:172.21.15.176:6789/0 conn(0x7f43a0153830 legacy=0x7f43a00cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:19.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.104+0000 7f4397fff640 1 -- 172.21.15.72:0/2434395291 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a00c9a70 con 0x7f43a00cb270 2023-12-13T00:28:19.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.106+0000 7f4397fff640 1 --2- 172.21.15.72:0/2434395291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43a00cb270 0x7f43a0159440 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f43880097a0 tx=0x7f438802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bcf16d8828fcf72 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:19.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.110+0000 7f439dd9b640 1 -- 172.21.15.72:0/2434395291 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388030610 con 0x7f43a00cb270 2023-12-13T00:28:19.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.110+0000 7f439dd9b640 1 -- 172.21.15.72:0/2434395291 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4388030770 con 0x7f43a00cb270 2023-12-13T00:28:19.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.110+0000 7f439dd9b640 1 -- 172.21.15.72:0/2434395291 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388030b00 con 0x7f43a00cb270 2023-12-13T00:28:19.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.111+0000 7f439f59e640 1 -- 172.21.15.72:0/2434395291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43a00cb270 msgr2=0x7f43a0159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:19.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.111+0000 7f439f59e640 1 --2- 172.21.15.72:0/2434395291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43a00cb270 0x7f43a0159440 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f43880097a0 tx=0x7f438802b960 comp rx=0 tx=0).stop 2023-12-13T00:28:19.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.111+0000 7f439f59e640 1 -- 172.21.15.72:0/2434395291 shutdown_connections 2023-12-13T00:28:19.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.111+0000 7f439f59e640 1 --2- 172.21.15.72:0/2434395291 >> v2:172.21.15.176:3300/0 conn(0x7f43a006d320 0x7f43a0159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.111+0000 7f439f59e640 1 --2- 172.21.15.72:0/2434395291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43a00cb270 0x7f43a0159440 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.111+0000 7f439f59e640 1 -- 172.21.15.72:0/2434395291 >> 172.21.15.72:0/2434395291 conn(0x7f43a00b0830 msgr2=0x7f43a00b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:19.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.111+0000 7f439f59e640 1 -- 172.21.15.72:0/2434395291 shutdown_connections 2023-12-13T00:28:19.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.111+0000 7f439f59e640 1 -- 172.21.15.72:0/2434395291 wait complete. 2023-12-13T00:28:19.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.112+0000 7f439f59e640 1 Processor -- start 2023-12-13T00:28:19.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.112+0000 7f439f59e640 1 -- start start 2023-12-13T00:28:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.113+0000 7f439f59e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a006d320 0x7f43a01ef660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.113+0000 7f439f59e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43a00cb270 0x7f43a00c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.113+0000 7f439f59e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43a0153830 0x7f43a01462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.113+0000 7f439f59e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a01eec90 con 0x7f43a006d320 2023-12-13T00:28:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.113+0000 7f439f59e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a0153e50 con 0x7f43a00cb270 2023-12-13T00:28:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.113+0000 7f439f59e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a01ef1d0 con 0x7f43a0153830 2023-12-13T00:28:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.113+0000 7f439e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a006d320 0x7f43a01ef660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.113+0000 7f4397fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43a00cb270 0x7f43a00c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.113+0000 7f439ed9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43a0153830 0x7f43a01462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.114+0000 7f4397fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43a00cb270 0x7f43a00c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:57428/0 (socket says 172.21.15.72:57428) 2023-12-13T00:28:19.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.114+0000 7f4397fff640 1 -- 172.21.15.72:0/1492320819 learned_addr learned my addr 172.21.15.72:0/1492320819 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:19.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.117+0000 7f439e59c640 1 -- 172.21.15.72:0/1492320819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43a0153830 msgr2=0x7f43a01462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:19.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.117+0000 7f439e59c640 1 --2- 172.21.15.72:0/1492320819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43a0153830 0x7f43a01462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.117+0000 7f439e59c640 1 -- 172.21.15.72:0/1492320819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43a00cb270 msgr2=0x7f43a00c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:19.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.117+0000 7f439e59c640 1 --2- 172.21.15.72:0/1492320819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43a00cb270 0x7f43a00c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.117+0000 7f439e59c640 1 -- 172.21.15.72:0/1492320819 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4388009400 con 0x7f43a006d320 2023-12-13T00:28:19.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.119+0000 7f439e59c640 1 --2- 172.21.15.72:0/1492320819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a006d320 0x7f43a01ef660 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f439000c390 tx=0x7f439000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:19.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.123+0000 7f4396ffd640 1 -- 172.21.15.72:0/1492320819 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390005ce0 con 0x7f43a006d320 2023-12-13T00:28:19.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.123+0000 7f4396ffd640 1 -- 172.21.15.72:0/1492320819 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4390005e40 con 0x7f43a006d320 2023-12-13T00:28:19.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.123+0000 7f4396ffd640 1 -- 172.21.15.72:0/1492320819 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390007310 con 0x7f43a006d320 2023-12-13T00:28:19.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.123+0000 7f439f59e640 1 -- 172.21.15.72:0/1492320819 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a01eee80 con 0x7f43a006d320 2023-12-13T00:28:19.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.123+0000 7f439f59e640 1 -- 172.21.15.72:0/1492320819 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a01efba0 con 0x7f43a006d320 2023-12-13T00:28:19.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.124+0000 7f439f59e640 1 -- 172.21.15.72:0/1492320819 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a01ef010 con 0x7f43a006d320 2023-12-13T00:28:19.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.373+0000 7f4396ffd640 1 -- 172.21.15.72:0/1492320819 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4390007470 con 0x7f43a006d320 2023-12-13T00:28:19.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.374+0000 7f4396ffd640 1 --2- 172.21.15.72:0/1492320819 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f438006b210 0x7f438006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.374+0000 7f4397fff640 1 --2- 172.21.15.72:0/1492320819 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f438006b210 0x7f438006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.374+0000 7f4397fff640 1 --2- 172.21.15.72:0/1492320819 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f438006b210 0x7f438006d6d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f43a00b02e0 tx=0x7f4388008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.386+0000 7f4396ffd640 1 -- 172.21.15.72:0/1492320819 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f4390001000 con 0x7f43a006d320 2023-12-13T00:28:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.386+0000 7f4396ffd640 1 -- 172.21.15.72:0/1492320819 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4390053d50 con 0x7f43a006d320 2023-12-13T00:28:19.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.592+0000 7f439f59e640 1 -- 172.21.15.72:0/1492320819 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f43a0067470 con 0x7f438006b210 2023-12-13T00:28:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.592+0000 7f4396ffd640 1 -- 172.21.15.72:0/1492320819 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f43a0067470 con 0x7f438006b210 2023-12-13T00:28:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 6 to deep-scrub 2023-12-13T00:28:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.594+0000 7f439f59e640 1 -- 172.21.15.72:0/1492320819 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f438006b210 msgr2=0x7f438006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.594+0000 7f439f59e640 1 --2- 172.21.15.72:0/1492320819 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f438006b210 0x7f438006d6d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f43a00b02e0 tx=0x7f4388008030 comp rx=0 tx=0).stop 2023-12-13T00:28:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.594+0000 7f439f59e640 1 -- 172.21.15.72:0/1492320819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a006d320 msgr2=0x7f43a01ef660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.594+0000 7f439f59e640 1 --2- 172.21.15.72:0/1492320819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a006d320 0x7f43a01ef660 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f439000c390 tx=0x7f439000c790 comp rx=0 tx=0).stop 2023-12-13T00:28:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.594+0000 7f439f59e640 1 -- 172.21.15.72:0/1492320819 shutdown_connections 2023-12-13T00:28:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.594+0000 7f439f59e640 1 --2- 172.21.15.72:0/1492320819 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f438006b210 0x7f438006d6d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.594+0000 7f439f59e640 1 --2- 172.21.15.72:0/1492320819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43a0153830 0x7f43a01462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.594+0000 7f439f59e640 1 --2- 172.21.15.72:0/1492320819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43a00cb270 0x7f43a00c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.594+0000 7f439f59e640 1 --2- 172.21.15.72:0/1492320819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a006d320 0x7f43a01ef660 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.594+0000 7f439f59e640 1 -- 172.21.15.72:0/1492320819 >> 172.21.15.72:0/1492320819 conn(0x7f43a00b0830 msgr2=0x7f43a01512c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.594+0000 7f439f59e640 1 -- 172.21.15.72:0/1492320819 shutdown_connections 2023-12-13T00:28:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.595+0000 7f439f59e640 1 -- 172.21.15.72:0/1492320819 wait complete. 2023-12-13T00:28:19.608 INFO:tasks.ceph:Scrubbing osd.7 2023-12-13T00:28:19.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-13T00:28:19.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.712+0000 7f9e6849b640 1 Processor -- start 2023-12-13T00:28:19.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.712+0000 7f9e6849b640 1 -- start start 2023-12-13T00:28:19.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.713+0000 7f9e6849b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e600cc420 0x7f9e60159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.713+0000 7f9e6849b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9e60159b50 0x7f9e600c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.713+0000 7f9e6849b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e600cbda0 con 0x7f9e600cda70 2023-12-13T00:28:19.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.713+0000 7f9e6849b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e600cc230 con 0x7f9e60159b50 2023-12-13T00:28:19.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.713+0000 7f9e6849b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e600cea60 con 0x7f9e600cc420 2023-12-13T00:28:19.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.714+0000 7f9e66a38640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9e60159b50 0x7f9e600c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.714+0000 7f9e66237640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f9e600cda70 0x7f9e600ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:41092/0 (socket says 172.21.15.72:41092) 2023-12-13T00:28:19.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.714+0000 7f9e66237640 1 -- 172.21.15.72:0/1178317620 learned_addr learned my addr 172.21.15.72:0/1178317620 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:28:19.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.714+0000 7f9e65a36640 1 --2- 172.21.15.72:0/1178317620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e600cc420 0x7f9e60159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.716+0000 7f9e66a38640 1 -- 172.21.15.72:0/1178317620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e600cc420 msgr2=0x7f9e60159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:19.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.716+0000 7f9e66a38640 1 --2- 172.21.15.72:0/1178317620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e600cc420 0x7f9e60159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.716+0000 7f9e66a38640 1 -- 172.21.15.72:0/1178317620 >> v1:172.21.15.176:6789/0 conn(0x7f9e600cda70 legacy=0x7f9e600ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:19.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.716+0000 7f9e66a38640 1 -- 172.21.15.72:0/1178317620 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e600cb4e0 con 0x7f9e60159b50 2023-12-13T00:28:19.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.718+0000 7f9e66a38640 1 --2- 172.21.15.72:0/1178317620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e60159b50 0x7f9e600c9620 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9e58009d90 tx=0x7f9e5802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ba9f08b1550393 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:19.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.720+0000 7f9e65235640 1 -- 172.21.15.72:0/1178317620 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5802cce0 con 0x7f9e60159b50 2023-12-13T00:28:19.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.722+0000 7f9e65235640 1 -- 172.21.15.72:0/1178317620 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5802ce40 con 0x7f9e60159b50 2023-12-13T00:28:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.722+0000 7f9e65235640 1 -- 172.21.15.72:0/1178317620 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e58034660 con 0x7f9e60159b50 2023-12-13T00:28:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.722+0000 7f9e6849b640 1 -- 172.21.15.72:0/1178317620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e60159b50 msgr2=0x7f9e600c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.722+0000 7f9e6849b640 1 --2- 172.21.15.72:0/1178317620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e60159b50 0x7f9e600c9620 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9e58009d90 tx=0x7f9e5802bf30 comp rx=0 tx=0).stop 2023-12-13T00:28:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.722+0000 7f9e6849b640 1 -- 172.21.15.72:0/1178317620 shutdown_connections 2023-12-13T00:28:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.722+0000 7f9e6849b640 1 --2- 172.21.15.72:0/1178317620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e60159b50 0x7f9e600c9620 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.722+0000 7f9e6849b640 1 --2- 172.21.15.72:0/1178317620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e600cc420 0x7f9e60159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.722+0000 7f9e6849b640 1 -- 172.21.15.72:0/1178317620 >> 172.21.15.72:0/1178317620 conn(0x7f9e600b07b0 msgr2=0x7f9e600b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.722+0000 7f9e6849b640 1 -- 172.21.15.72:0/1178317620 shutdown_connections 2023-12-13T00:28:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.722+0000 7f9e6849b640 1 -- 172.21.15.72:0/1178317620 wait complete. 2023-12-13T00:28:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.724+0000 7f9e6849b640 1 Processor -- start 2023-12-13T00:28:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.724+0000 7f9e6849b640 1 -- start start 2023-12-13T00:28:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.725+0000 7f9e6849b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e600cc420 0x7f9e60152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.725+0000 7f9e6849b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e600cda70 0x7f9e600c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.725+0000 7f9e6849b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e60159b50 0x7f9e600b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.725+0000 7f9e6849b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e600b3f80 con 0x7f9e60159b50 2023-12-13T00:28:19.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.725+0000 7f9e6849b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e601591c0 con 0x7f9e600cc420 2023-12-13T00:28:19.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.725+0000 7f9e6849b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e60159490 con 0x7f9e600cda70 2023-12-13T00:28:19.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.725+0000 7f9e66a38640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e60159b50 0x7f9e600b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.725+0000 7f9e65a36640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e600cda70 0x7f9e600c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.725+0000 7f9e66a38640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e60159b50 0x7f9e600b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57978/0 (socket says 172.21.15.72:57978) 2023-12-13T00:28:19.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.725+0000 7f9e66a38640 1 -- 172.21.15.72:0/3428513879 learned_addr learned my addr 172.21.15.72:0/3428513879 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:19.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.725+0000 7f9e66237640 1 --2- 172.21.15.72:0/3428513879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e600cc420 0x7f9e60152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.728+0000 7f9e66a38640 1 -- 172.21.15.72:0/3428513879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e600cda70 msgr2=0x7f9e600c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:19.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.728+0000 7f9e66a38640 1 --2- 172.21.15.72:0/3428513879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e600cda70 0x7f9e600c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.728+0000 7f9e66a38640 1 -- 172.21.15.72:0/3428513879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e600cc420 msgr2=0x7f9e60152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:19.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.728+0000 7f9e66a38640 1 --2- 172.21.15.72:0/3428513879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e600cc420 0x7f9e60152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.728+0000 7f9e66a38640 1 -- 172.21.15.72:0/3428513879 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e58009a70 con 0x7f9e60159b50 2023-12-13T00:28:19.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.731+0000 7f9e66a38640 1 --2- 172.21.15.72:0/3428513879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e60159b50 0x7f9e600b1840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9e58009d90 tx=0x7f9e58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:19.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.734+0000 7f9e56ffd640 1 -- 172.21.15.72:0/3428513879 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5803d600 con 0x7f9e60159b50 2023-12-13T00:28:19.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.734+0000 7f9e56ffd640 1 -- 172.21.15.72:0/3428513879 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5803d780 con 0x7f9e60159b50 2023-12-13T00:28:19.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.734+0000 7f9e56ffd640 1 -- 172.21.15.72:0/3428513879 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5803db30 con 0x7f9e60159b50 2023-12-13T00:28:19.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.734+0000 7f9e6849b640 1 -- 172.21.15.72:0/3428513879 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e60159770 con 0x7f9e60159b50 2023-12-13T00:28:19.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.734+0000 7f9e6849b640 1 -- 172.21.15.72:0/3428513879 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e600b3c10 con 0x7f9e60159b50 2023-12-13T00:28:19.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.735+0000 7f9e6849b640 1 -- 172.21.15.72:0/3428513879 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e600cb750 con 0x7f9e60159b50 2023-12-13T00:28:19.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.754+0000 7f9e56ffd640 1 -- 172.21.15.72:0/3428513879 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9e5803b040 con 0x7f9e60159b50 2023-12-13T00:28:19.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.754+0000 7f9e56ffd640 1 --2- 172.21.15.72:0/3428513879 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9e4406b210 0x7f9e4406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.754+0000 7f9e66237640 1 --2- 172.21.15.72:0/3428513879 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9e4406b210 0x7f9e4406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.755+0000 7f9e66237640 1 --2- 172.21.15.72:0/3428513879 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9e4406b210 0x7f9e4406d6d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c005880 tx=0x7f9e5c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:19.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.757+0000 7f9e56ffd640 1 -- 172.21.15.72:0/3428513879 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f9e5807ae20 con 0x7f9e60159b50 2023-12-13T00:28:19.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.757+0000 7f9e56ffd640 1 --2- 172.21.15.72:0/3428513879 >> [v2:172.21.15.176:6816/2976728609,v1:172.21.15.176:6817/2976728609] conn(0x7f9e44074970 0x7f9e44076e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.757+0000 7f9e56ffd640 1 -- 172.21.15.72:0/3428513879 --> [v2:172.21.15.176:6816/2976728609,v1:172.21.15.176:6817/2976728609] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e440774e0 con 0x7f9e44074970 2023-12-13T00:28:19.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.757+0000 7f9e65a36640 1 --2- 172.21.15.72:0/3428513879 >> [v2:172.21.15.176:6816/2976728609,v1:172.21.15.176:6817/2976728609] conn(0x7f9e44074970 0x7f9e44076e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.758+0000 7f9e56ffd640 1 -- 172.21.15.72:0/3428513879 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e58077160 con 0x7f9e60159b50 2023-12-13T00:28:19.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.758+0000 7f9e65a36640 1 --2- 172.21.15.72:0/3428513879 >> [v2:172.21.15.176:6816/2976728609,v1:172.21.15.176:6817/2976728609] conn(0x7f9e44074970 0x7f9e44076e10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:19.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.759+0000 7f9e56ffd640 1 -- 172.21.15.72:0/3428513879 <== osd.7 v2:172.21.15.176:6816/2976728609 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9e440774e0 con 0x7f9e44074970 2023-12-13T00:28:19.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.772+0000 7f9e6849b640 1 -- 172.21.15.72:0/3428513879 --> [v2:172.21.15.176:6816/2976728609,v1:172.21.15.176:6817/2976728609] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9e600cd0e0 con 0x7f9e44074970 2023-12-13T00:28:19.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.772+0000 7f9e56ffd640 1 -- 172.21.15.72:0/3428513879 <== osd.7 v2:172.21.15.176:6816/2976728609 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9e50009d50 con 0x7f9e44074970 2023-12-13T00:28:19.774 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-12-13T00:28:19.774 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-13T00:28:19.774 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-12-13T00:28:19.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.773+0000 7f9e6849b640 1 -- 172.21.15.72:0/3428513879 >> [v2:172.21.15.176:6816/2976728609,v1:172.21.15.176:6817/2976728609] conn(0x7f9e44074970 msgr2=0x7f9e44076e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:19.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.773+0000 7f9e6849b640 1 --2- 172.21.15.72:0/3428513879 >> [v2:172.21.15.176:6816/2976728609,v1:172.21.15.176:6817/2976728609] conn(0x7f9e44074970 0x7f9e44076e10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.773+0000 7f9e6849b640 1 -- 172.21.15.72:0/3428513879 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9e4406b210 msgr2=0x7f9e4406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:19.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.773+0000 7f9e6849b640 1 --2- 172.21.15.72:0/3428513879 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f9e4406b210 0x7f9e4406d6d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c005880 tx=0x7f9e5c009040 comp rx=0 tx=0).stop 2023-12-13T00:28:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.773+0000 7f9e6849b640 1 -- 172.21.15.72:0/3428513879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e60159b50 msgr2=0x7f9e600b1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.773+0000 7f9e6849b640 1 --2- 172.21.15.72:0/3428513879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e60159b50 0x7f9e600b1840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9e58009d90 tx=0x7f9e58004a40 comp rx=0 tx=0).stop 2023-12-13T00:28:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.773+0000 7f9e66a38640 1 -- 172.21.15.72:0/3428513879 reap_dead start 2023-12-13T00:28:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.773+0000 7f9e6849b640 1 -- 172.21.15.72:0/3428513879 shutdown_connections 2023-12-13T00:28:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.773+0000 7f9e6849b640 1 -- 172.21.15.72:0/3428513879 >> 172.21.15.72:0/3428513879 conn(0x7f9e600b07b0 msgr2=0x7f9e600b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.773+0000 7f9e6849b640 1 -- 172.21.15.72:0/3428513879 shutdown_connections 2023-12-13T00:28:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.773+0000 7f9e6849b640 1 -- 172.21.15.72:0/3428513879 wait complete. 2023-12-13T00:28:19.785 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-13T00:28:19.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.888+0000 7f9028589640 1 Processor -- start 2023-12-13T00:28:19.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.888+0000 7f9028589640 1 -- start start 2023-12-13T00:28:19.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.888+0000 7f9028589640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f90200c52e0 0x7f90200c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.889+0000 7f9028589640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90200c56c0 0x7f90200c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.889+0000 7f9028589640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f902015ac30 0x7f902015b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.889+0000 7f9028589640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90200c7250 con 0x7f902015ac30 2023-12-13T00:28:19.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.889+0000 7f9028589640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902015a7a0 con 0x7f90200c52e0 2023-12-13T00:28:19.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.889+0000 7f9028589640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902015b600 con 0x7f90200c56c0 2023-12-13T00:28:19.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.889+0000 7f9026b26640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f902015ac30 0x7f902015b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.889+0000 7f9025b24640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90200c56c0 0x7f90200c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.889+0000 7f9026325640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f90200c52e0 0x7f90200c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.889+0000 7f9026b26640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f902015ac30 0x7f902015b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57992/0 (socket says 172.21.15.72:57992) 2023-12-13T00:28:19.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.889+0000 7f9026b26640 1 -- 172.21.15.72:0/1392151621 learned_addr learned my addr 172.21.15.72:0/1392151621 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:19.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.891+0000 7f9026b26640 1 -- 172.21.15.72:0/1392151621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90200c56c0 msgr2=0x7f90200c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:19.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.891+0000 7f9026b26640 1 --2- 172.21.15.72:0/1392151621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90200c56c0 0x7f90200c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.892+0000 7f9026b26640 1 -- 172.21.15.72:0/1392151621 >> v2:172.21.15.176:3300/0 conn(0x7f90200c52e0 msgr2=0x7f90200c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:28:19.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.892+0000 7f9026b26640 1 --2- 172.21.15.72:0/1392151621 >> v2:172.21.15.176:3300/0 conn(0x7f90200c52e0 0x7f90200c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.892+0000 7f9026b26640 1 -- 172.21.15.72:0/1392151621 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90201574c0 con 0x7f902015ac30 2023-12-13T00:28:19.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.893+0000 7f9026b26640 1 --2- 172.21.15.72:0/1392151621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f902015ac30 0x7f902015b0c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9020070e20 tx=0x7f901802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c225baaf71132b server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:19.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.897+0000 7f9025323640 1 -- 172.21.15.72:0/1392151621 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901802cb00 con 0x7f902015ac30 2023-12-13T00:28:19.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.897+0000 7f9025323640 1 -- 172.21.15.72:0/1392151621 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901802cc60 con 0x7f902015ac30 2023-12-13T00:28:19.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.897+0000 7f9025323640 1 -- 172.21.15.72:0/1392151621 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90180343f0 con 0x7f902015ac30 2023-12-13T00:28:19.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.897+0000 7f9028589640 1 -- 172.21.15.72:0/1392151621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f902015ac30 msgr2=0x7f902015b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:19.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.897+0000 7f9028589640 1 --2- 172.21.15.72:0/1392151621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f902015ac30 0x7f902015b0c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9020070e20 tx=0x7f901802bf60 comp rx=0 tx=0).stop 2023-12-13T00:28:19.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.898+0000 7f9028589640 1 -- 172.21.15.72:0/1392151621 shutdown_connections 2023-12-13T00:28:19.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.898+0000 7f9028589640 1 --2- 172.21.15.72:0/1392151621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f902015ac30 0x7f902015b0c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.898+0000 7f9028589640 1 --2- 172.21.15.72:0/1392151621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90200c56c0 0x7f90200c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.898+0000 7f9028589640 1 --2- 172.21.15.72:0/1392151621 >> v2:172.21.15.176:3300/0 conn(0x7f90200c52e0 0x7f90200c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.898+0000 7f9028589640 1 -- 172.21.15.72:0/1392151621 >> 172.21.15.72:0/1392151621 conn(0x7f902006f6d0 msgr2=0x7f902006fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:19.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.898+0000 7f9028589640 1 -- 172.21.15.72:0/1392151621 shutdown_connections 2023-12-13T00:28:19.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.898+0000 7f9028589640 1 -- 172.21.15.72:0/1392151621 wait complete. 2023-12-13T00:28:19.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.899+0000 7f9028589640 1 Processor -- start 2023-12-13T00:28:19.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.899+0000 7f9028589640 1 -- start start 2023-12-13T00:28:19.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.899+0000 7f9028589640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90200c52e0 0x7f9020145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.899+0000 7f9028589640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90200c56c0 0x7f90201ed870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.899+0000 7f9028589640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f902015ac30 0x7f90201f0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:19.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.899+0000 7f9028589640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90201f11b0 con 0x7f902015ac30 2023-12-13T00:28:19.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.899+0000 7f9028589640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90201ece00 con 0x7f90200c56c0 2023-12-13T00:28:19.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.899+0000 7f9028589640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902014bbf0 con 0x7f90200c52e0 2023-12-13T00:28:19.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.900+0000 7f9026b26640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f902015ac30 0x7f90201f0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.900+0000 7f9026325640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90200c52e0 0x7f9020145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.900+0000 7f9025b24640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90200c56c0 0x7f90201ed870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:19.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.900+0000 7f9026b26640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f902015ac30 0x7f90201f0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58000/0 (socket says 172.21.15.72:58000) 2023-12-13T00:28:19.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.900+0000 7f9026b26640 1 -- 172.21.15.72:0/3380116859 learned_addr learned my addr 172.21.15.72:0/3380116859 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:19.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.904+0000 7f9026325640 1 -- 172.21.15.72:0/3380116859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90200c56c0 msgr2=0x7f90201ed870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:19.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.904+0000 7f9026325640 1 --2- 172.21.15.72:0/3380116859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90200c56c0 0x7f90201ed870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.904+0000 7f9026325640 1 -- 172.21.15.72:0/3380116859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f902015ac30 msgr2=0x7f90201f0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:19.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.904+0000 7f9026325640 1 --2- 172.21.15.72:0/3380116859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f902015ac30 0x7f90201f0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:19.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.904+0000 7f9026325640 1 -- 172.21.15.72:0/3380116859 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9018009b30 con 0x7f90200c52e0 2023-12-13T00:28:19.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.907+0000 7f9026325640 1 --2- 172.21.15.72:0/3380116859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90200c52e0 0x7f9020145240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f901c00e870 tx=0x7f901c00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:19.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.911+0000 7f9016ffd640 1 -- 172.21.15.72:0/3380116859 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c00c940 con 0x7f90200c52e0 2023-12-13T00:28:19.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.911+0000 7f9016ffd640 1 -- 172.21.15.72:0/3380116859 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901c00caa0 con 0x7f90200c52e0 2023-12-13T00:28:19.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.911+0000 7f9028589640 1 -- 172.21.15.72:0/3380116859 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902014bed0 con 0x7f90200c52e0 2023-12-13T00:28:19.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.911+0000 7f9016ffd640 1 -- 172.21.15.72:0/3380116859 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c00ce10 con 0x7f90200c52e0 2023-12-13T00:28:19.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.911+0000 7f9028589640 1 -- 172.21.15.72:0/3380116859 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90201ed350 con 0x7f90200c52e0 2023-12-13T00:28:19.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:19.912+0000 7f9028589640 1 -- 172.21.15.72:0/3380116859 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90201ed510 con 0x7f90200c52e0 2023-12-13T00:28:20.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.156+0000 7f9016ffd640 1 -- 172.21.15.72:0/3380116859 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f901c013470 con 0x7f90200c52e0 2023-12-13T00:28:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.156+0000 7f9016ffd640 1 --2- 172.21.15.72:0/3380116859 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f900406b210 0x7f900406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.156+0000 7f9025b24640 1 --2- 172.21.15.72:0/3380116859 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f900406b210 0x7f900406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.157+0000 7f9025b24640 1 --2- 172.21.15.72:0/3380116859 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f900406b210 0x7f900406d6d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9020071a80 tx=0x7f9010009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:20.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.160+0000 7f9016ffd640 1 -- 172.21.15.72:0/3380116859 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f901c058cd0 con 0x7f90200c52e0 2023-12-13T00:28:20.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.170+0000 7f9016ffd640 1 -- 172.21.15.72:0/3380116859 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f901c055010 con 0x7f90200c52e0 2023-12-13T00:28:20.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.342+0000 7f9028589640 1 -- 172.21.15.72:0/3380116859 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f9020156840 con 0x7f900406b210 2023-12-13T00:28:20.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.343+0000 7f9016ffd640 1 -- 172.21.15.72:0/3380116859 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9020156840 con 0x7f900406b210 2023-12-13T00:28:20.344 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 7 to deep-scrub 2023-12-13T00:28:20.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.345+0000 7f9028589640 1 -- 172.21.15.72:0/3380116859 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f900406b210 msgr2=0x7f900406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:20.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.345+0000 7f9028589640 1 --2- 172.21.15.72:0/3380116859 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f900406b210 0x7f900406d6d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9020071a80 tx=0x7f9010009190 comp rx=0 tx=0).stop 2023-12-13T00:28:20.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.345+0000 7f9028589640 1 -- 172.21.15.72:0/3380116859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90200c52e0 msgr2=0x7f9020145240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:20.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.345+0000 7f9028589640 1 --2- 172.21.15.72:0/3380116859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90200c52e0 0x7f9020145240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f901c00e870 tx=0x7f901c00ed30 comp rx=0 tx=0).stop 2023-12-13T00:28:20.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.345+0000 7f9028589640 1 -- 172.21.15.72:0/3380116859 shutdown_connections 2023-12-13T00:28:20.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.345+0000 7f9028589640 1 --2- 172.21.15.72:0/3380116859 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f900406b210 0x7f900406d6d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:20.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.345+0000 7f9028589640 1 --2- 172.21.15.72:0/3380116859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f902015ac30 0x7f90201f0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:20.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.345+0000 7f9028589640 1 --2- 172.21.15.72:0/3380116859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90200c56c0 0x7f90201ed870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:20.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.345+0000 7f9028589640 1 --2- 172.21.15.72:0/3380116859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90200c52e0 0x7f9020145240 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:20.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.345+0000 7f9028589640 1 -- 172.21.15.72:0/3380116859 >> 172.21.15.72:0/3380116859 conn(0x7f902006f6d0 msgr2=0x7f90200c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:20.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.345+0000 7f9028589640 1 -- 172.21.15.72:0/3380116859 shutdown_connections 2023-12-13T00:28:20.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.345+0000 7f9028589640 1 -- 172.21.15.72:0/3380116859 wait complete. 2023-12-13T00:28:20.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T00:28:20.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.456+0000 7f07a4a31640 1 Processor -- start 2023-12-13T00:28:20.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.456+0000 7f07a4a31640 1 -- start start 2023-12-13T00:28:20.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.456+0000 7f07a4a31640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07a00cda70 0x7f07a00ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:20.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.456+0000 7f07a4a31640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a00cbda0 con 0x7f07a00c9620 2023-12-13T00:28:20.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.456+0000 7f07a4a31640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a00cb4e0 con 0x7f07a00cc420 2023-12-13T00:28:20.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.456+0000 7f07a4a31640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a00cc230 con 0x7f07a00cda70 2023-12-13T00:28:20.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.457+0000 7f079ed9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f07a00c9620 0x7f07a0163eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46306/0 (socket says 172.21.15.72:46306) 2023-12-13T00:28:20.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.457+0000 7f079ed9d640 1 -- 172.21.15.72:0/902501560 learned_addr learned my addr 172.21.15.72:0/902501560 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:28:20.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.457+0000 7f079e59c640 1 --2- 172.21.15.72:0/902501560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07a00cda70 0x7f07a00ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:20.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.459+0000 7f079dd9b640 1 -- 172.21.15.72:0/902501560 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250163777 0 0) 0x7f07a00cbda0 con 0x7f07a00c9620 2023-12-13T00:28:20.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.459+0000 7f079dd9b640 1 -- 172.21.15.72:0/902501560 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f078c003520 con 0x7f07a00c9620 2023-12-13T00:28:20.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.460+0000 7f079dd9b640 1 -- 172.21.15.72:0/902501560 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943949853 0 0) 0x7f07a00cb4e0 con 0x7f07a00cc420 2023-12-13T00:28:20.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.460+0000 7f079dd9b640 1 -- 172.21.15.72:0/902501560 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a00cbda0 con 0x7f07a00cc420 2023-12-13T00:28:20.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.460+0000 7f079e59c640 1 -- 172.21.15.72:0/902501560 >> v1:172.21.15.176:6789/0 conn(0x7f07a00cc420 legacy=0x7f07a0159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:20.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.460+0000 7f079e59c640 1 -- 172.21.15.72:0/902501560 >> v1:172.21.15.72:6789/0 conn(0x7f07a00c9620 legacy=0x7f07a0163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:20.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.460+0000 7f079e59c640 1 -- 172.21.15.72:0/902501560 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a00cce00 con 0x7f07a00cda70 2023-12-13T00:28:20.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.462+0000 7f079e59c640 1 --2- 172.21.15.72:0/902501560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07a00cda70 0x7f07a00ce350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f07900097d0 tx=0x7f079002b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ca64a031ff1f106 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.466+0000 7f079dd9b640 1 -- 172.21.15.72:0/902501560 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790030880 con 0x7f07a00cda70 2023-12-13T00:28:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.466+0000 7f079dd9b640 1 -- 172.21.15.72:0/902501560 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07900309e0 con 0x7f07a00cda70 2023-12-13T00:28:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.466+0000 7f079dd9b640 1 -- 172.21.15.72:0/902501560 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790030d70 con 0x7f07a00cda70 2023-12-13T00:28:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.466+0000 7f07a4a31640 1 -- 172.21.15.72:0/902501560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07a00cda70 msgr2=0x7f07a00ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.466+0000 7f07a4a31640 1 --2- 172.21.15.72:0/902501560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07a00cda70 0x7f07a00ce350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f07900097d0 tx=0x7f079002b9c0 comp rx=0 tx=0).stop 2023-12-13T00:28:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.466+0000 7f07a4a31640 1 -- 172.21.15.72:0/902501560 shutdown_connections 2023-12-13T00:28:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.466+0000 7f07a4a31640 1 --2- 172.21.15.72:0/902501560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07a00cda70 0x7f07a00ce350 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.466+0000 7f07a4a31640 1 -- 172.21.15.72:0/902501560 >> 172.21.15.72:0/902501560 conn(0x7f07a00b07b0 msgr2=0x7f07a00b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:20.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.466+0000 7f07a4a31640 1 -- 172.21.15.72:0/902501560 shutdown_connections 2023-12-13T00:28:20.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.466+0000 7f07a4a31640 1 -- 172.21.15.72:0/902501560 wait complete. 2023-12-13T00:28:20.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.468+0000 7f07a4a31640 1 Processor -- start 2023-12-13T00:28:20.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.468+0000 7f07a4a31640 1 -- start start 2023-12-13T00:28:20.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.468+0000 7f07a4a31640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07a00c9620 0x7f07a0149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:20.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.468+0000 7f07a4a31640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07a00cc420 0x7f07a0151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:20.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.468+0000 7f07a4a31640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a00cda70 0x7f07a014e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:20.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.468+0000 7f07a4a31640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a01eece0 con 0x7f07a00cda70 2023-12-13T00:28:20.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.468+0000 7f07a4a31640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a0152b70 con 0x7f07a00cc420 2023-12-13T00:28:20.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.468+0000 7f07a4a31640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a01528b0 con 0x7f07a00c9620 2023-12-13T00:28:20.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.469+0000 7f079ed9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a00cda70 0x7f07a014e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:20.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.469+0000 7f079ed9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a00cda70 0x7f07a014e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58012/0 (socket says 172.21.15.72:58012) 2023-12-13T00:28:20.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.469+0000 7f079ed9d640 1 -- 172.21.15.72:0/1532576557 learned_addr learned my addr 172.21.15.72:0/1532576557 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:20.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.469+0000 7f0797fff640 1 --2- 172.21.15.72:0/1532576557 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07a00cc420 0x7f07a0151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:20.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.469+0000 7f079e59c640 1 --2- 172.21.15.72:0/1532576557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07a00c9620 0x7f07a0149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.472+0000 7f079ed9d640 1 -- 172.21.15.72:0/1532576557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07a00c9620 msgr2=0x7f07a0149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.472+0000 7f079ed9d640 1 --2- 172.21.15.72:0/1532576557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07a00c9620 0x7f07a0149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.472+0000 7f079ed9d640 1 -- 172.21.15.72:0/1532576557 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07a00cc420 msgr2=0x7f07a0151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.473+0000 7f079ed9d640 1 --2- 172.21.15.72:0/1532576557 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07a00cc420 0x7f07a0151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.473+0000 7f079ed9d640 1 -- 172.21.15.72:0/1532576557 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0790009400 con 0x7f07a00cda70 2023-12-13T00:28:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.475+0000 7f079ed9d640 1 --2- 172.21.15.72:0/1532576557 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a00cda70 0x7f07a014e070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f079800caa0 tx=0x7f079800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:20.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.477+0000 7f0796ffd640 1 -- 172.21.15.72:0/1532576557 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079800ac00 con 0x7f07a00cda70 2023-12-13T00:28:20.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.477+0000 7f07a4a31640 1 -- 172.21.15.72:0/1532576557 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a014fba0 con 0x7f07a00cda70 2023-12-13T00:28:20.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.477+0000 7f07a4a31640 1 -- 172.21.15.72:0/1532576557 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a0150160 con 0x7f07a00cda70 2023-12-13T00:28:20.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.478+0000 7f07a4a31640 1 -- 172.21.15.72:0/1532576557 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a00c5bc0 con 0x7f07a00cda70 2023-12-13T00:28:20.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.722+0000 7f0796ffd640 1 -- 172.21.15.72:0/1532576557 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0798001b50 con 0x7f07a00cda70 2023-12-13T00:28:20.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.722+0000 7f0796ffd640 1 -- 172.21.15.72:0/1532576557 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079801c440 con 0x7f07a00cda70 2023-12-13T00:28:20.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.722+0000 7f0796ffd640 1 -- 172.21.15.72:0/1532576557 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0798012400 con 0x7f07a00cda70 2023-12-13T00:28:20.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.723+0000 7f0796ffd640 1 --2- 172.21.15.72:0/1532576557 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f078006b1c0 0x7f078006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:20.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.723+0000 7f079e59c640 1 --2- 172.21.15.72:0/1532576557 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f078006b1c0 0x7f078006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:20.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.723+0000 7f079e59c640 1 --2- 172.21.15.72:0/1532576557 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f078006b1c0 0x7f078006d680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0790036000 tx=0x7f079003b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:20.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.738+0000 7f0796ffd640 1 -- 172.21.15.72:0/1532576557 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f0798058bb0 con 0x7f07a00cda70 2023-12-13T00:28:20.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.738+0000 7f0796ffd640 1 -- 172.21.15.72:0/1532576557 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0798054ef0 con 0x7f07a00cda70 2023-12-13T00:28:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.912+0000 7f07a4a31640 1 -- 172.21.15.72:0/1532576557 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07a00cba30 con 0x7f078006b1c0 2023-12-13T00:28:20.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.920+0000 7f0796ffd640 1 -- 172.21.15.72:0/1532576557 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367004 (secure 0 0 0) 0x7f079003f040 con 0x7f078006b1c0 2023-12-13T00:28:20.927 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:28:20.929 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-12-13T00:28:20.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.924+0000 7f07a4a31640 1 -- 172.21.15.72:0/1532576557 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f078006b1c0 msgr2=0x7f078006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:20.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.924+0000 7f07a4a31640 1 --2- 172.21.15.72:0/1532576557 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f078006b1c0 0x7f078006d680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0790036000 tx=0x7f079003b040 comp rx=0 tx=0).stop 2023-12-13T00:28:20.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.924+0000 7f07a4a31640 1 -- 172.21.15.72:0/1532576557 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a00cda70 msgr2=0x7f07a014e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:20.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.924+0000 7f07a4a31640 1 --2- 172.21.15.72:0/1532576557 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a00cda70 0x7f07a014e070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f079800caa0 tx=0x7f079800cf60 comp rx=0 tx=0).stop 2023-12-13T00:28:20.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.924+0000 7f07a4a31640 1 -- 172.21.15.72:0/1532576557 shutdown_connections 2023-12-13T00:28:20.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.924+0000 7f07a4a31640 1 --2- 172.21.15.72:0/1532576557 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f078006b1c0 0x7f078006d680 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:20.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.924+0000 7f07a4a31640 1 --2- 172.21.15.72:0/1532576557 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a00cda70 0x7f07a014e070 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:20.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.924+0000 7f07a4a31640 1 --2- 172.21.15.72:0/1532576557 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07a00cc420 0x7f07a0151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:20.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.924+0000 7f07a4a31640 1 --2- 172.21.15.72:0/1532576557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07a00c9620 0x7f07a0149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:20.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.924+0000 7f07a4a31640 1 -- 172.21.15.72:0/1532576557 >> 172.21.15.72:0/1532576557 conn(0x7f07a00b07b0 msgr2=0x7f07a00c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:20.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.924+0000 7f07a4a31640 1 -- 172.21.15.72:0/1532576557 shutdown_connections 2023-12-13T00:28:20.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:20.924+0000 7f07a4a31640 1 -- 172.21.15.72:0/1532576557 wait complete. 2023-12-13T00:28:20.936 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":868,"stamp":"2023-12-13T00:28:20.909597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44494843,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1597,"num_read_kb":1872,"num_write":18961,"num_write_kb":384585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22500,"ondisk_log_size":22500,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":560752,"kb_used_data":89264,"kb_used_omap":12,"kb_used_meta":471411,"kb_avail":754413968,"statfs":{"total":773094113280,"available":772519903232,"internally_reserved":0,"allocated":91406336,"data_stored":89913478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":482725426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":747,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002535"},"pg_stats":[{"pgid":"2.1f","version":"27'888","reported_seq":920,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:50.381274+0000","last_change":"2023-12-13T00:00:29.997631+0000","last_active":"2023-12-13T00:27:50.381274+0000","last_peered":"2023-12-13T00:27:50.381274+0000","last_clean":"2023-12-13T00:27:50.381274+0000","last_became_active":"2023-12-13T00:00:29.997381+0000","last_became_peered":"2023-12-13T00:00:29.997381+0000","last_unstale":"2023-12-13T00:27:50.381274+0000","last_undegraded":"2023-12-13T00:27:50.381274+0000","last_fullsized":"2023-12-13T00:27:50.381274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":4535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'54","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.858988+0000","last_change":"2023-12-13T00:00:31.138533+0000","last_active":"2023-12-13T00:28:04.858988+0000","last_peered":"2023-12-13T00:28:04.858988+0000","last_clean":"2023-12-13T00:28:04.858988+0000","last_became_active":"2023-12-13T00:00:31.138242+0000","last_became_peered":"2023-12-13T00:00:31.138242+0000","last_unstale":"2023-12-13T00:28:04.858988+0000","last_undegraded":"2023-12-13T00:28:04.858988+0000","last_fullsized":"2023-12-13T00:28:04.858988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'155","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:25.503482+0000","last_change":"2023-12-13T00:00:35.667840+0000","last_active":"2023-12-13T00:27:25.503482+0000","last_peered":"2023-12-13T00:27:25.503482+0000","last_clean":"2023-12-13T00:27:25.503482+0000","last_became_active":"2023-12-13T00:00:35.667498+0000","last_became_peered":"2023-12-13T00:00:35.667498+0000","last_unstale":"2023-12-13T00:27:25.503482+0000","last_undegraded":"2023-12-13T00:27:25.503482+0000","last_fullsized":"2023-12-13T00:27:25.503482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:17.304722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'846","reported_seq":878,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:56.956368+0000","last_change":"2023-12-13T00:00:30.001888+0000","last_active":"2023-12-13T00:27:56.956368+0000","last_peered":"2023-12-13T00:27:56.956368+0000","last_clean":"2023-12-13T00:27:56.956368+0000","last_became_active":"2023-12-13T00:00:30.001628+0000","last_became_peered":"2023-12-13T00:00:30.001628+0000","last_unstale":"2023-12-13T00:27:56.956368+0000","last_undegraded":"2023-12-13T00:27:56.956368+0000","last_fullsized":"2023-12-13T00:27:56.956368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'62","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.860359+0000","last_change":"2023-12-13T00:00:31.036420+0000","last_active":"2023-12-13T00:28:04.860359+0000","last_peered":"2023-12-13T00:28:04.860359+0000","last_clean":"2023-12-13T00:28:04.860359+0000","last_became_active":"2023-12-13T00:00:31.036197+0000","last_became_peered":"2023-12-13T00:00:31.036197+0000","last_unstale":"2023-12-13T00:28:04.860359+0000","last_undegraded":"2023-12-13T00:28:04.860359+0000","last_fullsized":"2023-12-13T00:28:04.860359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'165","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:30.828341+0000","last_change":"2023-12-13T00:00:35.665348+0000","last_active":"2023-12-13T00:27:30.828341+0000","last_peered":"2023-12-13T00:27:30.828341+0000","last_clean":"2023-12-13T00:27:30.828341+0000","last_became_active":"2023-12-13T00:00:35.664981+0000","last_became_peered":"2023-12-13T00:00:35.664981+0000","last_unstale":"2023-12-13T00:27:30.828341+0000","last_undegraded":"2023-12-13T00:27:30.828341+0000","last_fullsized":"2023-12-13T00:27:30.828341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":248,"num_write":136,"num_write_kb":7125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'11","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:01.617213+0000","last_change":"2023-12-13T00:00:30.009983+0000","last_active":"2023-12-13T00:28:01.617213+0000","last_peered":"2023-12-13T00:28:01.617213+0000","last_clean":"2023-12-13T00:28:01.617213+0000","last_became_active":"2023-12-13T00:00:30.009724+0000","last_became_peered":"2023-12-13T00:00:30.009724+0000","last_unstale":"2023-12-13T00:28:01.617213+0000","last_undegraded":"2023-12-13T00:28:01.617213+0000","last_fullsized":"2023-12-13T00:28:01.617213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'58","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.897807+0000","last_change":"2023-12-13T00:00:31.151042+0000","last_active":"2023-12-13T00:28:04.897807+0000","last_peered":"2023-12-13T00:28:04.897807+0000","last_clean":"2023-12-13T00:28:04.897807+0000","last_became_active":"2023-12-13T00:00:31.150735+0000","last_became_peered":"2023-12-13T00:00:31.150735+0000","last_unstale":"2023-12-13T00:28:04.897807+0000","last_undegraded":"2023-12-13T00:28:04.897807+0000","last_fullsized":"2023-12-13T00:28:04.897807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'163","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:06.658865+0000","last_change":"2023-12-13T00:00:35.668759+0000","last_active":"2023-12-13T00:28:06.658865+0000","last_peered":"2023-12-13T00:28:06.658865+0000","last_clean":"2023-12-13T00:28:06.658865+0000","last_became_active":"2023-12-13T00:00:35.668361+0000","last_became_peered":"2023-12-13T00:00:35.668361+0000","last_unstale":"2023-12-13T00:28:06.658865+0000","last_undegraded":"2023-12-13T00:28:06.658865+0000","last_fullsized":"2023-12-13T00:28:06.658865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":10445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:01.617166+0000","last_change":"2023-12-13T00:00:30.009921+0000","last_active":"2023-12-13T00:28:01.617166+0000","last_peered":"2023-12-13T00:28:01.617166+0000","last_clean":"2023-12-13T00:28:01.617166+0000","last_became_active":"2023-12-13T00:00:30.009644+0000","last_became_peered":"2023-12-13T00:00:30.009644+0000","last_unstale":"2023-12-13T00:28:01.617166+0000","last_undegraded":"2023-12-13T00:28:01.617166+0000","last_fullsized":"2023-12-13T00:28:01.617166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'63","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.878671+0000","last_change":"2023-12-13T00:00:31.146801+0000","last_active":"2023-12-13T00:28:04.878671+0000","last_peered":"2023-12-13T00:28:04.878671+0000","last_clean":"2023-12-13T00:28:04.878671+0000","last_became_active":"2023-12-13T00:00:31.146516+0000","last_became_peered":"2023-12-13T00:00:31.146516+0000","last_unstale":"2023-12-13T00:28:04.878671+0000","last_undegraded":"2023-12-13T00:28:04.878671+0000","last_fullsized":"2023-12-13T00:28:04.878671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'175","reported_seq":202,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:06.658832+0000","last_change":"2023-12-13T00:00:35.668621+0000","last_active":"2023-12-13T00:28:06.658832+0000","last_peered":"2023-12-13T00:28:06.658832+0000","last_clean":"2023-12-13T00:28:06.658832+0000","last_became_active":"2023-12-13T00:00:35.668298+0000","last_became_peered":"2023-12-13T00:00:35.668298+0000","last_unstale":"2023-12-13T00:28:06.658832+0000","last_undegraded":"2023-12-13T00:28:06.658832+0000","last_fullsized":"2023-12-13T00:28:06.658832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'50","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.878078+0000","last_change":"2023-12-13T00:00:31.036347+0000","last_active":"2023-12-13T00:28:04.878078+0000","last_peered":"2023-12-13T00:28:04.878078+0000","last_clean":"2023-12-13T00:28:04.878078+0000","last_became_active":"2023-12-13T00:00:31.036062+0000","last_became_peered":"2023-12-13T00:00:31.036062+0000","last_unstale":"2023-12-13T00:28:04.878078+0000","last_undegraded":"2023-12-13T00:28:04.878078+0000","last_fullsized":"2023-12-13T00:28:04.878078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'849","reported_seq":880,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:52.174766+0000","last_change":"2023-12-13T00:00:30.001066+0000","last_active":"2023-12-13T00:27:52.174766+0000","last_peered":"2023-12-13T00:27:52.174766+0000","last_clean":"2023-12-13T00:27:52.174766+0000","last_became_active":"2023-12-13T00:00:30.000782+0000","last_became_peered":"2023-12-13T00:00:30.000782+0000","last_unstale":"2023-12-13T00:27:52.174766+0000","last_undegraded":"2023-12-13T00:27:52.174766+0000","last_fullsized":"2023-12-13T00:27:52.174766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":4547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'149","reported_seq":177,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:38.961322+0000","last_change":"2023-12-13T00:00:35.662038+0000","last_active":"2023-12-13T00:27:38.961322+0000","last_peered":"2023-12-13T00:27:38.961322+0000","last_clean":"2023-12-13T00:27:38.961322+0000","last_became_active":"2023-12-13T00:00:35.661458+0000","last_became_peered":"2023-12-13T00:00:35.661458+0000","last_unstale":"2023-12-13T00:27:38.961322+0000","last_undegraded":"2023-12-13T00:27:38.961322+0000","last_fullsized":"2023-12-13T00:27:38.961322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":11179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'55","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.754043+0000","last_change":"2023-12-13T00:00:31.119718+0000","last_active":"2023-12-13T00:28:04.754043+0000","last_peered":"2023-12-13T00:28:04.754043+0000","last_clean":"2023-12-13T00:28:04.754043+0000","last_became_active":"2023-12-13T00:00:31.119447+0000","last_became_peered":"2023-12-13T00:00:31.119447+0000","last_unstale":"2023-12-13T00:28:04.754043+0000","last_undegraded":"2023-12-13T00:28:04.754043+0000","last_fullsized":"2023-12-13T00:28:04.754043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:14:08.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'215","reported_seq":245,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:55.948505+0000","last_change":"2023-12-13T00:00:29.968425+0000","last_active":"2023-12-13T00:27:55.948505+0000","last_peered":"2023-12-13T00:27:55.948505+0000","last_clean":"2023-12-13T00:27:55.948505+0000","last_became_active":"2023-12-13T00:00:29.967929+0000","last_became_peered":"2023-12-13T00:00:29.967929+0000","last_unstale":"2023-12-13T00:27:55.948505+0000","last_undegraded":"2023-12-13T00:27:55.948505+0000","last_fullsized":"2023-12-13T00:27:55.948505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:53.977921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":581,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'167","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:36.614523+0000","last_change":"2023-12-13T00:00:35.662848+0000","last_active":"2023-12-13T00:27:36.614523+0000","last_peered":"2023-12-13T00:27:36.614523+0000","last_clean":"2023-12-13T00:27:36.614523+0000","last_became_active":"2023-12-13T00:00:35.662469+0000","last_became_peered":"2023-12-13T00:00:35.662469+0000","last_unstale":"2023-12-13T00:27:36.614523+0000","last_undegraded":"2023-12-13T00:27:36.614523+0000","last_fullsized":"2023-12-13T00:27:36.614523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":19086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.831928+0000","last_change":"2023-12-13T00:00:31.143108+0000","last_active":"2023-12-13T00:28:04.831928+0000","last_peered":"2023-12-13T00:28:04.831928+0000","last_clean":"2023-12-13T00:28:04.831928+0000","last_became_active":"2023-12-13T00:00:31.142847+0000","last_became_peered":"2023-12-13T00:00:31.142847+0000","last_unstale":"2023-12-13T00:28:04.831928+0000","last_undegraded":"2023-12-13T00:28:04.831928+0000","last_fullsized":"2023-12-13T00:28:04.831928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'374","reported_seq":405,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.172605+0000","last_change":"2023-12-13T00:00:30.004483+0000","last_active":"2023-12-13T00:27:57.172605+0000","last_peered":"2023-12-13T00:27:57.172605+0000","last_clean":"2023-12-13T00:27:57.172605+0000","last_became_active":"2023-12-13T00:00:30.004195+0000","last_became_peered":"2023-12-13T00:00:30.004195+0000","last_unstale":"2023-12-13T00:27:57.172605+0000","last_undegraded":"2023-12-13T00:27:57.172605+0000","last_fullsized":"2023-12-13T00:27:57.172605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":373,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'154","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:28.849973+0000","last_change":"2023-12-13T00:00:35.660024+0000","last_active":"2023-12-13T00:27:28.849973+0000","last_peered":"2023-12-13T00:27:28.849973+0000","last_clean":"2023-12-13T00:27:28.849973+0000","last_became_active":"2023-12-13T00:00:35.659637+0000","last_became_peered":"2023-12-13T00:00:35.659637+0000","last_unstale":"2023-12-13T00:27:28.849973+0000","last_undegraded":"2023-12-13T00:27:28.849973+0000","last_fullsized":"2023-12-13T00:27:28.849973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:19.752973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":10280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'45","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.870912+0000","last_change":"2023-12-13T00:00:31.143938+0000","last_active":"2023-12-13T00:28:04.870912+0000","last_peered":"2023-12-13T00:28:04.870912+0000","last_clean":"2023-12-13T00:28:04.870912+0000","last_became_active":"2023-12-13T00:00:31.143673+0000","last_became_peered":"2023-12-13T00:00:31.143673+0000","last_unstale":"2023-12-13T00:28:04.870912+0000","last_undegraded":"2023-12-13T00:28:04.870912+0000","last_fullsized":"2023-12-13T00:28:04.870912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:51.140559+0000","last_change":"2023-12-13T00:00:30.005987+0000","last_active":"2023-12-13T00:27:51.140559+0000","last_peered":"2023-12-13T00:27:51.140559+0000","last_clean":"2023-12-13T00:27:51.140559+0000","last_became_active":"2023-12-13T00:00:30.005740+0000","last_became_peered":"2023-12-13T00:00:30.005740+0000","last_unstale":"2023-12-13T00:27:51.140559+0000","last_undegraded":"2023-12-13T00:27:51.140559+0000","last_fullsized":"2023-12-13T00:27:51.140559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'170","reported_seq":198,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:36.655835+0000","last_change":"2023-12-13T00:00:35.666041+0000","last_active":"2023-12-13T00:27:36.655835+0000","last_peered":"2023-12-13T00:27:36.655835+0000","last_clean":"2023-12-13T00:27:36.655835+0000","last_became_active":"2023-12-13T00:00:35.665670+0000","last_became_peered":"2023-12-13T00:00:35.665670+0000","last_unstale":"2023-12-13T00:27:36.655835+0000","last_undegraded":"2023-12-13T00:27:36.655835+0000","last_fullsized":"2023-12-13T00:27:36.655835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'51","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.832107+0000","last_change":"2023-12-13T00:00:31.146677+0000","last_active":"2023-12-13T00:28:04.832107+0000","last_peered":"2023-12-13T00:28:04.832107+0000","last_clean":"2023-12-13T00:28:04.832107+0000","last_became_active":"2023-12-13T00:00:31.146435+0000","last_became_peered":"2023-12-13T00:00:31.146435+0000","last_unstale":"2023-12-13T00:28:04.832107+0000","last_undegraded":"2023-12-13T00:28:04.832107+0000","last_fullsized":"2023-12-13T00:28:04.832107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'8","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.163606+0000","last_change":"2023-12-13T00:00:30.006240+0000","last_active":"2023-12-13T00:27:57.163606+0000","last_peered":"2023-12-13T00:27:57.163606+0000","last_clean":"2023-12-13T00:27:57.163606+0000","last_became_active":"2023-12-13T00:00:30.005909+0000","last_became_peered":"2023-12-13T00:00:30.005909+0000","last_unstale":"2023-12-13T00:27:57.163606+0000","last_undegraded":"2023-12-13T00:27:57.163606+0000","last_fullsized":"2023-12-13T00:27:57.163606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'164","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:41.656308+0000","last_change":"2023-12-13T00:00:35.665918+0000","last_active":"2023-12-13T00:27:41.656308+0000","last_peered":"2023-12-13T00:27:41.656308+0000","last_clean":"2023-12-13T00:27:41.656308+0000","last_became_active":"2023-12-13T00:00:35.665521+0000","last_became_peered":"2023-12-13T00:00:35.665521+0000","last_unstale":"2023-12-13T00:27:41.656308+0000","last_undegraded":"2023-12-13T00:27:41.656308+0000","last_fullsized":"2023-12-13T00:27:41.656308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.832423+0000","last_change":"2023-12-13T00:00:31.145392+0000","last_active":"2023-12-13T00:28:04.832423+0000","last_peered":"2023-12-13T00:28:04.832423+0000","last_clean":"2023-12-13T00:28:04.832423+0000","last_became_active":"2023-12-13T00:00:31.145115+0000","last_became_peered":"2023-12-13T00:00:31.145115+0000","last_unstale":"2023-12-13T00:28:04.832423+0000","last_undegraded":"2023-12-13T00:28:04.832423+0000","last_fullsized":"2023-12-13T00:28:04.832423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'169","reported_seq":200,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:03.269485+0000","last_change":"2023-12-13T00:00:30.006295+0000","last_active":"2023-12-13T00:28:03.269485+0000","last_peered":"2023-12-13T00:28:03.269485+0000","last_clean":"2023-12-13T00:28:03.269485+0000","last_became_active":"2023-12-13T00:00:30.005988+0000","last_became_peered":"2023-12-13T00:00:30.005988+0000","last_unstale":"2023-12-13T00:28:03.269485+0000","last_undegraded":"2023-12-13T00:28:03.269485+0000","last_fullsized":"2023-12-13T00:28:03.269485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'165","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.940396+0000","last_change":"2023-12-13T00:00:35.662996+0000","last_active":"2023-12-13T00:27:31.940396+0000","last_peered":"2023-12-13T00:27:31.940396+0000","last_clean":"2023-12-13T00:27:31.940396+0000","last_became_active":"2023-12-13T00:00:35.662612+0000","last_became_peered":"2023-12-13T00:00:35.662612+0000","last_unstale":"2023-12-13T00:27:31.940396+0000","last_undegraded":"2023-12-13T00:27:31.940396+0000","last_fullsized":"2023-12-13T00:27:31.940396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":14176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.822535+0000","last_change":"2023-12-13T00:00:31.118054+0000","last_active":"2023-12-13T00:28:04.822535+0000","last_peered":"2023-12-13T00:28:04.822535+0000","last_clean":"2023-12-13T00:28:04.822535+0000","last_became_active":"2023-12-13T00:00:31.117814+0000","last_became_peered":"2023-12-13T00:00:31.117814+0000","last_unstale":"2023-12-13T00:28:04.822535+0000","last_undegraded":"2023-12-13T00:28:04.822535+0000","last_fullsized":"2023-12-13T00:28:04.822535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:48:15.201991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'6","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:47.324095+0000","last_change":"2023-12-13T00:00:30.001001+0000","last_active":"2023-12-13T00:27:47.324095+0000","last_peered":"2023-12-13T00:27:47.324095+0000","last_clean":"2023-12-13T00:27:47.324095+0000","last_became_active":"2023-12-13T00:00:30.000755+0000","last_became_peered":"2023-12-13T00:00:30.000755+0000","last_unstale":"2023-12-13T00:27:47.324095+0000","last_undegraded":"2023-12-13T00:27:47.324095+0000","last_fullsized":"2023-12-13T00:27:47.324095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'145","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.942343+0000","last_change":"2023-12-13T00:01:00.545340+0000","last_active":"2023-12-13T00:27:31.942343+0000","last_peered":"2023-12-13T00:27:31.942343+0000","last_clean":"2023-12-13T00:27:31.942343+0000","last_became_active":"2023-12-13T00:01:00.544906+0000","last_became_peered":"2023-12-13T00:01:00.544906+0000","last_unstale":"2023-12-13T00:27:31.942343+0000","last_undegraded":"2023-12-13T00:27:31.942343+0000","last_fullsized":"2023-12-13T00:27:31.942343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:44:27.993144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,5],"acting":[6,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'57","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.887935+0000","last_change":"2023-12-13T00:00:31.143429+0000","last_active":"2023-12-13T00:28:04.887935+0000","last_peered":"2023-12-13T00:28:04.887935+0000","last_clean":"2023-12-13T00:28:04.887935+0000","last_became_active":"2023-12-13T00:00:31.143182+0000","last_became_peered":"2023-12-13T00:00:31.143182+0000","last_unstale":"2023-12-13T00:28:04.887935+0000","last_undegraded":"2023-12-13T00:28:04.887935+0000","last_fullsized":"2023-12-13T00:28:04.887935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'2","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:52.176950+0000","last_change":"2023-12-13T00:00:29.969160+0000","last_active":"2023-12-13T00:27:52.176950+0000","last_peered":"2023-12-13T00:27:52.176950+0000","last_clean":"2023-12-13T00:27:52.176950+0000","last_became_active":"2023-12-13T00:00:29.968860+0000","last_became_peered":"2023-12-13T00:00:29.968860+0000","last_unstale":"2023-12-13T00:27:52.176950+0000","last_undegraded":"2023-12-13T00:27:52.176950+0000","last_fullsized":"2023-12-13T00:27:52.176950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'163","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.585490+0000","last_change":"2023-12-13T00:00:35.642597+0000","last_active":"2023-12-13T00:27:29.585490+0000","last_peered":"2023-12-13T00:27:29.585490+0000","last_clean":"2023-12-13T00:27:29.585490+0000","last_became_active":"2023-12-13T00:00:35.642215+0000","last_became_peered":"2023-12-13T00:00:35.642215+0000","last_unstale":"2023-12-13T00:27:29.585490+0000","last_undegraded":"2023-12-13T00:27:29.585490+0000","last_fullsized":"2023-12-13T00:27:29.585490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:54:48.007993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":6488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'62","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.868003+0000","last_change":"2023-12-13T00:00:31.149832+0000","last_active":"2023-12-13T00:28:04.868003+0000","last_peered":"2023-12-13T00:28:04.868003+0000","last_clean":"2023-12-13T00:28:04.868003+0000","last_became_active":"2023-12-13T00:00:31.149587+0000","last_became_peered":"2023-12-13T00:00:31.149587+0000","last_unstale":"2023-12-13T00:28:04.868003+0000","last_undegraded":"2023-12-13T00:28:04.868003+0000","last_fullsized":"2023-12-13T00:28:04.868003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'792","reported_seq":824,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:50.381390+0000","last_change":"2023-12-13T00:00:29.998103+0000","last_active":"2023-12-13T00:27:50.381390+0000","last_peered":"2023-12-13T00:27:50.381390+0000","last_clean":"2023-12-13T00:27:50.381390+0000","last_became_active":"2023-12-13T00:00:29.997848+0000","last_became_peered":"2023-12-13T00:00:29.997848+0000","last_unstale":"2023-12-13T00:27:50.381390+0000","last_undegraded":"2023-12-13T00:27:50.381390+0000","last_fullsized":"2023-12-13T00:27:50.381390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":4476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'121","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.942347+0000","last_change":"2023-12-13T00:00:35.652104+0000","last_active":"2023-12-13T00:27:31.942347+0000","last_peered":"2023-12-13T00:27:31.942347+0000","last_clean":"2023-12-13T00:27:31.942347+0000","last_became_active":"2023-12-13T00:00:35.651766+0000","last_became_peered":"2023-12-13T00:00:35.651766+0000","last_unstale":"2023-12-13T00:27:31.942347+0000","last_undegraded":"2023-12-13T00:27:31.942347+0000","last_fullsized":"2023-12-13T00:27:31.942347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:08:10.211533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":7468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'58","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.860880+0000","last_change":"2023-12-13T00:00:31.120580+0000","last_active":"2023-12-13T00:28:04.860880+0000","last_peered":"2023-12-13T00:28:04.860880+0000","last_clean":"2023-12-13T00:28:04.860880+0000","last_became_active":"2023-12-13T00:00:31.120330+0000","last_became_peered":"2023-12-13T00:00:31.120330+0000","last_unstale":"2023-12-13T00:28:04.860880+0000","last_undegraded":"2023-12-13T00:28:04.860880+0000","last_fullsized":"2023-12-13T00:28:04.860880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'411","reported_seq":748,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:59.442964+0000","last_change":"2023-12-13T00:00:30.000752+0000","last_active":"2023-12-13T00:27:59.442964+0000","last_peered":"2023-12-13T00:27:59.442964+0000","last_clean":"2023-12-13T00:27:59.442964+0000","last_became_active":"2023-12-13T00:00:30.000015+0000","last_became_peered":"2023-12-13T00:00:30.000015+0000","last_unstale":"2023-12-13T00:27:59.442964+0000","last_undegraded":"2023-12-13T00:27:59.442964+0000","last_fullsized":"2023-12-13T00:27:59.442964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:20:46.566684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58234,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":306,"num_read_kb":318,"num_write":408,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'147","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:30.828661+0000","last_change":"2023-12-13T00:00:35.667415+0000","last_active":"2023-12-13T00:27:30.828661+0000","last_peered":"2023-12-13T00:27:30.828661+0000","last_clean":"2023-12-13T00:27:30.828661+0000","last_became_active":"2023-12-13T00:00:35.667028+0000","last_became_peered":"2023-12-13T00:00:35.667028+0000","last_unstale":"2023-12-13T00:27:30.828661+0000","last_undegraded":"2023-12-13T00:27:30.828661+0000","last_fullsized":"2023-12-13T00:27:30.828661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:09:58.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":5383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'60","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.822616+0000","last_change":"2023-12-13T00:00:31.140853+0000","last_active":"2023-12-13T00:28:04.822616+0000","last_peered":"2023-12-13T00:28:04.822616+0000","last_clean":"2023-12-13T00:28:04.822616+0000","last_became_active":"2023-12-13T00:00:31.140597+0000","last_became_peered":"2023-12-13T00:00:31.140597+0000","last_unstale":"2023-12-13T00:28:04.822616+0000","last_undegraded":"2023-12-13T00:28:04.822616+0000","last_fullsized":"2023-12-13T00:28:04.822616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:04:13.923453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'6","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:50.856481+0000","last_change":"2023-12-13T00:00:29.998765+0000","last_active":"2023-12-13T00:27:50.856481+0000","last_peered":"2023-12-13T00:27:50.856481+0000","last_clean":"2023-12-13T00:27:50.856481+0000","last_became_active":"2023-12-13T00:00:29.998552+0000","last_became_peered":"2023-12-13T00:00:29.998552+0000","last_unstale":"2023-12-13T00:27:50.856481+0000","last_undegraded":"2023-12-13T00:27:50.856481+0000","last_fullsized":"2023-12-13T00:27:50.856481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'127","reported_seq":155,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.549299+0000","last_change":"2023-12-13T00:00:35.666575+0000","last_active":"2023-12-13T00:27:29.549299+0000","last_peered":"2023-12-13T00:27:29.549299+0000","last_clean":"2023-12-13T00:27:29.549299+0000","last_became_active":"2023-12-13T00:00:35.666135+0000","last_became_peered":"2023-12-13T00:00:35.666135+0000","last_unstale":"2023-12-13T00:27:29.549299+0000","last_undegraded":"2023-12-13T00:27:29.549299+0000","last_fullsized":"2023-12-13T00:27:29.549299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":7535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'49","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.832991+0000","last_change":"2023-12-13T00:00:31.148698+0000","last_active":"2023-12-13T00:28:04.832991+0000","last_peered":"2023-12-13T00:28:04.832991+0000","last_clean":"2023-12-13T00:28:04.832991+0000","last_became_active":"2023-12-13T00:00:31.148421+0000","last_became_peered":"2023-12-13T00:00:31.148421+0000","last_unstale":"2023-12-13T00:28:04.832991+0000","last_undegraded":"2023-12-13T00:28:04.832991+0000","last_fullsized":"2023-12-13T00:28:04.832991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'5","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:53.927177+0000","last_change":"2023-12-13T00:00:30.001220+0000","last_active":"2023-12-13T00:27:53.927177+0000","last_peered":"2023-12-13T00:27:53.927177+0000","last_clean":"2023-12-13T00:27:53.927177+0000","last_became_active":"2023-12-13T00:00:30.000854+0000","last_became_peered":"2023-12-13T00:00:30.000854+0000","last_unstale":"2023-12-13T00:27:53.927177+0000","last_undegraded":"2023-12-13T00:27:53.927177+0000","last_fullsized":"2023-12-13T00:27:53.927177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:15.904956+0000","last_change":"2023-12-13T00:28:15.904996+0000","last_active":"2023-12-13T00:28:15.904956+0000","last_peered":"2023-12-13T00:28:15.904956+0000","last_clean":"2023-12-13T00:28:15.904956+0000","last_became_active":"2023-12-13T00:00:08.574464+0000","last_became_peered":"2023-12-13T00:00:08.574464+0000","last_unstale":"2023-12-13T00:28:15.904956+0000","last_undegraded":"2023-12-13T00:28:15.904956+0000","last_fullsized":"2023-12-13T00:28:15.904956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2023-12-13T00:28:15.904877+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2023-12-13T00:28:15.904877+0000","last_clean_scrub_stamp":"2023-12-13T00:28:15.904877+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:36:22.553417+0000","scrub_duration":0.0040292729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'166","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:48.962635+0000","last_change":"2023-12-13T00:00:35.661806+0000","last_active":"2023-12-13T00:27:48.962635+0000","last_peered":"2023-12-13T00:27:48.962635+0000","last_clean":"2023-12-13T00:27:48.962635+0000","last_became_active":"2023-12-13T00:00:35.660976+0000","last_became_peered":"2023-12-13T00:00:35.660976+0000","last_unstale":"2023-12-13T00:27:48.962635+0000","last_undegraded":"2023-12-13T00:27:48.962635+0000","last_fullsized":"2023-12-13T00:27:48.962635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":12423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'58","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.876810+0000","last_change":"2023-12-13T00:00:31.036383+0000","last_active":"2023-12-13T00:28:04.876810+0000","last_peered":"2023-12-13T00:28:04.876810+0000","last_clean":"2023-12-13T00:28:04.876810+0000","last_became_active":"2023-12-13T00:00:31.036127+0000","last_became_peered":"2023-12-13T00:00:31.036127+0000","last_unstale":"2023-12-13T00:28:04.876810+0000","last_undegraded":"2023-12-13T00:28:04.876810+0000","last_fullsized":"2023-12-13T00:28:04.876810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'7","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:40.042854+0000","last_change":"2023-12-13T00:00:30.006258+0000","last_active":"2023-12-13T00:27:40.042854+0000","last_peered":"2023-12-13T00:27:40.042854+0000","last_clean":"2023-12-13T00:27:40.042854+0000","last_became_active":"2023-12-13T00:00:30.005943+0000","last_became_peered":"2023-12-13T00:00:30.005943+0000","last_unstale":"2023-12-13T00:27:40.042854+0000","last_undegraded":"2023-12-13T00:27:40.042854+0000","last_fullsized":"2023-12-13T00:27:40.042854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:52:45.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'164","reported_seq":192,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.549287+0000","last_change":"2023-12-13T00:00:35.665140+0000","last_active":"2023-12-13T00:27:29.549287+0000","last_peered":"2023-12-13T00:27:29.549287+0000","last_clean":"2023-12-13T00:27:29.549287+0000","last_became_active":"2023-12-13T00:00:35.664071+0000","last_became_peered":"2023-12-13T00:00:35.664071+0000","last_unstale":"2023-12-13T00:27:29.549287+0000","last_undegraded":"2023-12-13T00:27:29.549287+0000","last_fullsized":"2023-12-13T00:27:29.549287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":5432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'59","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.873970+0000","last_change":"2023-12-13T00:00:31.147760+0000","last_active":"2023-12-13T00:28:04.873970+0000","last_peered":"2023-12-13T00:28:04.873970+0000","last_clean":"2023-12-13T00:28:04.873970+0000","last_became_active":"2023-12-13T00:00:31.147523+0000","last_became_peered":"2023-12-13T00:00:31.147523+0000","last_unstale":"2023-12-13T00:28:04.873970+0000","last_undegraded":"2023-12-13T00:28:04.873970+0000","last_fullsized":"2023-12-13T00:28:04.873970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:54.419193+0000","last_change":"2023-12-13T00:00:30.002705+0000","last_active":"2023-12-13T00:27:54.419193+0000","last_peered":"2023-12-13T00:27:54.419193+0000","last_clean":"2023-12-13T00:27:54.419193+0000","last_became_active":"2023-12-13T00:00:30.002427+0000","last_became_peered":"2023-12-13T00:00:30.002427+0000","last_unstale":"2023-12-13T00:27:54.419193+0000","last_undegraded":"2023-12-13T00:27:54.419193+0000","last_fullsized":"2023-12-13T00:27:54.419193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'177","reported_seq":205,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:35.503794+0000","last_change":"2023-12-13T00:00:35.661309+0000","last_active":"2023-12-13T00:27:35.503794+0000","last_peered":"2023-12-13T00:27:35.503794+0000","last_clean":"2023-12-13T00:27:35.503794+0000","last_became_active":"2023-12-13T00:00:35.660939+0000","last_became_peered":"2023-12-13T00:00:35.660939+0000","last_unstale":"2023-12-13T00:27:35.503794+0000","last_undegraded":"2023-12-13T00:27:35.503794+0000","last_fullsized":"2023-12-13T00:27:35.503794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":11316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'64","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.872215+0000","last_change":"2023-12-13T00:00:31.146265+0000","last_active":"2023-12-13T00:28:04.872215+0000","last_peered":"2023-12-13T00:28:04.872215+0000","last_clean":"2023-12-13T00:28:04.872215+0000","last_became_active":"2023-12-13T00:00:31.145997+0000","last_became_peered":"2023-12-13T00:00:31.145997+0000","last_unstale":"2023-12-13T00:28:04.872215+0000","last_undegraded":"2023-12-13T00:28:04.872215+0000","last_fullsized":"2023-12-13T00:28:04.872215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:52.386725+0000","last_change":"2023-12-13T00:00:29.968222+0000","last_active":"2023-12-13T00:27:52.386725+0000","last_peered":"2023-12-13T00:27:52.386725+0000","last_clean":"2023-12-13T00:27:52.386725+0000","last_became_active":"2023-12-13T00:00:29.967916+0000","last_became_peered":"2023-12-13T00:00:29.967916+0000","last_unstale":"2023-12-13T00:27:52.386725+0000","last_undegraded":"2023-12-13T00:27:52.386725+0000","last_fullsized":"2023-12-13T00:27:52.386725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'137","reported_seq":165,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.589474+0000","last_change":"2023-12-13T00:00:35.667745+0000","last_active":"2023-12-13T00:27:29.589474+0000","last_peered":"2023-12-13T00:27:29.589474+0000","last_clean":"2023-12-13T00:27:29.589474+0000","last_became_active":"2023-12-13T00:00:35.666891+0000","last_became_peered":"2023-12-13T00:00:35.666891+0000","last_unstale":"2023-12-13T00:27:29.589474+0000","last_undegraded":"2023-12-13T00:27:29.589474+0000","last_fullsized":"2023-12-13T00:27:29.589474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":9622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'54","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.894297+0000","last_change":"2023-12-13T00:00:31.148279+0000","last_active":"2023-12-13T00:28:04.894297+0000","last_peered":"2023-12-13T00:28:04.894297+0000","last_clean":"2023-12-13T00:28:04.894297+0000","last_became_active":"2023-12-13T00:00:31.148016+0000","last_became_peered":"2023-12-13T00:00:31.148016+0000","last_unstale":"2023-12-13T00:28:04.894297+0000","last_undegraded":"2023-12-13T00:28:04.894297+0000","last_fullsized":"2023-12-13T00:28:04.894297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'289","reported_seq":320,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.758899+0000","last_change":"2023-12-13T00:00:30.008152+0000","last_active":"2023-12-13T00:27:57.758899+0000","last_peered":"2023-12-13T00:27:57.758899+0000","last_clean":"2023-12-13T00:27:57.758899+0000","last_became_active":"2023-12-13T00:00:30.007907+0000","last_became_peered":"2023-12-13T00:00:30.007907+0000","last_unstale":"2023-12-13T00:27:57.758899+0000","last_undegraded":"2023-12-13T00:27:57.758899+0000","last_fullsized":"2023-12-13T00:27:57.758899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'132","reported_seq":160,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:26.786527+0000","last_change":"2023-12-13T00:00:35.660971+0000","last_active":"2023-12-13T00:27:26.786527+0000","last_peered":"2023-12-13T00:27:26.786527+0000","last_clean":"2023-12-13T00:27:26.786527+0000","last_became_active":"2023-12-13T00:00:35.660627+0000","last_became_peered":"2023-12-13T00:00:35.660627+0000","last_unstale":"2023-12-13T00:27:26.786527+0000","last_undegraded":"2023-12-13T00:27:26.786527+0000","last_fullsized":"2023-12-13T00:27:26.786527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":10143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'55","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.870971+0000","last_change":"2023-12-13T00:00:31.142437+0000","last_active":"2023-12-13T00:28:04.870971+0000","last_peered":"2023-12-13T00:28:04.870971+0000","last_clean":"2023-12-13T00:28:04.870971+0000","last_became_active":"2023-12-13T00:00:31.142150+0000","last_became_peered":"2023-12-13T00:00:31.142150+0000","last_unstale":"2023-12-13T00:28:04.870971+0000","last_undegraded":"2023-12-13T00:28:04.870971+0000","last_fullsized":"2023-12-13T00:28:04.870971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'797","reported_seq":827,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:05.092423+0000","last_change":"2023-12-13T00:00:30.000646+0000","last_active":"2023-12-13T00:28:05.092423+0000","last_peered":"2023-12-13T00:28:05.092423+0000","last_clean":"2023-12-13T00:28:05.092423+0000","last_became_active":"2023-12-13T00:00:30.000388+0000","last_became_peered":"2023-12-13T00:00:30.000388+0000","last_unstale":"2023-12-13T00:28:05.092423+0000","last_undegraded":"2023-12-13T00:28:05.092423+0000","last_fullsized":"2023-12-13T00:28:05.092423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277997,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'170","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.931405+0000","last_change":"2023-12-13T00:00:35.666659+0000","last_active":"2023-12-13T00:27:31.931405+0000","last_peered":"2023-12-13T00:27:31.931405+0000","last_clean":"2023-12-13T00:27:31.931405+0000","last_became_active":"2023-12-13T00:00:35.666304+0000","last_became_peered":"2023-12-13T00:00:35.666304+0000","last_unstale":"2023-12-13T00:27:31.931405+0000","last_undegraded":"2023-12-13T00:27:31.931405+0000","last_fullsized":"2023-12-13T00:27:31.931405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":11255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'48","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.895652+0000","last_change":"2023-12-13T00:00:31.037568+0000","last_active":"2023-12-13T00:28:04.895652+0000","last_peered":"2023-12-13T00:28:04.895652+0000","last_clean":"2023-12-13T00:28:04.895652+0000","last_became_active":"2023-12-13T00:00:31.037398+0000","last_became_peered":"2023-12-13T00:00:31.037398+0000","last_unstale":"2023-12-13T00:28:04.895652+0000","last_undegraded":"2023-12-13T00:28:04.895652+0000","last_fullsized":"2023-12-13T00:28:04.895652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'1355","reported_seq":1385,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:53.928686+0000","last_change":"2023-12-13T00:00:30.006086+0000","last_active":"2023-12-13T00:27:53.928686+0000","last_peered":"2023-12-13T00:27:53.928686+0000","last_clean":"2023-12-13T00:27:53.928686+0000","last_became_active":"2023-12-13T00:00:30.005752+0000","last_became_peered":"2023-12-13T00:00:30.005752+0000","last_unstale":"2023-12-13T00:27:53.928686+0000","last_undegraded":"2023-12-13T00:27:53.928686+0000","last_fullsized":"2023-12-13T00:27:53.928686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1355,"log_dups_size":0,"ondisk_log_size":1355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1349,"num_write_kb":4734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'175","reported_seq":202,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.824402+0000","last_change":"2023-12-13T00:00:35.666467+0000","last_active":"2023-12-13T00:27:29.824402+0000","last_peered":"2023-12-13T00:27:29.824402+0000","last_clean":"2023-12-13T00:27:29.824402+0000","last_became_active":"2023-12-13T00:00:35.666061+0000","last_became_peered":"2023-12-13T00:00:35.666061+0000","last_unstale":"2023-12-13T00:27:29.824402+0000","last_undegraded":"2023-12-13T00:27:29.824402+0000","last_fullsized":"2023-12-13T00:27:29.824402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":9890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'68","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.869966+0000","last_change":"2023-12-13T00:01:00.702387+0000","last_active":"2023-12-13T00:28:04.869966+0000","last_peered":"2023-12-13T00:28:04.869966+0000","last_clean":"2023-12-13T00:28:04.869966+0000","last_became_active":"2023-12-13T00:01:00.702089+0000","last_became_peered":"2023-12-13T00:01:00.702089+0000","last_unstale":"2023-12-13T00:28:04.869966+0000","last_undegraded":"2023-12-13T00:28:04.869966+0000","last_fullsized":"2023-12-13T00:28:04.869966+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'393","reported_seq":423,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:05.096248+0000","last_change":"2023-12-13T00:00:30.001171+0000","last_active":"2023-12-13T00:28:05.096248+0000","last_peered":"2023-12-13T00:28:05.096248+0000","last_clean":"2023-12-13T00:28:05.096248+0000","last_became_active":"2023-12-13T00:00:30.000803+0000","last_became_peered":"2023-12-13T00:00:30.000803+0000","last_unstale":"2023-12-13T00:28:05.096248+0000","last_undegraded":"2023-12-13T00:28:05.096248+0000","last_fullsized":"2023-12-13T00:28:05.096248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2931508,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":386,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'176","reported_seq":202,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.548618+0000","last_change":"2023-12-13T00:00:35.649561+0000","last_active":"2023-12-13T00:27:29.548618+0000","last_peered":"2023-12-13T00:27:29.548618+0000","last_clean":"2023-12-13T00:27:29.548618+0000","last_became_active":"2023-12-13T00:00:35.649151+0000","last_became_peered":"2023-12-13T00:00:35.649151+0000","last_unstale":"2023-12-13T00:27:29.548618+0000","last_undegraded":"2023-12-13T00:27:29.548618+0000","last_fullsized":"2023-12-13T00:27:29.548618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:06:34.023899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'60","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.821458+0000","last_change":"2023-12-13T00:00:31.116002+0000","last_active":"2023-12-13T00:28:04.821458+0000","last_peered":"2023-12-13T00:28:04.821458+0000","last_clean":"2023-12-13T00:28:04.821458+0000","last_became_active":"2023-12-13T00:00:31.115678+0000","last_became_peered":"2023-12-13T00:00:31.115678+0000","last_unstale":"2023-12-13T00:28:04.821458+0000","last_undegraded":"2023-12-13T00:28:04.821458+0000","last_fullsized":"2023-12-13T00:28:04.821458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:21:51.967408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'11","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:48.225267+0000","last_change":"2023-12-13T00:00:30.004329+0000","last_active":"2023-12-13T00:27:48.225267+0000","last_peered":"2023-12-13T00:27:48.225267+0000","last_clean":"2023-12-13T00:27:48.225267+0000","last_became_active":"2023-12-13T00:00:30.004089+0000","last_became_peered":"2023-12-13T00:00:30.004089+0000","last_unstale":"2023-12-13T00:27:48.225267+0000","last_undegraded":"2023-12-13T00:27:48.225267+0000","last_fullsized":"2023-12-13T00:27:48.225267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:05:04.403249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'148","reported_seq":175,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.559260+0000","last_change":"2023-12-13T00:00:35.652272+0000","last_active":"2023-12-13T00:27:29.559260+0000","last_peered":"2023-12-13T00:27:29.559260+0000","last_clean":"2023-12-13T00:27:29.559260+0000","last_became_active":"2023-12-13T00:00:35.651907+0000","last_became_peered":"2023-12-13T00:00:35.651907+0000","last_unstale":"2023-12-13T00:27:29.559260+0000","last_undegraded":"2023-12-13T00:27:29.559260+0000","last_fullsized":"2023-12-13T00:27:29.559260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":7909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'46","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.865955+0000","last_change":"2023-12-13T00:00:31.148754+0000","last_active":"2023-12-13T00:28:04.865955+0000","last_peered":"2023-12-13T00:28:04.865955+0000","last_clean":"2023-12-13T00:28:04.865955+0000","last_became_active":"2023-12-13T00:00:31.147846+0000","last_became_peered":"2023-12-13T00:00:31.147846+0000","last_unstale":"2023-12-13T00:28:04.865955+0000","last_undegraded":"2023-12-13T00:28:04.865955+0000","last_fullsized":"2023-12-13T00:28:04.865955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'1473","reported_seq":1503,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.518423+0000","last_change":"2023-12-13T00:00:30.001703+0000","last_active":"2023-12-13T00:28:04.518423+0000","last_peered":"2023-12-13T00:28:04.518423+0000","last_clean":"2023-12-13T00:28:04.518423+0000","last_became_active":"2023-12-13T00:00:30.001420+0000","last_became_peered":"2023-12-13T00:00:30.001420+0000","last_unstale":"2023-12-13T00:28:04.518423+0000","last_undegraded":"2023-12-13T00:28:04.518423+0000","last_fullsized":"2023-12-13T00:28:04.518423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1473,"log_dups_size":0,"ondisk_log_size":1473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1472,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'148","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.827357+0000","last_change":"2023-12-13T00:01:00.546607+0000","last_active":"2023-12-13T00:27:29.827357+0000","last_peered":"2023-12-13T00:27:29.827357+0000","last_clean":"2023-12-13T00:27:29.827357+0000","last_became_active":"2023-12-13T00:01:00.546264+0000","last_became_peered":"2023-12-13T00:01:00.546264+0000","last_unstale":"2023-12-13T00:27:29.827357+0000","last_undegraded":"2023-12-13T00:27:29.827357+0000","last_fullsized":"2023-12-13T00:27:29.827357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'60","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.870103+0000","last_change":"2023-12-13T00:00:31.138998+0000","last_active":"2023-12-13T00:28:04.870103+0000","last_peered":"2023-12-13T00:28:04.870103+0000","last_clean":"2023-12-13T00:28:04.870103+0000","last_became_active":"2023-12-13T00:00:31.138723+0000","last_became_peered":"2023-12-13T00:00:31.138723+0000","last_unstale":"2023-12-13T00:28:04.870103+0000","last_undegraded":"2023-12-13T00:28:04.870103+0000","last_fullsized":"2023-12-13T00:28:04.870103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'217","reported_seq":246,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.944367+0000","last_change":"2023-12-13T00:00:30.003079+0000","last_active":"2023-12-13T00:27:57.944367+0000","last_peered":"2023-12-13T00:27:57.944367+0000","last_clean":"2023-12-13T00:27:57.944367+0000","last_became_active":"2023-12-13T00:00:30.002823+0000","last_became_peered":"2023-12-13T00:00:30.002823+0000","last_unstale":"2023-12-13T00:27:57.944367+0000","last_undegraded":"2023-12-13T00:27:57.944367+0000","last_fullsized":"2023-12-13T00:27:57.944367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:53:07.829448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'219","reported_seq":255,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.827081+0000","last_change":"2023-12-13T00:01:00.697705+0000","last_active":"2023-12-13T00:27:29.827081+0000","last_peered":"2023-12-13T00:27:29.827081+0000","last_clean":"2023-12-13T00:27:29.827081+0000","last_became_active":"2023-12-13T00:01:00.697231+0000","last_became_peered":"2023-12-13T00:01:00.697231+0000","last_unstale":"2023-12-13T00:27:29.827081+0000","last_undegraded":"2023-12-13T00:27:29.827081+0000","last_fullsized":"2023-12-13T00:27:29.827081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":195,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'66","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.875248+0000","last_change":"2023-12-13T00:00:31.027503+0000","last_active":"2023-12-13T00:28:04.875248+0000","last_peered":"2023-12-13T00:28:04.875248+0000","last_clean":"2023-12-13T00:28:04.875248+0000","last_became_active":"2023-12-13T00:00:31.027239+0000","last_became_peered":"2023-12-13T00:00:31.027239+0000","last_unstale":"2023-12-13T00:28:04.875248+0000","last_undegraded":"2023-12-13T00:28:04.875248+0000","last_fullsized":"2023-12-13T00:28:04.875248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'5","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:53.927459+0000","last_change":"2023-12-13T00:00:30.009592+0000","last_active":"2023-12-13T00:27:53.927459+0000","last_peered":"2023-12-13T00:27:53.927459+0000","last_clean":"2023-12-13T00:27:53.927459+0000","last_became_active":"2023-12-13T00:00:30.009351+0000","last_became_peered":"2023-12-13T00:00:30.009351+0000","last_unstale":"2023-12-13T00:27:53.927459+0000","last_undegraded":"2023-12-13T00:27:53.927459+0000","last_fullsized":"2023-12-13T00:27:53.927459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'190","reported_seq":214,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:30.828933+0000","last_change":"2023-12-13T00:01:00.717446+0000","last_active":"2023-12-13T00:27:30.828933+0000","last_peered":"2023-12-13T00:27:30.828933+0000","last_clean":"2023-12-13T00:27:30.828933+0000","last_became_active":"2023-12-13T00:01:00.717019+0000","last_became_peered":"2023-12-13T00:01:00.717019+0000","last_unstale":"2023-12-13T00:27:30.828933+0000","last_undegraded":"2023-12-13T00:27:30.828933+0000","last_fullsized":"2023-12-13T00:27:30.828933+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":9378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"27'64","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.893315+0000","last_change":"2023-12-13T00:00:31.139946+0000","last_active":"2023-12-13T00:28:04.893315+0000","last_peered":"2023-12-13T00:28:04.893315+0000","last_clean":"2023-12-13T00:28:04.893315+0000","last_became_active":"2023-12-13T00:00:31.139656+0000","last_became_peered":"2023-12-13T00:00:31.139656+0000","last_unstale":"2023-12-13T00:28:04.893315+0000","last_undegraded":"2023-12-13T00:28:04.893315+0000","last_fullsized":"2023-12-13T00:28:04.893315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'83","reported_seq":113,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.528840+0000","last_change":"2023-12-13T00:00:30.003511+0000","last_active":"2023-12-13T00:28:04.528840+0000","last_peered":"2023-12-13T00:28:04.528840+0000","last_clean":"2023-12-13T00:28:04.528840+0000","last_became_active":"2023-12-13T00:00:30.002630+0000","last_became_peered":"2023-12-13T00:00:30.002630+0000","last_unstale":"2023-12-13T00:28:04.528840+0000","last_undegraded":"2023-12-13T00:28:04.528840+0000","last_fullsized":"2023-12-13T00:28:04.528840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'123","reported_seq":150,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.827852+0000","last_change":"2023-12-13T00:00:35.649725+0000","last_active":"2023-12-13T00:27:29.827852+0000","last_peered":"2023-12-13T00:27:29.827852+0000","last_clean":"2023-12-13T00:27:29.827852+0000","last_became_active":"2023-12-13T00:00:35.649401+0000","last_became_peered":"2023-12-13T00:00:35.649401+0000","last_unstale":"2023-12-13T00:27:29.827852+0000","last_undegraded":"2023-12-13T00:27:29.827852+0000","last_fullsized":"2023-12-13T00:27:29.827852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":7272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'122","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.600657+0000","last_change":"2023-12-13T00:00:35.662790+0000","last_active":"2023-12-13T00:27:29.600657+0000","last_peered":"2023-12-13T00:27:29.600657+0000","last_clean":"2023-12-13T00:27:29.600657+0000","last_became_active":"2023-12-13T00:00:35.662406+0000","last_became_peered":"2023-12-13T00:00:35.662406+0000","last_unstale":"2023-12-13T00:27:29.600657+0000","last_undegraded":"2023-12-13T00:27:29.600657+0000","last_fullsized":"2023-12-13T00:27:29.600657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":7728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'66","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.834125+0000","last_change":"2023-12-13T00:00:31.143141+0000","last_active":"2023-12-13T00:28:04.834125+0000","last_peered":"2023-12-13T00:28:04.834125+0000","last_clean":"2023-12-13T00:28:04.834125+0000","last_became_active":"2023-12-13T00:00:31.142823+0000","last_became_peered":"2023-12-13T00:00:31.142823+0000","last_unstale":"2023-12-13T00:28:04.834125+0000","last_undegraded":"2023-12-13T00:28:04.834125+0000","last_fullsized":"2023-12-13T00:28:04.834125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'7","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.169007+0000","last_change":"2023-12-13T00:00:30.004773+0000","last_active":"2023-12-13T00:27:57.169007+0000","last_peered":"2023-12-13T00:27:57.169007+0000","last_clean":"2023-12-13T00:27:57.169007+0000","last_became_active":"2023-12-13T00:00:30.004496+0000","last_became_peered":"2023-12-13T00:00:30.004496+0000","last_unstale":"2023-12-13T00:27:57.169007+0000","last_undegraded":"2023-12-13T00:27:57.169007+0000","last_fullsized":"2023-12-13T00:27:57.169007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'188","reported_seq":217,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:43.961956+0000","last_change":"2023-12-13T00:00:35.666457+0000","last_active":"2023-12-13T00:27:43.961956+0000","last_peered":"2023-12-13T00:27:43.961956+0000","last_clean":"2023-12-13T00:27:43.961956+0000","last_became_active":"2023-12-13T00:00:35.666075+0000","last_became_peered":"2023-12-13T00:00:35.666075+0000","last_unstale":"2023-12-13T00:27:43.961956+0000","last_undegraded":"2023-12-13T00:27:43.961956+0000","last_fullsized":"2023-12-13T00:27:43.961956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":17531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'63","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.860756+0000","last_change":"2023-12-13T00:00:31.116511+0000","last_active":"2023-12-13T00:28:04.860756+0000","last_peered":"2023-12-13T00:28:04.860756+0000","last_clean":"2023-12-13T00:28:04.860756+0000","last_became_active":"2023-12-13T00:00:31.116209+0000","last_became_peered":"2023-12-13T00:00:31.116209+0000","last_unstale":"2023-12-13T00:28:04.860756+0000","last_undegraded":"2023-12-13T00:28:04.860756+0000","last_fullsized":"2023-12-13T00:28:04.860756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'484","reported_seq":991,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.156120+0000","last_change":"2023-12-13T00:00:30.006475+0000","last_active":"2023-12-13T00:27:57.156120+0000","last_peered":"2023-12-13T00:27:57.156120+0000","last_clean":"2023-12-13T00:27:57.156120+0000","last_became_active":"2023-12-13T00:00:30.006026+0000","last_became_peered":"2023-12-13T00:00:30.006026+0000","last_unstale":"2023-12-13T00:27:57.156120+0000","last_undegraded":"2023-12-13T00:27:57.156120+0000","last_fullsized":"2023-12-13T00:27:57.156120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:29.225167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92099,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":501,"num_write":481,"num_write_kb":501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'1030","reported_seq":1753,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.994118+0000","last_change":"2023-12-13T00:00:30.004483+0000","last_active":"2023-12-13T00:28:04.994118+0000","last_peered":"2023-12-13T00:28:04.994118+0000","last_clean":"2023-12-13T00:28:04.994118+0000","last_became_active":"2023-12-13T00:00:30.004214+0000","last_became_peered":"2023-12-13T00:00:30.004214+0000","last_unstale":"2023-12-13T00:28:04.994118+0000","last_undegraded":"2023-12-13T00:28:04.994118+0000","last_fullsized":"2023-12-13T00:28:04.994118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1792997,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":693,"num_read_kb":705,"num_write":1026,"num_write_kb":2509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'68","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.837271+0000","last_change":"2023-12-13T00:00:31.147121+0000","last_active":"2023-12-13T00:28:04.837271+0000","last_peered":"2023-12-13T00:28:04.837271+0000","last_clean":"2023-12-13T00:28:04.837271+0000","last_became_active":"2023-12-13T00:00:31.146818+0000","last_became_peered":"2023-12-13T00:00:31.146818+0000","last_unstale":"2023-12-13T00:28:04.837271+0000","last_undegraded":"2023-12-13T00:28:04.837271+0000","last_fullsized":"2023-12-13T00:28:04.837271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'150","reported_seq":177,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:08.952320+0000","last_change":"2023-12-13T00:00:35.642485+0000","last_active":"2023-12-13T00:28:08.952320+0000","last_peered":"2023-12-13T00:28:08.952320+0000","last_clean":"2023-12-13T00:28:08.952320+0000","last_became_active":"2023-12-13T00:00:35.642114+0000","last_became_peered":"2023-12-13T00:00:35.642114+0000","last_unstale":"2023-12-13T00:28:08.952320+0000","last_undegraded":"2023-12-13T00:28:08.952320+0000","last_fullsized":"2023-12-13T00:28:08.952320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":10646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'2837","reported_seq":2867,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:00.506361+0000","last_change":"2023-12-13T00:00:29.972296+0000","last_active":"2023-12-13T00:28:00.506361+0000","last_peered":"2023-12-13T00:28:00.506361+0000","last_clean":"2023-12-13T00:28:00.506361+0000","last_became_active":"2023-12-13T00:00:29.972018+0000","last_became_peered":"2023-12-13T00:00:29.972018+0000","last_unstale":"2023-12-13T00:28:00.506361+0000","last_undegraded":"2023-12-13T00:28:00.506361+0000","last_fullsized":"2023-12-13T00:28:00.506361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":2837,"log_dups_size":0,"ondisk_log_size":2837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2827,"num_write_kb":13646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'70","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.898953+0000","last_change":"2023-12-13T00:00:31.037679+0000","last_active":"2023-12-13T00:28:04.898953+0000","last_peered":"2023-12-13T00:28:04.898953+0000","last_clean":"2023-12-13T00:28:04.898953+0000","last_became_active":"2023-12-13T00:00:31.037445+0000","last_became_peered":"2023-12-13T00:00:31.037445+0000","last_unstale":"2023-12-13T00:28:04.898953+0000","last_undegraded":"2023-12-13T00:28:04.898953+0000","last_fullsized":"2023-12-13T00:28:04.898953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'116","reported_seq":142,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.942392+0000","last_change":"2023-12-13T00:00:35.661405+0000","last_active":"2023-12-13T00:27:31.942392+0000","last_peered":"2023-12-13T00:27:31.942392+0000","last_clean":"2023-12-13T00:27:31.942392+0000","last_became_active":"2023-12-13T00:00:35.660984+0000","last_became_peered":"2023-12-13T00:00:35.660984+0000","last_unstale":"2023-12-13T00:27:31.942392+0000","last_undegraded":"2023-12-13T00:27:31.942392+0000","last_fullsized":"2023-12-13T00:27:31.942392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:24.668139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":9076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'57","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.887046+0000","last_change":"2023-12-13T00:00:31.147104+0000","last_active":"2023-12-13T00:28:04.887046+0000","last_peered":"2023-12-13T00:28:04.887046+0000","last_clean":"2023-12-13T00:28:04.887046+0000","last_became_active":"2023-12-13T00:00:31.145225+0000","last_became_peered":"2023-12-13T00:00:31.145225+0000","last_unstale":"2023-12-13T00:28:04.887046+0000","last_undegraded":"2023-12-13T00:28:04.887046+0000","last_fullsized":"2023-12-13T00:28:04.887046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'66","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.758045+0000","last_change":"2023-12-13T00:00:31.119735+0000","last_active":"2023-12-13T00:28:04.758045+0000","last_peered":"2023-12-13T00:28:04.758045+0000","last_clean":"2023-12-13T00:28:04.758045+0000","last_became_active":"2023-12-13T00:00:31.119474+0000","last_became_peered":"2023-12-13T00:00:31.119474+0000","last_unstale":"2023-12-13T00:28:04.758045+0000","last_undegraded":"2023-12-13T00:28:04.758045+0000","last_fullsized":"2023-12-13T00:28:04.758045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:43:30.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'62","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.877870+0000","last_change":"2023-12-13T00:00:31.027180+0000","last_active":"2023-12-13T00:28:04.877870+0000","last_peered":"2023-12-13T00:28:04.877870+0000","last_clean":"2023-12-13T00:28:04.877870+0000","last_became_active":"2023-12-13T00:00:31.026922+0000","last_became_peered":"2023-12-13T00:00:31.026922+0000","last_unstale":"2023-12-13T00:28:04.877870+0000","last_undegraded":"2023-12-13T00:28:04.877870+0000","last_fullsized":"2023-12-13T00:28:04.877870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'58","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.859258+0000","last_change":"2023-12-13T00:00:31.119937+0000","last_active":"2023-12-13T00:28:04.859258+0000","last_peered":"2023-12-13T00:28:04.859258+0000","last_clean":"2023-12-13T00:28:04.859258+0000","last_became_active":"2023-12-13T00:00:31.119685+0000","last_became_peered":"2023-12-13T00:00:31.119685+0000","last_unstale":"2023-12-13T00:28:04.859258+0000","last_undegraded":"2023-12-13T00:28:04.859258+0000","last_fullsized":"2023-12-13T00:28:04.859258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.818174+0000","last_change":"2023-12-13T00:00:31.150597+0000","last_active":"2023-12-13T00:28:04.818174+0000","last_peered":"2023-12-13T00:28:04.818174+0000","last_clean":"2023-12-13T00:28:04.818174+0000","last_became_active":"2023-12-13T00:00:31.150275+0000","last_became_peered":"2023-12-13T00:00:31.150275+0000","last_unstale":"2023-12-13T00:28:04.818174+0000","last_undegraded":"2023-12-13T00:28:04.818174+0000","last_fullsized":"2023-12-13T00:28:04.818174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:20.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'47","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.817976+0000","last_change":"2023-12-13T00:00:31.117688+0000","last_active":"2023-12-13T00:28:04.817976+0000","last_peered":"2023-12-13T00:28:04.817976+0000","last_clean":"2023-12-13T00:28:04.817976+0000","last_became_active":"2023-12-13T00:00:31.117409+0000","last_became_peered":"2023-12-13T00:00:31.117409+0000","last_unstale":"2023-12-13T00:28:04.817976+0000","last_undegraded":"2023-12-13T00:28:04.817976+0000","last_fullsized":"2023-12-13T00:28:04.817976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:45:12.753740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'59","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.891732+0000","last_change":"2023-12-13T00:00:31.142584+0000","last_active":"2023-12-13T00:28:04.891732+0000","last_peered":"2023-12-13T00:28:04.891732+0000","last_clean":"2023-12-13T00:28:04.891732+0000","last_became_active":"2023-12-13T00:00:31.141656+0000","last_became_peered":"2023-12-13T00:00:31.141656+0000","last_unstale":"2023-12-13T00:28:04.891732+0000","last_undegraded":"2023-12-13T00:28:04.891732+0000","last_fullsized":"2023-12-13T00:28:04.891732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'47","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.861484+0000","last_change":"2023-12-13T00:00:31.036263+0000","last_active":"2023-12-13T00:28:04.861484+0000","last_peered":"2023-12-13T00:28:04.861484+0000","last_clean":"2023-12-13T00:28:04.861484+0000","last_became_active":"2023-12-13T00:00:31.036113+0000","last_became_peered":"2023-12-13T00:00:31.036113+0000","last_unstale":"2023-12-13T00:28:04.861484+0000","last_undegraded":"2023-12-13T00:28:04.861484+0000","last_fullsized":"2023-12-13T00:28:04.861484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.873015+0000","last_change":"2023-12-13T00:00:31.027230+0000","last_active":"2023-12-13T00:28:04.873015+0000","last_peered":"2023-12-13T00:28:04.873015+0000","last_clean":"2023-12-13T00:28:04.873015+0000","last_became_active":"2023-12-13T00:00:31.026968+0000","last_became_peered":"2023-12-13T00:00:31.026968+0000","last_unstale":"2023-12-13T00:28:04.873015+0000","last_undegraded":"2023-12-13T00:28:04.873015+0000","last_fullsized":"2023-12-13T00:28:04.873015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'71","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.862876+0000","last_change":"2023-12-13T00:00:31.139140+0000","last_active":"2023-12-13T00:28:04.862876+0000","last_peered":"2023-12-13T00:28:04.862876+0000","last_clean":"2023-12-13T00:28:04.862876+0000","last_became_active":"2023-12-13T00:00:31.138869+0000","last_became_peered":"2023-12-13T00:00:31.138869+0000","last_unstale":"2023-12-13T00:28:04.862876+0000","last_undegraded":"2023-12-13T00:28:04.862876+0000","last_fullsized":"2023-12-13T00:28:04.862876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'64","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.902468+0000","last_change":"2023-12-13T00:00:31.146522+0000","last_active":"2023-12-13T00:28:04.902468+0000","last_peered":"2023-12-13T00:28:04.902468+0000","last_clean":"2023-12-13T00:28:04.902468+0000","last_became_active":"2023-12-13T00:00:31.146264+0000","last_became_peered":"2023-12-13T00:00:31.146264+0000","last_unstale":"2023-12-13T00:28:04.902468+0000","last_undegraded":"2023-12-13T00:28:04.902468+0000","last_fullsized":"2023-12-13T00:28:04.902468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'68","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.832878+0000","last_change":"2023-12-13T00:00:31.143709+0000","last_active":"2023-12-13T00:28:04.832878+0000","last_peered":"2023-12-13T00:28:04.832878+0000","last_clean":"2023-12-13T00:28:04.832878+0000","last_became_active":"2023-12-13T00:00:31.143472+0000","last_became_peered":"2023-12-13T00:00:31.143472+0000","last_unstale":"2023-12-13T00:28:04.832878+0000","last_undegraded":"2023-12-13T00:28:04.832878+0000","last_fullsized":"2023-12-13T00:28:04.832878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'52","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.878417+0000","last_change":"2023-12-13T00:00:31.146698+0000","last_active":"2023-12-13T00:28:04.878417+0000","last_peered":"2023-12-13T00:28:04.878417+0000","last_clean":"2023-12-13T00:28:04.878417+0000","last_became_active":"2023-12-13T00:00:31.146159+0000","last_became_peered":"2023-12-13T00:00:31.146159+0000","last_unstale":"2023-12-13T00:28:04.878417+0000","last_undegraded":"2023-12-13T00:28:04.878417+0000","last_fullsized":"2023-12-13T00:28:04.878417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'67","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.876452+0000","last_change":"2023-12-13T00:00:31.143946+0000","last_active":"2023-12-13T00:28:04.876452+0000","last_peered":"2023-12-13T00:28:04.876452+0000","last_clean":"2023-12-13T00:28:04.876452+0000","last_became_active":"2023-12-13T00:00:31.143663+0000","last_became_peered":"2023-12-13T00:00:31.143663+0000","last_unstale":"2023-12-13T00:28:04.876452+0000","last_undegraded":"2023-12-13T00:28:04.876452+0000","last_fullsized":"2023-12-13T00:28:04.876452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'69","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.756252+0000","last_change":"2023-12-13T00:00:31.142314+0000","last_active":"2023-12-13T00:28:04.756252+0000","last_peered":"2023-12-13T00:28:04.756252+0000","last_clean":"2023-12-13T00:28:04.756252+0000","last_became_active":"2023-12-13T00:00:31.142067+0000","last_became_peered":"2023-12-13T00:00:31.142067+0000","last_unstale":"2023-12-13T00:28:04.756252+0000","last_undegraded":"2023-12-13T00:28:04.756252+0000","last_fullsized":"2023-12-13T00:28:04.756252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:05:36.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'51","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.874384+0000","last_change":"2023-12-13T00:00:31.146764+0000","last_active":"2023-12-13T00:28:04.874384+0000","last_peered":"2023-12-13T00:28:04.874384+0000","last_clean":"2023-12-13T00:28:04.874384+0000","last_became_active":"2023-12-13T00:00:31.146501+0000","last_became_peered":"2023-12-13T00:00:31.146501+0000","last_unstale":"2023-12-13T00:28:04.874384+0000","last_undegraded":"2023-12-13T00:28:04.874384+0000","last_fullsized":"2023-12-13T00:28:04.874384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'67","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.872634+0000","last_change":"2023-12-13T00:00:31.138982+0000","last_active":"2023-12-13T00:28:04.872634+0000","last_peered":"2023-12-13T00:28:04.872634+0000","last_clean":"2023-12-13T00:28:04.872634+0000","last_became_active":"2023-12-13T00:00:31.138738+0000","last_became_peered":"2023-12-13T00:00:31.138738+0000","last_unstale":"2023-12-13T00:28:04.872634+0000","last_undegraded":"2023-12-13T00:28:04.872634+0000","last_fullsized":"2023-12-13T00:28:04.872634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'52","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.870204+0000","last_change":"2023-12-13T00:00:31.148499+0000","last_active":"2023-12-13T00:28:04.870204+0000","last_peered":"2023-12-13T00:28:04.870204+0000","last_clean":"2023-12-13T00:28:04.870204+0000","last_became_active":"2023-12-13T00:00:31.148251+0000","last_became_peered":"2023-12-13T00:00:31.148251+0000","last_unstale":"2023-12-13T00:28:04.870204+0000","last_undegraded":"2023-12-13T00:28:04.870204+0000","last_fullsized":"2023-12-13T00:28:04.870204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'58","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.817989+0000","last_change":"2023-12-13T00:00:31.117684+0000","last_active":"2023-12-13T00:28:04.817989+0000","last_peered":"2023-12-13T00:28:04.817989+0000","last_clean":"2023-12-13T00:28:04.817989+0000","last_became_active":"2023-12-13T00:00:31.117423+0000","last_became_peered":"2023-12-13T00:00:31.117423+0000","last_unstale":"2023-12-13T00:28:04.817989+0000","last_undegraded":"2023-12-13T00:28:04.817989+0000","last_fullsized":"2023-12-13T00:28:04.817989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:33:39.081529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'67","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.825415+0000","last_change":"2023-12-13T00:00:31.150615+0000","last_active":"2023-12-13T00:28:04.825415+0000","last_peered":"2023-12-13T00:28:04.825415+0000","last_clean":"2023-12-13T00:28:04.825415+0000","last_became_active":"2023-12-13T00:00:31.150324+0000","last_became_peered":"2023-12-13T00:00:31.150324+0000","last_unstale":"2023-12-13T00:28:04.825415+0000","last_undegraded":"2023-12-13T00:28:04.825415+0000","last_fullsized":"2023-12-13T00:28:04.825415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:15:16.348222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'63","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.877997+0000","last_change":"2023-12-13T00:00:31.147145+0000","last_active":"2023-12-13T00:28:04.877997+0000","last_peered":"2023-12-13T00:28:04.877997+0000","last_clean":"2023-12-13T00:28:04.877997+0000","last_became_active":"2023-12-13T00:00:31.146444+0000","last_became_peered":"2023-12-13T00:00:31.146444+0000","last_unstale":"2023-12-13T00:28:04.877997+0000","last_undegraded":"2023-12-13T00:28:04.877997+0000","last_fullsized":"2023-12-13T00:28:04.877997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'67","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.876742+0000","last_change":"2023-12-13T00:00:31.148920+0000","last_active":"2023-12-13T00:28:04.876742+0000","last_peered":"2023-12-13T00:28:04.876742+0000","last_clean":"2023-12-13T00:28:04.876742+0000","last_became_active":"2023-12-13T00:00:31.148529+0000","last_became_peered":"2023-12-13T00:00:31.148529+0000","last_unstale":"2023-12-13T00:28:04.876742+0000","last_undegraded":"2023-12-13T00:28:04.876742+0000","last_fullsized":"2023-12-13T00:28:04.876742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'59","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.866890+0000","last_change":"2023-12-13T00:00:31.149934+0000","last_active":"2023-12-13T00:28:04.866890+0000","last_peered":"2023-12-13T00:28:04.866890+0000","last_clean":"2023-12-13T00:28:04.866890+0000","last_became_active":"2023-12-13T00:00:31.149685+0000","last_became_peered":"2023-12-13T00:00:31.149685+0000","last_unstale":"2023-12-13T00:28:04.866890+0000","last_undegraded":"2023-12-13T00:28:04.866890+0000","last_fullsized":"2023-12-13T00:28:04.866890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'62","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.897559+0000","last_change":"2023-12-13T00:00:31.035879+0000","last_active":"2023-12-13T00:28:04.897559+0000","last_peered":"2023-12-13T00:28:04.897559+0000","last_clean":"2023-12-13T00:28:04.897559+0000","last_became_active":"2023-12-13T00:00:31.035672+0000","last_became_peered":"2023-12-13T00:00:31.035672+0000","last_unstale":"2023-12-13T00:28:04.897559+0000","last_undegraded":"2023-12-13T00:28:04.897559+0000","last_fullsized":"2023-12-13T00:28:04.897559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'65","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.866643+0000","last_change":"2023-12-13T00:00:31.146556+0000","last_active":"2023-12-13T00:28:04.866643+0000","last_peered":"2023-12-13T00:28:04.866643+0000","last_clean":"2023-12-13T00:28:04.866643+0000","last_became_active":"2023-12-13T00:00:31.146186+0000","last_became_peered":"2023-12-13T00:00:31.146186+0000","last_unstale":"2023-12-13T00:28:04.866643+0000","last_undegraded":"2023-12-13T00:28:04.866643+0000","last_fullsized":"2023-12-13T00:28:04.866643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'52","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.863535+0000","last_change":"2023-12-13T00:00:31.145365+0000","last_active":"2023-12-13T00:28:04.863535+0000","last_peered":"2023-12-13T00:28:04.863535+0000","last_clean":"2023-12-13T00:28:04.863535+0000","last_became_active":"2023-12-13T00:00:31.144458+0000","last_became_peered":"2023-12-13T00:00:31.144458+0000","last_unstale":"2023-12-13T00:28:04.863535+0000","last_undegraded":"2023-12-13T00:28:04.863535+0000","last_fullsized":"2023-12-13T00:28:04.863535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'57","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.887071+0000","last_change":"2023-12-13T00:00:31.145052+0000","last_active":"2023-12-13T00:28:04.887071+0000","last_peered":"2023-12-13T00:28:04.887071+0000","last_clean":"2023-12-13T00:28:04.887071+0000","last_became_active":"2023-12-13T00:00:31.144792+0000","last_became_peered":"2023-12-13T00:00:31.144792+0000","last_unstale":"2023-12-13T00:28:04.887071+0000","last_undegraded":"2023-12-13T00:28:04.887071+0000","last_fullsized":"2023-12-13T00:28:04.887071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'50","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.866312+0000","last_change":"2023-12-13T00:00:31.149527+0000","last_active":"2023-12-13T00:28:04.866312+0000","last_peered":"2023-12-13T00:28:04.866312+0000","last_clean":"2023-12-13T00:28:04.866312+0000","last_became_active":"2023-12-13T00:00:31.148875+0000","last_became_peered":"2023-12-13T00:00:31.148875+0000","last_unstale":"2023-12-13T00:28:04.866312+0000","last_undegraded":"2023-12-13T00:28:04.866312+0000","last_fullsized":"2023-12-13T00:28:04.866312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'66","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.887923+0000","last_change":"2023-12-13T00:00:31.144423+0000","last_active":"2023-12-13T00:28:04.887923+0000","last_peered":"2023-12-13T00:28:04.887923+0000","last_clean":"2023-12-13T00:28:04.887923+0000","last_became_active":"2023-12-13T00:00:31.144174+0000","last_became_peered":"2023-12-13T00:00:31.144174+0000","last_unstale":"2023-12-13T00:28:04.887923+0000","last_undegraded":"2023-12-13T00:28:04.887923+0000","last_fullsized":"2023-12-13T00:28:04.887923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'57","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.859213+0000","last_change":"2023-12-13T00:00:31.144074+0000","last_active":"2023-12-13T00:28:04.859213+0000","last_peered":"2023-12-13T00:28:04.859213+0000","last_clean":"2023-12-13T00:28:04.859213+0000","last_became_active":"2023-12-13T00:00:31.143809+0000","last_became_peered":"2023-12-13T00:00:31.143809+0000","last_unstale":"2023-12-13T00:28:04.859213+0000","last_undegraded":"2023-12-13T00:28:04.859213+0000","last_fullsized":"2023-12-13T00:28:04.859213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'47","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.858614+0000","last_change":"2023-12-13T00:00:31.116522+0000","last_active":"2023-12-13T00:28:04.858614+0000","last_peered":"2023-12-13T00:28:04.858614+0000","last_clean":"2023-12-13T00:28:04.858614+0000","last_became_active":"2023-12-13T00:00:31.116230+0000","last_became_peered":"2023-12-13T00:00:31.116230+0000","last_unstale":"2023-12-13T00:28:04.858614+0000","last_undegraded":"2023-12-13T00:28:04.858614+0000","last_fullsized":"2023-12-13T00:28:04.858614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'66","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.877794+0000","last_change":"2023-12-13T00:00:31.149691+0000","last_active":"2023-12-13T00:28:04.877794+0000","last_peered":"2023-12-13T00:28:04.877794+0000","last_clean":"2023-12-13T00:28:04.877794+0000","last_became_active":"2023-12-13T00:00:31.149410+0000","last_became_peered":"2023-12-13T00:00:31.149410+0000","last_unstale":"2023-12-13T00:28:04.877794+0000","last_undegraded":"2023-12-13T00:28:04.877794+0000","last_fullsized":"2023-12-13T00:28:04.877794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":248,"num_write":4193,"num_write_kb":331487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5031,"ondisk_log_size":5031,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3759,"ondisk_log_size":3759,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":43904475,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":1477,"num_read_kb":1524,"num_write":14609,"num_write_kb":50682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87957504,"data_stored":87808950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13591,"ondisk_log_size":13591,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509783,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53632,"kb_used_data":8568,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318208,"statfs":{"total":96636764160,"available":96581844992,"internally_reserved":0,"allocated":8773632,"data_stored":8578223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.34699999999999998,"5min":0.25800000000000001,"15min":0.23699999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.65800000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42999999999999999,"15min":0.42899999999999999},"min":{"1min":0.29299999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.60599999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.44700000000000001}]},{"osd":1,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.442,"15min":0.438},"min":{"1min":0.312,"5min":0.308,"15min":0.24299999999999999},"max":{"1min":0.58399999999999996,"5min":0.63500000000000001,"15min":0.68200000000000005},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.36299999999999999,"5min":0.29799999999999999,"15min":0.28199999999999997},"max":{"1min":0.52000000000000002,"5min":0.60099999999999998,"15min":0.61699999999999999},"last":0.42699999999999999}]},{"osd":2,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.432,"15min":0.42699999999999999},"min":{"1min":0.35999999999999999,"5min":0.29499999999999998,"15min":0.27100000000000002},"max":{"1min":0.59499999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.436,"15min":0.42899999999999999},"min":{"1min":0.35499999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60699999999999998,"5min":0.65100000000000002,"15min":0.65200000000000002},"last":0.437}]},{"osd":3,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.436,"15min":0.436},"min":{"1min":0.32700000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.56299999999999994,"5min":0.623,"15min":0.623},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.309},"max":{"1min":0.58099999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.46999999999999997}]},{"osd":4,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.372,"15min":0.371},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56399999999999995,"5min":0.753,"15min":0.753},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26300000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64100000000000001,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.34799999999999998}]},{"osd":5,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.40200000000000002,"15min":0.40100000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.22900000000000001},"max":{"1min":0.61099999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.44500000000000001,"15min":0.436},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.23100000000000001},"max":{"1min":0.628,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.39300000000000002}]},{"osd":6,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.23999999999999999},"max":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.438,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56899999999999995,"5min":0.67900000000000005,"15min":0.71799999999999997},"last":0.45500000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509782,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88192,"kb_used_data":16760,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94283648,"statfs":{"total":96636764160,"available":96546455552,"internally_reserved":0,"allocated":17162240,"data_stored":16985405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.34100000000000003,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.42799999999999999},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.23100000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.47999999999999998}]},{"osd":1,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.30399999999999999,"5min":0.28599999999999998,"15min":0.252},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.41899999999999998,"15min":0.41699999999999998},"min":{"1min":0.34599999999999997,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.498}]},{"osd":2,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.42299999999999999,"15min":0.41099999999999998},"min":{"1min":0.35799999999999998,"5min":0.30099999999999999,"15min":0.247},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.437,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.26500000000000001},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.39900000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.28999999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.438},{"interface":"front","average":{"1min":0.503,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32300000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.41599999999999998}]},{"osd":4,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.38,"15min":0.379},"min":{"1min":0.254,"5min":0.215,"15min":0.215},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.315},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.33700000000000002}]},{"osd":5,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.378},"min":{"1min":0.24399999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44500000000000001,"15min":0.436},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.249},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.38300000000000001}]},{"osd":7,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.441,"15min":0.44},"min":{"1min":0.32200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.433,"15min":0.439},"min":{"1min":0.29499999999999998,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.36599999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509784,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58980,"kb_used_data":9756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312860,"statfs":{"total":96636764160,"available":96576368640,"internally_reserved":0,"allocated":9990144,"data_stored":9784207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.41999999999999998},"min":{"1min":0.33500000000000002,"5min":0.216,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40400000000000003,"15min":0.40999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.41199999999999998},"min":{"1min":0.373,"5min":0.248,"15min":0.224},"max":{"1min":0.55700000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.432,"15min":0.435},"min":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.251},"max":{"1min":0.53000000000000003,"5min":0.57699999999999996,"15min":0.59999999999999998},"last":0.65400000000000003}]},{"osd":2,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.43099999999999999,"15min":0.432},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27100000000000002},"max":{"1min":0.54800000000000004,"5min":0.60099999999999998,"15min":0.60699999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.65500000000000003},"last":0.71599999999999997}]},{"osd":3,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54300000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.378,"5min":0.33200000000000002,"15min":0.28699999999999998},"max":{"1min":0.63100000000000001,"5min":0.65500000000000003,"15min":0.66800000000000004},"last":0.52900000000000003}]},{"osd":5,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38300000000000001,"15min":0.38200000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.221},"max":{"1min":0.61299999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.65100000000000002},"last":0.63700000000000001}]},{"osd":6,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.378,"15min":0.38500000000000001},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.247},"max":{"1min":0.624,"5min":0.63100000000000001,"15min":0.71999999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.30099999999999999,"5min":0.27300000000000002,"15min":0.23899999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.71899999999999997},"last":0.68899999999999995}]},{"osd":7,"last update":"Wed Dec 13 00:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.42999999999999999,"15min":0.42699999999999999},"min":{"1min":0.32500000000000001,"5min":0.26300000000000001,"15min":0.25600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.70299999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47099999999999997,"15min":0.46200000000000002},"min":{"1min":0.34799999999999998,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.67100000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509784,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96880,"kb_used_data":21288,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94274960,"statfs":{"total":96636764160,"available":96537559040,"internally_reserved":0,"allocated":21798912,"data_stored":21617833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.317,"15min":0.316},"min":{"1min":0.22600000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.42699999999999999,"5min":0.53200000000000003,"15min":0.64000000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.312,"15min":0.312},"min":{"1min":0.246,"5min":0.19600000000000001,"15min":0.192},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.57899999999999996},"last":0.33300000000000002}]},{"osd":1,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34000000000000002,"15min":0.33000000000000002},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.20200000000000001},"max":{"1min":0.41299999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.371,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.28499999999999998,"5min":0.27400000000000002,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.42299999999999999}]},{"osd":2,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.26600000000000001,"5min":0.249,"15min":0.22800000000000001},"max":{"1min":0.47799999999999998,"5min":0.59899999999999998,"15min":0.69399999999999995},"last":0.376},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39800000000000002,"15min":0.39600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.23799999999999999},"max":{"1min":0.51400000000000001,"5min":0.59699999999999998,"15min":0.66300000000000003},"last":0.443}]},{"osd":4,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.311},"max":{"1min":0.72199999999999998,"5min":0.80100000000000005,"15min":0.90700000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.38500000000000001,"5min":0.34100000000000003,"15min":0.316},"max":{"1min":0.64500000000000002,"5min":0.76700000000000002,"15min":0.84199999999999997},"last":0.505}]},{"osd":5,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.83199999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50700000000000001,"15min":0.5},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.30599999999999999},"max":{"1min":0.72799999999999998,"5min":0.76000000000000001,"15min":0.81999999999999995},"last":0.46500000000000002}]},{"osd":6,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.67600000000000005,"5min":0.78600000000000003,"15min":0.80600000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54600000000000004,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.79300000000000004},"last":0.49199999999999999}]},{"osd":7,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.78800000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.39500000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.85799999999999998},"last":0.54400000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509782,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36200,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335640,"statfs":{"total":96636764160,"available":96599695360,"internally_reserved":0,"allocated":884736,"data_stored":706002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.308,"15min":0.29899999999999999},"min":{"1min":0.20399999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.49299999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.308,"5min":0.32000000000000001,"15min":0.32800000000000001},"min":{"1min":0.251,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.41199999999999998,"5min":0.57599999999999996,"15min":0.63600000000000001},"last":0.28399999999999997}]},{"osd":2,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33100000000000002,"15min":0.32500000000000001},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.44500000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35599999999999998,"15min":0.35199999999999998},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.23100000000000001},"max":{"1min":0.501,"5min":0.53800000000000003,"15min":0.55000000000000004},"last":0.35299999999999998}]},{"osd":3,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38100000000000001,"15min":0.375},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.5,"5min":0.60599999999999998,"15min":0.60799999999999998},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.39200000000000002,"15min":0.38400000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.52100000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.505}]},{"osd":4,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59199999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.371,"5min":0.316,"15min":0.316},"max":{"1min":0.747,"5min":0.79800000000000004,"15min":0.84699999999999998},"last":0.67700000000000005}]},{"osd":5,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.69099999999999995,"5min":0.78500000000000003,"15min":0.81999999999999995},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51000000000000001,"15min":0.48999999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.32000000000000001},"max":{"1min":0.71899999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.29099999999999998},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":0.89300000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.35999999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66700000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59099999999999997}]},{"osd":7,"last update":"Wed Dec 13 00:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.38800000000000001,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":0.67500000000000004,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.34999999999999998},"max":{"1min":0.68999999999999995,"5min":0.82699999999999996,"15min":0.85799999999999998},"last":0.71499999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542486,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70184,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94301656,"statfs":{"total":96636764160,"available":96564895744,"internally_reserved":0,"allocated":8683520,"data_stored":8504788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.313,"15min":0.308},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.38400000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.32200000000000001,"15min":0.32700000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.19},"max":{"1min":0.42799999999999999,"5min":0.53200000000000003,"15min":0.60299999999999998},"last":0.32900000000000001}]},{"osd":1,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.33000000000000002,"15min":0.33100000000000002},"min":{"1min":0.23599999999999999,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.38200000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.746},"last":0.34200000000000003}]},{"osd":3,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35899999999999999,"15min":0.36799999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46800000000000003,"5min":0.57399999999999995,"15min":1.03},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.376,"15min":0.38500000000000001},"min":{"1min":0.26000000000000001,"5min":0.247,"15min":0.23499999999999999},"max":{"1min":0.41799999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.316}]},{"osd":4,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46899999999999997,"15min":0.46600000000000003},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.85399999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.496,"15min":0.48699999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.28499999999999998},"max":{"1min":0.65700000000000003,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.48099999999999998}]},{"osd":5,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.47899999999999998,"15min":0.46899999999999997},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.317},"max":{"1min":0.56899999999999995,"5min":0.70799999999999996,"15min":0.82099999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51600000000000001,"15min":0.496},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.316},"max":{"1min":0.76100000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.40400000000000003}]},{"osd":6,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.36799999999999999,"5min":0.36199999999999999,"15min":0.34499999999999997},"max":{"1min":0.61799999999999999,"5min":0.74399999999999999,"15min":0.79800000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.498,"15min":0.503},"min":{"1min":0.377,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.52500000000000002,"5min":0.75800000000000001,"15min":0.78200000000000003},"last":0.45700000000000002}]},{"osd":7,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53500000000000003,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.438},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35499999999999998},"max":{"1min":0.63800000000000001,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.46800000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542486,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67936,"kb_used_data":6232,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94303904,"statfs":{"total":96636764160,"available":96567197696,"internally_reserved":0,"allocated":6381568,"data_stored":6195602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.32900000000000001,"15min":0.32000000000000001},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.19400000000000001},"max":{"1min":0.56599999999999995,"5min":0.627,"15min":0.66900000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33000000000000002,"15min":0.316},"min":{"1min":0.22700000000000001,"5min":0.221,"15min":0.19900000000000001},"max":{"1min":0.47299999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.253}]},{"osd":2,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32600000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57999999999999996,"5min":0.60699999999999998,"15min":0.64600000000000002},"last":0.309},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.37,"15min":0.35399999999999998},"min":{"1min":0.246,"5min":0.24299999999999999,"15min":0.23000000000000001},"max":{"1min":0.52800000000000002,"5min":0.61299999999999999,"15min":0.72299999999999998},"last":0.29799999999999999}]},{"osd":3,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36199999999999999,"15min":0.35499999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.22900000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.36799999999999999},"min":{"1min":0.28999999999999998,"5min":0.26300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.65400000000000003},"last":0.27100000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.33500000000000002,"5min":0.30499999999999999,"15min":0.25800000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51500000000000001,"15min":0.47899999999999998},"min":{"1min":0.36499999999999999,"5min":0.35899999999999999,"15min":0.27200000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.58299999999999996}]},{"osd":5,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52500000000000002,"15min":0.48499999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.505},"min":{"1min":0.40000000000000002,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.5}]},{"osd":6,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52000000000000002},"min":{"1min":0.40200000000000002,"5min":0.33800000000000002,"15min":0.33600000000000002},"max":{"1min":0.71699999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.51900000000000002},"min":{"1min":0.41999999999999998,"5min":0.377,"15min":0.34499999999999997},"max":{"1min":0.81699999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47699999999999998}]},{"osd":7,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69399999999999995,"5min":0.746,"15min":0.79500000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":0.54100000000000004},"min":{"1min":0.371,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.51000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575191,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88748,"kb_used_data":17316,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94283092,"statfs":{"total":96636764160,"available":96545886208,"internally_reserved":0,"allocated":17731584,"data_stored":17541418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.307,"5min":0.255,"15min":0.20200000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.70399999999999996},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41399999999999998,"15min":0.40699999999999997},"min":{"1min":0.30099999999999999,"5min":0.28000000000000003,"15min":0.23999999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.67300000000000004},"last":0.373}]},{"osd":1,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.434,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.249},"max":{"1min":0.61499999999999999,"5min":0.625,"15min":0.67300000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.33300000000000002,"5min":0.28999999999999998,"15min":0.247},"max":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.73399999999999999},"last":0.442}]},{"osd":2,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.42999999999999999,"15min":0.42299999999999999},"min":{"1min":0.317,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.628,"5min":0.628,"15min":0.68700000000000006},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41599999999999998,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.65900000000000003},"last":0.39800000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44600000000000001,"15min":0.436},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.27300000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.68999999999999995},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.44800000000000001},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.69099999999999995},"last":0.309}]},{"osd":4,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38800000000000001,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.215},"max":{"1min":0.58599999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40100000000000002,"15min":0.38600000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.22900000000000001},"max":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.65000000000000002},"last":0.38900000000000001}]},{"osd":6,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.374,"15min":0.36499999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.22500000000000001},"max":{"1min":0.48299999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.42299999999999999,"15min":0.41799999999999998},"min":{"1min":0.26100000000000001,"5min":0.25800000000000001,"15min":0.24399999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.77400000000000002},"last":0.56599999999999995}]},{"osd":7,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.41899999999999998},"min":{"1min":0.29999999999999999,"5min":0.27400000000000002,"15min":0.22900000000000001},"max":{"1min":0.60099999999999998,"5min":0.61099999999999999,"15min":0.68899999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.433},"min":{"1min":0.36699999999999999,"5min":0.27000000000000002,"15min":0.26700000000000002},"max":{"1min":0.64500000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6098944,"data_stored":6080128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21516288,"data_stored":21502359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9707520,"data_stored":9668733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16855040,"data_stored":16835576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16879616,"data_stored":16869931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8491008,"data_stored":8462749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T00:28:20.945 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.945 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.945 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.945 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.945 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.945 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.945 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.945 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.945 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.946 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.946 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.946 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.946 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.946 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.946 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.946 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.946 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.947 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.947 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.947 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.947 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.947 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.947 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.947 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.947 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.947 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.947 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.948 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.948 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.948 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.948 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.948 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.948 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.948 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.949 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.949 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.949 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.949 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.949 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.949 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.949 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.949 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.949 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.949 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.950 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.950 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.950 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.950 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.950 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.950 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.950 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.950 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.951 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.951 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.951 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.951 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.951 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.951 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.951 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.951 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.951 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.951 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.952 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.952 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.952 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.952 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.952 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.952 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.952 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.952 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.952 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.952 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.953 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.953 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.953 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.953 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.953 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.953 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.953 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.953 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.953 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.954 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.954 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.954 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.954 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.954 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.954 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.954 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.954 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.954 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.954 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.955 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.955 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.955 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.955 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.955 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.955 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.956 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.956 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.956 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.956 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.956 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.957 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.957 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.957 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.957 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.958 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.958 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.958 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.958 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.958 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.959 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.959 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.959 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.959 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.959 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.960 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.960 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.960 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.960 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.960 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.961 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.961 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.961 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.961 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.961 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.962 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.962 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:20.962 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-13T00:28:37.842 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:28:37.845 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:28:40.963 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T00:28:41.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.063+0000 7fa61c017640 1 Processor -- start 2023-12-13T00:28:41.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.063+0000 7fa61c017640 1 -- start start 2023-12-13T00:28:41.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.064+0000 7fa61c017640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa614157240 0x7fa6140c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:41.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.064+0000 7fa61c017640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6141577f0 con 0x7fa6140c4610 2023-12-13T00:28:41.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.064+0000 7fa61c017640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa614157a90 con 0x7fa614151220 2023-12-13T00:28:41.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.064+0000 7fa61c017640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61406f470 con 0x7fa614157240 2023-12-13T00:28:41.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.064+0000 7fa619db3640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fa614151220 0x7fa61406ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:46710/0 (socket says 172.21.15.72:46710) 2023-12-13T00:28:41.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.064+0000 7fa619db3640 1 -- 172.21.15.72:0/1578770056 learned_addr learned my addr 172.21.15.72:0/1578770056 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:28:41.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.064+0000 7fa6195b2640 1 --2- 172.21.15.72:0/1578770056 >> v2:172.21.15.72:3300/0 conn(0x7fa614157240 0x7fa6140c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:41.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.067+0000 7fa618db1640 1 -- 172.21.15.72:0/1578770056 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134516847 0 0) 0x7fa614157a90 con 0x7fa614151220 2023-12-13T00:28:41.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.067+0000 7fa618db1640 1 -- 172.21.15.72:0/1578770056 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa600003520 con 0x7fa614151220 2023-12-13T00:28:41.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.068+0000 7fa6195b2640 1 -- 172.21.15.72:0/1578770056 >> v1:172.21.15.176:6789/0 conn(0x7fa614151220 legacy=0x7fa61406ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:41.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.068+0000 7fa6195b2640 1 -- 172.21.15.72:0/1578770056 >> v1:172.21.15.72:6789/0 conn(0x7fa6140c4610 legacy=0x7fa6140710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:41.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.068+0000 7fa6195b2640 1 -- 172.21.15.72:0/1578770056 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa614157d30 con 0x7fa614157240 2023-12-13T00:28:41.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.071+0000 7fa6195b2640 1 --2- 172.21.15.72:0/1578770056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614157240 0x7fa6140c40d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa61406f5b0 tx=0x7fa61002b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20d01ff5fcbba4e server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:41.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.076+0000 7fa618db1640 1 -- 172.21.15.72:0/1578770056 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610030890 con 0x7fa614157240 2023-12-13T00:28:41.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.076+0000 7fa618db1640 1 -- 172.21.15.72:0/1578770056 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6100309f0 con 0x7fa614157240 2023-12-13T00:28:41.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.076+0000 7fa618db1640 1 -- 172.21.15.72:0/1578770056 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610030d80 con 0x7fa614157240 2023-12-13T00:28:41.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.076+0000 7fa61c017640 1 -- 172.21.15.72:0/1578770056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614157240 msgr2=0x7fa6140c40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:41.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.076+0000 7fa61c017640 1 --2- 172.21.15.72:0/1578770056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614157240 0x7fa6140c40d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa61406f5b0 tx=0x7fa61002b9d0 comp rx=0 tx=0).stop 2023-12-13T00:28:41.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.076+0000 7fa61c017640 1 -- 172.21.15.72:0/1578770056 shutdown_connections 2023-12-13T00:28:41.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.076+0000 7fa61c017640 1 --2- 172.21.15.72:0/1578770056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614157240 0x7fa6140c40d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:41.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.076+0000 7fa61c017640 1 -- 172.21.15.72:0/1578770056 >> 172.21.15.72:0/1578770056 conn(0x7fa61406c5f0 msgr2=0x7fa61406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:41.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.076+0000 7fa61c017640 1 -- 172.21.15.72:0/1578770056 shutdown_connections 2023-12-13T00:28:41.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.076+0000 7fa61c017640 1 -- 172.21.15.72:0/1578770056 wait complete. 2023-12-13T00:28:41.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.078+0000 7fa61c017640 1 Processor -- start 2023-12-13T00:28:41.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.078+0000 7fa61c017640 1 -- start start 2023-12-13T00:28:41.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.078+0000 7fa61c017640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6140c4610 0x7fa614151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:41.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.078+0000 7fa61c017640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa614151220 0x7fa6140c2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:41.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.078+0000 7fa61c017640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614157240 0x7fa614144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:41.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.078+0000 7fa61c017640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140c3ef0 con 0x7fa614157240 2023-12-13T00:28:41.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.078+0000 7fa61c017640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6141f23f0 con 0x7fa614151220 2023-12-13T00:28:41.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.078+0000 7fa61c017640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140c3370 con 0x7fa6140c4610 2023-12-13T00:28:41.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.079+0000 7fa6195b2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa614151220 0x7fa6140c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:41.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.079+0000 7fa619db3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6140c4610 0x7fa614151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:41.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.079+0000 7fa61a5b4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614157240 0x7fa614144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:41.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.079+0000 7fa6195b2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa614151220 0x7fa6140c2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:56380/0 (socket says 172.21.15.72:56380) 2023-12-13T00:28:41.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.079+0000 7fa6195b2640 1 -- 172.21.15.72:0/3272962880 learned_addr learned my addr 172.21.15.72:0/3272962880 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:28:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.083+0000 7fa6195b2640 1 -- 172.21.15.72:0/3272962880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6140c4610 msgr2=0x7fa614151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.083+0000 7fa6195b2640 1 --2- 172.21.15.72:0/3272962880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6140c4610 0x7fa614151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.083+0000 7fa6195b2640 1 -- 172.21.15.72:0/3272962880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614157240 msgr2=0x7fa614144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.083+0000 7fa6195b2640 1 --2- 172.21.15.72:0/3272962880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614157240 0x7fa614144330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.083+0000 7fa6195b2640 1 -- 172.21.15.72:0/3272962880 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa610009400 con 0x7fa614151220 2023-12-13T00:28:41.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.085+0000 7fa6195b2640 1 --2- 172.21.15.72:0/3272962880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa614151220 0x7fa6140c2660 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa610009890 tx=0x7fa6100046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:41.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.089+0000 7fa6067fc640 1 -- 172.21.15.72:0/3272962880 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61003e070 con 0x7fa614151220 2023-12-13T00:28:41.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.089+0000 7fa6067fc640 1 -- 172.21.15.72:0/3272962880 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa610039aa0 con 0x7fa614151220 2023-12-13T00:28:41.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.089+0000 7fa6067fc640 1 -- 172.21.15.72:0/3272962880 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610039e50 con 0x7fa614151220 2023-12-13T00:28:41.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.089+0000 7fa61c017640 1 -- 172.21.15.72:0/3272962880 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6140c3650 con 0x7fa614151220 2023-12-13T00:28:41.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.089+0000 7fa61c017640 1 -- 172.21.15.72:0/3272962880 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6140c3c10 con 0x7fa614151220 2023-12-13T00:28:41.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.090+0000 7fa61c017640 1 -- 172.21.15.72:0/3272962880 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa614072020 con 0x7fa614151220 2023-12-13T00:28:41.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.331+0000 7fa6067fc640 1 -- 172.21.15.72:0/3272962880 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa6100423f0 con 0x7fa614151220 2023-12-13T00:28:41.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.331+0000 7fa6067fc640 1 --2- 172.21.15.72:0/3272962880 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa5f806b1c0 0x7fa5f806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:28:41.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.331+0000 7fa619db3640 1 --2- 172.21.15.72:0/3272962880 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa5f806b1c0 0x7fa5f806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:28:41.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.332+0000 7fa619db3640 1 --2- 172.21.15.72:0/3272962880 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa5f806b1c0 0x7fa5f806d680 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa6080011e0 tx=0x7fa608007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:28:41.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.336+0000 7fa6067fc640 1 -- 172.21.15.72:0/3272962880 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fa61007a540 con 0x7fa614151220 2023-12-13T00:28:41.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.351+0000 7fa6067fc640 1 -- 172.21.15.72:0/3272962880 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa610076880 con 0x7fa614151220 2023-12-13T00:28:41.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.524+0000 7fa61c017640 1 -- 172.21.15.72:0/3272962880 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa614070ba0 con 0x7fa5f806b1c0 2023-12-13T00:28:41.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.534+0000 7fa6067fc640 1 -- 172.21.15.72:0/3272962880 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368697 (secure 0 0 0) 0x7fa6080014d0 con 0x7fa5f806b1c0 2023-12-13T00:28:41.539 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:28:41.541 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-12-13T00:28:41.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.538+0000 7fa61c017640 1 -- 172.21.15.72:0/3272962880 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa5f806b1c0 msgr2=0x7fa5f806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:41.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.538+0000 7fa61c017640 1 --2- 172.21.15.72:0/3272962880 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa5f806b1c0 0x7fa5f806d680 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa6080011e0 tx=0x7fa608007d30 comp rx=0 tx=0).stop 2023-12-13T00:28:41.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.538+0000 7fa61c017640 1 -- 172.21.15.72:0/3272962880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa614151220 msgr2=0x7fa6140c2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:28:41.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.538+0000 7fa61c017640 1 --2- 172.21.15.72:0/3272962880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa614151220 0x7fa6140c2660 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa610009890 tx=0x7fa6100046c0 comp rx=0 tx=0).stop 2023-12-13T00:28:41.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.538+0000 7fa61c017640 1 -- 172.21.15.72:0/3272962880 shutdown_connections 2023-12-13T00:28:41.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.538+0000 7fa61c017640 1 --2- 172.21.15.72:0/3272962880 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa5f806b1c0 0x7fa5f806d680 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:41.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.538+0000 7fa61c017640 1 --2- 172.21.15.72:0/3272962880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614157240 0x7fa614144330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:41.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.538+0000 7fa61c017640 1 --2- 172.21.15.72:0/3272962880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa614151220 0x7fa6140c2660 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:41.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.538+0000 7fa61c017640 1 --2- 172.21.15.72:0/3272962880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6140c4610 0x7fa614151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:28:41.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.538+0000 7fa61c017640 1 -- 172.21.15.72:0/3272962880 >> 172.21.15.72:0/3272962880 conn(0x7fa61406c5f0 msgr2=0x7fa61414f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:28:41.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.538+0000 7fa61c017640 1 -- 172.21.15.72:0/3272962880 shutdown_connections 2023-12-13T00:28:41.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:28:41.538+0000 7fa61c017640 1 -- 172.21.15.72:0/3272962880 wait complete. 2023-12-13T00:28:41.550 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":878,"stamp":"2023-12-13T00:28:40.915022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44494843,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1597,"num_read_kb":1872,"num_write":18961,"num_write_kb":384585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22531,"ondisk_log_size":22531,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":560752,"kb_used_data":89264,"kb_used_omap":12,"kb_used_meta":471411,"kb_avail":754413968,"statfs":{"total":773094113280,"available":772519903232,"internally_reserved":0,"allocated":91406336,"data_stored":89913478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":482725426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003224"},"pg_stats":[{"pgid":"2.1f","version":"27'893","reported_seq":933,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:29.139599+0000","last_change":"2023-12-13T00:28:29.139661+0000","last_active":"2023-12-13T00:28:29.139599+0000","last_peered":"2023-12-13T00:28:29.139599+0000","last_clean":"2023-12-13T00:28:29.139599+0000","last_became_active":"2023-12-13T00:00:29.997381+0000","last_became_peered":"2023-12-13T00:00:29.997381+0000","last_unstale":"2023-12-13T00:28:29.139599+0000","last_undegraded":"2023-12-13T00:28:29.139599+0000","last_fullsized":"2023-12-13T00:28:29.139599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'893","last_scrub_stamp":"2023-12-13T00:28:29.139513+0000","last_deep_scrub":"27'893","last_deep_scrub_stamp":"2023-12-13T00:28:29.139513+0000","last_clean_scrub_stamp":"2023-12-13T00:28:29.139513+0000","objects_scrubbed":5,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:42:10.924829+0000","scrub_duration":0.013572704,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":4535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'54","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.804135+0000","last_change":"2023-12-13T00:00:31.138533+0000","last_active":"2023-12-13T00:28:18.804135+0000","last_peered":"2023-12-13T00:28:18.804135+0000","last_clean":"2023-12-13T00:28:18.804135+0000","last_became_active":"2023-12-13T00:00:31.138242+0000","last_became_peered":"2023-12-13T00:00:31.138242+0000","last_unstale":"2023-12-13T00:28:18.804135+0000","last_undegraded":"2023-12-13T00:28:18.804135+0000","last_fullsized":"2023-12-13T00:28:18.804135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'155","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.588560+0000","last_change":"2023-12-13T00:00:35.667840+0000","last_active":"2023-12-13T00:27:29.588560+0000","last_peered":"2023-12-13T00:27:29.588560+0000","last_clean":"2023-12-13T00:27:29.588560+0000","last_became_active":"2023-12-13T00:00:35.667498+0000","last_became_peered":"2023-12-13T00:00:35.667498+0000","last_unstale":"2023-12-13T00:27:29.588560+0000","last_undegraded":"2023-12-13T00:27:29.588560+0000","last_fullsized":"2023-12-13T00:27:29.588560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'846","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.804088+0000","last_change":"2023-12-13T00:00:30.001888+0000","last_active":"2023-12-13T00:28:18.804088+0000","last_peered":"2023-12-13T00:28:18.804088+0000","last_clean":"2023-12-13T00:28:18.804088+0000","last_became_active":"2023-12-13T00:00:30.001628+0000","last_became_peered":"2023-12-13T00:00:30.001628+0000","last_unstale":"2023-12-13T00:28:18.804088+0000","last_undegraded":"2023-12-13T00:28:18.804088+0000","last_fullsized":"2023-12-13T00:28:18.804088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'62","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:23.425898+0000","last_change":"2023-12-13T00:28:23.425921+0000","last_active":"2023-12-13T00:28:23.425898+0000","last_peered":"2023-12-13T00:28:23.425898+0000","last_clean":"2023-12-13T00:28:23.425898+0000","last_became_active":"2023-12-13T00:00:31.036197+0000","last_became_peered":"2023-12-13T00:00:31.036197+0000","last_unstale":"2023-12-13T00:28:23.425898+0000","last_undegraded":"2023-12-13T00:28:23.425898+0000","last_fullsized":"2023-12-13T00:28:23.425898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'62","last_scrub_stamp":"2023-12-13T00:28:23.425813+0000","last_deep_scrub":"27'62","last_deep_scrub_stamp":"2023-12-13T00:28:23.425813+0000","last_clean_scrub_stamp":"2023-12-13T00:28:23.425813+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:33:18.747179+0000","scrub_duration":0.001921973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'165","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:30.828341+0000","last_change":"2023-12-13T00:00:35.665348+0000","last_active":"2023-12-13T00:27:30.828341+0000","last_peered":"2023-12-13T00:27:30.828341+0000","last_clean":"2023-12-13T00:27:30.828341+0000","last_became_active":"2023-12-13T00:00:35.664981+0000","last_became_peered":"2023-12-13T00:00:35.664981+0000","last_unstale":"2023-12-13T00:27:30.828341+0000","last_undegraded":"2023-12-13T00:27:30.828341+0000","last_fullsized":"2023-12-13T00:27:30.828341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":248,"num_write":136,"num_write_kb":7125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:33.302643+0000","last_change":"2023-12-13T00:28:33.302667+0000","last_active":"2023-12-13T00:28:33.302643+0000","last_peered":"2023-12-13T00:28:33.302643+0000","last_clean":"2023-12-13T00:28:33.302643+0000","last_became_active":"2023-12-13T00:00:30.009724+0000","last_became_peered":"2023-12-13T00:00:30.009724+0000","last_unstale":"2023-12-13T00:28:33.302643+0000","last_undegraded":"2023-12-13T00:28:33.302643+0000","last_fullsized":"2023-12-13T00:28:33.302643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2023-12-13T00:28:33.302572+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2023-12-13T00:28:33.302572+0000","last_clean_scrub_stamp":"2023-12-13T00:28:33.302572+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:09:03.008018+0000","scrub_duration":0.0025511840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'58","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:28.924075+0000","last_change":"2023-12-13T00:28:28.924111+0000","last_active":"2023-12-13T00:28:28.924075+0000","last_peered":"2023-12-13T00:28:28.924075+0000","last_clean":"2023-12-13T00:28:28.924075+0000","last_became_active":"2023-12-13T00:00:31.150735+0000","last_became_peered":"2023-12-13T00:00:31.150735+0000","last_unstale":"2023-12-13T00:28:28.924075+0000","last_undegraded":"2023-12-13T00:28:28.924075+0000","last_fullsized":"2023-12-13T00:28:28.924075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-12-13T00:28:28.923981+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-12-13T00:28:28.923981+0000","last_clean_scrub_stamp":"2023-12-13T00:28:28.923981+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:40:47.032764+0000","scrub_duration":0.0010969529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'163","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:06.658865+0000","last_change":"2023-12-13T00:00:35.668759+0000","last_active":"2023-12-13T00:28:06.658865+0000","last_peered":"2023-12-13T00:28:06.658865+0000","last_clean":"2023-12-13T00:28:06.658865+0000","last_became_active":"2023-12-13T00:00:35.668361+0000","last_became_peered":"2023-12-13T00:00:35.668361+0000","last_unstale":"2023-12-13T00:28:06.658865+0000","last_undegraded":"2023-12-13T00:28:06.658865+0000","last_fullsized":"2023-12-13T00:28:06.658865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":10445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:01.617166+0000","last_change":"2023-12-13T00:00:30.009921+0000","last_active":"2023-12-13T00:28:01.617166+0000","last_peered":"2023-12-13T00:28:01.617166+0000","last_clean":"2023-12-13T00:28:01.617166+0000","last_became_active":"2023-12-13T00:00:30.009644+0000","last_became_peered":"2023-12-13T00:00:30.009644+0000","last_unstale":"2023-12-13T00:28:01.617166+0000","last_undegraded":"2023-12-13T00:28:01.617166+0000","last_fullsized":"2023-12-13T00:28:01.617166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'63","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:28.257980+0000","last_change":"2023-12-13T00:28:28.257999+0000","last_active":"2023-12-13T00:28:28.257980+0000","last_peered":"2023-12-13T00:28:28.257980+0000","last_clean":"2023-12-13T00:28:28.257980+0000","last_became_active":"2023-12-13T00:00:31.146516+0000","last_became_peered":"2023-12-13T00:00:31.146516+0000","last_unstale":"2023-12-13T00:28:28.257980+0000","last_undegraded":"2023-12-13T00:28:28.257980+0000","last_fullsized":"2023-12-13T00:28:28.257980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'63","last_scrub_stamp":"2023-12-13T00:28:28.257908+0000","last_deep_scrub":"27'63","last_deep_scrub_stamp":"2023-12-13T00:28:28.257908+0000","last_clean_scrub_stamp":"2023-12-13T00:28:28.257908+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:55:00.846548+0000","scrub_duration":0.00097492599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'175","reported_seq":202,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:06.658832+0000","last_change":"2023-12-13T00:00:35.668621+0000","last_active":"2023-12-13T00:28:06.658832+0000","last_peered":"2023-12-13T00:28:06.658832+0000","last_clean":"2023-12-13T00:28:06.658832+0000","last_became_active":"2023-12-13T00:00:35.668298+0000","last_became_peered":"2023-12-13T00:00:35.668298+0000","last_unstale":"2023-12-13T00:28:06.658832+0000","last_undegraded":"2023-12-13T00:28:06.658832+0000","last_fullsized":"2023-12-13T00:28:06.658832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'50","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:31.257779+0000","last_change":"2023-12-13T00:28:31.257801+0000","last_active":"2023-12-13T00:28:31.257779+0000","last_peered":"2023-12-13T00:28:31.257779+0000","last_clean":"2023-12-13T00:28:31.257779+0000","last_became_active":"2023-12-13T00:00:31.036062+0000","last_became_peered":"2023-12-13T00:00:31.036062+0000","last_unstale":"2023-12-13T00:28:31.257779+0000","last_undegraded":"2023-12-13T00:28:31.257779+0000","last_fullsized":"2023-12-13T00:28:31.257779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-13T00:28:31.257707+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-13T00:28:31.257707+0000","last_clean_scrub_stamp":"2023-12-13T00:28:31.257707+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:17:04.269503+0000","scrub_duration":0.001111849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'849","reported_seq":880,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:52.174766+0000","last_change":"2023-12-13T00:00:30.001066+0000","last_active":"2023-12-13T00:27:52.174766+0000","last_peered":"2023-12-13T00:27:52.174766+0000","last_clean":"2023-12-13T00:27:52.174766+0000","last_became_active":"2023-12-13T00:00:30.000782+0000","last_became_peered":"2023-12-13T00:00:30.000782+0000","last_unstale":"2023-12-13T00:27:52.174766+0000","last_undegraded":"2023-12-13T00:27:52.174766+0000","last_fullsized":"2023-12-13T00:27:52.174766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":4547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'149","reported_seq":177,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:38.961322+0000","last_change":"2023-12-13T00:00:35.662038+0000","last_active":"2023-12-13T00:27:38.961322+0000","last_peered":"2023-12-13T00:27:38.961322+0000","last_clean":"2023-12-13T00:27:38.961322+0000","last_became_active":"2023-12-13T00:00:35.661458+0000","last_became_peered":"2023-12-13T00:00:35.661458+0000","last_unstale":"2023-12-13T00:27:38.961322+0000","last_undegraded":"2023-12-13T00:27:38.961322+0000","last_fullsized":"2023-12-13T00:27:38.961322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":11179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'55","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:33.071406+0000","last_change":"2023-12-13T00:28:33.071426+0000","last_active":"2023-12-13T00:28:33.071406+0000","last_peered":"2023-12-13T00:28:33.071406+0000","last_clean":"2023-12-13T00:28:33.071406+0000","last_became_active":"2023-12-13T00:00:31.119447+0000","last_became_peered":"2023-12-13T00:00:31.119447+0000","last_unstale":"2023-12-13T00:28:33.071406+0000","last_undegraded":"2023-12-13T00:28:33.071406+0000","last_fullsized":"2023-12-13T00:28:33.071406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2023-12-13T00:28:33.071296+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2023-12-13T00:28:33.071296+0000","last_clean_scrub_stamp":"2023-12-13T00:28:33.071296+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:32:09.634850+0000","scrub_duration":0.001330962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'215","reported_seq":254,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:22.122456+0000","last_change":"2023-12-13T00:28:22.122493+0000","last_active":"2023-12-13T00:28:22.122456+0000","last_peered":"2023-12-13T00:28:22.122456+0000","last_clean":"2023-12-13T00:28:22.122456+0000","last_became_active":"2023-12-13T00:00:29.967929+0000","last_became_peered":"2023-12-13T00:00:29.967929+0000","last_unstale":"2023-12-13T00:28:22.122456+0000","last_undegraded":"2023-12-13T00:28:22.122456+0000","last_fullsized":"2023-12-13T00:28:22.122456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'215","last_scrub_stamp":"2023-12-13T00:28:22.122378+0000","last_deep_scrub":"27'215","last_deep_scrub_stamp":"2023-12-13T00:28:22.122378+0000","last_clean_scrub_stamp":"2023-12-13T00:28:22.122378+0000","objects_scrubbed":1,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:35:04.951172+0000","scrub_duration":0.001579186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":581,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'167","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:36.614523+0000","last_change":"2023-12-13T00:00:35.662848+0000","last_active":"2023-12-13T00:27:36.614523+0000","last_peered":"2023-12-13T00:27:36.614523+0000","last_clean":"2023-12-13T00:27:36.614523+0000","last_became_active":"2023-12-13T00:00:35.662469+0000","last_became_peered":"2023-12-13T00:00:35.662469+0000","last_unstale":"2023-12-13T00:27:36.614523+0000","last_undegraded":"2023-12-13T00:27:36.614523+0000","last_fullsized":"2023-12-13T00:27:36.614523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":19086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.831928+0000","last_change":"2023-12-13T00:00:31.143108+0000","last_active":"2023-12-13T00:28:04.831928+0000","last_peered":"2023-12-13T00:28:04.831928+0000","last_clean":"2023-12-13T00:28:04.831928+0000","last_became_active":"2023-12-13T00:00:31.142847+0000","last_became_peered":"2023-12-13T00:00:31.142847+0000","last_unstale":"2023-12-13T00:28:04.831928+0000","last_undegraded":"2023-12-13T00:28:04.831928+0000","last_fullsized":"2023-12-13T00:28:04.831928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'376","reported_seq":416,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:35.081637+0000","last_change":"2023-12-13T00:28:35.081637+0000","last_active":"2023-12-13T00:28:35.081637+0000","last_peered":"2023-12-13T00:28:35.081637+0000","last_clean":"2023-12-13T00:28:35.081637+0000","last_became_active":"2023-12-13T00:00:30.004195+0000","last_became_peered":"2023-12-13T00:00:30.004195+0000","last_unstale":"2023-12-13T00:28:35.081637+0000","last_undegraded":"2023-12-13T00:28:35.081637+0000","last_fullsized":"2023-12-13T00:28:35.081637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'376","last_scrub_stamp":"2023-12-13T00:28:35.081548+0000","last_deep_scrub":"27'376","last_deep_scrub_stamp":"2023-12-13T00:28:35.081548+0000","last_clean_scrub_stamp":"2023-12-13T00:28:35.081548+0000","objects_scrubbed":2,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:19:25.297573+0000","scrub_duration":0.0030443100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":373,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'154","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:43.948473+0000","last_change":"2023-12-13T00:00:35.660024+0000","last_active":"2023-12-13T00:27:43.948473+0000","last_peered":"2023-12-13T00:27:43.948473+0000","last_clean":"2023-12-13T00:27:43.948473+0000","last_became_active":"2023-12-13T00:00:35.659637+0000","last_became_peered":"2023-12-13T00:00:35.659637+0000","last_unstale":"2023-12-13T00:27:43.948473+0000","last_undegraded":"2023-12-13T00:27:43.948473+0000","last_fullsized":"2023-12-13T00:27:43.948473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":10280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'45","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.870912+0000","last_change":"2023-12-13T00:00:31.143938+0000","last_active":"2023-12-13T00:28:04.870912+0000","last_peered":"2023-12-13T00:28:04.870912+0000","last_clean":"2023-12-13T00:28:04.870912+0000","last_became_active":"2023-12-13T00:00:31.143673+0000","last_became_peered":"2023-12-13T00:00:31.143673+0000","last_unstale":"2023-12-13T00:28:04.870912+0000","last_undegraded":"2023-12-13T00:28:04.870912+0000","last_fullsized":"2023-12-13T00:28:04.870912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'7","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:30.333598+0000","last_change":"2023-12-13T00:28:30.333618+0000","last_active":"2023-12-13T00:28:30.333598+0000","last_peered":"2023-12-13T00:28:30.333598+0000","last_clean":"2023-12-13T00:28:30.333598+0000","last_became_active":"2023-12-13T00:00:30.005740+0000","last_became_peered":"2023-12-13T00:00:30.005740+0000","last_unstale":"2023-12-13T00:28:30.333598+0000","last_undegraded":"2023-12-13T00:28:30.333598+0000","last_fullsized":"2023-12-13T00:28:30.333598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:30.333541+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:30.333541+0000","last_clean_scrub_stamp":"2023-12-13T00:28:30.333541+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:00:50.961984+0000","scrub_duration":0.001992972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'170","reported_seq":198,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:36.655835+0000","last_change":"2023-12-13T00:00:35.666041+0000","last_active":"2023-12-13T00:27:36.655835+0000","last_peered":"2023-12-13T00:27:36.655835+0000","last_clean":"2023-12-13T00:27:36.655835+0000","last_became_active":"2023-12-13T00:00:35.665670+0000","last_became_peered":"2023-12-13T00:00:35.665670+0000","last_unstale":"2023-12-13T00:27:36.655835+0000","last_undegraded":"2023-12-13T00:27:36.655835+0000","last_fullsized":"2023-12-13T00:27:36.655835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'51","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.832107+0000","last_change":"2023-12-13T00:00:31.146677+0000","last_active":"2023-12-13T00:28:04.832107+0000","last_peered":"2023-12-13T00:28:04.832107+0000","last_clean":"2023-12-13T00:28:04.832107+0000","last_became_active":"2023-12-13T00:00:31.146435+0000","last_became_peered":"2023-12-13T00:00:31.146435+0000","last_unstale":"2023-12-13T00:28:04.832107+0000","last_undegraded":"2023-12-13T00:28:04.832107+0000","last_fullsized":"2023-12-13T00:28:04.832107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'8","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:17.322797+0000","last_change":"2023-12-13T00:00:30.006240+0000","last_active":"2023-12-13T00:28:17.322797+0000","last_peered":"2023-12-13T00:28:17.322797+0000","last_clean":"2023-12-13T00:28:17.322797+0000","last_became_active":"2023-12-13T00:00:30.005909+0000","last_became_peered":"2023-12-13T00:00:30.005909+0000","last_unstale":"2023-12-13T00:28:17.322797+0000","last_undegraded":"2023-12-13T00:28:17.322797+0000","last_fullsized":"2023-12-13T00:28:17.322797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'164","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:41.656308+0000","last_change":"2023-12-13T00:00:35.665918+0000","last_active":"2023-12-13T00:27:41.656308+0000","last_peered":"2023-12-13T00:27:41.656308+0000","last_clean":"2023-12-13T00:27:41.656308+0000","last_became_active":"2023-12-13T00:00:35.665521+0000","last_became_peered":"2023-12-13T00:00:35.665521+0000","last_unstale":"2023-12-13T00:27:41.656308+0000","last_undegraded":"2023-12-13T00:27:41.656308+0000","last_fullsized":"2023-12-13T00:27:41.656308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.832423+0000","last_change":"2023-12-13T00:00:31.145392+0000","last_active":"2023-12-13T00:28:04.832423+0000","last_peered":"2023-12-13T00:28:04.832423+0000","last_clean":"2023-12-13T00:28:04.832423+0000","last_became_active":"2023-12-13T00:00:31.145115+0000","last_became_peered":"2023-12-13T00:00:31.145115+0000","last_unstale":"2023-12-13T00:28:04.832423+0000","last_undegraded":"2023-12-13T00:28:04.832423+0000","last_fullsized":"2023-12-13T00:28:04.832423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'169","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.059686+0000","last_change":"2023-12-13T00:00:30.006295+0000","last_active":"2023-12-13T00:28:18.059686+0000","last_peered":"2023-12-13T00:28:18.059686+0000","last_clean":"2023-12-13T00:28:18.059686+0000","last_became_active":"2023-12-13T00:00:30.005988+0000","last_became_peered":"2023-12-13T00:00:30.005988+0000","last_unstale":"2023-12-13T00:28:18.059686+0000","last_undegraded":"2023-12-13T00:28:18.059686+0000","last_fullsized":"2023-12-13T00:28:18.059686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'165","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.940396+0000","last_change":"2023-12-13T00:00:35.662996+0000","last_active":"2023-12-13T00:27:31.940396+0000","last_peered":"2023-12-13T00:27:31.940396+0000","last_clean":"2023-12-13T00:27:31.940396+0000","last_became_active":"2023-12-13T00:00:35.662612+0000","last_became_peered":"2023-12-13T00:00:35.662612+0000","last_unstale":"2023-12-13T00:27:31.940396+0000","last_undegraded":"2023-12-13T00:27:31.940396+0000","last_fullsized":"2023-12-13T00:27:31.940396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":14176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'57","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.829080+0000","last_change":"2023-12-13T00:00:31.118054+0000","last_active":"2023-12-13T00:28:04.829080+0000","last_peered":"2023-12-13T00:28:04.829080+0000","last_clean":"2023-12-13T00:28:04.829080+0000","last_became_active":"2023-12-13T00:00:31.117814+0000","last_became_peered":"2023-12-13T00:00:31.117814+0000","last_unstale":"2023-12-13T00:28:04.829080+0000","last_undegraded":"2023-12-13T00:28:04.829080+0000","last_fullsized":"2023-12-13T00:28:04.829080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'6","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:47.324095+0000","last_change":"2023-12-13T00:00:30.001001+0000","last_active":"2023-12-13T00:27:47.324095+0000","last_peered":"2023-12-13T00:27:47.324095+0000","last_clean":"2023-12-13T00:27:47.324095+0000","last_became_active":"2023-12-13T00:00:30.000755+0000","last_became_peered":"2023-12-13T00:00:30.000755+0000","last_unstale":"2023-12-13T00:27:47.324095+0000","last_undegraded":"2023-12-13T00:27:47.324095+0000","last_fullsized":"2023-12-13T00:27:47.324095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'145","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:43.949608+0000","last_change":"2023-12-13T00:01:00.545340+0000","last_active":"2023-12-13T00:27:43.949608+0000","last_peered":"2023-12-13T00:27:43.949608+0000","last_clean":"2023-12-13T00:27:43.949608+0000","last_became_active":"2023-12-13T00:01:00.544906+0000","last_became_peered":"2023-12-13T00:01:00.544906+0000","last_unstale":"2023-12-13T00:27:43.949608+0000","last_undegraded":"2023-12-13T00:27:43.949608+0000","last_fullsized":"2023-12-13T00:27:43.949608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,5],"acting":[6,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:24.142032+0000","last_change":"2023-12-13T00:28:24.142076+0000","last_active":"2023-12-13T00:28:24.142032+0000","last_peered":"2023-12-13T00:28:24.142032+0000","last_clean":"2023-12-13T00:28:24.142032+0000","last_became_active":"2023-12-13T00:00:31.143182+0000","last_became_peered":"2023-12-13T00:00:31.143182+0000","last_unstale":"2023-12-13T00:28:24.142032+0000","last_undegraded":"2023-12-13T00:28:24.142032+0000","last_fullsized":"2023-12-13T00:28:24.142032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:24.141950+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:24.141950+0000","last_clean_scrub_stamp":"2023-12-13T00:28:24.141950+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:23:02.587212+0000","scrub_duration":0.0015258120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:35.452206+0000","last_change":"2023-12-13T00:28:35.452225+0000","last_active":"2023-12-13T00:28:35.452206+0000","last_peered":"2023-12-13T00:28:35.452206+0000","last_clean":"2023-12-13T00:28:35.452206+0000","last_became_active":"2023-12-13T00:00:29.968860+0000","last_became_peered":"2023-12-13T00:00:29.968860+0000","last_unstale":"2023-12-13T00:28:35.452206+0000","last_undegraded":"2023-12-13T00:28:35.452206+0000","last_fullsized":"2023-12-13T00:28:35.452206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-13T00:28:35.452139+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-13T00:28:35.452139+0000","last_clean_scrub_stamp":"2023-12-13T00:28:35.452139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:35:28.566025+0000","scrub_duration":0.00098817000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'163","reported_seq":192,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:43.949577+0000","last_change":"2023-12-13T00:00:35.642597+0000","last_active":"2023-12-13T00:27:43.949577+0000","last_peered":"2023-12-13T00:27:43.949577+0000","last_clean":"2023-12-13T00:27:43.949577+0000","last_became_active":"2023-12-13T00:00:35.642215+0000","last_became_peered":"2023-12-13T00:00:35.642215+0000","last_unstale":"2023-12-13T00:27:43.949577+0000","last_undegraded":"2023-12-13T00:27:43.949577+0000","last_fullsized":"2023-12-13T00:27:43.949577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":6488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'62","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.868003+0000","last_change":"2023-12-13T00:00:31.149832+0000","last_active":"2023-12-13T00:28:04.868003+0000","last_peered":"2023-12-13T00:28:04.868003+0000","last_clean":"2023-12-13T00:28:04.868003+0000","last_became_active":"2023-12-13T00:00:31.149587+0000","last_became_peered":"2023-12-13T00:00:31.149587+0000","last_unstale":"2023-12-13T00:28:04.868003+0000","last_undegraded":"2023-12-13T00:28:04.868003+0000","last_fullsized":"2023-12-13T00:28:04.868003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'792","reported_seq":824,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:50.381390+0000","last_change":"2023-12-13T00:00:29.998103+0000","last_active":"2023-12-13T00:27:50.381390+0000","last_peered":"2023-12-13T00:27:50.381390+0000","last_clean":"2023-12-13T00:27:50.381390+0000","last_became_active":"2023-12-13T00:00:29.997848+0000","last_became_peered":"2023-12-13T00:00:29.997848+0000","last_unstale":"2023-12-13T00:27:50.381390+0000","last_undegraded":"2023-12-13T00:27:50.381390+0000","last_fullsized":"2023-12-13T00:27:50.381390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":4476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'121","reported_seq":150,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:43.949632+0000","last_change":"2023-12-13T00:00:35.652104+0000","last_active":"2023-12-13T00:27:43.949632+0000","last_peered":"2023-12-13T00:27:43.949632+0000","last_clean":"2023-12-13T00:27:43.949632+0000","last_became_active":"2023-12-13T00:00:35.651766+0000","last_became_peered":"2023-12-13T00:00:35.651766+0000","last_unstale":"2023-12-13T00:27:43.949632+0000","last_undegraded":"2023-12-13T00:27:43.949632+0000","last_fullsized":"2023-12-13T00:27:43.949632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":7468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'58","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.804233+0000","last_change":"2023-12-13T00:00:31.120580+0000","last_active":"2023-12-13T00:28:18.804233+0000","last_peered":"2023-12-13T00:28:18.804233+0000","last_clean":"2023-12-13T00:28:18.804233+0000","last_became_active":"2023-12-13T00:00:31.120330+0000","last_became_peered":"2023-12-13T00:00:31.120330+0000","last_unstale":"2023-12-13T00:28:18.804233+0000","last_undegraded":"2023-12-13T00:28:18.804233+0000","last_fullsized":"2023-12-13T00:28:18.804233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'412","reported_seq":758,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:26.117195+0000","last_change":"2023-12-13T00:28:26.117217+0000","last_active":"2023-12-13T00:28:26.117195+0000","last_peered":"2023-12-13T00:28:26.117195+0000","last_clean":"2023-12-13T00:28:26.117195+0000","last_became_active":"2023-12-13T00:00:30.000015+0000","last_became_peered":"2023-12-13T00:00:30.000015+0000","last_unstale":"2023-12-13T00:28:26.117195+0000","last_undegraded":"2023-12-13T00:28:26.117195+0000","last_fullsized":"2023-12-13T00:28:26.117195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'412","last_scrub_stamp":"2023-12-13T00:28:26.117130+0000","last_deep_scrub":"27'412","last_deep_scrub_stamp":"2023-12-13T00:28:26.117130+0000","last_clean_scrub_stamp":"2023-12-13T00:28:26.117130+0000","objects_scrubbed":3,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:30:24.978930+0000","scrub_duration":0.002759671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58234,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":306,"num_read_kb":318,"num_write":408,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'147","reported_seq":175,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.942177+0000","last_change":"2023-12-13T00:00:35.667415+0000","last_active":"2023-12-13T00:27:31.942177+0000","last_peered":"2023-12-13T00:27:31.942177+0000","last_clean":"2023-12-13T00:27:31.942177+0000","last_became_active":"2023-12-13T00:00:35.667028+0000","last_became_peered":"2023-12-13T00:00:35.667028+0000","last_unstale":"2023-12-13T00:27:31.942177+0000","last_undegraded":"2023-12-13T00:27:31.942177+0000","last_fullsized":"2023-12-13T00:27:31.942177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":5383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'60","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.829164+0000","last_change":"2023-12-13T00:00:31.140853+0000","last_active":"2023-12-13T00:28:04.829164+0000","last_peered":"2023-12-13T00:28:04.829164+0000","last_clean":"2023-12-13T00:28:04.829164+0000","last_became_active":"2023-12-13T00:00:31.140597+0000","last_became_peered":"2023-12-13T00:00:31.140597+0000","last_unstale":"2023-12-13T00:28:04.829164+0000","last_undegraded":"2023-12-13T00:28:04.829164+0000","last_fullsized":"2023-12-13T00:28:04.829164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'6","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:17.322778+0000","last_change":"2023-12-13T00:00:29.998765+0000","last_active":"2023-12-13T00:28:17.322778+0000","last_peered":"2023-12-13T00:28:17.322778+0000","last_clean":"2023-12-13T00:28:17.322778+0000","last_became_active":"2023-12-13T00:00:29.998552+0000","last_became_peered":"2023-12-13T00:00:29.998552+0000","last_unstale":"2023-12-13T00:28:17.322778+0000","last_undegraded":"2023-12-13T00:28:17.322778+0000","last_fullsized":"2023-12-13T00:28:17.322778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'127","reported_seq":155,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.549299+0000","last_change":"2023-12-13T00:00:35.666575+0000","last_active":"2023-12-13T00:27:29.549299+0000","last_peered":"2023-12-13T00:27:29.549299+0000","last_clean":"2023-12-13T00:27:29.549299+0000","last_became_active":"2023-12-13T00:00:35.666135+0000","last_became_peered":"2023-12-13T00:00:35.666135+0000","last_unstale":"2023-12-13T00:27:29.549299+0000","last_undegraded":"2023-12-13T00:27:29.549299+0000","last_fullsized":"2023-12-13T00:27:29.549299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":7535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'49","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.832991+0000","last_change":"2023-12-13T00:00:31.148698+0000","last_active":"2023-12-13T00:28:04.832991+0000","last_peered":"2023-12-13T00:28:04.832991+0000","last_clean":"2023-12-13T00:28:04.832991+0000","last_became_active":"2023-12-13T00:00:31.148421+0000","last_became_peered":"2023-12-13T00:00:31.148421+0000","last_unstale":"2023-12-13T00:28:04.832991+0000","last_undegraded":"2023-12-13T00:28:04.832991+0000","last_fullsized":"2023-12-13T00:28:04.832991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'5","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:53.927177+0000","last_change":"2023-12-13T00:00:30.001220+0000","last_active":"2023-12-13T00:27:53.927177+0000","last_peered":"2023-12-13T00:27:53.927177+0000","last_clean":"2023-12-13T00:27:53.927177+0000","last_became_active":"2023-12-13T00:00:30.000854+0000","last_became_peered":"2023-12-13T00:00:30.000854+0000","last_unstale":"2023-12-13T00:27:53.927177+0000","last_undegraded":"2023-12-13T00:27:53.927177+0000","last_fullsized":"2023-12-13T00:27:53.927177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:15.904956+0000","last_change":"2023-12-13T00:28:15.904996+0000","last_active":"2023-12-13T00:28:15.904956+0000","last_peered":"2023-12-13T00:28:15.904956+0000","last_clean":"2023-12-13T00:28:15.904956+0000","last_became_active":"2023-12-13T00:00:08.574464+0000","last_became_peered":"2023-12-13T00:00:08.574464+0000","last_unstale":"2023-12-13T00:28:15.904956+0000","last_undegraded":"2023-12-13T00:28:15.904956+0000","last_fullsized":"2023-12-13T00:28:15.904956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2023-12-13T00:28:15.904877+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2023-12-13T00:28:15.904877+0000","last_clean_scrub_stamp":"2023-12-13T00:28:15.904877+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:36:22.553417+0000","scrub_duration":0.0040292729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'166","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:48.962635+0000","last_change":"2023-12-13T00:00:35.661806+0000","last_active":"2023-12-13T00:27:48.962635+0000","last_peered":"2023-12-13T00:27:48.962635+0000","last_clean":"2023-12-13T00:27:48.962635+0000","last_became_active":"2023-12-13T00:00:35.660976+0000","last_became_peered":"2023-12-13T00:00:35.660976+0000","last_unstale":"2023-12-13T00:27:48.962635+0000","last_undegraded":"2023-12-13T00:27:48.962635+0000","last_fullsized":"2023-12-13T00:27:48.962635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":12423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'58","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.876810+0000","last_change":"2023-12-13T00:00:31.036383+0000","last_active":"2023-12-13T00:28:04.876810+0000","last_peered":"2023-12-13T00:28:04.876810+0000","last_clean":"2023-12-13T00:28:04.876810+0000","last_became_active":"2023-12-13T00:00:31.036127+0000","last_became_peered":"2023-12-13T00:00:31.036127+0000","last_unstale":"2023-12-13T00:28:04.876810+0000","last_undegraded":"2023-12-13T00:28:04.876810+0000","last_fullsized":"2023-12-13T00:28:04.876810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:32.127657+0000","last_change":"2023-12-13T00:28:32.127692+0000","last_active":"2023-12-13T00:28:32.127657+0000","last_peered":"2023-12-13T00:28:32.127657+0000","last_clean":"2023-12-13T00:28:32.127657+0000","last_became_active":"2023-12-13T00:00:30.005943+0000","last_became_peered":"2023-12-13T00:00:30.005943+0000","last_unstale":"2023-12-13T00:28:32.127657+0000","last_undegraded":"2023-12-13T00:28:32.127657+0000","last_fullsized":"2023-12-13T00:28:32.127657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2023-12-13T00:28:32.127578+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2023-12-13T00:28:32.127578+0000","last_clean_scrub_stamp":"2023-12-13T00:28:32.127578+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:51:20.859478+0000","scrub_duration":0.0026550509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'164","reported_seq":192,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.549287+0000","last_change":"2023-12-13T00:00:35.665140+0000","last_active":"2023-12-13T00:27:29.549287+0000","last_peered":"2023-12-13T00:27:29.549287+0000","last_clean":"2023-12-13T00:27:29.549287+0000","last_became_active":"2023-12-13T00:00:35.664071+0000","last_became_peered":"2023-12-13T00:00:35.664071+0000","last_unstale":"2023-12-13T00:27:29.549287+0000","last_undegraded":"2023-12-13T00:27:29.549287+0000","last_fullsized":"2023-12-13T00:27:29.549287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":5432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'59","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.873970+0000","last_change":"2023-12-13T00:00:31.147760+0000","last_active":"2023-12-13T00:28:04.873970+0000","last_peered":"2023-12-13T00:28:04.873970+0000","last_clean":"2023-12-13T00:28:04.873970+0000","last_became_active":"2023-12-13T00:00:31.147523+0000","last_became_peered":"2023-12-13T00:00:31.147523+0000","last_unstale":"2023-12-13T00:28:04.873970+0000","last_undegraded":"2023-12-13T00:28:04.873970+0000","last_fullsized":"2023-12-13T00:28:04.873970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:54.419193+0000","last_change":"2023-12-13T00:00:30.002705+0000","last_active":"2023-12-13T00:27:54.419193+0000","last_peered":"2023-12-13T00:27:54.419193+0000","last_clean":"2023-12-13T00:27:54.419193+0000","last_became_active":"2023-12-13T00:00:30.002427+0000","last_became_peered":"2023-12-13T00:00:30.002427+0000","last_unstale":"2023-12-13T00:27:54.419193+0000","last_undegraded":"2023-12-13T00:27:54.419193+0000","last_fullsized":"2023-12-13T00:27:54.419193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'177","reported_seq":205,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:35.503794+0000","last_change":"2023-12-13T00:00:35.661309+0000","last_active":"2023-12-13T00:27:35.503794+0000","last_peered":"2023-12-13T00:27:35.503794+0000","last_clean":"2023-12-13T00:27:35.503794+0000","last_became_active":"2023-12-13T00:00:35.660939+0000","last_became_peered":"2023-12-13T00:00:35.660939+0000","last_unstale":"2023-12-13T00:27:35.503794+0000","last_undegraded":"2023-12-13T00:27:35.503794+0000","last_fullsized":"2023-12-13T00:27:35.503794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":11316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'64","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.872215+0000","last_change":"2023-12-13T00:00:31.146265+0000","last_active":"2023-12-13T00:28:04.872215+0000","last_peered":"2023-12-13T00:28:04.872215+0000","last_clean":"2023-12-13T00:28:04.872215+0000","last_became_active":"2023-12-13T00:00:31.145997+0000","last_became_peered":"2023-12-13T00:00:31.145997+0000","last_unstale":"2023-12-13T00:28:04.872215+0000","last_undegraded":"2023-12-13T00:28:04.872215+0000","last_fullsized":"2023-12-13T00:28:04.872215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:52.386725+0000","last_change":"2023-12-13T00:00:29.968222+0000","last_active":"2023-12-13T00:27:52.386725+0000","last_peered":"2023-12-13T00:27:52.386725+0000","last_clean":"2023-12-13T00:27:52.386725+0000","last_became_active":"2023-12-13T00:00:29.967916+0000","last_became_peered":"2023-12-13T00:00:29.967916+0000","last_unstale":"2023-12-13T00:27:52.386725+0000","last_undegraded":"2023-12-13T00:27:52.386725+0000","last_fullsized":"2023-12-13T00:27:52.386725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'137","reported_seq":165,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.589474+0000","last_change":"2023-12-13T00:00:35.667745+0000","last_active":"2023-12-13T00:27:29.589474+0000","last_peered":"2023-12-13T00:27:29.589474+0000","last_clean":"2023-12-13T00:27:29.589474+0000","last_became_active":"2023-12-13T00:00:35.666891+0000","last_became_peered":"2023-12-13T00:00:35.666891+0000","last_unstale":"2023-12-13T00:27:29.589474+0000","last_undegraded":"2023-12-13T00:27:29.589474+0000","last_fullsized":"2023-12-13T00:27:29.589474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":9622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'54","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:26.150820+0000","last_change":"2023-12-13T00:28:26.150842+0000","last_active":"2023-12-13T00:28:26.150820+0000","last_peered":"2023-12-13T00:28:26.150820+0000","last_clean":"2023-12-13T00:28:26.150820+0000","last_became_active":"2023-12-13T00:00:31.148016+0000","last_became_peered":"2023-12-13T00:00:31.148016+0000","last_unstale":"2023-12-13T00:28:26.150820+0000","last_undegraded":"2023-12-13T00:28:26.150820+0000","last_fullsized":"2023-12-13T00:28:26.150820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2023-12-13T00:28:26.150748+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2023-12-13T00:28:26.150748+0000","last_clean_scrub_stamp":"2023-12-13T00:28:26.150748+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:33:21.472115+0000","scrub_duration":0.00095305200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'289","reported_seq":320,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.758899+0000","last_change":"2023-12-13T00:00:30.008152+0000","last_active":"2023-12-13T00:27:57.758899+0000","last_peered":"2023-12-13T00:27:57.758899+0000","last_clean":"2023-12-13T00:27:57.758899+0000","last_became_active":"2023-12-13T00:00:30.007907+0000","last_became_peered":"2023-12-13T00:00:30.007907+0000","last_unstale":"2023-12-13T00:27:57.758899+0000","last_undegraded":"2023-12-13T00:27:57.758899+0000","last_fullsized":"2023-12-13T00:27:57.758899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'132","reported_seq":160,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:26.786527+0000","last_change":"2023-12-13T00:00:35.660971+0000","last_active":"2023-12-13T00:27:26.786527+0000","last_peered":"2023-12-13T00:27:26.786527+0000","last_clean":"2023-12-13T00:27:26.786527+0000","last_became_active":"2023-12-13T00:00:35.660627+0000","last_became_peered":"2023-12-13T00:00:35.660627+0000","last_unstale":"2023-12-13T00:27:26.786527+0000","last_undegraded":"2023-12-13T00:27:26.786527+0000","last_fullsized":"2023-12-13T00:27:26.786527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":10143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'55","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:19.224564+0000","last_change":"2023-12-13T00:28:19.224564+0000","last_active":"2023-12-13T00:28:19.224564+0000","last_peered":"2023-12-13T00:28:19.224564+0000","last_clean":"2023-12-13T00:28:19.224564+0000","last_became_active":"2023-12-13T00:00:31.142150+0000","last_became_peered":"2023-12-13T00:00:31.142150+0000","last_unstale":"2023-12-13T00:28:19.224564+0000","last_undegraded":"2023-12-13T00:28:19.224564+0000","last_fullsized":"2023-12-13T00:28:19.224564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2023-12-13T00:28:19.224487+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2023-12-13T00:28:19.224487+0000","last_clean_scrub_stamp":"2023-12-13T00:28:19.224487+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:22:16.290641+0000","scrub_duration":0.00092248000000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'797","reported_seq":828,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.059693+0000","last_change":"2023-12-13T00:00:30.000646+0000","last_active":"2023-12-13T00:28:18.059693+0000","last_peered":"2023-12-13T00:28:18.059693+0000","last_clean":"2023-12-13T00:28:18.059693+0000","last_became_active":"2023-12-13T00:00:30.000388+0000","last_became_peered":"2023-12-13T00:00:30.000388+0000","last_unstale":"2023-12-13T00:28:18.059693+0000","last_undegraded":"2023-12-13T00:28:18.059693+0000","last_fullsized":"2023-12-13T00:28:18.059693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277997,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'170","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.931405+0000","last_change":"2023-12-13T00:00:35.666659+0000","last_active":"2023-12-13T00:27:31.931405+0000","last_peered":"2023-12-13T00:27:31.931405+0000","last_clean":"2023-12-13T00:27:31.931405+0000","last_became_active":"2023-12-13T00:00:35.666304+0000","last_became_peered":"2023-12-13T00:00:35.666304+0000","last_unstale":"2023-12-13T00:27:31.931405+0000","last_undegraded":"2023-12-13T00:27:31.931405+0000","last_fullsized":"2023-12-13T00:27:31.931405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":11255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'48","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:34.826516+0000","last_change":"2023-12-13T00:28:34.826536+0000","last_active":"2023-12-13T00:28:34.826516+0000","last_peered":"2023-12-13T00:28:34.826516+0000","last_clean":"2023-12-13T00:28:34.826516+0000","last_became_active":"2023-12-13T00:00:31.037398+0000","last_became_peered":"2023-12-13T00:00:31.037398+0000","last_unstale":"2023-12-13T00:28:34.826516+0000","last_undegraded":"2023-12-13T00:28:34.826516+0000","last_fullsized":"2023-12-13T00:28:34.826516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2023-12-13T00:28:34.826451+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2023-12-13T00:28:34.826451+0000","last_clean_scrub_stamp":"2023-12-13T00:28:34.826451+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:59:15.682252+0000","scrub_duration":0.001357818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'1355","reported_seq":1386,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:15.033776+0000","last_change":"2023-12-13T00:00:30.006086+0000","last_active":"2023-12-13T00:28:15.033776+0000","last_peered":"2023-12-13T00:28:15.033776+0000","last_clean":"2023-12-13T00:28:15.033776+0000","last_became_active":"2023-12-13T00:00:30.005752+0000","last_became_peered":"2023-12-13T00:00:30.005752+0000","last_unstale":"2023-12-13T00:28:15.033776+0000","last_undegraded":"2023-12-13T00:28:15.033776+0000","last_fullsized":"2023-12-13T00:28:15.033776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1355,"log_dups_size":0,"ondisk_log_size":1355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1349,"num_write_kb":4734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'175","reported_seq":202,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.824402+0000","last_change":"2023-12-13T00:00:35.666467+0000","last_active":"2023-12-13T00:27:29.824402+0000","last_peered":"2023-12-13T00:27:29.824402+0000","last_clean":"2023-12-13T00:27:29.824402+0000","last_became_active":"2023-12-13T00:00:35.666061+0000","last_became_peered":"2023-12-13T00:00:35.666061+0000","last_unstale":"2023-12-13T00:27:29.824402+0000","last_undegraded":"2023-12-13T00:27:29.824402+0000","last_fullsized":"2023-12-13T00:27:29.824402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":9890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'68","reported_seq":113,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:38.158958+0000","last_change":"2023-12-13T00:28:38.158977+0000","last_active":"2023-12-13T00:28:38.158958+0000","last_peered":"2023-12-13T00:28:38.158958+0000","last_clean":"2023-12-13T00:28:38.158958+0000","last_became_active":"2023-12-13T00:01:00.702089+0000","last_became_peered":"2023-12-13T00:01:00.702089+0000","last_unstale":"2023-12-13T00:28:38.158958+0000","last_undegraded":"2023-12-13T00:28:38.158958+0000","last_fullsized":"2023-12-13T00:28:38.158958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'68","last_scrub_stamp":"2023-12-13T00:28:38.158895+0000","last_deep_scrub":"27'68","last_deep_scrub_stamp":"2023-12-13T00:28:38.158895+0000","last_clean_scrub_stamp":"2023-12-13T00:28:38.158895+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:39:59.902571+0000","scrub_duration":0.001233034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'393","reported_seq":424,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:17.322998+0000","last_change":"2023-12-13T00:00:30.001171+0000","last_active":"2023-12-13T00:28:17.322998+0000","last_peered":"2023-12-13T00:28:17.322998+0000","last_clean":"2023-12-13T00:28:17.322998+0000","last_became_active":"2023-12-13T00:00:30.000803+0000","last_became_peered":"2023-12-13T00:00:30.000803+0000","last_unstale":"2023-12-13T00:28:17.322998+0000","last_undegraded":"2023-12-13T00:28:17.322998+0000","last_fullsized":"2023-12-13T00:28:17.322998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2931508,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":386,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'176","reported_seq":203,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.826019+0000","last_change":"2023-12-13T00:00:35.649561+0000","last_active":"2023-12-13T00:27:29.826019+0000","last_peered":"2023-12-13T00:27:29.826019+0000","last_clean":"2023-12-13T00:27:29.826019+0000","last_became_active":"2023-12-13T00:00:35.649151+0000","last_became_peered":"2023-12-13T00:00:35.649151+0000","last_unstale":"2023-12-13T00:27:29.826019+0000","last_undegraded":"2023-12-13T00:27:29.826019+0000","last_fullsized":"2023-12-13T00:27:29.826019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'60","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:36.237979+0000","last_change":"2023-12-13T00:28:36.238000+0000","last_active":"2023-12-13T00:28:36.237979+0000","last_peered":"2023-12-13T00:28:36.237979+0000","last_clean":"2023-12-13T00:28:36.237979+0000","last_became_active":"2023-12-13T00:00:31.115678+0000","last_became_peered":"2023-12-13T00:00:31.115678+0000","last_unstale":"2023-12-13T00:28:36.237979+0000","last_undegraded":"2023-12-13T00:28:36.237979+0000","last_fullsized":"2023-12-13T00:28:36.237979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'60","last_scrub_stamp":"2023-12-13T00:28:36.237907+0000","last_deep_scrub":"27'60","last_deep_scrub_stamp":"2023-12-13T00:28:36.237907+0000","last_clean_scrub_stamp":"2023-12-13T00:28:36.237907+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:50:24.671743+0000","scrub_duration":0.001189753,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'15","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:32.043769+0000","last_change":"2023-12-13T00:28:32.043793+0000","last_active":"2023-12-13T00:28:32.043769+0000","last_peered":"2023-12-13T00:28:32.043769+0000","last_clean":"2023-12-13T00:28:32.043769+0000","last_became_active":"2023-12-13T00:00:30.004089+0000","last_became_peered":"2023-12-13T00:00:30.004089+0000","last_unstale":"2023-12-13T00:28:32.043769+0000","last_undegraded":"2023-12-13T00:28:32.043769+0000","last_fullsized":"2023-12-13T00:28:32.043769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2023-12-13T00:28:32.043698+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2023-12-13T00:28:32.043698+0000","last_clean_scrub_stamp":"2023-12-13T00:28:32.043698+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:59:12.899499+0000","scrub_duration":0.0033306949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'148","reported_seq":175,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.559260+0000","last_change":"2023-12-13T00:00:35.652272+0000","last_active":"2023-12-13T00:27:29.559260+0000","last_peered":"2023-12-13T00:27:29.559260+0000","last_clean":"2023-12-13T00:27:29.559260+0000","last_became_active":"2023-12-13T00:00:35.651907+0000","last_became_peered":"2023-12-13T00:00:35.651907+0000","last_unstale":"2023-12-13T00:27:29.559260+0000","last_undegraded":"2023-12-13T00:27:29.559260+0000","last_fullsized":"2023-12-13T00:27:29.559260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":7909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'46","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.865955+0000","last_change":"2023-12-13T00:00:31.148754+0000","last_active":"2023-12-13T00:28:04.865955+0000","last_peered":"2023-12-13T00:28:04.865955+0000","last_clean":"2023-12-13T00:28:04.865955+0000","last_became_active":"2023-12-13T00:00:31.147846+0000","last_became_peered":"2023-12-13T00:00:31.147846+0000","last_unstale":"2023-12-13T00:28:04.865955+0000","last_undegraded":"2023-12-13T00:28:04.865955+0000","last_fullsized":"2023-12-13T00:28:04.865955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'1477","reported_seq":1516,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:19.181691+0000","last_change":"2023-12-13T00:28:19.181691+0000","last_active":"2023-12-13T00:28:19.181691+0000","last_peered":"2023-12-13T00:28:19.181691+0000","last_clean":"2023-12-13T00:28:19.181691+0000","last_became_active":"2023-12-13T00:00:30.001420+0000","last_became_peered":"2023-12-13T00:00:30.001420+0000","last_unstale":"2023-12-13T00:28:19.181691+0000","last_undegraded":"2023-12-13T00:28:19.181691+0000","last_fullsized":"2023-12-13T00:28:19.181691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1477","last_scrub_stamp":"2023-12-13T00:28:19.181611+0000","last_deep_scrub":"27'1477","last_deep_scrub_stamp":"2023-12-13T00:28:19.181611+0000","last_clean_scrub_stamp":"2023-12-13T00:28:19.181611+0000","objects_scrubbed":5,"log_size":1477,"log_dups_size":0,"ondisk_log_size":1477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:50:30.914232+0000","scrub_duration":0.013805400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1472,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'148","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.059832+0000","last_change":"2023-12-13T00:01:00.546607+0000","last_active":"2023-12-13T00:28:18.059832+0000","last_peered":"2023-12-13T00:28:18.059832+0000","last_clean":"2023-12-13T00:28:18.059832+0000","last_became_active":"2023-12-13T00:01:00.546264+0000","last_became_peered":"2023-12-13T00:01:00.546264+0000","last_unstale":"2023-12-13T00:28:18.059832+0000","last_undegraded":"2023-12-13T00:28:18.059832+0000","last_fullsized":"2023-12-13T00:28:18.059832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'60","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:27.237666+0000","last_change":"2023-12-13T00:28:27.237666+0000","last_active":"2023-12-13T00:28:27.237666+0000","last_peered":"2023-12-13T00:28:27.237666+0000","last_clean":"2023-12-13T00:28:27.237666+0000","last_became_active":"2023-12-13T00:00:31.138723+0000","last_became_peered":"2023-12-13T00:00:31.138723+0000","last_unstale":"2023-12-13T00:28:27.237666+0000","last_undegraded":"2023-12-13T00:28:27.237666+0000","last_fullsized":"2023-12-13T00:28:27.237666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'60","last_scrub_stamp":"2023-12-13T00:28:27.237585+0000","last_deep_scrub":"27'60","last_deep_scrub_stamp":"2023-12-13T00:28:27.237585+0000","last_clean_scrub_stamp":"2023-12-13T00:28:27.237585+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:53:27.429911+0000","scrub_duration":0.000960584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'220","reported_seq":258,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:30.078636+0000","last_change":"2023-12-13T00:28:30.078699+0000","last_active":"2023-12-13T00:28:30.078636+0000","last_peered":"2023-12-13T00:28:30.078636+0000","last_clean":"2023-12-13T00:28:30.078636+0000","last_became_active":"2023-12-13T00:00:30.002823+0000","last_became_peered":"2023-12-13T00:00:30.002823+0000","last_unstale":"2023-12-13T00:28:30.078636+0000","last_undegraded":"2023-12-13T00:28:30.078636+0000","last_fullsized":"2023-12-13T00:28:30.078636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'220","last_scrub_stamp":"2023-12-13T00:28:30.078552+0000","last_deep_scrub":"27'220","last_deep_scrub_stamp":"2023-12-13T00:28:30.078552+0000","last_clean_scrub_stamp":"2023-12-13T00:28:30.078552+0000","objects_scrubbed":3,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:40:48.187335+0000","scrub_duration":0.0037294989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'219","reported_seq":256,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:16.561224+0000","last_change":"2023-12-13T00:01:00.697705+0000","last_active":"2023-12-13T00:28:16.561224+0000","last_peered":"2023-12-13T00:28:16.561224+0000","last_clean":"2023-12-13T00:28:16.561224+0000","last_became_active":"2023-12-13T00:01:00.697231+0000","last_became_peered":"2023-12-13T00:01:00.697231+0000","last_unstale":"2023-12-13T00:28:16.561224+0000","last_undegraded":"2023-12-13T00:28:16.561224+0000","last_fullsized":"2023-12-13T00:28:16.561224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":195,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'66","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:33.389091+0000","last_change":"2023-12-13T00:28:33.389111+0000","last_active":"2023-12-13T00:28:33.389091+0000","last_peered":"2023-12-13T00:28:33.389091+0000","last_clean":"2023-12-13T00:28:33.389091+0000","last_became_active":"2023-12-13T00:00:31.027239+0000","last_became_peered":"2023-12-13T00:00:31.027239+0000","last_unstale":"2023-12-13T00:28:33.389091+0000","last_undegraded":"2023-12-13T00:28:33.389091+0000","last_fullsized":"2023-12-13T00:28:33.389091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2023-12-13T00:28:33.389025+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2023-12-13T00:28:33.389025+0000","last_clean_scrub_stamp":"2023-12-13T00:28:33.389025+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:09:03.094471+0000","scrub_duration":0.001342815,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'5","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:53.927459+0000","last_change":"2023-12-13T00:00:30.009592+0000","last_active":"2023-12-13T00:27:53.927459+0000","last_peered":"2023-12-13T00:27:53.927459+0000","last_clean":"2023-12-13T00:27:53.927459+0000","last_became_active":"2023-12-13T00:00:30.009351+0000","last_became_peered":"2023-12-13T00:00:30.009351+0000","last_unstale":"2023-12-13T00:27:53.927459+0000","last_undegraded":"2023-12-13T00:27:53.927459+0000","last_fullsized":"2023-12-13T00:27:53.927459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'190","reported_seq":214,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:30.828933+0000","last_change":"2023-12-13T00:01:00.717446+0000","last_active":"2023-12-13T00:27:30.828933+0000","last_peered":"2023-12-13T00:27:30.828933+0000","last_clean":"2023-12-13T00:27:30.828933+0000","last_became_active":"2023-12-13T00:01:00.717019+0000","last_became_peered":"2023-12-13T00:01:00.717019+0000","last_unstale":"2023-12-13T00:27:30.828933+0000","last_undegraded":"2023-12-13T00:27:30.828933+0000","last_fullsized":"2023-12-13T00:27:30.828933+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":9378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"27'64","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:30.200435+0000","last_change":"2023-12-13T00:28:30.200455+0000","last_active":"2023-12-13T00:28:30.200435+0000","last_peered":"2023-12-13T00:28:30.200435+0000","last_clean":"2023-12-13T00:28:30.200435+0000","last_became_active":"2023-12-13T00:00:31.139656+0000","last_became_peered":"2023-12-13T00:00:31.139656+0000","last_unstale":"2023-12-13T00:28:30.200435+0000","last_undegraded":"2023-12-13T00:28:30.200435+0000","last_fullsized":"2023-12-13T00:28:30.200435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2023-12-13T00:28:30.200368+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2023-12-13T00:28:30.200368+0000","last_clean_scrub_stamp":"2023-12-13T00:28:30.200368+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:05:42.786288+0000","scrub_duration":0.0010289330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'84","reported_seq":122,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:21.916919+0000","last_change":"2023-12-13T00:28:21.916941+0000","last_active":"2023-12-13T00:28:21.916919+0000","last_peered":"2023-12-13T00:28:21.916919+0000","last_clean":"2023-12-13T00:28:21.916919+0000","last_became_active":"2023-12-13T00:00:30.002630+0000","last_became_peered":"2023-12-13T00:00:30.002630+0000","last_unstale":"2023-12-13T00:28:21.916919+0000","last_undegraded":"2023-12-13T00:28:21.916919+0000","last_fullsized":"2023-12-13T00:28:21.916919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'84","last_scrub_stamp":"2023-12-13T00:28:21.916861+0000","last_deep_scrub":"27'84","last_deep_scrub_stamp":"2023-12-13T00:28:21.916861+0000","last_clean_scrub_stamp":"2023-12-13T00:28:21.916861+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:34:21.020077+0000","scrub_duration":0.002537564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'123","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.059882+0000","last_change":"2023-12-13T00:00:35.649725+0000","last_active":"2023-12-13T00:28:18.059882+0000","last_peered":"2023-12-13T00:28:18.059882+0000","last_clean":"2023-12-13T00:28:18.059882+0000","last_became_active":"2023-12-13T00:00:35.649401+0000","last_became_peered":"2023-12-13T00:00:35.649401+0000","last_unstale":"2023-12-13T00:28:18.059882+0000","last_undegraded":"2023-12-13T00:28:18.059882+0000","last_fullsized":"2023-12-13T00:28:18.059882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":7272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'122","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.600657+0000","last_change":"2023-12-13T00:00:35.662790+0000","last_active":"2023-12-13T00:27:29.600657+0000","last_peered":"2023-12-13T00:27:29.600657+0000","last_clean":"2023-12-13T00:27:29.600657+0000","last_became_active":"2023-12-13T00:00:35.662406+0000","last_became_peered":"2023-12-13T00:00:35.662406+0000","last_unstale":"2023-12-13T00:27:29.600657+0000","last_undegraded":"2023-12-13T00:27:29.600657+0000","last_fullsized":"2023-12-13T00:27:29.600657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":7728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'66","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.834125+0000","last_change":"2023-12-13T00:00:31.143141+0000","last_active":"2023-12-13T00:28:04.834125+0000","last_peered":"2023-12-13T00:28:04.834125+0000","last_clean":"2023-12-13T00:28:04.834125+0000","last_became_active":"2023-12-13T00:00:31.142823+0000","last_became_peered":"2023-12-13T00:00:31.142823+0000","last_unstale":"2023-12-13T00:28:04.834125+0000","last_undegraded":"2023-12-13T00:28:04.834125+0000","last_fullsized":"2023-12-13T00:28:04.834125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'7","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:57.169007+0000","last_change":"2023-12-13T00:00:30.004773+0000","last_active":"2023-12-13T00:27:57.169007+0000","last_peered":"2023-12-13T00:27:57.169007+0000","last_clean":"2023-12-13T00:27:57.169007+0000","last_became_active":"2023-12-13T00:00:30.004496+0000","last_became_peered":"2023-12-13T00:00:30.004496+0000","last_unstale":"2023-12-13T00:27:57.169007+0000","last_undegraded":"2023-12-13T00:27:57.169007+0000","last_fullsized":"2023-12-13T00:27:57.169007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'188","reported_seq":217,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:43.961956+0000","last_change":"2023-12-13T00:00:35.666457+0000","last_active":"2023-12-13T00:27:43.961956+0000","last_peered":"2023-12-13T00:27:43.961956+0000","last_clean":"2023-12-13T00:27:43.961956+0000","last_became_active":"2023-12-13T00:00:35.666075+0000","last_became_peered":"2023-12-13T00:00:35.666075+0000","last_unstale":"2023-12-13T00:27:43.961956+0000","last_undegraded":"2023-12-13T00:27:43.961956+0000","last_fullsized":"2023-12-13T00:27:43.961956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":17531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'63","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:26.387168+0000","last_change":"2023-12-13T00:28:26.387186+0000","last_active":"2023-12-13T00:28:26.387168+0000","last_peered":"2023-12-13T00:28:26.387168+0000","last_clean":"2023-12-13T00:28:26.387168+0000","last_became_active":"2023-12-13T00:00:31.116209+0000","last_became_peered":"2023-12-13T00:00:31.116209+0000","last_unstale":"2023-12-13T00:28:26.387168+0000","last_undegraded":"2023-12-13T00:28:26.387168+0000","last_fullsized":"2023-12-13T00:28:26.387168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'63","last_scrub_stamp":"2023-12-13T00:28:26.387107+0000","last_deep_scrub":"27'63","last_deep_scrub_stamp":"2023-12-13T00:28:26.387107+0000","last_clean_scrub_stamp":"2023-12-13T00:28:26.387107+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:20:18.635398+0000","scrub_duration":0.00089511699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'486","reported_seq":1002,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:27.221032+0000","last_change":"2023-12-13T00:28:27.221072+0000","last_active":"2023-12-13T00:28:27.221032+0000","last_peered":"2023-12-13T00:28:27.221032+0000","last_clean":"2023-12-13T00:28:27.221032+0000","last_became_active":"2023-12-13T00:00:30.006026+0000","last_became_peered":"2023-12-13T00:00:30.006026+0000","last_unstale":"2023-12-13T00:28:27.221032+0000","last_undegraded":"2023-12-13T00:28:27.221032+0000","last_fullsized":"2023-12-13T00:28:27.221032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'486","last_scrub_stamp":"2023-12-13T00:28:27.220940+0000","last_deep_scrub":"27'486","last_deep_scrub_stamp":"2023-12-13T00:28:27.220940+0000","last_clean_scrub_stamp":"2023-12-13T00:28:27.220940+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:02:36.774137+0000","scrub_duration":0.003497904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92099,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":501,"num_write":481,"num_write_kb":501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'1030","reported_seq":1753,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.994118+0000","last_change":"2023-12-13T00:00:30.004483+0000","last_active":"2023-12-13T00:28:04.994118+0000","last_peered":"2023-12-13T00:28:04.994118+0000","last_clean":"2023-12-13T00:28:04.994118+0000","last_became_active":"2023-12-13T00:00:30.004214+0000","last_became_peered":"2023-12-13T00:00:30.004214+0000","last_unstale":"2023-12-13T00:28:04.994118+0000","last_undegraded":"2023-12-13T00:28:04.994118+0000","last_fullsized":"2023-12-13T00:28:04.994118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:28.640579+0000","last_clean_scrub_stamp":"2023-12-13T00:00:28.640579+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1792997,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":693,"num_read_kb":705,"num_write":1026,"num_write_kb":2509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'68","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.837271+0000","last_change":"2023-12-13T00:00:31.147121+0000","last_active":"2023-12-13T00:28:04.837271+0000","last_peered":"2023-12-13T00:28:04.837271+0000","last_clean":"2023-12-13T00:28:04.837271+0000","last_became_active":"2023-12-13T00:00:31.146818+0000","last_became_peered":"2023-12-13T00:00:31.146818+0000","last_unstale":"2023-12-13T00:28:04.837271+0000","last_undegraded":"2023-12-13T00:28:04.837271+0000","last_fullsized":"2023-12-13T00:28:04.837271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'150","reported_seq":177,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:08.952320+0000","last_change":"2023-12-13T00:00:35.642485+0000","last_active":"2023-12-13T00:28:08.952320+0000","last_peered":"2023-12-13T00:28:08.952320+0000","last_clean":"2023-12-13T00:28:08.952320+0000","last_became_active":"2023-12-13T00:00:35.642114+0000","last_became_peered":"2023-12-13T00:00:35.642114+0000","last_unstale":"2023-12-13T00:28:08.952320+0000","last_undegraded":"2023-12-13T00:28:08.952320+0000","last_fullsized":"2023-12-13T00:28:08.952320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":10646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'2841","reported_seq":2879,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:37.492377+0000","last_change":"2023-12-13T00:28:37.492403+0000","last_active":"2023-12-13T00:28:37.492377+0000","last_peered":"2023-12-13T00:28:37.492377+0000","last_clean":"2023-12-13T00:28:37.492377+0000","last_became_active":"2023-12-13T00:00:29.972018+0000","last_became_peered":"2023-12-13T00:00:29.972018+0000","last_unstale":"2023-12-13T00:28:37.492377+0000","last_undegraded":"2023-12-13T00:28:37.492377+0000","last_fullsized":"2023-12-13T00:28:37.492377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2841","last_scrub_stamp":"2023-12-13T00:28:37.492311+0000","last_deep_scrub":"27'2841","last_deep_scrub_stamp":"2023-12-13T00:28:37.492311+0000","last_clean_scrub_stamp":"2023-12-13T00:28:37.492311+0000","objects_scrubbed":4,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:48:54.932186+0000","scrub_duration":0.032490435999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2827,"num_write_kb":13646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'70","reported_seq":107,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:36.841889+0000","last_change":"2023-12-13T00:28:36.841907+0000","last_active":"2023-12-13T00:28:36.841889+0000","last_peered":"2023-12-13T00:28:36.841889+0000","last_clean":"2023-12-13T00:28:36.841889+0000","last_became_active":"2023-12-13T00:00:31.037445+0000","last_became_peered":"2023-12-13T00:00:31.037445+0000","last_unstale":"2023-12-13T00:28:36.841889+0000","last_undegraded":"2023-12-13T00:28:36.841889+0000","last_fullsized":"2023-12-13T00:28:36.841889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'70","last_scrub_stamp":"2023-12-13T00:28:36.841827+0000","last_deep_scrub":"27'70","last_deep_scrub_stamp":"2023-12-13T00:28:36.841827+0000","last_clean_scrub_stamp":"2023-12-13T00:28:36.841827+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:32:13.405381+0000","scrub_duration":0.001030577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'116","reported_seq":143,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:08.950739+0000","last_change":"2023-12-13T00:00:35.661405+0000","last_active":"2023-12-13T00:28:08.950739+0000","last_peered":"2023-12-13T00:28:08.950739+0000","last_clean":"2023-12-13T00:28:08.950739+0000","last_became_active":"2023-12-13T00:00:35.660984+0000","last_became_peered":"2023-12-13T00:00:35.660984+0000","last_unstale":"2023-12-13T00:28:08.950739+0000","last_undegraded":"2023-12-13T00:28:08.950739+0000","last_fullsized":"2023-12-13T00:28:08.950739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":9076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:29.162461+0000","last_change":"2023-12-13T00:28:29.162479+0000","last_active":"2023-12-13T00:28:29.162461+0000","last_peered":"2023-12-13T00:28:29.162461+0000","last_clean":"2023-12-13T00:28:29.162461+0000","last_became_active":"2023-12-13T00:00:31.145225+0000","last_became_peered":"2023-12-13T00:00:31.145225+0000","last_unstale":"2023-12-13T00:28:29.162461+0000","last_undegraded":"2023-12-13T00:28:29.162461+0000","last_fullsized":"2023-12-13T00:28:29.162461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:29.162405+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:29.162405+0000","last_clean_scrub_stamp":"2023-12-13T00:28:29.162405+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:04:14.041159+0000","scrub_duration":0.001250794,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'66","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.758765+0000","last_change":"2023-12-13T00:00:31.119735+0000","last_active":"2023-12-13T00:28:04.758765+0000","last_peered":"2023-12-13T00:28:04.758765+0000","last_clean":"2023-12-13T00:28:04.758765+0000","last_became_active":"2023-12-13T00:00:31.119474+0000","last_became_peered":"2023-12-13T00:00:31.119474+0000","last_unstale":"2023-12-13T00:28:04.758765+0000","last_undegraded":"2023-12-13T00:28:04.758765+0000","last_fullsized":"2023-12-13T00:28:04.758765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'62","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:22.188610+0000","last_change":"2023-12-13T00:28:22.188630+0000","last_active":"2023-12-13T00:28:22.188610+0000","last_peered":"2023-12-13T00:28:22.188610+0000","last_clean":"2023-12-13T00:28:22.188610+0000","last_became_active":"2023-12-13T00:00:31.026922+0000","last_became_peered":"2023-12-13T00:00:31.026922+0000","last_unstale":"2023-12-13T00:28:22.188610+0000","last_undegraded":"2023-12-13T00:28:22.188610+0000","last_fullsized":"2023-12-13T00:28:22.188610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'62","last_scrub_stamp":"2023-12-13T00:28:22.188548+0000","last_deep_scrub":"27'62","last_deep_scrub_stamp":"2023-12-13T00:28:22.188548+0000","last_clean_scrub_stamp":"2023-12-13T00:28:22.188548+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:49:45.817340+0000","scrub_duration":0.00098737400000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'58","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.859258+0000","last_change":"2023-12-13T00:00:31.119937+0000","last_active":"2023-12-13T00:28:04.859258+0000","last_peered":"2023-12-13T00:28:04.859258+0000","last_clean":"2023-12-13T00:28:04.859258+0000","last_became_active":"2023-12-13T00:00:31.119685+0000","last_became_peered":"2023-12-13T00:00:31.119685+0000","last_unstale":"2023-12-13T00:28:04.859258+0000","last_undegraded":"2023-12-13T00:28:04.859258+0000","last_fullsized":"2023-12-13T00:28:04.859258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'45","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.818381+0000","last_change":"2023-12-13T00:00:31.150597+0000","last_active":"2023-12-13T00:28:04.818381+0000","last_peered":"2023-12-13T00:28:04.818381+0000","last_clean":"2023-12-13T00:28:04.818381+0000","last_became_active":"2023-12-13T00:00:31.150275+0000","last_became_peered":"2023-12-13T00:00:31.150275+0000","last_unstale":"2023-12-13T00:28:04.818381+0000","last_undegraded":"2023-12-13T00:28:04.818381+0000","last_fullsized":"2023-12-13T00:28:04.818381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'47","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:37.199192+0000","last_change":"2023-12-13T00:28:37.199211+0000","last_active":"2023-12-13T00:28:37.199192+0000","last_peered":"2023-12-13T00:28:37.199192+0000","last_clean":"2023-12-13T00:28:37.199192+0000","last_became_active":"2023-12-13T00:00:31.117409+0000","last_became_peered":"2023-12-13T00:00:31.117409+0000","last_unstale":"2023-12-13T00:28:37.199192+0000","last_undegraded":"2023-12-13T00:28:37.199192+0000","last_fullsized":"2023-12-13T00:28:37.199192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2023-12-13T00:28:37.199129+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2023-12-13T00:28:37.199129+0000","last_clean_scrub_stamp":"2023-12-13T00:28:37.199129+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:01:50.944562+0000","scrub_duration":0.0012582509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'59","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:36.226157+0000","last_change":"2023-12-13T00:28:36.226175+0000","last_active":"2023-12-13T00:28:36.226157+0000","last_peered":"2023-12-13T00:28:36.226157+0000","last_clean":"2023-12-13T00:28:36.226157+0000","last_became_active":"2023-12-13T00:00:31.141656+0000","last_became_peered":"2023-12-13T00:00:31.141656+0000","last_unstale":"2023-12-13T00:28:36.226157+0000","last_undegraded":"2023-12-13T00:28:36.226157+0000","last_fullsized":"2023-12-13T00:28:36.226157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'59","last_scrub_stamp":"2023-12-13T00:28:36.226090+0000","last_deep_scrub":"27'59","last_deep_scrub_stamp":"2023-12-13T00:28:36.226090+0000","last_clean_scrub_stamp":"2023-12-13T00:28:36.226090+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:49:10.922803+0000","scrub_duration":0.00088218499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'47","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.804196+0000","last_change":"2023-12-13T00:00:31.036263+0000","last_active":"2023-12-13T00:28:18.804196+0000","last_peered":"2023-12-13T00:28:18.804196+0000","last_clean":"2023-12-13T00:28:18.804196+0000","last_became_active":"2023-12-13T00:00:31.036113+0000","last_became_peered":"2023-12-13T00:00:31.036113+0000","last_unstale":"2023-12-13T00:28:18.804196+0000","last_undegraded":"2023-12-13T00:28:18.804196+0000","last_fullsized":"2023-12-13T00:28:18.804196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'57","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:29.241402+0000","last_change":"2023-12-13T00:28:29.241422+0000","last_active":"2023-12-13T00:28:29.241402+0000","last_peered":"2023-12-13T00:28:29.241402+0000","last_clean":"2023-12-13T00:28:29.241402+0000","last_became_active":"2023-12-13T00:00:31.026968+0000","last_became_peered":"2023-12-13T00:00:31.026968+0000","last_unstale":"2023-12-13T00:28:29.241402+0000","last_undegraded":"2023-12-13T00:28:29.241402+0000","last_fullsized":"2023-12-13T00:28:29.241402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:29.241340+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:29.241340+0000","last_clean_scrub_stamp":"2023-12-13T00:28:29.241340+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:15:31.650259+0000","scrub_duration":0.001146413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'71","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.862876+0000","last_change":"2023-12-13T00:00:31.139140+0000","last_active":"2023-12-13T00:28:04.862876+0000","last_peered":"2023-12-13T00:28:04.862876+0000","last_clean":"2023-12-13T00:28:04.862876+0000","last_became_active":"2023-12-13T00:00:31.138869+0000","last_became_peered":"2023-12-13T00:00:31.138869+0000","last_unstale":"2023-12-13T00:28:04.862876+0000","last_undegraded":"2023-12-13T00:28:04.862876+0000","last_fullsized":"2023-12-13T00:28:04.862876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'64","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:23.891788+0000","last_change":"2023-12-13T00:28:23.891810+0000","last_active":"2023-12-13T00:28:23.891788+0000","last_peered":"2023-12-13T00:28:23.891788+0000","last_clean":"2023-12-13T00:28:23.891788+0000","last_became_active":"2023-12-13T00:00:31.146264+0000","last_became_peered":"2023-12-13T00:00:31.146264+0000","last_unstale":"2023-12-13T00:28:23.891788+0000","last_undegraded":"2023-12-13T00:28:23.891788+0000","last_fullsized":"2023-12-13T00:28:23.891788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2023-12-13T00:28:23.891712+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2023-12-13T00:28:23.891712+0000","last_clean_scrub_stamp":"2023-12-13T00:28:23.891712+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:51:29.227897+0000","scrub_duration":0.001254544,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'68","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:21.053596+0000","last_change":"2023-12-13T00:28:21.053631+0000","last_active":"2023-12-13T00:28:21.053596+0000","last_peered":"2023-12-13T00:28:21.053596+0000","last_clean":"2023-12-13T00:28:21.053596+0000","last_became_active":"2023-12-13T00:00:31.143472+0000","last_became_peered":"2023-12-13T00:00:31.143472+0000","last_unstale":"2023-12-13T00:28:21.053596+0000","last_undegraded":"2023-12-13T00:28:21.053596+0000","last_fullsized":"2023-12-13T00:28:21.053596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'68","last_scrub_stamp":"2023-12-13T00:28:21.053523+0000","last_deep_scrub":"27'68","last_deep_scrub_stamp":"2023-12-13T00:28:21.053523+0000","last_clean_scrub_stamp":"2023-12-13T00:28:21.053523+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:02:30.606720+0000","scrub_duration":0.0014989020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'52","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:27.382187+0000","last_change":"2023-12-13T00:28:27.382226+0000","last_active":"2023-12-13T00:28:27.382187+0000","last_peered":"2023-12-13T00:28:27.382187+0000","last_clean":"2023-12-13T00:28:27.382187+0000","last_became_active":"2023-12-13T00:00:31.146159+0000","last_became_peered":"2023-12-13T00:00:31.146159+0000","last_unstale":"2023-12-13T00:28:27.382187+0000","last_undegraded":"2023-12-13T00:28:27.382187+0000","last_fullsized":"2023-12-13T00:28:27.382187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2023-12-13T00:28:27.382098+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2023-12-13T00:28:27.382098+0000","last_clean_scrub_stamp":"2023-12-13T00:28:27.382098+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:04:12.260853+0000","scrub_duration":0.001152623,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'67","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.876452+0000","last_change":"2023-12-13T00:00:31.143946+0000","last_active":"2023-12-13T00:28:04.876452+0000","last_peered":"2023-12-13T00:28:04.876452+0000","last_clean":"2023-12-13T00:28:04.876452+0000","last_became_active":"2023-12-13T00:00:31.143663+0000","last_became_peered":"2023-12-13T00:00:31.143663+0000","last_unstale":"2023-12-13T00:28:04.876452+0000","last_undegraded":"2023-12-13T00:28:04.876452+0000","last_fullsized":"2023-12-13T00:28:04.876452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'69","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:20.344968+0000","last_change":"2023-12-13T00:00:31.142314+0000","last_active":"2023-12-13T00:28:20.344968+0000","last_peered":"2023-12-13T00:28:20.344968+0000","last_clean":"2023-12-13T00:28:20.344968+0000","last_became_active":"2023-12-13T00:00:31.142067+0000","last_became_peered":"2023-12-13T00:00:31.142067+0000","last_unstale":"2023-12-13T00:28:20.344968+0000","last_undegraded":"2023-12-13T00:28:20.344968+0000","last_fullsized":"2023-12-13T00:28:20.344968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'51","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:17.322901+0000","last_change":"2023-12-13T00:00:31.146764+0000","last_active":"2023-12-13T00:28:17.322901+0000","last_peered":"2023-12-13T00:28:17.322901+0000","last_clean":"2023-12-13T00:28:17.322901+0000","last_became_active":"2023-12-13T00:00:31.146501+0000","last_became_peered":"2023-12-13T00:00:31.146501+0000","last_unstale":"2023-12-13T00:28:17.322901+0000","last_undegraded":"2023-12-13T00:28:17.322901+0000","last_fullsized":"2023-12-13T00:28:17.322901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'67","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:17.322937+0000","last_change":"2023-12-13T00:00:31.138982+0000","last_active":"2023-12-13T00:28:17.322937+0000","last_peered":"2023-12-13T00:28:17.322937+0000","last_clean":"2023-12-13T00:28:17.322937+0000","last_became_active":"2023-12-13T00:00:31.138738+0000","last_became_peered":"2023-12-13T00:00:31.138738+0000","last_unstale":"2023-12-13T00:28:17.322937+0000","last_undegraded":"2023-12-13T00:28:17.322937+0000","last_fullsized":"2023-12-13T00:28:17.322937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'52","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.804187+0000","last_change":"2023-12-13T00:00:31.148499+0000","last_active":"2023-12-13T00:28:18.804187+0000","last_peered":"2023-12-13T00:28:18.804187+0000","last_clean":"2023-12-13T00:28:18.804187+0000","last_became_active":"2023-12-13T00:00:31.148251+0000","last_became_peered":"2023-12-13T00:00:31.148251+0000","last_unstale":"2023-12-13T00:28:18.804187+0000","last_undegraded":"2023-12-13T00:28:18.804187+0000","last_fullsized":"2023-12-13T00:28:18.804187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'58","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:38.176733+0000","last_change":"2023-12-13T00:28:38.176733+0000","last_active":"2023-12-13T00:28:38.176733+0000","last_peered":"2023-12-13T00:28:38.176733+0000","last_clean":"2023-12-13T00:28:38.176733+0000","last_became_active":"2023-12-13T00:00:31.117423+0000","last_became_peered":"2023-12-13T00:00:31.117423+0000","last_unstale":"2023-12-13T00:28:38.176733+0000","last_undegraded":"2023-12-13T00:28:38.176733+0000","last_fullsized":"2023-12-13T00:28:38.176733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-12-13T00:28:38.176651+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-12-13T00:28:38.176651+0000","last_clean_scrub_stamp":"2023-12-13T00:28:38.176651+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:31:57.197976+0000","scrub_duration":0.00092640599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'67","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:33.115979+0000","last_change":"2023-12-13T00:28:33.116013+0000","last_active":"2023-12-13T00:28:33.115979+0000","last_peered":"2023-12-13T00:28:33.115979+0000","last_clean":"2023-12-13T00:28:33.115979+0000","last_became_active":"2023-12-13T00:00:31.150324+0000","last_became_peered":"2023-12-13T00:00:31.150324+0000","last_unstale":"2023-12-13T00:28:33.115979+0000","last_undegraded":"2023-12-13T00:28:33.115979+0000","last_fullsized":"2023-12-13T00:28:33.115979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'67","last_scrub_stamp":"2023-12-13T00:28:33.115863+0000","last_deep_scrub":"27'67","last_deep_scrub_stamp":"2023-12-13T00:28:33.115863+0000","last_clean_scrub_stamp":"2023-12-13T00:28:33.115863+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:07:24.061579+0000","scrub_duration":0.001322997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'63","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.877997+0000","last_change":"2023-12-13T00:00:31.147145+0000","last_active":"2023-12-13T00:28:04.877997+0000","last_peered":"2023-12-13T00:28:04.877997+0000","last_clean":"2023-12-13T00:28:04.877997+0000","last_became_active":"2023-12-13T00:00:31.146444+0000","last_became_peered":"2023-12-13T00:00:31.146444+0000","last_unstale":"2023-12-13T00:28:04.877997+0000","last_undegraded":"2023-12-13T00:28:04.877997+0000","last_fullsized":"2023-12-13T00:28:04.877997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'67","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:25.363437+0000","last_change":"2023-12-13T00:28:25.363455+0000","last_active":"2023-12-13T00:28:25.363437+0000","last_peered":"2023-12-13T00:28:25.363437+0000","last_clean":"2023-12-13T00:28:25.363437+0000","last_became_active":"2023-12-13T00:00:31.148529+0000","last_became_peered":"2023-12-13T00:00:31.148529+0000","last_unstale":"2023-12-13T00:28:25.363437+0000","last_undegraded":"2023-12-13T00:28:25.363437+0000","last_fullsized":"2023-12-13T00:28:25.363437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'67","last_scrub_stamp":"2023-12-13T00:28:25.363359+0000","last_deep_scrub":"27'67","last_deep_scrub_stamp":"2023-12-13T00:28:25.363359+0000","last_clean_scrub_stamp":"2023-12-13T00:28:25.363359+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:30:26.094520+0000","scrub_duration":0.0010738740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'59","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.866890+0000","last_change":"2023-12-13T00:00:31.149934+0000","last_active":"2023-12-13T00:28:04.866890+0000","last_peered":"2023-12-13T00:28:04.866890+0000","last_clean":"2023-12-13T00:28:04.866890+0000","last_became_active":"2023-12-13T00:00:31.149685+0000","last_became_peered":"2023-12-13T00:00:31.149685+0000","last_unstale":"2023-12-13T00:28:04.866890+0000","last_undegraded":"2023-12-13T00:28:04.866890+0000","last_fullsized":"2023-12-13T00:28:04.866890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'62","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.897559+0000","last_change":"2023-12-13T00:00:31.035879+0000","last_active":"2023-12-13T00:28:04.897559+0000","last_peered":"2023-12-13T00:28:04.897559+0000","last_clean":"2023-12-13T00:28:04.897559+0000","last_became_active":"2023-12-13T00:00:31.035672+0000","last_became_peered":"2023-12-13T00:00:31.035672+0000","last_unstale":"2023-12-13T00:28:04.897559+0000","last_undegraded":"2023-12-13T00:28:04.897559+0000","last_fullsized":"2023-12-13T00:28:04.897559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'65","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.866643+0000","last_change":"2023-12-13T00:00:31.146556+0000","last_active":"2023-12-13T00:28:04.866643+0000","last_peered":"2023-12-13T00:28:04.866643+0000","last_clean":"2023-12-13T00:28:04.866643+0000","last_became_active":"2023-12-13T00:00:31.146186+0000","last_became_peered":"2023-12-13T00:00:31.146186+0000","last_unstale":"2023-12-13T00:28:04.866643+0000","last_undegraded":"2023-12-13T00:28:04.866643+0000","last_fullsized":"2023-12-13T00:28:04.866643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'52","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.863535+0000","last_change":"2023-12-13T00:00:31.145365+0000","last_active":"2023-12-13T00:28:04.863535+0000","last_peered":"2023-12-13T00:28:04.863535+0000","last_clean":"2023-12-13T00:28:04.863535+0000","last_became_active":"2023-12-13T00:00:31.144458+0000","last_became_peered":"2023-12-13T00:00:31.144458+0000","last_unstale":"2023-12-13T00:28:04.863535+0000","last_undegraded":"2023-12-13T00:28:04.863535+0000","last_fullsized":"2023-12-13T00:28:04.863535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'57","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:20.190360+0000","last_change":"2023-12-13T00:28:20.190377+0000","last_active":"2023-12-13T00:28:20.190360+0000","last_peered":"2023-12-13T00:28:20.190360+0000","last_clean":"2023-12-13T00:28:20.190360+0000","last_became_active":"2023-12-13T00:00:31.144792+0000","last_became_peered":"2023-12-13T00:00:31.144792+0000","last_unstale":"2023-12-13T00:28:20.190360+0000","last_undegraded":"2023-12-13T00:28:20.190360+0000","last_fullsized":"2023-12-13T00:28:20.190360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:20.190304+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:20.190304+0000","last_clean_scrub_stamp":"2023-12-13T00:28:20.190304+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:16:25.962310+0000","scrub_duration":0.0010028070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'50","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:24.347581+0000","last_change":"2023-12-13T00:28:24.347618+0000","last_active":"2023-12-13T00:28:24.347581+0000","last_peered":"2023-12-13T00:28:24.347581+0000","last_clean":"2023-12-13T00:28:24.347581+0000","last_became_active":"2023-12-13T00:00:31.148875+0000","last_became_peered":"2023-12-13T00:00:31.148875+0000","last_unstale":"2023-12-13T00:28:24.347581+0000","last_undegraded":"2023-12-13T00:28:24.347581+0000","last_fullsized":"2023-12-13T00:28:24.347581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-13T00:28:24.347486+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-13T00:28:24.347486+0000","last_clean_scrub_stamp":"2023-12-13T00:28:24.347486+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:41:33.521746+0000","scrub_duration":0.001393895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'66","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:25.176823+0000","last_change":"2023-12-13T00:28:25.176823+0000","last_active":"2023-12-13T00:28:25.176823+0000","last_peered":"2023-12-13T00:28:25.176823+0000","last_clean":"2023-12-13T00:28:25.176823+0000","last_became_active":"2023-12-13T00:00:31.144174+0000","last_became_peered":"2023-12-13T00:00:31.144174+0000","last_unstale":"2023-12-13T00:28:25.176823+0000","last_undegraded":"2023-12-13T00:28:25.176823+0000","last_fullsized":"2023-12-13T00:28:25.176823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2023-12-13T00:28:25.176745+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2023-12-13T00:28:25.176745+0000","last_clean_scrub_stamp":"2023-12-13T00:28:25.176745+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:36:46.260217+0000","scrub_duration":0.0010312170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'57","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.859213+0000","last_change":"2023-12-13T00:00:31.144074+0000","last_active":"2023-12-13T00:28:04.859213+0000","last_peered":"2023-12-13T00:28:04.859213+0000","last_clean":"2023-12-13T00:28:04.859213+0000","last_became_active":"2023-12-13T00:00:31.143809+0000","last_became_peered":"2023-12-13T00:00:31.143809+0000","last_unstale":"2023-12-13T00:28:04.859213+0000","last_undegraded":"2023-12-13T00:28:04.859213+0000","last_fullsized":"2023-12-13T00:28:04.859213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'47","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:27.432298+0000","last_change":"2023-12-13T00:28:27.432315+0000","last_active":"2023-12-13T00:28:27.432298+0000","last_peered":"2023-12-13T00:28:27.432298+0000","last_clean":"2023-12-13T00:28:27.432298+0000","last_became_active":"2023-12-13T00:00:31.116230+0000","last_became_peered":"2023-12-13T00:00:31.116230+0000","last_unstale":"2023-12-13T00:28:27.432298+0000","last_undegraded":"2023-12-13T00:28:27.432298+0000","last_fullsized":"2023-12-13T00:28:27.432298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2023-12-13T00:28:27.432235+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2023-12-13T00:28:27.432235+0000","last_clean_scrub_stamp":"2023-12-13T00:28:27.432235+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:43:11.126576+0000","scrub_duration":0.00088450200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'66","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.877794+0000","last_change":"2023-12-13T00:00:31.149691+0000","last_active":"2023-12-13T00:28:04.877794+0000","last_peered":"2023-12-13T00:28:04.877794+0000","last_clean":"2023-12-13T00:28:04.877794+0000","last_became_active":"2023-12-13T00:00:31.149410+0000","last_became_peered":"2023-12-13T00:00:31.149410+0000","last_unstale":"2023-12-13T00:28:04.877794+0000","last_undegraded":"2023-12-13T00:28:04.877794+0000","last_fullsized":"2023-12-13T00:28:04.877794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":248,"num_write":4193,"num_write_kb":331487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5031,"ondisk_log_size":5031,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3759,"ondisk_log_size":3759,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":43904475,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":1477,"num_read_kb":1524,"num_write":14609,"num_write_kb":50682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87957504,"data_stored":87808950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13622,"ondisk_log_size":13622,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509787,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53632,"kb_used_data":8568,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318208,"statfs":{"total":96636764160,"available":96581844992,"internally_reserved":0,"allocated":8773632,"data_stored":8578223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.34699999999999998,"5min":0.25800000000000001,"15min":0.23699999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.65800000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42999999999999999,"15min":0.42899999999999999},"min":{"1min":0.29299999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.60599999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.59199999999999997}]},{"osd":1,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.442,"15min":0.438},"min":{"1min":0.312,"5min":0.308,"15min":0.24299999999999999},"max":{"1min":0.58399999999999996,"5min":0.63500000000000001,"15min":0.68200000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.36299999999999999,"5min":0.29799999999999999,"15min":0.28199999999999997},"max":{"1min":0.52000000000000002,"5min":0.60099999999999998,"15min":0.61699999999999999},"last":0.56200000000000006}]},{"osd":2,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.432,"15min":0.42699999999999999},"min":{"1min":0.35999999999999999,"5min":0.29499999999999998,"15min":0.27100000000000002},"max":{"1min":0.59499999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.436,"15min":0.42899999999999999},"min":{"1min":0.35499999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60699999999999998,"5min":0.65100000000000002,"15min":0.65200000000000002},"last":0.55100000000000005}]},{"osd":3,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.436,"15min":0.436},"min":{"1min":0.32700000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.56299999999999994,"5min":0.623,"15min":0.623},"last":0.504},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.309},"max":{"1min":0.58099999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.49299999999999999}]},{"osd":4,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.372,"15min":0.371},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56399999999999995,"5min":0.753,"15min":0.753},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26300000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64100000000000001,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.34999999999999998}]},{"osd":5,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.40200000000000002,"15min":0.40100000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.22900000000000001},"max":{"1min":0.61099999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.44500000000000001,"15min":0.436},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.23100000000000001},"max":{"1min":0.628,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.44500000000000001}]},{"osd":6,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.23999999999999999},"max":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.438,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56899999999999995,"5min":0.67900000000000005,"15min":0.71799999999999997},"last":0.40400000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509786,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88192,"kb_used_data":16760,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94283648,"statfs":{"total":96636764160,"available":96546455552,"internally_reserved":0,"allocated":17162240,"data_stored":16985405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.34100000000000003,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.42799999999999999},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.23100000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.35499999999999998}]},{"osd":1,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.30399999999999999,"5min":0.28599999999999998,"15min":0.252},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.41899999999999998,"15min":0.41699999999999998},"min":{"1min":0.34599999999999997,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.44400000000000001}]},{"osd":2,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.42299999999999999,"15min":0.41099999999999998},"min":{"1min":0.35799999999999998,"5min":0.30099999999999999,"15min":0.247},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.437,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.26500000000000001},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.46300000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.28999999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.495},{"interface":"front","average":{"1min":0.503,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32300000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.40000000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.38,"15min":0.379},"min":{"1min":0.254,"5min":0.215,"15min":0.215},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.433}]},{"osd":5,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.378},"min":{"1min":0.24399999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44500000000000001,"15min":0.436},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.249},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.441,"15min":0.44},"min":{"1min":0.32200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.433,"15min":0.439},"min":{"1min":0.29499999999999998,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.51900000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509788,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58980,"kb_used_data":9756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312860,"statfs":{"total":96636764160,"available":96576368640,"internally_reserved":0,"allocated":9990144,"data_stored":9784207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.27800000000000002,"5min":0.216,"15min":0.20499999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.41599999999999998,"15min":0.41399999999999998},"min":{"1min":0.30399999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.55500000000000005}]},{"osd":1,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.42799999999999999,"15min":0.41499999999999998},"min":{"1min":0.33300000000000002,"5min":0.248,"15min":0.224},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.379,"5min":0.29899999999999999,"15min":0.251},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.502}]},{"osd":2,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.442,"15min":0.436},"min":{"1min":0.36499999999999999,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.435,"15min":0.433},"min":{"1min":0.32600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.46200000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.442,"15min":0.432},"min":{"1min":0.34999999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59599999999999997,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.47499999999999998,"15min":0.46400000000000002},"min":{"1min":0.34300000000000003,"5min":0.33200000000000002,"15min":0.316},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.59099999999999997}]},{"osd":5,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.39300000000000002,"15min":0.38600000000000001},"min":{"1min":0.30499999999999999,"5min":0.224,"15min":0.221},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.39800000000000002,"15min":0.38400000000000001},"min":{"1min":0.26600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.34000000000000002}]},{"osd":6,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.247},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.71999999999999997},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46200000000000002,"15min":0.442},"min":{"1min":0.34799999999999998,"5min":0.27300000000000002,"15min":0.23899999999999999},"max":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.71899999999999997},"last":0.38600000000000001}]},{"osd":7,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.441,"15min":0.42899999999999999},"min":{"1min":0.36199999999999999,"5min":0.26300000000000001,"15min":0.25600000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.47599999999999998,"15min":0.46500000000000002},"min":{"1min":0.32700000000000001,"5min":0.316,"15min":0.28999999999999998},"max":{"1min":0.71099999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.39600000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509788,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96880,"kb_used_data":21288,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94274960,"statfs":{"total":96636764160,"available":96537559040,"internally_reserved":0,"allocated":21798912,"data_stored":21617833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.317,"15min":0.316},"min":{"1min":0.22600000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.42699999999999999,"5min":0.53200000000000003,"15min":0.64000000000000001},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.312,"15min":0.312},"min":{"1min":0.246,"5min":0.19600000000000001,"15min":0.192},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.57899999999999996},"last":0.26200000000000001}]},{"osd":1,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34000000000000002,"15min":0.33000000000000002},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.20200000000000001},"max":{"1min":0.41299999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.371,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.28499999999999998,"5min":0.27400000000000002,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.33300000000000002}]},{"osd":2,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.26600000000000001,"5min":0.249,"15min":0.22800000000000001},"max":{"1min":0.47799999999999998,"5min":0.59899999999999998,"15min":0.69399999999999995},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39800000000000002,"15min":0.39600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.23799999999999999},"max":{"1min":0.51400000000000001,"5min":0.59699999999999998,"15min":0.66300000000000003},"last":0.316}]},{"osd":4,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.311},"max":{"1min":0.72199999999999998,"5min":0.80100000000000005,"15min":0.90700000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.38500000000000001,"5min":0.34100000000000003,"15min":0.316},"max":{"1min":0.64500000000000002,"5min":0.76700000000000002,"15min":0.84199999999999997},"last":0.71099999999999997}]},{"osd":5,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.83199999999999996},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50700000000000001,"15min":0.5},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.30599999999999999},"max":{"1min":0.72799999999999998,"5min":0.76000000000000001,"15min":0.81999999999999995},"last":0.624}]},{"osd":6,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.67600000000000005,"5min":0.78600000000000003,"15min":0.80600000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54600000000000004,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.79300000000000004},"last":0.755}]},{"osd":7,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.78800000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.39500000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.85799999999999998},"last":0.74199999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509786,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36200,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335640,"statfs":{"total":96636764160,"available":96599695360,"internally_reserved":0,"allocated":884736,"data_stored":706002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.307,"15min":0.30099999999999999},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.47599999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.32200000000000001,"15min":0.32900000000000001},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.63600000000000001},"last":0.29199999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33200000000000002,"15min":0.32700000000000001},"min":{"1min":0.26100000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.498,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35299999999999998,"15min":0.35199999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51700000000000002,"5min":0.53100000000000003,"15min":0.55000000000000004},"last":0.32500000000000001}]},{"osd":3,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38,"15min":0.376},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.59599999999999997,"5min":0.60599999999999998,"15min":0.60799999999999998},"last":0.373},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.25600000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.505,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.48999999999999999,"15min":0.47399999999999998},"min":{"1min":0.29499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65300000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.495,"15min":0.48199999999999998},"min":{"1min":0.35799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.72199999999999998,"5min":0.79500000000000004,"15min":0.84699999999999998},"last":0.51000000000000001}]},{"osd":5,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.69499999999999995,"5min":0.78500000000000003,"15min":0.81999999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.505,"15min":0.49199999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.32000000000000001},"max":{"1min":0.628,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.44}]},{"osd":6,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.29099999999999998},"max":{"1min":0.73499999999999999,"5min":0.79000000000000004,"15min":0.89300000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.39600000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66900000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.54200000000000004}]},{"osd":7,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77500000000000002,"5min":0.78400000000000003,"15min":0.83899999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.54200000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.71499999999999997,"5min":0.82699999999999996,"15min":0.85799999999999998},"last":0.46000000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542490,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70184,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94301656,"statfs":{"total":96636764160,"available":96564895744,"internally_reserved":0,"allocated":8683520,"data_stored":8504788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.313,"15min":0.308},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.38400000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.32200000000000001,"15min":0.32700000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.19},"max":{"1min":0.42799999999999999,"5min":0.53200000000000003,"15min":0.60299999999999998},"last":0.443}]},{"osd":1,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.33000000000000002,"15min":0.33100000000000002},"min":{"1min":0.23599999999999999,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.38200000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.746},"last":0.57699999999999996}]},{"osd":3,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35899999999999999,"15min":0.36799999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46800000000000003,"5min":0.57399999999999995,"15min":1.03},"last":0.496},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.376,"15min":0.38500000000000001},"min":{"1min":0.26000000000000001,"5min":0.247,"15min":0.23499999999999999},"max":{"1min":0.41799999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46899999999999997,"15min":0.46600000000000003},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.85399999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.496,"15min":0.48699999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.28499999999999998},"max":{"1min":0.65700000000000003,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.50900000000000001}]},{"osd":5,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.47899999999999998,"15min":0.46899999999999997},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.317},"max":{"1min":0.56899999999999995,"5min":0.70799999999999996,"15min":0.82099999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51600000000000001,"15min":0.496},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.316},"max":{"1min":0.76100000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60599999999999998}]},{"osd":6,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.36799999999999999,"5min":0.36199999999999999,"15min":0.34499999999999997},"max":{"1min":0.61799999999999999,"5min":0.74399999999999999,"15min":0.79800000000000004},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.498,"15min":0.503},"min":{"1min":0.377,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.52500000000000002,"5min":0.75800000000000001,"15min":0.78200000000000003},"last":0.57099999999999995}]},{"osd":7,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53500000000000003,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35499999999999998},"max":{"1min":0.63800000000000001,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.66000000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542490,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67936,"kb_used_data":6232,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94303904,"statfs":{"total":96636764160,"available":96567197696,"internally_reserved":0,"allocated":6381568,"data_stored":6195602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.32900000000000001,"15min":0.32000000000000001},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.19400000000000001},"max":{"1min":0.56599999999999995,"5min":0.627,"15min":0.66900000000000004},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33000000000000002,"15min":0.316},"min":{"1min":0.22700000000000001,"5min":0.221,"15min":0.19900000000000001},"max":{"1min":0.47299999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.23799999999999999}]},{"osd":2,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32600000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57999999999999996,"5min":0.60699999999999998,"15min":0.64600000000000002},"last":0.253},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.37,"15min":0.35399999999999998},"min":{"1min":0.246,"5min":0.24299999999999999,"15min":0.23000000000000001},"max":{"1min":0.52800000000000002,"5min":0.61299999999999999,"15min":0.72299999999999998},"last":0.315}]},{"osd":3,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36199999999999999,"15min":0.35499999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.22900000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.36799999999999999},"min":{"1min":0.28999999999999998,"5min":0.26300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.65400000000000003},"last":0.28999999999999998}]},{"osd":4,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.33500000000000002,"5min":0.30499999999999999,"15min":0.25800000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.37},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51500000000000001,"15min":0.47899999999999998},"min":{"1min":0.36499999999999999,"5min":0.35899999999999999,"15min":0.27200000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.42099999999999999}]},{"osd":5,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52500000000000002,"15min":0.48499999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.379},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.505},"min":{"1min":0.40000000000000002,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40999999999999998}]},{"osd":6,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52000000000000002},"min":{"1min":0.40200000000000002,"5min":0.33800000000000002,"15min":0.33600000000000002},"max":{"1min":0.71699999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.51900000000000002},"min":{"1min":0.41999999999999998,"5min":0.377,"15min":0.34499999999999997},"max":{"1min":0.81699999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.39700000000000002}]},{"osd":7,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69399999999999995,"5min":0.746,"15min":0.79500000000000004},"last":0.441},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":0.54100000000000004},"min":{"1min":0.371,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.45000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575195,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88748,"kb_used_data":17316,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94283092,"statfs":{"total":96636764160,"available":96545886208,"internally_reserved":0,"allocated":17731584,"data_stored":17541418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.307,"5min":0.255,"15min":0.20200000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.70399999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41399999999999998,"15min":0.40699999999999997},"min":{"1min":0.30099999999999999,"5min":0.28000000000000003,"15min":0.23999999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.67300000000000004},"last":0.39900000000000002}]},{"osd":1,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.434,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.249},"max":{"1min":0.61499999999999999,"5min":0.625,"15min":0.67300000000000004},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.33300000000000002,"5min":0.28999999999999998,"15min":0.247},"max":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.73399999999999999},"last":0.44600000000000001}]},{"osd":2,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.42999999999999999,"15min":0.42299999999999999},"min":{"1min":0.317,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.628,"5min":0.628,"15min":0.68700000000000006},"last":0.379},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41599999999999998,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.65900000000000003},"last":0.437}]},{"osd":3,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44600000000000001,"15min":0.436},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.27300000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.68999999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.44800000000000001},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.69099999999999995},"last":0.36899999999999999}]},{"osd":4,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38800000000000001,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.215},"max":{"1min":0.58599999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.317},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40100000000000002,"15min":0.38600000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.22900000000000001},"max":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.65000000000000002},"last":0.501}]},{"osd":6,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.374,"15min":0.36499999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.22500000000000001},"max":{"1min":0.48299999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.42299999999999999,"15min":0.41799999999999998},"min":{"1min":0.26100000000000001,"5min":0.25800000000000001,"15min":0.24399999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.77400000000000002},"last":0.42599999999999999}]},{"osd":7,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.41899999999999998},"min":{"1min":0.29999999999999999,"5min":0.27400000000000002,"15min":0.22900000000000001},"max":{"1min":0.60099999999999998,"5min":0.61099999999999999,"15min":0.68899999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.433},"min":{"1min":0.36699999999999999,"5min":0.27000000000000002,"15min":0.26700000000000002},"max":{"1min":0.64500000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.46600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6098944,"data_stored":6080128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21516288,"data_stored":21502359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9707520,"data_stored":9668733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16855040,"data_stored":16835576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16879616,"data_stored":16869931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8491008,"data_stored":8462749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T00:28:41.556 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.556 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.557 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.557 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.557 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.557 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.557 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.557 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.557 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.558 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.558 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.558 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.558 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.558 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.558 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.558 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.558 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.558 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.559 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.559 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.559 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.559 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.559 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.559 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.559 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.559 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.559 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.560 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.560 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.560 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.560 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.560 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.560 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.560 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.560 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.560 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.561 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.561 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.561 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.561 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.561 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.561 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.561 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.561 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.561 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.562 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.562 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.562 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.562 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.562 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.562 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.562 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.562 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.563 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.563 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.563 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.563 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.563 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.563 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.563 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.563 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.563 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.564 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-12-13T00:00:28.640579+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=28, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.564 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.564 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.564 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.564 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.564 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.564 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.564 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.565 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.565 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.565 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.565 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.565 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.565 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.565 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.565 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.566 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.566 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.566 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.566 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.566 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:28:41.566 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-13T00:29:01.568 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T00:29:01.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.671+0000 7fb67bf05640 1 Processor -- start 2023-12-13T00:29:01.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.671+0000 7fb67bf05640 1 -- start start 2023-12-13T00:29:01.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.672+0000 7fb67bf05640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740c46c0 0x7fb6740c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:01.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.672+0000 7fb67bf05640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6740c76f0 con 0x7fb674150460 2023-12-13T00:29:01.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.672+0000 7fb67bf05640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6740c2bc0 con 0x7fb6740c4aa0 2023-12-13T00:29:01.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.672+0000 7fb67bf05640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6740c6dc0 con 0x7fb6740c46c0 2023-12-13T00:29:01.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.672+0000 7fb67a4a2640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb674150460 0x7fb6740c1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52640/0 (socket says 172.21.15.72:52640) 2023-12-13T00:29:01.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.672+0000 7fb67a4a2640 1 -- 172.21.15.72:0/2437736027 learned_addr learned my addr 172.21.15.72:0/2437736027 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:29:01.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.672+0000 7fb679ca1640 1 --2- 172.21.15.72:0/2437736027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740c46c0 0x7fb6740c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:01.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.675+0000 7fb678c9f640 1 -- 172.21.15.72:0/2437736027 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014864680 0 0) 0x7fb6740c2bc0 con 0x7fb6740c4aa0 2023-12-13T00:29:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.675+0000 7fb678c9f640 1 -- 172.21.15.72:0/2437736027 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb660005730 con 0x7fb6740c4aa0 2023-12-13T00:29:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.675+0000 7fb678c9f640 1 -- 172.21.15.72:0/2437736027 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627673618 0 0) 0x7fb6740c76f0 con 0x7fb674150460 2023-12-13T00:29:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.675+0000 7fb678c9f640 1 -- 172.21.15.72:0/2437736027 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6740c2bc0 con 0x7fb674150460 2023-12-13T00:29:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.675+0000 7fb679ca1640 1 -- 172.21.15.72:0/2437736027 >> v1:172.21.15.176:6789/0 conn(0x7fb6740c4aa0 legacy=0x7fb67414fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.675+0000 7fb679ca1640 1 -- 172.21.15.72:0/2437736027 >> v1:172.21.15.72:6789/0 conn(0x7fb674150460 legacy=0x7fb6740c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.675+0000 7fb679ca1640 1 -- 172.21.15.72:0/2437736027 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6740c70a0 con 0x7fb6740c46c0 2023-12-13T00:29:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.677+0000 7fb679ca1640 1 --2- 172.21.15.72:0/2437736027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740c46c0 0x7fb6740c53c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb6700097d0 tx=0x7fb67002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c86efc2fbb249250 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:01.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.681+0000 7fb678c9f640 1 -- 172.21.15.72:0/2437736027 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb670031890 con 0x7fb6740c46c0 2023-12-13T00:29:01.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.681+0000 7fb678c9f640 1 -- 172.21.15.72:0/2437736027 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6700319f0 con 0x7fb6740c46c0 2023-12-13T00:29:01.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.681+0000 7fb678c9f640 1 -- 172.21.15.72:0/2437736027 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb670031d80 con 0x7fb6740c46c0 2023-12-13T00:29:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.682+0000 7fb67bf05640 1 -- 172.21.15.72:0/2437736027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740c46c0 msgr2=0x7fb6740c53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.682+0000 7fb67bf05640 1 --2- 172.21.15.72:0/2437736027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740c46c0 0x7fb6740c53c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb6700097d0 tx=0x7fb67002b930 comp rx=0 tx=0).stop 2023-12-13T00:29:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.682+0000 7fb67bf05640 1 -- 172.21.15.72:0/2437736027 shutdown_connections 2023-12-13T00:29:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.682+0000 7fb67bf05640 1 --2- 172.21.15.72:0/2437736027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740c46c0 0x7fb6740c53c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.682+0000 7fb67bf05640 1 -- 172.21.15.72:0/2437736027 >> 172.21.15.72:0/2437736027 conn(0x7fb67406c5f0 msgr2=0x7fb67406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.682+0000 7fb67bf05640 1 -- 172.21.15.72:0/2437736027 shutdown_connections 2023-12-13T00:29:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.682+0000 7fb67bf05640 1 -- 172.21.15.72:0/2437736027 wait complete. 2023-12-13T00:29:01.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.683+0000 7fb67bf05640 1 Processor -- start 2023-12-13T00:29:01.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.683+0000 7fb67bf05640 1 -- start start 2023-12-13T00:29:01.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.684+0000 7fb67bf05640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6740c46c0 0x7fb674071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:01.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.684+0000 7fb67bf05640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740c4aa0 0x7fb6741f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:01.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.684+0000 7fb67bf05640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb674150460 0x7fb6741f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:01.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.684+0000 7fb67bf05640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6741537c0 con 0x7fb674150460 2023-12-13T00:29:01.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.684+0000 7fb67bf05640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67415a410 con 0x7fb6740c46c0 2023-12-13T00:29:01.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.684+0000 7fb67bf05640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6741534e0 con 0x7fb6740c4aa0 2023-12-13T00:29:01.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.684+0000 7fb67a4a2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb674150460 0x7fb6741f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:01.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.684+0000 7fb679ca1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6740c46c0 0x7fb674071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:01.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.684+0000 7fb67a4a2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb674150460 0x7fb6741f28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51998/0 (socket says 172.21.15.72:51998) 2023-12-13T00:29:01.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.684+0000 7fb67a4a2640 1 -- 172.21.15.72:0/1757796892 learned_addr learned my addr 172.21.15.72:0/1757796892 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:29:01.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.685+0000 7fb6794a0640 1 --2- 172.21.15.72:0/1757796892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740c4aa0 0x7fb6741f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:01.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.688+0000 7fb67a4a2640 1 -- 172.21.15.72:0/1757796892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740c4aa0 msgr2=0x7fb6741f2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:01.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.688+0000 7fb67a4a2640 1 --2- 172.21.15.72:0/1757796892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740c4aa0 0x7fb6741f2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:01.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.688+0000 7fb67a4a2640 1 -- 172.21.15.72:0/1757796892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6740c46c0 msgr2=0x7fb674071df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:01.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.688+0000 7fb67a4a2640 1 --2- 172.21.15.72:0/1757796892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6740c46c0 0x7fb674071df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:01.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.688+0000 7fb67a4a2640 1 -- 172.21.15.72:0/1757796892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb670009400 con 0x7fb674150460 2023-12-13T00:29:01.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.690+0000 7fb67a4a2640 1 --2- 172.21.15.72:0/1757796892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb674150460 0x7fb6741f28b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00caa0 tx=0x7fb66c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:01.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.695+0000 7fb66a7fc640 1 -- 172.21.15.72:0/1757796892 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c00ac00 con 0x7fb674150460 2023-12-13T00:29:01.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.695+0000 7fb66a7fc640 1 -- 172.21.15.72:0/1757796892 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66c00ad60 con 0x7fb674150460 2023-12-13T00:29:01.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.695+0000 7fb66a7fc640 1 -- 172.21.15.72:0/1757796892 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c012620 con 0x7fb674150460 2023-12-13T00:29:01.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.695+0000 7fb67bf05640 1 -- 172.21.15.72:0/1757796892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb674159e50 con 0x7fb674150460 2023-12-13T00:29:01.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.695+0000 7fb67bf05640 1 -- 172.21.15.72:0/1757796892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6741f1e50 con 0x7fb674150460 2023-12-13T00:29:01.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.696+0000 7fb67bf05640 1 -- 172.21.15.72:0/1757796892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6741f2040 con 0x7fb674150460 2023-12-13T00:29:01.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.939+0000 7fb66a7fc640 1 -- 172.21.15.72:0/1757796892 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb66c007070 con 0x7fb674150460 2023-12-13T00:29:01.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.940+0000 7fb66a7fc640 1 --2- 172.21.15.72:0/1757796892 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb65806b210 0x7fb65806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:01.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.940+0000 7fb679ca1640 1 --2- 172.21.15.72:0/1757796892 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb65806b210 0x7fb65806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:01.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.940+0000 7fb679ca1640 1 --2- 172.21.15.72:0/1757796892 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb65806b210 0x7fb65806d6d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb670036000 tx=0x7fb67003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:01.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.953+0000 7fb66a7fc640 1 -- 172.21.15.72:0/1757796892 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fb66c0587d0 con 0x7fb674150460 2023-12-13T00:29:01.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:01.953+0000 7fb66a7fc640 1 -- 172.21.15.72:0/1757796892 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb66c054b10 con 0x7fb674150460 2023-12-13T00:29:02.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:02.117+0000 7fb67bf05640 1 -- 172.21.15.72:0/1757796892 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6740c5900 con 0x7fb65806b210 2023-12-13T00:29:02.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:02.126+0000 7fb66a7fc640 1 -- 172.21.15.72:0/1757796892 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371884 (secure 0 0 0) 0x7fb67003a420 con 0x7fb65806b210 2023-12-13T00:29:02.130 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:29:02.132 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-12-13T00:29:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:02.129+0000 7fb67bf05640 1 -- 172.21.15.72:0/1757796892 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb65806b210 msgr2=0x7fb65806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:02.129+0000 7fb67bf05640 1 --2- 172.21.15.72:0/1757796892 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb65806b210 0x7fb65806d6d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb670036000 tx=0x7fb67003c040 comp rx=0 tx=0).stop 2023-12-13T00:29:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:02.129+0000 7fb67bf05640 1 -- 172.21.15.72:0/1757796892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb674150460 msgr2=0x7fb6741f28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:02.129+0000 7fb67bf05640 1 --2- 172.21.15.72:0/1757796892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb674150460 0x7fb6741f28b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00caa0 tx=0x7fb66c00cf60 comp rx=0 tx=0).stop 2023-12-13T00:29:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:02.129+0000 7fb67bf05640 1 -- 172.21.15.72:0/1757796892 shutdown_connections 2023-12-13T00:29:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:02.129+0000 7fb67bf05640 1 --2- 172.21.15.72:0/1757796892 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fb65806b210 0x7fb65806d6d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:02.129+0000 7fb67bf05640 1 --2- 172.21.15.72:0/1757796892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb674150460 0x7fb6741f28b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:02.129+0000 7fb67bf05640 1 --2- 172.21.15.72:0/1757796892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740c4aa0 0x7fb6741f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:02.129+0000 7fb67bf05640 1 --2- 172.21.15.72:0/1757796892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6740c46c0 0x7fb674071df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:02.129+0000 7fb67bf05640 1 -- 172.21.15.72:0/1757796892 >> 172.21.15.72:0/1757796892 conn(0x7fb67406c5f0 msgr2=0x7fb674153f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:02.130+0000 7fb67bf05640 1 -- 172.21.15.72:0/1757796892 shutdown_connections 2023-12-13T00:29:02.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:02.130+0000 7fb67bf05640 1 -- 172.21.15.72:0/1757796892 wait complete. 2023-12-13T00:29:02.140 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":888,"stamp":"2023-12-13T00:29:00.920637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44494843,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1597,"num_read_kb":1872,"num_write":18961,"num_write_kb":384585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22567,"ondisk_log_size":22567,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":544112,"kb_used_data":89264,"kb_used_omap":12,"kb_used_meta":454771,"kb_avail":754430608,"statfs":{"total":773094113280,"available":772536942592,"internally_reserved":0,"allocated":91406336,"data_stored":89913478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":465686066},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003159"},"pg_stats":[{"pgid":"2.1f","version":"27'893","reported_seq":933,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:29.139599+0000","last_change":"2023-12-13T00:28:29.139661+0000","last_active":"2023-12-13T00:28:29.139599+0000","last_peered":"2023-12-13T00:28:29.139599+0000","last_clean":"2023-12-13T00:28:29.139599+0000","last_became_active":"2023-12-13T00:00:29.997381+0000","last_became_peered":"2023-12-13T00:00:29.997381+0000","last_unstale":"2023-12-13T00:28:29.139599+0000","last_undegraded":"2023-12-13T00:28:29.139599+0000","last_fullsized":"2023-12-13T00:28:29.139599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'893","last_scrub_stamp":"2023-12-13T00:28:29.139513+0000","last_deep_scrub":"27'893","last_deep_scrub_stamp":"2023-12-13T00:28:29.139513+0000","last_clean_scrub_stamp":"2023-12-13T00:28:29.139513+0000","objects_scrubbed":5,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:42:10.924829+0000","scrub_duration":0.013572704,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":4535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'54","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.804135+0000","last_change":"2023-12-13T00:00:31.138533+0000","last_active":"2023-12-13T00:28:18.804135+0000","last_peered":"2023-12-13T00:28:18.804135+0000","last_clean":"2023-12-13T00:28:18.804135+0000","last_became_active":"2023-12-13T00:00:31.138242+0000","last_became_peered":"2023-12-13T00:00:31.138242+0000","last_unstale":"2023-12-13T00:28:18.804135+0000","last_undegraded":"2023-12-13T00:28:18.804135+0000","last_fullsized":"2023-12-13T00:28:18.804135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'155","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:50.063447+0000","last_change":"2023-12-13T00:28:50.063484+0000","last_active":"2023-12-13T00:28:50.063447+0000","last_peered":"2023-12-13T00:28:50.063447+0000","last_clean":"2023-12-13T00:28:50.063447+0000","last_became_active":"2023-12-13T00:00:35.667498+0000","last_became_peered":"2023-12-13T00:00:35.667498+0000","last_unstale":"2023-12-13T00:28:50.063447+0000","last_undegraded":"2023-12-13T00:28:50.063447+0000","last_fullsized":"2023-12-13T00:28:50.063447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'155","last_scrub_stamp":"2023-12-13T00:28:50.063365+0000","last_deep_scrub":"27'155","last_deep_scrub_stamp":"2023-12-13T00:28:50.063365+0000","last_clean_scrub_stamp":"2023-12-13T00:28:50.063365+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:47:54.554846+0000","scrub_duration":0.0015139660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'847","reported_seq":888,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:47.534975+0000","last_change":"2023-12-13T00:28:47.534996+0000","last_active":"2023-12-13T00:28:47.534975+0000","last_peered":"2023-12-13T00:28:47.534975+0000","last_clean":"2023-12-13T00:28:47.534975+0000","last_became_active":"2023-12-13T00:00:30.001628+0000","last_became_peered":"2023-12-13T00:00:30.001628+0000","last_unstale":"2023-12-13T00:28:47.534975+0000","last_undegraded":"2023-12-13T00:28:47.534975+0000","last_fullsized":"2023-12-13T00:28:47.534975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'847","last_scrub_stamp":"2023-12-13T00:28:47.534918+0000","last_deep_scrub":"27'847","last_deep_scrub_stamp":"2023-12-13T00:28:47.534918+0000","last_clean_scrub_stamp":"2023-12-13T00:28:47.534918+0000","objects_scrubbed":1,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:36:14.144385+0000","scrub_duration":0.011101267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'62","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:23.425898+0000","last_change":"2023-12-13T00:28:23.425921+0000","last_active":"2023-12-13T00:28:23.425898+0000","last_peered":"2023-12-13T00:28:23.425898+0000","last_clean":"2023-12-13T00:28:23.425898+0000","last_became_active":"2023-12-13T00:00:31.036197+0000","last_became_peered":"2023-12-13T00:00:31.036197+0000","last_unstale":"2023-12-13T00:28:23.425898+0000","last_undegraded":"2023-12-13T00:28:23.425898+0000","last_fullsized":"2023-12-13T00:28:23.425898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'62","last_scrub_stamp":"2023-12-13T00:28:23.425813+0000","last_deep_scrub":"27'62","last_deep_scrub_stamp":"2023-12-13T00:28:23.425813+0000","last_clean_scrub_stamp":"2023-12-13T00:28:23.425813+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:33:18.747179+0000","scrub_duration":0.001921973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'165","reported_seq":204,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:48.150794+0000","last_change":"2023-12-13T00:28:48.150817+0000","last_active":"2023-12-13T00:28:48.150794+0000","last_peered":"2023-12-13T00:28:48.150794+0000","last_clean":"2023-12-13T00:28:48.150794+0000","last_became_active":"2023-12-13T00:00:35.664981+0000","last_became_peered":"2023-12-13T00:00:35.664981+0000","last_unstale":"2023-12-13T00:28:48.150794+0000","last_undegraded":"2023-12-13T00:28:48.150794+0000","last_fullsized":"2023-12-13T00:28:48.150794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'165","last_scrub_stamp":"2023-12-13T00:28:48.150719+0000","last_deep_scrub":"27'165","last_deep_scrub_stamp":"2023-12-13T00:28:48.150719+0000","last_clean_scrub_stamp":"2023-12-13T00:28:48.150719+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:34:39.892054+0000","scrub_duration":0.0020656839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":248,"num_write":136,"num_write_kb":7125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:33.302643+0000","last_change":"2023-12-13T00:28:33.302667+0000","last_active":"2023-12-13T00:28:33.302643+0000","last_peered":"2023-12-13T00:28:33.302643+0000","last_clean":"2023-12-13T00:28:33.302643+0000","last_became_active":"2023-12-13T00:00:30.009724+0000","last_became_peered":"2023-12-13T00:00:30.009724+0000","last_unstale":"2023-12-13T00:28:33.302643+0000","last_undegraded":"2023-12-13T00:28:33.302643+0000","last_fullsized":"2023-12-13T00:28:33.302643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2023-12-13T00:28:33.302572+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2023-12-13T00:28:33.302572+0000","last_clean_scrub_stamp":"2023-12-13T00:28:33.302572+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:09:03.008018+0000","scrub_duration":0.0025511840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'58","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:28.924075+0000","last_change":"2023-12-13T00:28:28.924111+0000","last_active":"2023-12-13T00:28:28.924075+0000","last_peered":"2023-12-13T00:28:28.924075+0000","last_clean":"2023-12-13T00:28:28.924075+0000","last_became_active":"2023-12-13T00:00:31.150735+0000","last_became_peered":"2023-12-13T00:00:31.150735+0000","last_unstale":"2023-12-13T00:28:28.924075+0000","last_undegraded":"2023-12-13T00:28:28.924075+0000","last_fullsized":"2023-12-13T00:28:28.924075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-12-13T00:28:28.923981+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-12-13T00:28:28.923981+0000","last_clean_scrub_stamp":"2023-12-13T00:28:28.923981+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:40:47.032764+0000","scrub_duration":0.0010969529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'163","reported_seq":198,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:51.197798+0000","last_change":"2023-12-13T00:28:51.197818+0000","last_active":"2023-12-13T00:28:51.197798+0000","last_peered":"2023-12-13T00:28:51.197798+0000","last_clean":"2023-12-13T00:28:51.197798+0000","last_became_active":"2023-12-13T00:00:35.668361+0000","last_became_peered":"2023-12-13T00:00:35.668361+0000","last_unstale":"2023-12-13T00:28:51.197798+0000","last_undegraded":"2023-12-13T00:28:51.197798+0000","last_fullsized":"2023-12-13T00:28:51.197798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'163","last_scrub_stamp":"2023-12-13T00:28:51.197729+0000","last_deep_scrub":"27'163","last_deep_scrub_stamp":"2023-12-13T00:28:51.197729+0000","last_clean_scrub_stamp":"2023-12-13T00:28:51.197729+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:49:56.958095+0000","scrub_duration":0.001643537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":10445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:39.170459+0000","last_change":"2023-12-13T00:28:39.170483+0000","last_active":"2023-12-13T00:28:39.170459+0000","last_peered":"2023-12-13T00:28:39.170459+0000","last_clean":"2023-12-13T00:28:39.170459+0000","last_became_active":"2023-12-13T00:00:30.009644+0000","last_became_peered":"2023-12-13T00:00:30.009644+0000","last_unstale":"2023-12-13T00:28:39.170459+0000","last_undegraded":"2023-12-13T00:28:39.170459+0000","last_fullsized":"2023-12-13T00:28:39.170459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:39.170392+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:39.170392+0000","last_clean_scrub_stamp":"2023-12-13T00:28:39.170392+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:30:48.680502+0000","scrub_duration":0.001730407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'63","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:28.257980+0000","last_change":"2023-12-13T00:28:28.257999+0000","last_active":"2023-12-13T00:28:28.257980+0000","last_peered":"2023-12-13T00:28:28.257980+0000","last_clean":"2023-12-13T00:28:28.257980+0000","last_became_active":"2023-12-13T00:00:31.146516+0000","last_became_peered":"2023-12-13T00:00:31.146516+0000","last_unstale":"2023-12-13T00:28:28.257980+0000","last_undegraded":"2023-12-13T00:28:28.257980+0000","last_fullsized":"2023-12-13T00:28:28.257980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'63","last_scrub_stamp":"2023-12-13T00:28:28.257908+0000","last_deep_scrub":"27'63","last_deep_scrub_stamp":"2023-12-13T00:28:28.257908+0000","last_clean_scrub_stamp":"2023-12-13T00:28:28.257908+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:55:00.846548+0000","scrub_duration":0.00097492599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'175","reported_seq":210,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:50.183496+0000","last_change":"2023-12-13T00:28:50.183516+0000","last_active":"2023-12-13T00:28:50.183496+0000","last_peered":"2023-12-13T00:28:50.183496+0000","last_clean":"2023-12-13T00:28:50.183496+0000","last_became_active":"2023-12-13T00:00:35.668298+0000","last_became_peered":"2023-12-13T00:00:35.668298+0000","last_unstale":"2023-12-13T00:28:50.183496+0000","last_undegraded":"2023-12-13T00:28:50.183496+0000","last_fullsized":"2023-12-13T00:28:50.183496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'175","last_scrub_stamp":"2023-12-13T00:28:50.183430+0000","last_deep_scrub":"27'175","last_deep_scrub_stamp":"2023-12-13T00:28:50.183430+0000","last_clean_scrub_stamp":"2023-12-13T00:28:50.183430+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:16:52.106250+0000","scrub_duration":0.001845415,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'50","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:31.257801+0000","last_change":"2023-12-13T00:28:31.257801+0000","last_active":"2023-12-13T00:28:31.257801+0000","last_peered":"2023-12-13T00:28:31.257801+0000","last_clean":"2023-12-13T00:28:31.257801+0000","last_became_active":"2023-12-13T00:00:31.036062+0000","last_became_peered":"2023-12-13T00:00:31.036062+0000","last_unstale":"2023-12-13T00:28:31.257801+0000","last_undegraded":"2023-12-13T00:28:31.257801+0000","last_fullsized":"2023-12-13T00:28:31.257801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-13T00:28:31.257707+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-13T00:28:31.257707+0000","last_clean_scrub_stamp":"2023-12-13T00:28:31.257707+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:17:04.269503+0000","scrub_duration":0.001111849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'852","reported_seq":891,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:52.378285+0000","last_change":"2023-12-13T00:28:52.378314+0000","last_active":"2023-12-13T00:28:52.378285+0000","last_peered":"2023-12-13T00:28:52.378285+0000","last_clean":"2023-12-13T00:28:52.378285+0000","last_became_active":"2023-12-13T00:00:30.000782+0000","last_became_peered":"2023-12-13T00:00:30.000782+0000","last_unstale":"2023-12-13T00:28:52.378285+0000","last_undegraded":"2023-12-13T00:28:52.378285+0000","last_fullsized":"2023-12-13T00:28:52.378285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'852","last_scrub_stamp":"2023-12-13T00:28:52.378221+0000","last_deep_scrub":"27'852","last_deep_scrub_stamp":"2023-12-13T00:28:52.378221+0000","last_clean_scrub_stamp":"2023-12-13T00:28:52.378221+0000","objects_scrubbed":3,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:22:35.711609+0000","scrub_duration":0.014447793,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":4547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'149","reported_seq":177,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:38.961322+0000","last_change":"2023-12-13T00:00:35.662038+0000","last_active":"2023-12-13T00:27:38.961322+0000","last_peered":"2023-12-13T00:27:38.961322+0000","last_clean":"2023-12-13T00:27:38.961322+0000","last_became_active":"2023-12-13T00:00:35.661458+0000","last_became_peered":"2023-12-13T00:00:35.661458+0000","last_unstale":"2023-12-13T00:27:38.961322+0000","last_undegraded":"2023-12-13T00:27:38.961322+0000","last_fullsized":"2023-12-13T00:27:38.961322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":11179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'55","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:33.071406+0000","last_change":"2023-12-13T00:28:33.071426+0000","last_active":"2023-12-13T00:28:33.071406+0000","last_peered":"2023-12-13T00:28:33.071406+0000","last_clean":"2023-12-13T00:28:33.071406+0000","last_became_active":"2023-12-13T00:00:31.119447+0000","last_became_peered":"2023-12-13T00:00:31.119447+0000","last_unstale":"2023-12-13T00:28:33.071406+0000","last_undegraded":"2023-12-13T00:28:33.071406+0000","last_fullsized":"2023-12-13T00:28:33.071406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2023-12-13T00:28:33.071296+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2023-12-13T00:28:33.071296+0000","last_clean_scrub_stamp":"2023-12-13T00:28:33.071296+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:32:09.634850+0000","scrub_duration":0.001330962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'215","reported_seq":255,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:22.122493+0000","last_change":"2023-12-13T00:28:22.122493+0000","last_active":"2023-12-13T00:28:22.122493+0000","last_peered":"2023-12-13T00:28:22.122493+0000","last_clean":"2023-12-13T00:28:22.122493+0000","last_became_active":"2023-12-13T00:00:29.967929+0000","last_became_peered":"2023-12-13T00:00:29.967929+0000","last_unstale":"2023-12-13T00:28:22.122493+0000","last_undegraded":"2023-12-13T00:28:22.122493+0000","last_fullsized":"2023-12-13T00:28:22.122493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'215","last_scrub_stamp":"2023-12-13T00:28:22.122378+0000","last_deep_scrub":"27'215","last_deep_scrub_stamp":"2023-12-13T00:28:22.122378+0000","last_clean_scrub_stamp":"2023-12-13T00:28:22.122378+0000","objects_scrubbed":1,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:35:04.951172+0000","scrub_duration":0.001579186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":581,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'167","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:36.614523+0000","last_change":"2023-12-13T00:00:35.662848+0000","last_active":"2023-12-13T00:27:36.614523+0000","last_peered":"2023-12-13T00:27:36.614523+0000","last_clean":"2023-12-13T00:27:36.614523+0000","last_became_active":"2023-12-13T00:00:35.662469+0000","last_became_peered":"2023-12-13T00:00:35.662469+0000","last_unstale":"2023-12-13T00:27:36.614523+0000","last_undegraded":"2023-12-13T00:27:36.614523+0000","last_fullsized":"2023-12-13T00:27:36.614523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":19086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:46.938387+0000","last_change":"2023-12-13T00:28:46.938408+0000","last_active":"2023-12-13T00:28:46.938387+0000","last_peered":"2023-12-13T00:28:46.938387+0000","last_clean":"2023-12-13T00:28:46.938387+0000","last_became_active":"2023-12-13T00:00:31.142847+0000","last_became_peered":"2023-12-13T00:00:31.142847+0000","last_unstale":"2023-12-13T00:28:46.938387+0000","last_undegraded":"2023-12-13T00:28:46.938387+0000","last_fullsized":"2023-12-13T00:28:46.938387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:46.938316+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:46.938316+0000","last_clean_scrub_stamp":"2023-12-13T00:28:46.938316+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:53:47.130643+0000","scrub_duration":0.00094867900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'376","reported_seq":416,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:35.081637+0000","last_change":"2023-12-13T00:28:35.081637+0000","last_active":"2023-12-13T00:28:35.081637+0000","last_peered":"2023-12-13T00:28:35.081637+0000","last_clean":"2023-12-13T00:28:35.081637+0000","last_became_active":"2023-12-13T00:00:30.004195+0000","last_became_peered":"2023-12-13T00:00:30.004195+0000","last_unstale":"2023-12-13T00:28:35.081637+0000","last_undegraded":"2023-12-13T00:28:35.081637+0000","last_fullsized":"2023-12-13T00:28:35.081637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'376","last_scrub_stamp":"2023-12-13T00:28:35.081548+0000","last_deep_scrub":"27'376","last_deep_scrub_stamp":"2023-12-13T00:28:35.081548+0000","last_clean_scrub_stamp":"2023-12-13T00:28:35.081548+0000","objects_scrubbed":2,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:19:25.297573+0000","scrub_duration":0.0030443100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":373,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'154","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:54.009659+0000","last_change":"2023-12-13T00:28:54.009680+0000","last_active":"2023-12-13T00:28:54.009659+0000","last_peered":"2023-12-13T00:28:54.009659+0000","last_clean":"2023-12-13T00:28:54.009659+0000","last_became_active":"2023-12-13T00:00:35.659637+0000","last_became_peered":"2023-12-13T00:00:35.659637+0000","last_unstale":"2023-12-13T00:28:54.009659+0000","last_undegraded":"2023-12-13T00:28:54.009659+0000","last_fullsized":"2023-12-13T00:28:54.009659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'154","last_scrub_stamp":"2023-12-13T00:28:54.009591+0000","last_deep_scrub":"27'154","last_deep_scrub_stamp":"2023-12-13T00:28:54.009591+0000","last_clean_scrub_stamp":"2023-12-13T00:28:54.009591+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:33:48.756870+0000","scrub_duration":0.001554557,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":10280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'45","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:39.199140+0000","last_change":"2023-12-13T00:28:39.199140+0000","last_active":"2023-12-13T00:28:39.199140+0000","last_peered":"2023-12-13T00:28:39.199140+0000","last_clean":"2023-12-13T00:28:39.199140+0000","last_became_active":"2023-12-13T00:00:31.143673+0000","last_became_peered":"2023-12-13T00:00:31.143673+0000","last_unstale":"2023-12-13T00:28:39.199140+0000","last_undegraded":"2023-12-13T00:28:39.199140+0000","last_fullsized":"2023-12-13T00:28:39.199140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-13T00:28:39.199060+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-13T00:28:39.199060+0000","last_clean_scrub_stamp":"2023-12-13T00:28:39.199060+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:18:51.888473+0000","scrub_duration":0.00096585599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'7","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:30.333618+0000","last_change":"2023-12-13T00:28:30.333618+0000","last_active":"2023-12-13T00:28:30.333618+0000","last_peered":"2023-12-13T00:28:30.333618+0000","last_clean":"2023-12-13T00:28:30.333618+0000","last_became_active":"2023-12-13T00:00:30.005740+0000","last_became_peered":"2023-12-13T00:00:30.005740+0000","last_unstale":"2023-12-13T00:28:30.333618+0000","last_undegraded":"2023-12-13T00:28:30.333618+0000","last_fullsized":"2023-12-13T00:28:30.333618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:30.333541+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:30.333541+0000","last_clean_scrub_stamp":"2023-12-13T00:28:30.333541+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:00:50.961984+0000","scrub_duration":0.001992972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'170","reported_seq":206,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:54.149919+0000","last_change":"2023-12-13T00:28:54.149938+0000","last_active":"2023-12-13T00:28:54.149919+0000","last_peered":"2023-12-13T00:28:54.149919+0000","last_clean":"2023-12-13T00:28:54.149919+0000","last_became_active":"2023-12-13T00:00:35.665670+0000","last_became_peered":"2023-12-13T00:00:35.665670+0000","last_unstale":"2023-12-13T00:28:54.149919+0000","last_undegraded":"2023-12-13T00:28:54.149919+0000","last_fullsized":"2023-12-13T00:28:54.149919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'170","last_scrub_stamp":"2023-12-13T00:28:54.149855+0000","last_deep_scrub":"27'170","last_deep_scrub_stamp":"2023-12-13T00:28:54.149855+0000","last_clean_scrub_stamp":"2023-12-13T00:28:54.149855+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:19:36.272242+0000","scrub_duration":0.001524921,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'51","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:51.957464+0000","last_change":"2023-12-13T00:28:51.957483+0000","last_active":"2023-12-13T00:28:51.957464+0000","last_peered":"2023-12-13T00:28:51.957464+0000","last_clean":"2023-12-13T00:28:51.957464+0000","last_became_active":"2023-12-13T00:00:31.146435+0000","last_became_peered":"2023-12-13T00:00:31.146435+0000","last_unstale":"2023-12-13T00:28:51.957464+0000","last_undegraded":"2023-12-13T00:28:51.957464+0000","last_fullsized":"2023-12-13T00:28:51.957464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2023-12-13T00:28:51.957397+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2023-12-13T00:28:51.957397+0000","last_clean_scrub_stamp":"2023-12-13T00:28:51.957397+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:15:54.366317+0000","scrub_duration":0.00097599899999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'10","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:41.210535+0000","last_change":"2023-12-13T00:28:41.210570+0000","last_active":"2023-12-13T00:28:41.210535+0000","last_peered":"2023-12-13T00:28:41.210535+0000","last_clean":"2023-12-13T00:28:41.210535+0000","last_became_active":"2023-12-13T00:00:30.005909+0000","last_became_peered":"2023-12-13T00:00:30.005909+0000","last_unstale":"2023-12-13T00:28:41.210535+0000","last_undegraded":"2023-12-13T00:28:41.210535+0000","last_fullsized":"2023-12-13T00:28:41.210535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2023-12-13T00:28:41.210455+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2023-12-13T00:28:41.210455+0000","last_clean_scrub_stamp":"2023-12-13T00:28:41.210455+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:53:50.670216+0000","scrub_duration":0.0021685620000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'164","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:45.110808+0000","last_change":"2023-12-13T00:28:45.110846+0000","last_active":"2023-12-13T00:28:45.110808+0000","last_peered":"2023-12-13T00:28:45.110808+0000","last_clean":"2023-12-13T00:28:45.110808+0000","last_became_active":"2023-12-13T00:00:35.665521+0000","last_became_peered":"2023-12-13T00:00:35.665521+0000","last_unstale":"2023-12-13T00:28:45.110808+0000","last_undegraded":"2023-12-13T00:28:45.110808+0000","last_fullsized":"2023-12-13T00:28:45.110808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'164","last_scrub_stamp":"2023-12-13T00:28:45.110706+0000","last_deep_scrub":"27'164","last_deep_scrub_stamp":"2023-12-13T00:28:45.110706+0000","last_clean_scrub_stamp":"2023-12-13T00:28:45.110706+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:12:17.829651+0000","scrub_duration":0.0021503999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'57","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.059778+0000","last_change":"2023-12-13T00:00:31.145392+0000","last_active":"2023-12-13T00:28:18.059778+0000","last_peered":"2023-12-13T00:28:18.059778+0000","last_clean":"2023-12-13T00:28:18.059778+0000","last_became_active":"2023-12-13T00:00:31.145115+0000","last_became_peered":"2023-12-13T00:00:31.145115+0000","last_unstale":"2023-12-13T00:28:18.059778+0000","last_undegraded":"2023-12-13T00:28:18.059778+0000","last_fullsized":"2023-12-13T00:28:18.059778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'171","reported_seq":211,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:38.973198+0000","last_change":"2023-12-13T00:28:38.973220+0000","last_active":"2023-12-13T00:28:38.973198+0000","last_peered":"2023-12-13T00:28:38.973198+0000","last_clean":"2023-12-13T00:28:38.973198+0000","last_became_active":"2023-12-13T00:00:30.005988+0000","last_became_peered":"2023-12-13T00:00:30.005988+0000","last_unstale":"2023-12-13T00:28:38.973198+0000","last_undegraded":"2023-12-13T00:28:38.973198+0000","last_fullsized":"2023-12-13T00:28:38.973198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'171","last_scrub_stamp":"2023-12-13T00:28:38.973118+0000","last_deep_scrub":"27'171","last_deep_scrub_stamp":"2023-12-13T00:28:38.973118+0000","last_clean_scrub_stamp":"2023-12-13T00:28:38.973118+0000","objects_scrubbed":2,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:10.652676+0000","scrub_duration":0.0034998709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'165","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.059822+0000","last_change":"2023-12-13T00:00:35.662996+0000","last_active":"2023-12-13T00:28:18.059822+0000","last_peered":"2023-12-13T00:28:18.059822+0000","last_clean":"2023-12-13T00:28:18.059822+0000","last_became_active":"2023-12-13T00:00:35.662612+0000","last_became_peered":"2023-12-13T00:00:35.662612+0000","last_unstale":"2023-12-13T00:28:18.059822+0000","last_undegraded":"2023-12-13T00:28:18.059822+0000","last_fullsized":"2023-12-13T00:28:18.059822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":14176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:44.147372+0000","last_change":"2023-12-13T00:28:44.147393+0000","last_active":"2023-12-13T00:28:44.147372+0000","last_peered":"2023-12-13T00:28:44.147372+0000","last_clean":"2023-12-13T00:28:44.147372+0000","last_became_active":"2023-12-13T00:00:31.117814+0000","last_became_peered":"2023-12-13T00:00:31.117814+0000","last_unstale":"2023-12-13T00:28:44.147372+0000","last_undegraded":"2023-12-13T00:28:44.147372+0000","last_fullsized":"2023-12-13T00:28:44.147372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:44.147296+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:44.147296+0000","last_clean_scrub_stamp":"2023-12-13T00:28:44.147296+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:50:07.776088+0000","scrub_duration":0.00099350000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'7","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:46.241923+0000","last_change":"2023-12-13T00:28:46.241945+0000","last_active":"2023-12-13T00:28:46.241923+0000","last_peered":"2023-12-13T00:28:46.241923+0000","last_clean":"2023-12-13T00:28:46.241923+0000","last_became_active":"2023-12-13T00:00:30.000755+0000","last_became_peered":"2023-12-13T00:00:30.000755+0000","last_unstale":"2023-12-13T00:28:46.241923+0000","last_undegraded":"2023-12-13T00:28:46.241923+0000","last_fullsized":"2023-12-13T00:28:46.241923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:46.241866+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:46.241866+0000","last_clean_scrub_stamp":"2023-12-13T00:28:46.241866+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:57:37.680204+0000","scrub_duration":0.0021721430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'145","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:53.389094+0000","last_change":"2023-12-13T00:28:53.389113+0000","last_active":"2023-12-13T00:28:53.389094+0000","last_peered":"2023-12-13T00:28:53.389094+0000","last_clean":"2023-12-13T00:28:53.389094+0000","last_became_active":"2023-12-13T00:01:00.544906+0000","last_became_peered":"2023-12-13T00:01:00.544906+0000","last_unstale":"2023-12-13T00:28:53.389094+0000","last_undegraded":"2023-12-13T00:28:53.389094+0000","last_fullsized":"2023-12-13T00:28:53.389094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'145","last_scrub_stamp":"2023-12-13T00:28:53.389028+0000","last_deep_scrub":"27'145","last_deep_scrub_stamp":"2023-12-13T00:28:53.389028+0000","last_clean_scrub_stamp":"2023-12-13T00:28:53.389028+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:40:15.132704+0000","scrub_duration":0.0015357649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,5],"acting":[6,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:24.142032+0000","last_change":"2023-12-13T00:28:24.142076+0000","last_active":"2023-12-13T00:28:24.142032+0000","last_peered":"2023-12-13T00:28:24.142032+0000","last_clean":"2023-12-13T00:28:24.142032+0000","last_became_active":"2023-12-13T00:00:31.143182+0000","last_became_peered":"2023-12-13T00:00:31.143182+0000","last_unstale":"2023-12-13T00:28:24.142032+0000","last_undegraded":"2023-12-13T00:28:24.142032+0000","last_fullsized":"2023-12-13T00:28:24.142032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:24.141950+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:24.141950+0000","last_clean_scrub_stamp":"2023-12-13T00:28:24.141950+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:23:02.587212+0000","scrub_duration":0.0015258120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:35.452206+0000","last_change":"2023-12-13T00:28:35.452225+0000","last_active":"2023-12-13T00:28:35.452206+0000","last_peered":"2023-12-13T00:28:35.452206+0000","last_clean":"2023-12-13T00:28:35.452206+0000","last_became_active":"2023-12-13T00:00:29.968860+0000","last_became_peered":"2023-12-13T00:00:29.968860+0000","last_unstale":"2023-12-13T00:28:35.452206+0000","last_undegraded":"2023-12-13T00:28:35.452206+0000","last_fullsized":"2023-12-13T00:28:35.452206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-13T00:28:35.452139+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-13T00:28:35.452139+0000","last_clean_scrub_stamp":"2023-12-13T00:28:35.452139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:35:28.566025+0000","scrub_duration":0.00098817000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'163","reported_seq":200,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:49.276541+0000","last_change":"2023-12-13T00:28:49.276562+0000","last_active":"2023-12-13T00:28:49.276541+0000","last_peered":"2023-12-13T00:28:49.276541+0000","last_clean":"2023-12-13T00:28:49.276541+0000","last_became_active":"2023-12-13T00:00:35.642215+0000","last_became_peered":"2023-12-13T00:00:35.642215+0000","last_unstale":"2023-12-13T00:28:49.276541+0000","last_undegraded":"2023-12-13T00:28:49.276541+0000","last_fullsized":"2023-12-13T00:28:49.276541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'163","last_scrub_stamp":"2023-12-13T00:28:49.276460+0000","last_deep_scrub":"27'163","last_deep_scrub_stamp":"2023-12-13T00:28:49.276460+0000","last_clean_scrub_stamp":"2023-12-13T00:28:49.276460+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:40:36.202097+0000","scrub_duration":0.0018069290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":6488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'62","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.868003+0000","last_change":"2023-12-13T00:00:31.149832+0000","last_active":"2023-12-13T00:28:04.868003+0000","last_peered":"2023-12-13T00:28:04.868003+0000","last_clean":"2023-12-13T00:28:04.868003+0000","last_became_active":"2023-12-13T00:00:31.149587+0000","last_became_peered":"2023-12-13T00:00:31.149587+0000","last_unstale":"2023-12-13T00:28:04.868003+0000","last_undegraded":"2023-12-13T00:28:04.868003+0000","last_fullsized":"2023-12-13T00:28:04.868003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'793","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:53.376052+0000","last_change":"2023-12-13T00:28:53.376075+0000","last_active":"2023-12-13T00:28:53.376052+0000","last_peered":"2023-12-13T00:28:53.376052+0000","last_clean":"2023-12-13T00:28:53.376052+0000","last_became_active":"2023-12-13T00:00:29.997848+0000","last_became_peered":"2023-12-13T00:00:29.997848+0000","last_unstale":"2023-12-13T00:28:53.376052+0000","last_undegraded":"2023-12-13T00:28:53.376052+0000","last_fullsized":"2023-12-13T00:28:53.376052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'793","last_scrub_stamp":"2023-12-13T00:28:53.375997+0000","last_deep_scrub":"27'793","last_deep_scrub_stamp":"2023-12-13T00:28:53.375997+0000","last_clean_scrub_stamp":"2023-12-13T00:28:53.375997+0000","objects_scrubbed":1,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:18:55.892407+0000","scrub_duration":0.010981958,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":4476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'121","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:45.165260+0000","last_change":"2023-12-13T00:28:45.165299+0000","last_active":"2023-12-13T00:28:45.165260+0000","last_peered":"2023-12-13T00:28:45.165260+0000","last_clean":"2023-12-13T00:28:45.165260+0000","last_became_active":"2023-12-13T00:00:35.651766+0000","last_became_peered":"2023-12-13T00:00:35.651766+0000","last_unstale":"2023-12-13T00:28:45.165260+0000","last_undegraded":"2023-12-13T00:28:45.165260+0000","last_fullsized":"2023-12-13T00:28:45.165260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'121","last_scrub_stamp":"2023-12-13T00:28:45.165150+0000","last_deep_scrub":"27'121","last_deep_scrub_stamp":"2023-12-13T00:28:45.165150+0000","last_clean_scrub_stamp":"2023-12-13T00:28:45.165150+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:14:35.008693+0000","scrub_duration":0.0018200479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":7468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'58","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.804233+0000","last_change":"2023-12-13T00:00:31.120580+0000","last_active":"2023-12-13T00:28:18.804233+0000","last_peered":"2023-12-13T00:28:18.804233+0000","last_clean":"2023-12-13T00:28:18.804233+0000","last_became_active":"2023-12-13T00:00:31.120330+0000","last_became_peered":"2023-12-13T00:00:31.120330+0000","last_unstale":"2023-12-13T00:28:18.804233+0000","last_undegraded":"2023-12-13T00:28:18.804233+0000","last_fullsized":"2023-12-13T00:28:18.804233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'412","reported_seq":758,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:26.117195+0000","last_change":"2023-12-13T00:28:26.117217+0000","last_active":"2023-12-13T00:28:26.117195+0000","last_peered":"2023-12-13T00:28:26.117195+0000","last_clean":"2023-12-13T00:28:26.117195+0000","last_became_active":"2023-12-13T00:00:30.000015+0000","last_became_peered":"2023-12-13T00:00:30.000015+0000","last_unstale":"2023-12-13T00:28:26.117195+0000","last_undegraded":"2023-12-13T00:28:26.117195+0000","last_fullsized":"2023-12-13T00:28:26.117195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'412","last_scrub_stamp":"2023-12-13T00:28:26.117130+0000","last_deep_scrub":"27'412","last_deep_scrub_stamp":"2023-12-13T00:28:26.117130+0000","last_clean_scrub_stamp":"2023-12-13T00:28:26.117130+0000","objects_scrubbed":3,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:30:24.978930+0000","scrub_duration":0.002759671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58234,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":306,"num_read_kb":318,"num_write":408,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'147","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:51.300520+0000","last_change":"2023-12-13T00:28:51.300541+0000","last_active":"2023-12-13T00:28:51.300520+0000","last_peered":"2023-12-13T00:28:51.300520+0000","last_clean":"2023-12-13T00:28:51.300520+0000","last_became_active":"2023-12-13T00:00:35.667028+0000","last_became_peered":"2023-12-13T00:00:35.667028+0000","last_unstale":"2023-12-13T00:28:51.300520+0000","last_undegraded":"2023-12-13T00:28:51.300520+0000","last_fullsized":"2023-12-13T00:28:51.300520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'147","last_scrub_stamp":"2023-12-13T00:28:51.300454+0000","last_deep_scrub":"27'147","last_deep_scrub_stamp":"2023-12-13T00:28:51.300454+0000","last_clean_scrub_stamp":"2023-12-13T00:28:51.300454+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:17:24.312250+0000","scrub_duration":0.001522614,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":5383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'60","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:43.144047+0000","last_change":"2023-12-13T00:28:43.144086+0000","last_active":"2023-12-13T00:28:43.144047+0000","last_peered":"2023-12-13T00:28:43.144047+0000","last_clean":"2023-12-13T00:28:43.144047+0000","last_became_active":"2023-12-13T00:00:31.140597+0000","last_became_peered":"2023-12-13T00:00:31.140597+0000","last_unstale":"2023-12-13T00:28:43.144047+0000","last_undegraded":"2023-12-13T00:28:43.144047+0000","last_fullsized":"2023-12-13T00:28:43.144047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'60","last_scrub_stamp":"2023-12-13T00:28:43.143962+0000","last_deep_scrub":"27'60","last_deep_scrub_stamp":"2023-12-13T00:28:43.143962+0000","last_clean_scrub_stamp":"2023-12-13T00:28:43.143962+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:22:40.210116+0000","scrub_duration":0.001118927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'7","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:48.319830+0000","last_change":"2023-12-13T00:28:48.319856+0000","last_active":"2023-12-13T00:28:48.319830+0000","last_peered":"2023-12-13T00:28:48.319830+0000","last_clean":"2023-12-13T00:28:48.319830+0000","last_became_active":"2023-12-13T00:00:29.998552+0000","last_became_peered":"2023-12-13T00:00:29.998552+0000","last_unstale":"2023-12-13T00:28:48.319830+0000","last_undegraded":"2023-12-13T00:28:48.319830+0000","last_fullsized":"2023-12-13T00:28:48.319830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:48.319762+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:48.319762+0000","last_clean_scrub_stamp":"2023-12-13T00:28:48.319762+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:56:31.750088+0000","scrub_duration":0.0023572189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'127","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.804268+0000","last_change":"2023-12-13T00:00:35.666575+0000","last_active":"2023-12-13T00:28:18.804268+0000","last_peered":"2023-12-13T00:28:18.804268+0000","last_clean":"2023-12-13T00:28:18.804268+0000","last_became_active":"2023-12-13T00:00:35.666135+0000","last_became_peered":"2023-12-13T00:00:35.666135+0000","last_unstale":"2023-12-13T00:28:18.804268+0000","last_undegraded":"2023-12-13T00:28:18.804268+0000","last_fullsized":"2023-12-13T00:28:18.804268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":7535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'49","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.832991+0000","last_change":"2023-12-13T00:00:31.148698+0000","last_active":"2023-12-13T00:28:04.832991+0000","last_peered":"2023-12-13T00:28:04.832991+0000","last_clean":"2023-12-13T00:28:04.832991+0000","last_became_active":"2023-12-13T00:00:31.148421+0000","last_became_peered":"2023-12-13T00:00:31.148421+0000","last_unstale":"2023-12-13T00:28:04.832991+0000","last_undegraded":"2023-12-13T00:28:04.832991+0000","last_fullsized":"2023-12-13T00:28:04.832991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'8","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:54.366080+0000","last_change":"2023-12-13T00:28:54.366124+0000","last_active":"2023-12-13T00:28:54.366080+0000","last_peered":"2023-12-13T00:28:54.366080+0000","last_clean":"2023-12-13T00:28:54.366080+0000","last_became_active":"2023-12-13T00:00:30.000854+0000","last_became_peered":"2023-12-13T00:00:30.000854+0000","last_unstale":"2023-12-13T00:28:54.366080+0000","last_undegraded":"2023-12-13T00:28:54.366080+0000","last_fullsized":"2023-12-13T00:28:54.366080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2023-12-13T00:28:54.365977+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2023-12-13T00:28:54.365977+0000","last_clean_scrub_stamp":"2023-12-13T00:28:54.365977+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:08:15.266525+0000","scrub_duration":0.0028323900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:15.904956+0000","last_change":"2023-12-13T00:28:15.904996+0000","last_active":"2023-12-13T00:28:15.904956+0000","last_peered":"2023-12-13T00:28:15.904956+0000","last_clean":"2023-12-13T00:28:15.904956+0000","last_became_active":"2023-12-13T00:00:08.574464+0000","last_became_peered":"2023-12-13T00:00:08.574464+0000","last_unstale":"2023-12-13T00:28:15.904956+0000","last_undegraded":"2023-12-13T00:28:15.904956+0000","last_fullsized":"2023-12-13T00:28:15.904956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2023-12-13T00:28:15.904877+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2023-12-13T00:28:15.904877+0000","last_clean_scrub_stamp":"2023-12-13T00:28:15.904877+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:36:22.553417+0000","scrub_duration":0.0040292729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'166","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:48.962635+0000","last_change":"2023-12-13T00:00:35.661806+0000","last_active":"2023-12-13T00:27:48.962635+0000","last_peered":"2023-12-13T00:27:48.962635+0000","last_clean":"2023-12-13T00:27:48.962635+0000","last_became_active":"2023-12-13T00:00:35.660976+0000","last_became_peered":"2023-12-13T00:00:35.660976+0000","last_unstale":"2023-12-13T00:27:48.962635+0000","last_undegraded":"2023-12-13T00:27:48.962635+0000","last_fullsized":"2023-12-13T00:27:48.962635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":12423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'58","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:58.323239+0000","last_change":"2023-12-13T00:28:58.323281+0000","last_active":"2023-12-13T00:28:58.323239+0000","last_peered":"2023-12-13T00:28:58.323239+0000","last_clean":"2023-12-13T00:28:58.323239+0000","last_became_active":"2023-12-13T00:00:31.036127+0000","last_became_peered":"2023-12-13T00:00:31.036127+0000","last_unstale":"2023-12-13T00:28:58.323239+0000","last_undegraded":"2023-12-13T00:28:58.323239+0000","last_fullsized":"2023-12-13T00:28:58.323239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-12-13T00:28:58.323160+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-12-13T00:28:58.323160+0000","last_clean_scrub_stamp":"2023-12-13T00:28:58.323160+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:25:14.317802+0000","scrub_duration":0.001107993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:32.127657+0000","last_change":"2023-12-13T00:28:32.127692+0000","last_active":"2023-12-13T00:28:32.127657+0000","last_peered":"2023-12-13T00:28:32.127657+0000","last_clean":"2023-12-13T00:28:32.127657+0000","last_became_active":"2023-12-13T00:00:30.005943+0000","last_became_peered":"2023-12-13T00:00:30.005943+0000","last_unstale":"2023-12-13T00:28:32.127657+0000","last_undegraded":"2023-12-13T00:28:32.127657+0000","last_fullsized":"2023-12-13T00:28:32.127657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2023-12-13T00:28:32.127578+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2023-12-13T00:28:32.127578+0000","last_clean_scrub_stamp":"2023-12-13T00:28:32.127578+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:51:20.859478+0000","scrub_duration":0.0026550509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'164","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:42.160309+0000","last_change":"2023-12-13T00:28:42.160309+0000","last_active":"2023-12-13T00:28:42.160309+0000","last_peered":"2023-12-13T00:28:42.160309+0000","last_clean":"2023-12-13T00:28:42.160309+0000","last_became_active":"2023-12-13T00:00:35.664071+0000","last_became_peered":"2023-12-13T00:00:35.664071+0000","last_unstale":"2023-12-13T00:28:42.160309+0000","last_undegraded":"2023-12-13T00:28:42.160309+0000","last_fullsized":"2023-12-13T00:28:42.160309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'164","last_scrub_stamp":"2023-12-13T00:28:42.160213+0000","last_deep_scrub":"27'164","last_deep_scrub_stamp":"2023-12-13T00:28:42.160213+0000","last_clean_scrub_stamp":"2023-12-13T00:28:42.160213+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:14:39.060151+0000","scrub_duration":0.0016151290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":5432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'59","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.873970+0000","last_change":"2023-12-13T00:00:31.147760+0000","last_active":"2023-12-13T00:28:04.873970+0000","last_peered":"2023-12-13T00:28:04.873970+0000","last_clean":"2023-12-13T00:28:04.873970+0000","last_became_active":"2023-12-13T00:00:31.147523+0000","last_became_peered":"2023-12-13T00:00:31.147523+0000","last_unstale":"2023-12-13T00:28:04.873970+0000","last_undegraded":"2023-12-13T00:28:04.873970+0000","last_fullsized":"2023-12-13T00:28:04.873970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:41.555126+0000","last_change":"2023-12-13T00:28:41.555161+0000","last_active":"2023-12-13T00:28:41.555126+0000","last_peered":"2023-12-13T00:28:41.555126+0000","last_clean":"2023-12-13T00:28:41.555126+0000","last_became_active":"2023-12-13T00:00:30.002427+0000","last_became_peered":"2023-12-13T00:00:30.002427+0000","last_unstale":"2023-12-13T00:28:41.555126+0000","last_undegraded":"2023-12-13T00:28:41.555126+0000","last_fullsized":"2023-12-13T00:28:41.555126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2023-12-13T00:28:41.555034+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2023-12-13T00:28:41.555034+0000","last_clean_scrub_stamp":"2023-12-13T00:28:41.555034+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:13:56.431900+0000","scrub_duration":0.0022469870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'177","reported_seq":205,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:35.503794+0000","last_change":"2023-12-13T00:00:35.661309+0000","last_active":"2023-12-13T00:27:35.503794+0000","last_peered":"2023-12-13T00:27:35.503794+0000","last_clean":"2023-12-13T00:27:35.503794+0000","last_became_active":"2023-12-13T00:00:35.660939+0000","last_became_peered":"2023-12-13T00:00:35.660939+0000","last_unstale":"2023-12-13T00:27:35.503794+0000","last_undegraded":"2023-12-13T00:27:35.503794+0000","last_fullsized":"2023-12-13T00:27:35.503794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":11316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'64","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.872215+0000","last_change":"2023-12-13T00:00:31.146265+0000","last_active":"2023-12-13T00:28:04.872215+0000","last_peered":"2023-12-13T00:28:04.872215+0000","last_clean":"2023-12-13T00:28:04.872215+0000","last_became_active":"2023-12-13T00:00:31.145997+0000","last_became_peered":"2023-12-13T00:00:31.145997+0000","last_unstale":"2023-12-13T00:28:04.872215+0000","last_undegraded":"2023-12-13T00:28:04.872215+0000","last_fullsized":"2023-12-13T00:28:04.872215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'7","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:41.954922+0000","last_change":"2023-12-13T00:28:41.954942+0000","last_active":"2023-12-13T00:28:41.954922+0000","last_peered":"2023-12-13T00:28:41.954922+0000","last_clean":"2023-12-13T00:28:41.954922+0000","last_became_active":"2023-12-13T00:00:29.967916+0000","last_became_peered":"2023-12-13T00:00:29.967916+0000","last_unstale":"2023-12-13T00:28:41.954922+0000","last_undegraded":"2023-12-13T00:28:41.954922+0000","last_fullsized":"2023-12-13T00:28:41.954922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:41.954861+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:41.954861+0000","last_clean_scrub_stamp":"2023-12-13T00:28:41.954861+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:49:34.653049+0000","scrub_duration":0.0018726369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'137","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:17.322998+0000","last_change":"2023-12-13T00:00:35.667745+0000","last_active":"2023-12-13T00:28:17.322998+0000","last_peered":"2023-12-13T00:28:17.322998+0000","last_clean":"2023-12-13T00:28:17.322998+0000","last_became_active":"2023-12-13T00:00:35.666891+0000","last_became_peered":"2023-12-13T00:00:35.666891+0000","last_unstale":"2023-12-13T00:28:17.322998+0000","last_undegraded":"2023-12-13T00:28:17.322998+0000","last_fullsized":"2023-12-13T00:28:17.322998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":9622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'54","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:26.150820+0000","last_change":"2023-12-13T00:28:26.150842+0000","last_active":"2023-12-13T00:28:26.150820+0000","last_peered":"2023-12-13T00:28:26.150820+0000","last_clean":"2023-12-13T00:28:26.150820+0000","last_became_active":"2023-12-13T00:00:31.148016+0000","last_became_peered":"2023-12-13T00:00:31.148016+0000","last_unstale":"2023-12-13T00:28:26.150820+0000","last_undegraded":"2023-12-13T00:28:26.150820+0000","last_fullsized":"2023-12-13T00:28:26.150820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2023-12-13T00:28:26.150748+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2023-12-13T00:28:26.150748+0000","last_clean_scrub_stamp":"2023-12-13T00:28:26.150748+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:33:21.472115+0000","scrub_duration":0.00095305200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'291","reported_seq":330,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:42.164800+0000","last_change":"2023-12-13T00:28:42.164841+0000","last_active":"2023-12-13T00:28:42.164800+0000","last_peered":"2023-12-13T00:28:42.164800+0000","last_clean":"2023-12-13T00:28:42.164800+0000","last_became_active":"2023-12-13T00:00:30.007907+0000","last_became_peered":"2023-12-13T00:00:30.007907+0000","last_unstale":"2023-12-13T00:28:42.164800+0000","last_undegraded":"2023-12-13T00:28:42.164800+0000","last_fullsized":"2023-12-13T00:28:42.164800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'291","last_scrub_stamp":"2023-12-13T00:28:42.164728+0000","last_deep_scrub":"27'291","last_deep_scrub_stamp":"2023-12-13T00:28:42.164728+0000","last_clean_scrub_stamp":"2023-12-13T00:28:42.164728+0000","objects_scrubbed":2,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:34:33.906063+0000","scrub_duration":0.00265343,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'132","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:41.917153+0000","last_change":"2023-12-13T00:28:41.917153+0000","last_active":"2023-12-13T00:28:41.917153+0000","last_peered":"2023-12-13T00:28:41.917153+0000","last_clean":"2023-12-13T00:28:41.917153+0000","last_became_active":"2023-12-13T00:00:35.660627+0000","last_became_peered":"2023-12-13T00:00:35.660627+0000","last_unstale":"2023-12-13T00:28:41.917153+0000","last_undegraded":"2023-12-13T00:28:41.917153+0000","last_fullsized":"2023-12-13T00:28:41.917153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'132","last_scrub_stamp":"2023-12-13T00:28:41.916997+0000","last_deep_scrub":"27'132","last_deep_scrub_stamp":"2023-12-13T00:28:41.916997+0000","last_clean_scrub_stamp":"2023-12-13T00:28:41.916997+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:02:51.470194+0000","scrub_duration":0.0017199540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":10143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'55","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:19.224564+0000","last_change":"2023-12-13T00:28:19.224564+0000","last_active":"2023-12-13T00:28:19.224564+0000","last_peered":"2023-12-13T00:28:19.224564+0000","last_clean":"2023-12-13T00:28:19.224564+0000","last_became_active":"2023-12-13T00:00:31.142150+0000","last_became_peered":"2023-12-13T00:00:31.142150+0000","last_unstale":"2023-12-13T00:28:19.224564+0000","last_undegraded":"2023-12-13T00:28:19.224564+0000","last_fullsized":"2023-12-13T00:28:19.224564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2023-12-13T00:28:19.224487+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2023-12-13T00:28:19.224487+0000","last_clean_scrub_stamp":"2023-12-13T00:28:19.224487+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:22:16.290641+0000","scrub_duration":0.00092248000000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'806","reported_seq":845,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:40.006646+0000","last_change":"2023-12-13T00:28:40.006677+0000","last_active":"2023-12-13T00:28:40.006646+0000","last_peered":"2023-12-13T00:28:40.006646+0000","last_clean":"2023-12-13T00:28:40.006646+0000","last_became_active":"2023-12-13T00:00:30.000388+0000","last_became_peered":"2023-12-13T00:00:30.000388+0000","last_unstale":"2023-12-13T00:28:40.006646+0000","last_undegraded":"2023-12-13T00:28:40.006646+0000","last_fullsized":"2023-12-13T00:28:40.006646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'806","last_scrub_stamp":"2023-12-13T00:28:40.006581+0000","last_deep_scrub":"27'806","last_deep_scrub_stamp":"2023-12-13T00:28:40.006581+0000","last_clean_scrub_stamp":"2023-12-13T00:28:40.006581+0000","objects_scrubbed":9,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:33:57.889707+0000","scrub_duration":0.009767141,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277997,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'170","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.931405+0000","last_change":"2023-12-13T00:00:35.666659+0000","last_active":"2023-12-13T00:27:31.931405+0000","last_peered":"2023-12-13T00:27:31.931405+0000","last_clean":"2023-12-13T00:27:31.931405+0000","last_became_active":"2023-12-13T00:00:35.666304+0000","last_became_peered":"2023-12-13T00:00:35.666304+0000","last_unstale":"2023-12-13T00:27:31.931405+0000","last_undegraded":"2023-12-13T00:27:31.931405+0000","last_fullsized":"2023-12-13T00:27:31.931405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":11255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'48","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:34.826516+0000","last_change":"2023-12-13T00:28:34.826536+0000","last_active":"2023-12-13T00:28:34.826516+0000","last_peered":"2023-12-13T00:28:34.826516+0000","last_clean":"2023-12-13T00:28:34.826516+0000","last_became_active":"2023-12-13T00:00:31.037398+0000","last_became_peered":"2023-12-13T00:00:31.037398+0000","last_unstale":"2023-12-13T00:28:34.826516+0000","last_undegraded":"2023-12-13T00:28:34.826516+0000","last_fullsized":"2023-12-13T00:28:34.826516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2023-12-13T00:28:34.826451+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2023-12-13T00:28:34.826451+0000","last_clean_scrub_stamp":"2023-12-13T00:28:34.826451+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:59:15.682252+0000","scrub_duration":0.001357818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'1357","reported_seq":1396,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:41.198342+0000","last_change":"2023-12-13T00:28:41.198366+0000","last_active":"2023-12-13T00:28:41.198342+0000","last_peered":"2023-12-13T00:28:41.198342+0000","last_clean":"2023-12-13T00:28:41.198342+0000","last_became_active":"2023-12-13T00:00:30.005752+0000","last_became_peered":"2023-12-13T00:00:30.005752+0000","last_unstale":"2023-12-13T00:28:41.198342+0000","last_undegraded":"2023-12-13T00:28:41.198342+0000","last_fullsized":"2023-12-13T00:28:41.198342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1357","last_scrub_stamp":"2023-12-13T00:28:41.198286+0000","last_deep_scrub":"27'1357","last_deep_scrub_stamp":"2023-12-13T00:28:41.198286+0000","last_clean_scrub_stamp":"2023-12-13T00:28:41.198286+0000","objects_scrubbed":2,"log_size":1357,"log_dups_size":0,"ondisk_log_size":1357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:13:56.075151+0000","scrub_duration":0.012562190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1349,"num_write_kb":4734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'175","reported_seq":202,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.824402+0000","last_change":"2023-12-13T00:00:35.666467+0000","last_active":"2023-12-13T00:27:29.824402+0000","last_peered":"2023-12-13T00:27:29.824402+0000","last_clean":"2023-12-13T00:27:29.824402+0000","last_became_active":"2023-12-13T00:00:35.666061+0000","last_became_peered":"2023-12-13T00:00:35.666061+0000","last_unstale":"2023-12-13T00:27:29.824402+0000","last_undegraded":"2023-12-13T00:27:29.824402+0000","last_fullsized":"2023-12-13T00:27:29.824402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":9890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'68","reported_seq":113,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:38.158958+0000","last_change":"2023-12-13T00:28:38.158977+0000","last_active":"2023-12-13T00:28:38.158958+0000","last_peered":"2023-12-13T00:28:38.158958+0000","last_clean":"2023-12-13T00:28:38.158958+0000","last_became_active":"2023-12-13T00:01:00.702089+0000","last_became_peered":"2023-12-13T00:01:00.702089+0000","last_unstale":"2023-12-13T00:28:38.158958+0000","last_undegraded":"2023-12-13T00:28:38.158958+0000","last_fullsized":"2023-12-13T00:28:38.158958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'68","last_scrub_stamp":"2023-12-13T00:28:38.158895+0000","last_deep_scrub":"27'68","last_deep_scrub_stamp":"2023-12-13T00:28:38.158895+0000","last_clean_scrub_stamp":"2023-12-13T00:28:38.158895+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:39:59.902571+0000","scrub_duration":0.001233034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'395","reported_seq":434,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:49.337548+0000","last_change":"2023-12-13T00:28:49.337585+0000","last_active":"2023-12-13T00:28:49.337548+0000","last_peered":"2023-12-13T00:28:49.337548+0000","last_clean":"2023-12-13T00:28:49.337548+0000","last_became_active":"2023-12-13T00:00:30.000803+0000","last_became_peered":"2023-12-13T00:00:30.000803+0000","last_unstale":"2023-12-13T00:28:49.337548+0000","last_undegraded":"2023-12-13T00:28:49.337548+0000","last_fullsized":"2023-12-13T00:28:49.337548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'395","last_scrub_stamp":"2023-12-13T00:28:49.337458+0000","last_deep_scrub":"27'395","last_deep_scrub_stamp":"2023-12-13T00:28:49.337458+0000","last_clean_scrub_stamp":"2023-12-13T00:28:49.337458+0000","objects_scrubbed":2,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:21:10.689739+0000","scrub_duration":0.0083268639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2931508,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":386,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'176","reported_seq":212,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:46.186772+0000","last_change":"2023-12-13T00:28:46.186793+0000","last_active":"2023-12-13T00:28:46.186772+0000","last_peered":"2023-12-13T00:28:46.186772+0000","last_clean":"2023-12-13T00:28:46.186772+0000","last_became_active":"2023-12-13T00:00:35.649151+0000","last_became_peered":"2023-12-13T00:00:35.649151+0000","last_unstale":"2023-12-13T00:28:46.186772+0000","last_undegraded":"2023-12-13T00:28:46.186772+0000","last_fullsized":"2023-12-13T00:28:46.186772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'176","last_scrub_stamp":"2023-12-13T00:28:46.186698+0000","last_deep_scrub":"27'176","last_deep_scrub_stamp":"2023-12-13T00:28:46.186698+0000","last_clean_scrub_stamp":"2023-12-13T00:28:46.186698+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:03:58.809328+0000","scrub_duration":0.0016794010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'60","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:36.237979+0000","last_change":"2023-12-13T00:28:36.238000+0000","last_active":"2023-12-13T00:28:36.237979+0000","last_peered":"2023-12-13T00:28:36.237979+0000","last_clean":"2023-12-13T00:28:36.237979+0000","last_became_active":"2023-12-13T00:00:31.115678+0000","last_became_peered":"2023-12-13T00:00:31.115678+0000","last_unstale":"2023-12-13T00:28:36.237979+0000","last_undegraded":"2023-12-13T00:28:36.237979+0000","last_fullsized":"2023-12-13T00:28:36.237979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'60","last_scrub_stamp":"2023-12-13T00:28:36.237907+0000","last_deep_scrub":"27'60","last_deep_scrub_stamp":"2023-12-13T00:28:36.237907+0000","last_clean_scrub_stamp":"2023-12-13T00:28:36.237907+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:50:24.671743+0000","scrub_duration":0.001189753,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'15","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:32.043769+0000","last_change":"2023-12-13T00:28:32.043793+0000","last_active":"2023-12-13T00:28:32.043769+0000","last_peered":"2023-12-13T00:28:32.043769+0000","last_clean":"2023-12-13T00:28:32.043769+0000","last_became_active":"2023-12-13T00:00:30.004089+0000","last_became_peered":"2023-12-13T00:00:30.004089+0000","last_unstale":"2023-12-13T00:28:32.043769+0000","last_undegraded":"2023-12-13T00:28:32.043769+0000","last_fullsized":"2023-12-13T00:28:32.043769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2023-12-13T00:28:32.043698+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2023-12-13T00:28:32.043698+0000","last_clean_scrub_stamp":"2023-12-13T00:28:32.043698+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:59:12.899499+0000","scrub_duration":0.0033306949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'148","reported_seq":175,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.559260+0000","last_change":"2023-12-13T00:00:35.652272+0000","last_active":"2023-12-13T00:27:29.559260+0000","last_peered":"2023-12-13T00:27:29.559260+0000","last_clean":"2023-12-13T00:27:29.559260+0000","last_became_active":"2023-12-13T00:00:35.651907+0000","last_became_peered":"2023-12-13T00:00:35.651907+0000","last_unstale":"2023-12-13T00:27:29.559260+0000","last_undegraded":"2023-12-13T00:27:29.559260+0000","last_fullsized":"2023-12-13T00:27:29.559260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":7909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'46","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.865955+0000","last_change":"2023-12-13T00:00:31.148754+0000","last_active":"2023-12-13T00:28:04.865955+0000","last_peered":"2023-12-13T00:28:04.865955+0000","last_clean":"2023-12-13T00:28:04.865955+0000","last_became_active":"2023-12-13T00:00:31.147846+0000","last_became_peered":"2023-12-13T00:00:31.147846+0000","last_unstale":"2023-12-13T00:28:04.865955+0000","last_undegraded":"2023-12-13T00:28:04.865955+0000","last_fullsized":"2023-12-13T00:28:04.865955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'1477","reported_seq":1516,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:19.181691+0000","last_change":"2023-12-13T00:28:19.181691+0000","last_active":"2023-12-13T00:28:19.181691+0000","last_peered":"2023-12-13T00:28:19.181691+0000","last_clean":"2023-12-13T00:28:19.181691+0000","last_became_active":"2023-12-13T00:00:30.001420+0000","last_became_peered":"2023-12-13T00:00:30.001420+0000","last_unstale":"2023-12-13T00:28:19.181691+0000","last_undegraded":"2023-12-13T00:28:19.181691+0000","last_fullsized":"2023-12-13T00:28:19.181691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1477","last_scrub_stamp":"2023-12-13T00:28:19.181611+0000","last_deep_scrub":"27'1477","last_deep_scrub_stamp":"2023-12-13T00:28:19.181611+0000","last_clean_scrub_stamp":"2023-12-13T00:28:19.181611+0000","objects_scrubbed":5,"log_size":1477,"log_dups_size":0,"ondisk_log_size":1477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:50:30.914232+0000","scrub_duration":0.013805400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1472,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'148","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.059832+0000","last_change":"2023-12-13T00:01:00.546607+0000","last_active":"2023-12-13T00:28:18.059832+0000","last_peered":"2023-12-13T00:28:18.059832+0000","last_clean":"2023-12-13T00:28:18.059832+0000","last_became_active":"2023-12-13T00:01:00.546264+0000","last_became_peered":"2023-12-13T00:01:00.546264+0000","last_unstale":"2023-12-13T00:28:18.059832+0000","last_undegraded":"2023-12-13T00:28:18.059832+0000","last_fullsized":"2023-12-13T00:28:18.059832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'60","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:27.237666+0000","last_change":"2023-12-13T00:28:27.237666+0000","last_active":"2023-12-13T00:28:27.237666+0000","last_peered":"2023-12-13T00:28:27.237666+0000","last_clean":"2023-12-13T00:28:27.237666+0000","last_became_active":"2023-12-13T00:00:31.138723+0000","last_became_peered":"2023-12-13T00:00:31.138723+0000","last_unstale":"2023-12-13T00:28:27.237666+0000","last_undegraded":"2023-12-13T00:28:27.237666+0000","last_fullsized":"2023-12-13T00:28:27.237666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'60","last_scrub_stamp":"2023-12-13T00:28:27.237585+0000","last_deep_scrub":"27'60","last_deep_scrub_stamp":"2023-12-13T00:28:27.237585+0000","last_clean_scrub_stamp":"2023-12-13T00:28:27.237585+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:53:27.429911+0000","scrub_duration":0.000960584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'220","reported_seq":258,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:30.078636+0000","last_change":"2023-12-13T00:28:30.078699+0000","last_active":"2023-12-13T00:28:30.078636+0000","last_peered":"2023-12-13T00:28:30.078636+0000","last_clean":"2023-12-13T00:28:30.078636+0000","last_became_active":"2023-12-13T00:00:30.002823+0000","last_became_peered":"2023-12-13T00:00:30.002823+0000","last_unstale":"2023-12-13T00:28:30.078636+0000","last_undegraded":"2023-12-13T00:28:30.078636+0000","last_fullsized":"2023-12-13T00:28:30.078636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'220","last_scrub_stamp":"2023-12-13T00:28:30.078552+0000","last_deep_scrub":"27'220","last_deep_scrub_stamp":"2023-12-13T00:28:30.078552+0000","last_clean_scrub_stamp":"2023-12-13T00:28:30.078552+0000","objects_scrubbed":3,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:40:48.187335+0000","scrub_duration":0.0037294989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'219","reported_seq":264,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:52.223877+0000","last_change":"2023-12-13T00:28:52.223898+0000","last_active":"2023-12-13T00:28:52.223877+0000","last_peered":"2023-12-13T00:28:52.223877+0000","last_clean":"2023-12-13T00:28:52.223877+0000","last_became_active":"2023-12-13T00:01:00.697231+0000","last_became_peered":"2023-12-13T00:01:00.697231+0000","last_unstale":"2023-12-13T00:28:52.223877+0000","last_undegraded":"2023-12-13T00:28:52.223877+0000","last_fullsized":"2023-12-13T00:28:52.223877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'219","last_scrub_stamp":"2023-12-13T00:28:52.223810+0000","last_deep_scrub":"27'219","last_deep_scrub_stamp":"2023-12-13T00:28:52.223810+0000","last_clean_scrub_stamp":"2023-12-13T00:28:52.223810+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:50:31.544246+0000","scrub_duration":0.00158483,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":195,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'66","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:33.389091+0000","last_change":"2023-12-13T00:28:33.389111+0000","last_active":"2023-12-13T00:28:33.389091+0000","last_peered":"2023-12-13T00:28:33.389091+0000","last_clean":"2023-12-13T00:28:33.389091+0000","last_became_active":"2023-12-13T00:00:31.027239+0000","last_became_peered":"2023-12-13T00:00:31.027239+0000","last_unstale":"2023-12-13T00:28:33.389091+0000","last_undegraded":"2023-12-13T00:28:33.389091+0000","last_fullsized":"2023-12-13T00:28:33.389091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2023-12-13T00:28:33.389025+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2023-12-13T00:28:33.389025+0000","last_clean_scrub_stamp":"2023-12-13T00:28:33.389025+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:09:03.094471+0000","scrub_duration":0.001342815,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:38.193475+0000","last_change":"2023-12-13T00:28:38.193497+0000","last_active":"2023-12-13T00:28:38.193475+0000","last_peered":"2023-12-13T00:28:38.193475+0000","last_clean":"2023-12-13T00:28:38.193475+0000","last_became_active":"2023-12-13T00:00:30.009351+0000","last_became_peered":"2023-12-13T00:00:30.009351+0000","last_unstale":"2023-12-13T00:28:38.193475+0000","last_undegraded":"2023-12-13T00:28:38.193475+0000","last_fullsized":"2023-12-13T00:28:38.193475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2023-12-13T00:28:38.193420+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2023-12-13T00:28:38.193420+0000","last_clean_scrub_stamp":"2023-12-13T00:28:38.193420+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:34:55.196705+0000","scrub_duration":0.0019863580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'190","reported_seq":214,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:30.828933+0000","last_change":"2023-12-13T00:01:00.717446+0000","last_active":"2023-12-13T00:27:30.828933+0000","last_peered":"2023-12-13T00:27:30.828933+0000","last_clean":"2023-12-13T00:27:30.828933+0000","last_became_active":"2023-12-13T00:01:00.717019+0000","last_became_peered":"2023-12-13T00:01:00.717019+0000","last_unstale":"2023-12-13T00:27:30.828933+0000","last_undegraded":"2023-12-13T00:27:30.828933+0000","last_fullsized":"2023-12-13T00:27:30.828933+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":9378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"27'64","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:30.200435+0000","last_change":"2023-12-13T00:28:30.200455+0000","last_active":"2023-12-13T00:28:30.200435+0000","last_peered":"2023-12-13T00:28:30.200435+0000","last_clean":"2023-12-13T00:28:30.200435+0000","last_became_active":"2023-12-13T00:00:31.139656+0000","last_became_peered":"2023-12-13T00:00:31.139656+0000","last_unstale":"2023-12-13T00:28:30.200435+0000","last_undegraded":"2023-12-13T00:28:30.200435+0000","last_fullsized":"2023-12-13T00:28:30.200435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2023-12-13T00:28:30.200368+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2023-12-13T00:28:30.200368+0000","last_clean_scrub_stamp":"2023-12-13T00:28:30.200368+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:05:42.786288+0000","scrub_duration":0.0010289330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'84","reported_seq":122,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:21.916919+0000","last_change":"2023-12-13T00:28:21.916941+0000","last_active":"2023-12-13T00:28:21.916919+0000","last_peered":"2023-12-13T00:28:21.916919+0000","last_clean":"2023-12-13T00:28:21.916919+0000","last_became_active":"2023-12-13T00:00:30.002630+0000","last_became_peered":"2023-12-13T00:00:30.002630+0000","last_unstale":"2023-12-13T00:28:21.916919+0000","last_undegraded":"2023-12-13T00:28:21.916919+0000","last_fullsized":"2023-12-13T00:28:21.916919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'84","last_scrub_stamp":"2023-12-13T00:28:21.916861+0000","last_deep_scrub":"27'84","last_deep_scrub_stamp":"2023-12-13T00:28:21.916861+0000","last_clean_scrub_stamp":"2023-12-13T00:28:21.916861+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:34:21.020077+0000","scrub_duration":0.002537564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'123","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.059882+0000","last_change":"2023-12-13T00:00:35.649725+0000","last_active":"2023-12-13T00:28:18.059882+0000","last_peered":"2023-12-13T00:28:18.059882+0000","last_clean":"2023-12-13T00:28:18.059882+0000","last_became_active":"2023-12-13T00:00:35.649401+0000","last_became_peered":"2023-12-13T00:00:35.649401+0000","last_unstale":"2023-12-13T00:28:18.059882+0000","last_undegraded":"2023-12-13T00:28:18.059882+0000","last_fullsized":"2023-12-13T00:28:18.059882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":7272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'122","reported_seq":152,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.059886+0000","last_change":"2023-12-13T00:00:35.662790+0000","last_active":"2023-12-13T00:28:18.059886+0000","last_peered":"2023-12-13T00:28:18.059886+0000","last_clean":"2023-12-13T00:28:18.059886+0000","last_became_active":"2023-12-13T00:00:35.662406+0000","last_became_peered":"2023-12-13T00:00:35.662406+0000","last_unstale":"2023-12-13T00:28:18.059886+0000","last_undegraded":"2023-12-13T00:28:18.059886+0000","last_fullsized":"2023-12-13T00:28:18.059886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":7728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'66","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:42.928265+0000","last_change":"2023-12-13T00:28:42.928300+0000","last_active":"2023-12-13T00:28:42.928265+0000","last_peered":"2023-12-13T00:28:42.928265+0000","last_clean":"2023-12-13T00:28:42.928265+0000","last_became_active":"2023-12-13T00:00:31.142823+0000","last_became_peered":"2023-12-13T00:00:31.142823+0000","last_unstale":"2023-12-13T00:28:42.928265+0000","last_undegraded":"2023-12-13T00:28:42.928265+0000","last_fullsized":"2023-12-13T00:28:42.928265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2023-12-13T00:28:42.928203+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2023-12-13T00:28:42.928203+0000","last_clean_scrub_stamp":"2023-12-13T00:28:42.928203+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:50:06.556995+0000","scrub_duration":0.0010733419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:44.169296+0000","last_change":"2023-12-13T00:28:44.169330+0000","last_active":"2023-12-13T00:28:44.169296+0000","last_peered":"2023-12-13T00:28:44.169296+0000","last_clean":"2023-12-13T00:28:44.169296+0000","last_became_active":"2023-12-13T00:00:30.004496+0000","last_became_peered":"2023-12-13T00:00:30.004496+0000","last_unstale":"2023-12-13T00:28:44.169296+0000","last_undegraded":"2023-12-13T00:28:44.169296+0000","last_fullsized":"2023-12-13T00:28:44.169296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:44.169196+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:44.169196+0000","last_clean_scrub_stamp":"2023-12-13T00:28:44.169196+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:15:10.983277+0000","scrub_duration":0.0010496419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'188","reported_seq":217,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:43.961956+0000","last_change":"2023-12-13T00:00:35.666457+0000","last_active":"2023-12-13T00:27:43.961956+0000","last_peered":"2023-12-13T00:27:43.961956+0000","last_clean":"2023-12-13T00:27:43.961956+0000","last_became_active":"2023-12-13T00:00:35.666075+0000","last_became_peered":"2023-12-13T00:00:35.666075+0000","last_unstale":"2023-12-13T00:27:43.961956+0000","last_undegraded":"2023-12-13T00:27:43.961956+0000","last_fullsized":"2023-12-13T00:27:43.961956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":17531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'63","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:26.387168+0000","last_change":"2023-12-13T00:28:26.387186+0000","last_active":"2023-12-13T00:28:26.387168+0000","last_peered":"2023-12-13T00:28:26.387168+0000","last_clean":"2023-12-13T00:28:26.387168+0000","last_became_active":"2023-12-13T00:00:31.116209+0000","last_became_peered":"2023-12-13T00:00:31.116209+0000","last_unstale":"2023-12-13T00:28:26.387168+0000","last_undegraded":"2023-12-13T00:28:26.387168+0000","last_fullsized":"2023-12-13T00:28:26.387168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'63","last_scrub_stamp":"2023-12-13T00:28:26.387107+0000","last_deep_scrub":"27'63","last_deep_scrub_stamp":"2023-12-13T00:28:26.387107+0000","last_clean_scrub_stamp":"2023-12-13T00:28:26.387107+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:20:18.635398+0000","scrub_duration":0.00089511699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'486","reported_seq":1002,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:27.221032+0000","last_change":"2023-12-13T00:28:27.221072+0000","last_active":"2023-12-13T00:28:27.221032+0000","last_peered":"2023-12-13T00:28:27.221032+0000","last_clean":"2023-12-13T00:28:27.221032+0000","last_became_active":"2023-12-13T00:00:30.006026+0000","last_became_peered":"2023-12-13T00:00:30.006026+0000","last_unstale":"2023-12-13T00:28:27.221032+0000","last_undegraded":"2023-12-13T00:28:27.221032+0000","last_fullsized":"2023-12-13T00:28:27.221032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'486","last_scrub_stamp":"2023-12-13T00:28:27.220940+0000","last_deep_scrub":"27'486","last_deep_scrub_stamp":"2023-12-13T00:28:27.220940+0000","last_clean_scrub_stamp":"2023-12-13T00:28:27.220940+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:02:36.774137+0000","scrub_duration":0.003497904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92099,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":501,"num_write":481,"num_write_kb":501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'1033","reported_seq":1764,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:43.219768+0000","last_change":"2023-12-13T00:28:43.219796+0000","last_active":"2023-12-13T00:28:43.219768+0000","last_peered":"2023-12-13T00:28:43.219768+0000","last_clean":"2023-12-13T00:28:43.219768+0000","last_became_active":"2023-12-13T00:00:30.004214+0000","last_became_peered":"2023-12-13T00:00:30.004214+0000","last_unstale":"2023-12-13T00:28:43.219768+0000","last_undegraded":"2023-12-13T00:28:43.219768+0000","last_fullsized":"2023-12-13T00:28:43.219768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1033","last_scrub_stamp":"2023-12-13T00:28:43.219704+0000","last_deep_scrub":"27'1033","last_deep_scrub_stamp":"2023-12-13T00:28:43.219704+0000","last_clean_scrub_stamp":"2023-12-13T00:28:43.219704+0000","objects_scrubbed":3,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:57:11.700770+0000","scrub_duration":0.0078829299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1792997,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":693,"num_read_kb":705,"num_write":1026,"num_write_kb":2509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'68","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:48.916365+0000","last_change":"2023-12-13T00:28:48.916384+0000","last_active":"2023-12-13T00:28:48.916365+0000","last_peered":"2023-12-13T00:28:48.916365+0000","last_clean":"2023-12-13T00:28:48.916365+0000","last_became_active":"2023-12-13T00:00:31.146818+0000","last_became_peered":"2023-12-13T00:00:31.146818+0000","last_unstale":"2023-12-13T00:28:48.916365+0000","last_undegraded":"2023-12-13T00:28:48.916365+0000","last_fullsized":"2023-12-13T00:28:48.916365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'68","last_scrub_stamp":"2023-12-13T00:28:48.916293+0000","last_deep_scrub":"27'68","last_deep_scrub_stamp":"2023-12-13T00:28:48.916293+0000","last_clean_scrub_stamp":"2023-12-13T00:28:48.916293+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:55:21.504933+0000","scrub_duration":0.0013653420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'150","reported_seq":177,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:08.952320+0000","last_change":"2023-12-13T00:00:35.642485+0000","last_active":"2023-12-13T00:28:08.952320+0000","last_peered":"2023-12-13T00:28:08.952320+0000","last_clean":"2023-12-13T00:28:08.952320+0000","last_became_active":"2023-12-13T00:00:35.642114+0000","last_became_peered":"2023-12-13T00:00:35.642114+0000","last_unstale":"2023-12-13T00:28:08.952320+0000","last_undegraded":"2023-12-13T00:28:08.952320+0000","last_fullsized":"2023-12-13T00:28:08.952320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":10646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'2841","reported_seq":2879,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:37.492377+0000","last_change":"2023-12-13T00:28:37.492403+0000","last_active":"2023-12-13T00:28:37.492377+0000","last_peered":"2023-12-13T00:28:37.492377+0000","last_clean":"2023-12-13T00:28:37.492377+0000","last_became_active":"2023-12-13T00:00:29.972018+0000","last_became_peered":"2023-12-13T00:00:29.972018+0000","last_unstale":"2023-12-13T00:28:37.492377+0000","last_undegraded":"2023-12-13T00:28:37.492377+0000","last_fullsized":"2023-12-13T00:28:37.492377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2841","last_scrub_stamp":"2023-12-13T00:28:37.492311+0000","last_deep_scrub":"27'2841","last_deep_scrub_stamp":"2023-12-13T00:28:37.492311+0000","last_clean_scrub_stamp":"2023-12-13T00:28:37.492311+0000","objects_scrubbed":4,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:48:54.932186+0000","scrub_duration":0.032490435999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2827,"num_write_kb":13646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'70","reported_seq":107,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:36.841889+0000","last_change":"2023-12-13T00:28:36.841907+0000","last_active":"2023-12-13T00:28:36.841889+0000","last_peered":"2023-12-13T00:28:36.841889+0000","last_clean":"2023-12-13T00:28:36.841889+0000","last_became_active":"2023-12-13T00:00:31.037445+0000","last_became_peered":"2023-12-13T00:00:31.037445+0000","last_unstale":"2023-12-13T00:28:36.841889+0000","last_undegraded":"2023-12-13T00:28:36.841889+0000","last_fullsized":"2023-12-13T00:28:36.841889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'70","last_scrub_stamp":"2023-12-13T00:28:36.841827+0000","last_deep_scrub":"27'70","last_deep_scrub_stamp":"2023-12-13T00:28:36.841827+0000","last_clean_scrub_stamp":"2023-12-13T00:28:36.841827+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:32:13.405381+0000","scrub_duration":0.001030577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'116","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:52.979507+0000","last_change":"2023-12-13T00:28:52.979547+0000","last_active":"2023-12-13T00:28:52.979507+0000","last_peered":"2023-12-13T00:28:52.979507+0000","last_clean":"2023-12-13T00:28:52.979507+0000","last_became_active":"2023-12-13T00:00:35.660984+0000","last_became_peered":"2023-12-13T00:00:35.660984+0000","last_unstale":"2023-12-13T00:28:52.979507+0000","last_undegraded":"2023-12-13T00:28:52.979507+0000","last_fullsized":"2023-12-13T00:28:52.979507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'116","last_scrub_stamp":"2023-12-13T00:28:52.979429+0000","last_deep_scrub":"27'116","last_deep_scrub_stamp":"2023-12-13T00:28:52.979429+0000","last_clean_scrub_stamp":"2023-12-13T00:28:52.979429+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:42:34.764745+0000","scrub_duration":0.001495531,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":9076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:29.162461+0000","last_change":"2023-12-13T00:28:29.162479+0000","last_active":"2023-12-13T00:28:29.162461+0000","last_peered":"2023-12-13T00:28:29.162461+0000","last_clean":"2023-12-13T00:28:29.162461+0000","last_became_active":"2023-12-13T00:00:31.145225+0000","last_became_peered":"2023-12-13T00:00:31.145225+0000","last_unstale":"2023-12-13T00:28:29.162461+0000","last_undegraded":"2023-12-13T00:28:29.162461+0000","last_fullsized":"2023-12-13T00:28:29.162461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:29.162405+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:29.162405+0000","last_clean_scrub_stamp":"2023-12-13T00:28:29.162405+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:04:14.041159+0000","scrub_duration":0.001250794,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'66","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:39.122997+0000","last_change":"2023-12-13T00:28:39.123017+0000","last_active":"2023-12-13T00:28:39.122997+0000","last_peered":"2023-12-13T00:28:39.122997+0000","last_clean":"2023-12-13T00:28:39.122997+0000","last_became_active":"2023-12-13T00:00:31.119474+0000","last_became_peered":"2023-12-13T00:00:31.119474+0000","last_unstale":"2023-12-13T00:28:39.122997+0000","last_undegraded":"2023-12-13T00:28:39.122997+0000","last_fullsized":"2023-12-13T00:28:39.122997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2023-12-13T00:28:39.122931+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2023-12-13T00:28:39.122931+0000","last_clean_scrub_stamp":"2023-12-13T00:28:39.122931+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:35:21.951724+0000","scrub_duration":0.0011100109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'62","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:22.188610+0000","last_change":"2023-12-13T00:28:22.188630+0000","last_active":"2023-12-13T00:28:22.188610+0000","last_peered":"2023-12-13T00:28:22.188610+0000","last_clean":"2023-12-13T00:28:22.188610+0000","last_became_active":"2023-12-13T00:00:31.026922+0000","last_became_peered":"2023-12-13T00:00:31.026922+0000","last_unstale":"2023-12-13T00:28:22.188610+0000","last_undegraded":"2023-12-13T00:28:22.188610+0000","last_fullsized":"2023-12-13T00:28:22.188610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'62","last_scrub_stamp":"2023-12-13T00:28:22.188548+0000","last_deep_scrub":"27'62","last_deep_scrub_stamp":"2023-12-13T00:28:22.188548+0000","last_clean_scrub_stamp":"2023-12-13T00:28:22.188548+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:49:45.817340+0000","scrub_duration":0.00098737400000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'58","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:53.450911+0000","last_change":"2023-12-13T00:28:53.450930+0000","last_active":"2023-12-13T00:28:53.450911+0000","last_peered":"2023-12-13T00:28:53.450911+0000","last_clean":"2023-12-13T00:28:53.450911+0000","last_became_active":"2023-12-13T00:00:31.119685+0000","last_became_peered":"2023-12-13T00:00:31.119685+0000","last_unstale":"2023-12-13T00:28:53.450911+0000","last_undegraded":"2023-12-13T00:28:53.450911+0000","last_fullsized":"2023-12-13T00:28:53.450911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-12-13T00:28:53.450847+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-12-13T00:28:53.450847+0000","last_clean_scrub_stamp":"2023-12-13T00:28:53.450847+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:44:37.656495+0000","scrub_duration":0.0010318650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'45","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:40.262577+0000","last_change":"2023-12-13T00:28:40.262577+0000","last_active":"2023-12-13T00:28:40.262577+0000","last_peered":"2023-12-13T00:28:40.262577+0000","last_clean":"2023-12-13T00:28:40.262577+0000","last_became_active":"2023-12-13T00:00:31.150275+0000","last_became_peered":"2023-12-13T00:00:31.150275+0000","last_unstale":"2023-12-13T00:28:40.262577+0000","last_undegraded":"2023-12-13T00:28:40.262577+0000","last_fullsized":"2023-12-13T00:28:40.262577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-13T00:28:40.262455+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-13T00:28:40.262455+0000","last_clean_scrub_stamp":"2023-12-13T00:28:40.262455+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:33:58.145582+0000","scrub_duration":0.00145042,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'47","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:37.199211+0000","last_change":"2023-12-13T00:28:37.199211+0000","last_active":"2023-12-13T00:28:37.199211+0000","last_peered":"2023-12-13T00:28:37.199211+0000","last_clean":"2023-12-13T00:28:37.199211+0000","last_became_active":"2023-12-13T00:00:31.117409+0000","last_became_peered":"2023-12-13T00:00:31.117409+0000","last_unstale":"2023-12-13T00:28:37.199211+0000","last_undegraded":"2023-12-13T00:28:37.199211+0000","last_fullsized":"2023-12-13T00:28:37.199211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2023-12-13T00:28:37.199129+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2023-12-13T00:28:37.199129+0000","last_clean_scrub_stamp":"2023-12-13T00:28:37.199129+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:01:50.944562+0000","scrub_duration":0.0012582509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'59","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:36.226175+0000","last_change":"2023-12-13T00:28:36.226175+0000","last_active":"2023-12-13T00:28:36.226175+0000","last_peered":"2023-12-13T00:28:36.226175+0000","last_clean":"2023-12-13T00:28:36.226175+0000","last_became_active":"2023-12-13T00:00:31.141656+0000","last_became_peered":"2023-12-13T00:00:31.141656+0000","last_unstale":"2023-12-13T00:28:36.226175+0000","last_undegraded":"2023-12-13T00:28:36.226175+0000","last_fullsized":"2023-12-13T00:28:36.226175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'59","last_scrub_stamp":"2023-12-13T00:28:36.226090+0000","last_deep_scrub":"27'59","last_deep_scrub_stamp":"2023-12-13T00:28:36.226090+0000","last_clean_scrub_stamp":"2023-12-13T00:28:36.226090+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:49:10.922803+0000","scrub_duration":0.00088218499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'47","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.804196+0000","last_change":"2023-12-13T00:00:31.036263+0000","last_active":"2023-12-13T00:28:18.804196+0000","last_peered":"2023-12-13T00:28:18.804196+0000","last_clean":"2023-12-13T00:28:18.804196+0000","last_became_active":"2023-12-13T00:00:31.036113+0000","last_became_peered":"2023-12-13T00:00:31.036113+0000","last_unstale":"2023-12-13T00:28:18.804196+0000","last_undegraded":"2023-12-13T00:28:18.804196+0000","last_fullsized":"2023-12-13T00:28:18.804196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:29.241422+0000","last_change":"2023-12-13T00:28:29.241422+0000","last_active":"2023-12-13T00:28:29.241422+0000","last_peered":"2023-12-13T00:28:29.241422+0000","last_clean":"2023-12-13T00:28:29.241422+0000","last_became_active":"2023-12-13T00:00:31.026968+0000","last_became_peered":"2023-12-13T00:00:31.026968+0000","last_unstale":"2023-12-13T00:28:29.241422+0000","last_undegraded":"2023-12-13T00:28:29.241422+0000","last_fullsized":"2023-12-13T00:28:29.241422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:29.241340+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:29.241340+0000","last_clean_scrub_stamp":"2023-12-13T00:28:29.241340+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:15:31.650259+0000","scrub_duration":0.001146413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'71","reported_seq":109,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:51.503257+0000","last_change":"2023-12-13T00:28:51.503292+0000","last_active":"2023-12-13T00:28:51.503257+0000","last_peered":"2023-12-13T00:28:51.503257+0000","last_clean":"2023-12-13T00:28:51.503257+0000","last_became_active":"2023-12-13T00:00:31.138869+0000","last_became_peered":"2023-12-13T00:00:31.138869+0000","last_unstale":"2023-12-13T00:28:51.503257+0000","last_undegraded":"2023-12-13T00:28:51.503257+0000","last_fullsized":"2023-12-13T00:28:51.503257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'71","last_scrub_stamp":"2023-12-13T00:28:51.503181+0000","last_deep_scrub":"27'71","last_deep_scrub_stamp":"2023-12-13T00:28:51.503181+0000","last_clean_scrub_stamp":"2023-12-13T00:28:51.503181+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:08:04.701204+0000","scrub_duration":0.001225117,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'64","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:23.891788+0000","last_change":"2023-12-13T00:28:23.891810+0000","last_active":"2023-12-13T00:28:23.891788+0000","last_peered":"2023-12-13T00:28:23.891788+0000","last_clean":"2023-12-13T00:28:23.891788+0000","last_became_active":"2023-12-13T00:00:31.146264+0000","last_became_peered":"2023-12-13T00:00:31.146264+0000","last_unstale":"2023-12-13T00:28:23.891788+0000","last_undegraded":"2023-12-13T00:28:23.891788+0000","last_fullsized":"2023-12-13T00:28:23.891788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2023-12-13T00:28:23.891712+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2023-12-13T00:28:23.891712+0000","last_clean_scrub_stamp":"2023-12-13T00:28:23.891712+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:51:29.227897+0000","scrub_duration":0.001254544,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'68","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:21.053596+0000","last_change":"2023-12-13T00:28:21.053631+0000","last_active":"2023-12-13T00:28:21.053596+0000","last_peered":"2023-12-13T00:28:21.053596+0000","last_clean":"2023-12-13T00:28:21.053596+0000","last_became_active":"2023-12-13T00:00:31.143472+0000","last_became_peered":"2023-12-13T00:00:31.143472+0000","last_unstale":"2023-12-13T00:28:21.053596+0000","last_undegraded":"2023-12-13T00:28:21.053596+0000","last_fullsized":"2023-12-13T00:28:21.053596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'68","last_scrub_stamp":"2023-12-13T00:28:21.053523+0000","last_deep_scrub":"27'68","last_deep_scrub_stamp":"2023-12-13T00:28:21.053523+0000","last_clean_scrub_stamp":"2023-12-13T00:28:21.053523+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:02:30.606720+0000","scrub_duration":0.0014989020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'52","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:27.382187+0000","last_change":"2023-12-13T00:28:27.382226+0000","last_active":"2023-12-13T00:28:27.382187+0000","last_peered":"2023-12-13T00:28:27.382187+0000","last_clean":"2023-12-13T00:28:27.382187+0000","last_became_active":"2023-12-13T00:00:31.146159+0000","last_became_peered":"2023-12-13T00:00:31.146159+0000","last_unstale":"2023-12-13T00:28:27.382187+0000","last_undegraded":"2023-12-13T00:28:27.382187+0000","last_fullsized":"2023-12-13T00:28:27.382187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2023-12-13T00:28:27.382098+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2023-12-13T00:28:27.382098+0000","last_clean_scrub_stamp":"2023-12-13T00:28:27.382098+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:04:12.260853+0000","scrub_duration":0.001152623,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'67","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:57.334099+0000","last_change":"2023-12-13T00:28:57.334118+0000","last_active":"2023-12-13T00:28:57.334099+0000","last_peered":"2023-12-13T00:28:57.334099+0000","last_clean":"2023-12-13T00:28:57.334099+0000","last_became_active":"2023-12-13T00:00:31.143663+0000","last_became_peered":"2023-12-13T00:00:31.143663+0000","last_unstale":"2023-12-13T00:28:57.334099+0000","last_undegraded":"2023-12-13T00:28:57.334099+0000","last_fullsized":"2023-12-13T00:28:57.334099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'67","last_scrub_stamp":"2023-12-13T00:28:57.334032+0000","last_deep_scrub":"27'67","last_deep_scrub_stamp":"2023-12-13T00:28:57.334032+0000","last_clean_scrub_stamp":"2023-12-13T00:28:57.334032+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:56:51.246356+0000","scrub_duration":0.0013995189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'69","reported_seq":107,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:47.073022+0000","last_change":"2023-12-13T00:28:47.073043+0000","last_active":"2023-12-13T00:28:47.073022+0000","last_peered":"2023-12-13T00:28:47.073022+0000","last_clean":"2023-12-13T00:28:47.073022+0000","last_became_active":"2023-12-13T00:00:31.142067+0000","last_became_peered":"2023-12-13T00:00:31.142067+0000","last_unstale":"2023-12-13T00:28:47.073022+0000","last_undegraded":"2023-12-13T00:28:47.073022+0000","last_fullsized":"2023-12-13T00:28:47.073022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'69","last_scrub_stamp":"2023-12-13T00:28:47.072960+0000","last_deep_scrub":"27'69","last_deep_scrub_stamp":"2023-12-13T00:28:47.072960+0000","last_clean_scrub_stamp":"2023-12-13T00:28:47.072960+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:05:33.159119+0000","scrub_duration":0.0013398869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'51","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:17.322901+0000","last_change":"2023-12-13T00:00:31.146764+0000","last_active":"2023-12-13T00:28:17.322901+0000","last_peered":"2023-12-13T00:28:17.322901+0000","last_clean":"2023-12-13T00:28:17.322901+0000","last_became_active":"2023-12-13T00:00:31.146501+0000","last_became_peered":"2023-12-13T00:00:31.146501+0000","last_unstale":"2023-12-13T00:28:17.322901+0000","last_undegraded":"2023-12-13T00:28:17.322901+0000","last_fullsized":"2023-12-13T00:28:17.322901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'67","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:40.189909+0000","last_change":"2023-12-13T00:28:40.189927+0000","last_active":"2023-12-13T00:28:40.189909+0000","last_peered":"2023-12-13T00:28:40.189909+0000","last_clean":"2023-12-13T00:28:40.189909+0000","last_became_active":"2023-12-13T00:00:31.138738+0000","last_became_peered":"2023-12-13T00:00:31.138738+0000","last_unstale":"2023-12-13T00:28:40.189909+0000","last_undegraded":"2023-12-13T00:28:40.189909+0000","last_fullsized":"2023-12-13T00:28:40.189909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'67","last_scrub_stamp":"2023-12-13T00:28:40.189828+0000","last_deep_scrub":"27'67","last_deep_scrub_stamp":"2023-12-13T00:28:40.189828+0000","last_clean_scrub_stamp":"2023-12-13T00:28:40.189828+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:29:07.474756+0000","scrub_duration":0.00095464400000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'52","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:50.518152+0000","last_change":"2023-12-13T00:28:50.518190+0000","last_active":"2023-12-13T00:28:50.518152+0000","last_peered":"2023-12-13T00:28:50.518152+0000","last_clean":"2023-12-13T00:28:50.518152+0000","last_became_active":"2023-12-13T00:00:31.148251+0000","last_became_peered":"2023-12-13T00:00:31.148251+0000","last_unstale":"2023-12-13T00:28:50.518152+0000","last_undegraded":"2023-12-13T00:28:50.518152+0000","last_fullsized":"2023-12-13T00:28:50.518152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2023-12-13T00:28:50.518079+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2023-12-13T00:28:50.518079+0000","last_clean_scrub_stamp":"2023-12-13T00:28:50.518079+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:24:22.899572+0000","scrub_duration":0.0010737329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'58","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:38.176733+0000","last_change":"2023-12-13T00:28:38.176733+0000","last_active":"2023-12-13T00:28:38.176733+0000","last_peered":"2023-12-13T00:28:38.176733+0000","last_clean":"2023-12-13T00:28:38.176733+0000","last_became_active":"2023-12-13T00:00:31.117423+0000","last_became_peered":"2023-12-13T00:00:31.117423+0000","last_unstale":"2023-12-13T00:28:38.176733+0000","last_undegraded":"2023-12-13T00:28:38.176733+0000","last_fullsized":"2023-12-13T00:28:38.176733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-12-13T00:28:38.176651+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-12-13T00:28:38.176651+0000","last_clean_scrub_stamp":"2023-12-13T00:28:38.176651+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:31:57.197976+0000","scrub_duration":0.00092640599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'67","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:33.115979+0000","last_change":"2023-12-13T00:28:33.116013+0000","last_active":"2023-12-13T00:28:33.115979+0000","last_peered":"2023-12-13T00:28:33.115979+0000","last_clean":"2023-12-13T00:28:33.115979+0000","last_became_active":"2023-12-13T00:00:31.150324+0000","last_became_peered":"2023-12-13T00:00:31.150324+0000","last_unstale":"2023-12-13T00:28:33.115979+0000","last_undegraded":"2023-12-13T00:28:33.115979+0000","last_fullsized":"2023-12-13T00:28:33.115979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'67","last_scrub_stamp":"2023-12-13T00:28:33.115863+0000","last_deep_scrub":"27'67","last_deep_scrub_stamp":"2023-12-13T00:28:33.115863+0000","last_clean_scrub_stamp":"2023-12-13T00:28:33.115863+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:07:24.061579+0000","scrub_duration":0.001322997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'63","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.877997+0000","last_change":"2023-12-13T00:00:31.147145+0000","last_active":"2023-12-13T00:28:04.877997+0000","last_peered":"2023-12-13T00:28:04.877997+0000","last_clean":"2023-12-13T00:28:04.877997+0000","last_became_active":"2023-12-13T00:00:31.146444+0000","last_became_peered":"2023-12-13T00:00:31.146444+0000","last_unstale":"2023-12-13T00:28:04.877997+0000","last_undegraded":"2023-12-13T00:28:04.877997+0000","last_fullsized":"2023-12-13T00:28:04.877997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'67","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:25.363437+0000","last_change":"2023-12-13T00:28:25.363455+0000","last_active":"2023-12-13T00:28:25.363437+0000","last_peered":"2023-12-13T00:28:25.363437+0000","last_clean":"2023-12-13T00:28:25.363437+0000","last_became_active":"2023-12-13T00:00:31.148529+0000","last_became_peered":"2023-12-13T00:00:31.148529+0000","last_unstale":"2023-12-13T00:28:25.363437+0000","last_undegraded":"2023-12-13T00:28:25.363437+0000","last_fullsized":"2023-12-13T00:28:25.363437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'67","last_scrub_stamp":"2023-12-13T00:28:25.363359+0000","last_deep_scrub":"27'67","last_deep_scrub_stamp":"2023-12-13T00:28:25.363359+0000","last_clean_scrub_stamp":"2023-12-13T00:28:25.363359+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:30:26.094520+0000","scrub_duration":0.0010738740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'59","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:50.981134+0000","last_change":"2023-12-13T00:28:50.981152+0000","last_active":"2023-12-13T00:28:50.981134+0000","last_peered":"2023-12-13T00:28:50.981134+0000","last_clean":"2023-12-13T00:28:50.981134+0000","last_became_active":"2023-12-13T00:00:31.149685+0000","last_became_peered":"2023-12-13T00:00:31.149685+0000","last_unstale":"2023-12-13T00:28:50.981134+0000","last_undegraded":"2023-12-13T00:28:50.981134+0000","last_fullsized":"2023-12-13T00:28:50.981134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'59","last_scrub_stamp":"2023-12-13T00:28:50.981064+0000","last_deep_scrub":"27'59","last_deep_scrub_stamp":"2023-12-13T00:28:50.981064+0000","last_clean_scrub_stamp":"2023-12-13T00:28:50.981064+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:44:35.186712+0000","scrub_duration":0.00088980899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'62","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:39.871025+0000","last_change":"2023-12-13T00:28:39.871044+0000","last_active":"2023-12-13T00:28:39.871025+0000","last_peered":"2023-12-13T00:28:39.871025+0000","last_clean":"2023-12-13T00:28:39.871025+0000","last_became_active":"2023-12-13T00:00:31.035672+0000","last_became_peered":"2023-12-13T00:00:31.035672+0000","last_unstale":"2023-12-13T00:28:39.871025+0000","last_undegraded":"2023-12-13T00:28:39.871025+0000","last_fullsized":"2023-12-13T00:28:39.871025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'62","last_scrub_stamp":"2023-12-13T00:28:39.870953+0000","last_deep_scrub":"27'62","last_deep_scrub_stamp":"2023-12-13T00:28:39.870953+0000","last_clean_scrub_stamp":"2023-12-13T00:28:39.870953+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:35:22.699747+0000","scrub_duration":0.0011428779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'65","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.866643+0000","last_change":"2023-12-13T00:00:31.146556+0000","last_active":"2023-12-13T00:28:04.866643+0000","last_peered":"2023-12-13T00:28:04.866643+0000","last_clean":"2023-12-13T00:28:04.866643+0000","last_became_active":"2023-12-13T00:00:31.146186+0000","last_became_peered":"2023-12-13T00:00:31.146186+0000","last_unstale":"2023-12-13T00:28:04.866643+0000","last_undegraded":"2023-12-13T00:28:04.866643+0000","last_fullsized":"2023-12-13T00:28:04.866643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'52","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:43.136951+0000","last_change":"2023-12-13T00:28:43.136970+0000","last_active":"2023-12-13T00:28:43.136951+0000","last_peered":"2023-12-13T00:28:43.136951+0000","last_clean":"2023-12-13T00:28:43.136951+0000","last_became_active":"2023-12-13T00:00:31.144458+0000","last_became_peered":"2023-12-13T00:00:31.144458+0000","last_unstale":"2023-12-13T00:28:43.136951+0000","last_undegraded":"2023-12-13T00:28:43.136951+0000","last_fullsized":"2023-12-13T00:28:43.136951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2023-12-13T00:28:43.136884+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2023-12-13T00:28:43.136884+0000","last_clean_scrub_stamp":"2023-12-13T00:28:43.136884+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:16:45.059703+0000","scrub_duration":0.0010172639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'57","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:20.190360+0000","last_change":"2023-12-13T00:28:20.190377+0000","last_active":"2023-12-13T00:28:20.190360+0000","last_peered":"2023-12-13T00:28:20.190360+0000","last_clean":"2023-12-13T00:28:20.190360+0000","last_became_active":"2023-12-13T00:00:31.144792+0000","last_became_peered":"2023-12-13T00:00:31.144792+0000","last_unstale":"2023-12-13T00:28:20.190360+0000","last_undegraded":"2023-12-13T00:28:20.190360+0000","last_fullsized":"2023-12-13T00:28:20.190360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:20.190304+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:20.190304+0000","last_clean_scrub_stamp":"2023-12-13T00:28:20.190304+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:16:25.962310+0000","scrub_duration":0.0010028070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'50","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:24.347581+0000","last_change":"2023-12-13T00:28:24.347618+0000","last_active":"2023-12-13T00:28:24.347581+0000","last_peered":"2023-12-13T00:28:24.347581+0000","last_clean":"2023-12-13T00:28:24.347581+0000","last_became_active":"2023-12-13T00:00:31.148875+0000","last_became_peered":"2023-12-13T00:00:31.148875+0000","last_unstale":"2023-12-13T00:28:24.347581+0000","last_undegraded":"2023-12-13T00:28:24.347581+0000","last_fullsized":"2023-12-13T00:28:24.347581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-13T00:28:24.347486+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-13T00:28:24.347486+0000","last_clean_scrub_stamp":"2023-12-13T00:28:24.347486+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:41:33.521746+0000","scrub_duration":0.001393895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'66","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:25.176823+0000","last_change":"2023-12-13T00:28:25.176823+0000","last_active":"2023-12-13T00:28:25.176823+0000","last_peered":"2023-12-13T00:28:25.176823+0000","last_clean":"2023-12-13T00:28:25.176823+0000","last_became_active":"2023-12-13T00:00:31.144174+0000","last_became_peered":"2023-12-13T00:00:31.144174+0000","last_unstale":"2023-12-13T00:28:25.176823+0000","last_undegraded":"2023-12-13T00:28:25.176823+0000","last_fullsized":"2023-12-13T00:28:25.176823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2023-12-13T00:28:25.176745+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2023-12-13T00:28:25.176745+0000","last_clean_scrub_stamp":"2023-12-13T00:28:25.176745+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:36:46.260217+0000","scrub_duration":0.0010312170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'57","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.859213+0000","last_change":"2023-12-13T00:00:31.144074+0000","last_active":"2023-12-13T00:28:04.859213+0000","last_peered":"2023-12-13T00:28:04.859213+0000","last_clean":"2023-12-13T00:28:04.859213+0000","last_became_active":"2023-12-13T00:00:31.143809+0000","last_became_peered":"2023-12-13T00:00:31.143809+0000","last_unstale":"2023-12-13T00:28:04.859213+0000","last_undegraded":"2023-12-13T00:28:04.859213+0000","last_fullsized":"2023-12-13T00:28:04.859213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'47","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:27.432298+0000","last_change":"2023-12-13T00:28:27.432315+0000","last_active":"2023-12-13T00:28:27.432298+0000","last_peered":"2023-12-13T00:28:27.432298+0000","last_clean":"2023-12-13T00:28:27.432298+0000","last_became_active":"2023-12-13T00:00:31.116230+0000","last_became_peered":"2023-12-13T00:00:31.116230+0000","last_unstale":"2023-12-13T00:28:27.432298+0000","last_undegraded":"2023-12-13T00:28:27.432298+0000","last_fullsized":"2023-12-13T00:28:27.432298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2023-12-13T00:28:27.432235+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2023-12-13T00:28:27.432235+0000","last_clean_scrub_stamp":"2023-12-13T00:28:27.432235+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:43:11.126576+0000","scrub_duration":0.00088450200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'66","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:04.877794+0000","last_change":"2023-12-13T00:00:31.149691+0000","last_active":"2023-12-13T00:28:04.877794+0000","last_peered":"2023-12-13T00:28:04.877794+0000","last_clean":"2023-12-13T00:28:04.877794+0000","last_became_active":"2023-12-13T00:00:31.149410+0000","last_became_peered":"2023-12-13T00:00:31.149410+0000","last_unstale":"2023-12-13T00:28:04.877794+0000","last_undegraded":"2023-12-13T00:28:04.877794+0000","last_fullsized":"2023-12-13T00:28:04.877794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:29.745646+0000","last_clean_scrub_stamp":"2023-12-13T00:00:29.745646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":248,"num_write":4193,"num_write_kb":331487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5031,"ondisk_log_size":5031,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3759,"ondisk_log_size":3759,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":43904475,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":1477,"num_read_kb":1524,"num_write":14609,"num_write_kb":50682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87957504,"data_stored":87808950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13658,"ondisk_log_size":13658,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509791,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53632,"kb_used_data":8568,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318208,"statfs":{"total":96636764160,"available":96581844992,"internally_reserved":0,"allocated":8773632,"data_stored":8578223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.34699999999999998,"5min":0.25800000000000001,"15min":0.23699999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.65800000000000003},"last":0.629},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42999999999999999,"15min":0.42899999999999999},"min":{"1min":0.29299999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.60599999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.52500000000000002}]},{"osd":1,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.442,"15min":0.438},"min":{"1min":0.312,"5min":0.308,"15min":0.24299999999999999},"max":{"1min":0.58399999999999996,"5min":0.63500000000000001,"15min":0.68200000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.36299999999999999,"5min":0.29799999999999999,"15min":0.28199999999999997},"max":{"1min":0.52000000000000002,"5min":0.60099999999999998,"15min":0.61699999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.432,"15min":0.42699999999999999},"min":{"1min":0.35999999999999999,"5min":0.29499999999999998,"15min":0.27100000000000002},"max":{"1min":0.59499999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.436,"15min":0.42899999999999999},"min":{"1min":0.35499999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60699999999999998,"5min":0.65100000000000002,"15min":0.65200000000000002},"last":0.66300000000000003}]},{"osd":3,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.436,"15min":0.436},"min":{"1min":0.32700000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.56299999999999994,"5min":0.623,"15min":0.623},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.309},"max":{"1min":0.58099999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.54800000000000004}]},{"osd":4,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.372,"15min":0.371},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56399999999999995,"5min":0.753,"15min":0.753},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26300000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64100000000000001,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.56899999999999995}]},{"osd":5,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.40200000000000002,"15min":0.40100000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.22900000000000001},"max":{"1min":0.61099999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.44500000000000001,"15min":0.436},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.23100000000000001},"max":{"1min":0.628,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.61899999999999999}]},{"osd":6,"last update":"Wed Dec 13 00:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.23999999999999999},"max":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.438,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56899999999999995,"5min":0.67900000000000005,"15min":0.71799999999999997},"last":0.67200000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509790,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88192,"kb_used_data":16760,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94283648,"statfs":{"total":96636764160,"available":96546455552,"internally_reserved":0,"allocated":17162240,"data_stored":16985405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.34100000000000003,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.42799999999999999},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.23100000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.42299999999999999}]},{"osd":1,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.30399999999999999,"5min":0.28599999999999998,"15min":0.252},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.41899999999999998,"15min":0.41699999999999998},"min":{"1min":0.34599999999999997,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.42299999999999999,"15min":0.41099999999999998},"min":{"1min":0.35799999999999998,"5min":0.30099999999999999,"15min":0.247},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.437,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.26500000000000001},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.432}]},{"osd":3,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.28999999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.378},{"interface":"front","average":{"1min":0.503,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32300000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.442}]},{"osd":4,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.38,"15min":0.379},"min":{"1min":0.254,"5min":0.215,"15min":0.215},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.36699999999999999}]},{"osd":5,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.378},"min":{"1min":0.24399999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44500000000000001,"15min":0.436},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.249},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.307}]},{"osd":7,"last update":"Wed Dec 13 00:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.441,"15min":0.44},"min":{"1min":0.32200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.433,"15min":0.439},"min":{"1min":0.29499999999999998,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.32200000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509792,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58980,"kb_used_data":9756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312860,"statfs":{"total":96636764160,"available":96576368640,"internally_reserved":0,"allocated":9990144,"data_stored":9784207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.27800000000000002,"5min":0.216,"15min":0.20499999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.41599999999999998,"15min":0.41399999999999998},"min":{"1min":0.30399999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.45000000000000001}]},{"osd":1,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.42799999999999999,"15min":0.41499999999999998},"min":{"1min":0.33300000000000002,"5min":0.248,"15min":0.224},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.441},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.379,"5min":0.29899999999999999,"15min":0.251},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.442,"15min":0.436},"min":{"1min":0.36499999999999999,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.435,"15min":0.433},"min":{"1min":0.32600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.498}]},{"osd":3,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.442,"15min":0.432},"min":{"1min":0.34999999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59599999999999997,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.47499999999999998,"15min":0.46400000000000002},"min":{"1min":0.34300000000000003,"5min":0.33200000000000002,"15min":0.316},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.47499999999999998}]},{"osd":5,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.39300000000000002,"15min":0.38600000000000001},"min":{"1min":0.30499999999999999,"5min":0.224,"15min":0.221},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.39800000000000002,"15min":0.38400000000000001},"min":{"1min":0.26600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.38700000000000001}]},{"osd":6,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.247},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.71999999999999997},"last":0.315},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46200000000000002,"15min":0.442},"min":{"1min":0.34799999999999998,"5min":0.27300000000000002,"15min":0.23899999999999999},"max":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.71899999999999997},"last":0.36899999999999999}]},{"osd":7,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.441,"15min":0.42899999999999999},"min":{"1min":0.36199999999999999,"5min":0.26300000000000001,"15min":0.25600000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.47599999999999998,"15min":0.46500000000000002},"min":{"1min":0.32700000000000001,"5min":0.316,"15min":0.28999999999999998},"max":{"1min":0.71099999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.35499999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509792,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96880,"kb_used_data":21288,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94274960,"statfs":{"total":96636764160,"available":96537559040,"internally_reserved":0,"allocated":21798912,"data_stored":21617833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.317,"15min":0.316},"min":{"1min":0.22600000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.42699999999999999,"5min":0.53200000000000003,"15min":0.64000000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.312,"15min":0.312},"min":{"1min":0.246,"5min":0.19600000000000001,"15min":0.192},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.57899999999999996},"last":0.48099999999999998}]},{"osd":1,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34000000000000002,"15min":0.33000000000000002},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.20200000000000001},"max":{"1min":0.41299999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.28499999999999998,"5min":0.27400000000000002,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.52200000000000002}]},{"osd":2,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.26600000000000001,"5min":0.249,"15min":0.22800000000000001},"max":{"1min":0.47799999999999998,"5min":0.59899999999999998,"15min":0.69399999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39800000000000002,"15min":0.39600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.23799999999999999},"max":{"1min":0.51400000000000001,"5min":0.59699999999999998,"15min":0.66300000000000003},"last":0.57699999999999996}]},{"osd":4,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.311},"max":{"1min":0.72199999999999998,"5min":0.80100000000000005,"15min":0.90700000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.38500000000000001,"5min":0.34100000000000003,"15min":0.316},"max":{"1min":0.64500000000000002,"5min":0.76700000000000002,"15min":0.84199999999999997},"last":0.56200000000000006}]},{"osd":5,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.83199999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50700000000000001,"15min":0.5},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.30599999999999999},"max":{"1min":0.72799999999999998,"5min":0.76000000000000001,"15min":0.81999999999999995},"last":0.58899999999999997}]},{"osd":6,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.67600000000000005,"5min":0.78600000000000003,"15min":0.80600000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54600000000000004,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.79300000000000004},"last":0.65300000000000002}]},{"osd":7,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.78800000000000003},"last":0.622},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.39500000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.85799999999999998},"last":0.63900000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509790,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36200,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335640,"statfs":{"total":96636764160,"available":96599695360,"internally_reserved":0,"allocated":884736,"data_stored":706002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.307,"15min":0.30099999999999999},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.47599999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.32200000000000001,"15min":0.32900000000000001},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.63600000000000001},"last":0.26600000000000001}]},{"osd":2,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33200000000000002,"15min":0.32700000000000001},"min":{"1min":0.26100000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.498,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35299999999999998,"15min":0.35199999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51700000000000002,"5min":0.53100000000000003,"15min":0.55000000000000004},"last":0.33300000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38,"15min":0.376},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.59599999999999997,"5min":0.60599999999999998,"15min":0.60799999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.25600000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.505,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.32200000000000001}]},{"osd":4,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.48999999999999999,"15min":0.47399999999999998},"min":{"1min":0.29499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65300000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.495,"15min":0.48199999999999998},"min":{"1min":0.35799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.72199999999999998,"5min":0.79500000000000004,"15min":0.84699999999999998},"last":0.49099999999999999}]},{"osd":5,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.69499999999999995,"5min":0.78500000000000003,"15min":0.81999999999999995},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.505,"15min":0.49199999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.32000000000000001},"max":{"1min":0.628,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47199999999999998}]},{"osd":6,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.29099999999999998},"max":{"1min":0.73499999999999999,"5min":0.79000000000000004,"15min":0.89300000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.39600000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66900000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.503}]},{"osd":7,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77500000000000002,"5min":0.78400000000000003,"15min":0.83899999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.54200000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.71499999999999997,"5min":0.82699999999999996,"15min":0.85799999999999998},"last":0.45700000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542494,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53544,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318296,"statfs":{"total":96636764160,"available":96581935104,"internally_reserved":0,"allocated":8683520,"data_stored":8504788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.313,"15min":0.308},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.38400000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.32200000000000001,"15min":0.32700000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.19},"max":{"1min":0.42799999999999999,"5min":0.53200000000000003,"15min":0.60299999999999998},"last":0.32100000000000001}]},{"osd":1,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.33000000000000002,"15min":0.33100000000000002},"min":{"1min":0.23599999999999999,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.38200000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.746},"last":0.33900000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35899999999999999,"15min":0.36799999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46800000000000003,"5min":0.57399999999999995,"15min":1.03},"last":0.376},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.376,"15min":0.38500000000000001},"min":{"1min":0.26000000000000001,"5min":0.247,"15min":0.23499999999999999},"max":{"1min":0.41799999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.30099999999999999}]},{"osd":4,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46899999999999997,"15min":0.46600000000000003},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.85399999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.496,"15min":0.48699999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.28499999999999998},"max":{"1min":0.65700000000000003,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.58499999999999996}]},{"osd":5,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.47899999999999998,"15min":0.46899999999999997},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.317},"max":{"1min":0.56899999999999995,"5min":0.70799999999999996,"15min":0.82099999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51600000000000001,"15min":0.496},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.316},"max":{"1min":0.76100000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.52700000000000002}]},{"osd":6,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.36799999999999999,"5min":0.36199999999999999,"15min":0.34499999999999997},"max":{"1min":0.61799999999999999,"5min":0.74399999999999999,"15min":0.79800000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.498,"15min":0.503},"min":{"1min":0.377,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.52500000000000002,"5min":0.75800000000000001,"15min":0.78200000000000003},"last":0.55200000000000005}]},{"osd":7,"last update":"Wed Dec 13 00:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53500000000000003,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35499999999999998},"max":{"1min":0.63800000000000001,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.627}]}]},{"osd":0,"up_from":14,"seq":60129542494,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67936,"kb_used_data":6232,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94303904,"statfs":{"total":96636764160,"available":96567197696,"internally_reserved":0,"allocated":6381568,"data_stored":6195602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.32900000000000001,"15min":0.32000000000000001},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.19400000000000001},"max":{"1min":0.56599999999999995,"5min":0.627,"15min":0.66900000000000004},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33000000000000002,"15min":0.316},"min":{"1min":0.22700000000000001,"5min":0.221,"15min":0.19900000000000001},"max":{"1min":0.47299999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.255}]},{"osd":2,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32600000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57999999999999996,"5min":0.60699999999999998,"15min":0.64600000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.37,"15min":0.35399999999999998},"min":{"1min":0.246,"5min":0.24299999999999999,"15min":0.23000000000000001},"max":{"1min":0.52800000000000002,"5min":0.61299999999999999,"15min":0.72299999999999998},"last":0.30499999999999999}]},{"osd":3,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36199999999999999,"15min":0.35499999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.22900000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.36799999999999999},"min":{"1min":0.28999999999999998,"5min":0.26300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.65400000000000003},"last":0.316}]},{"osd":4,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.33500000000000002,"5min":0.30499999999999999,"15min":0.25800000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51500000000000001,"15min":0.47899999999999998},"min":{"1min":0.36499999999999999,"5min":0.35899999999999999,"15min":0.27200000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.45800000000000002}]},{"osd":5,"last update":"Wed Dec 13 00:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52500000000000002,"15min":0.48499999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.505},"min":{"1min":0.40000000000000002,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.39300000000000002}]},{"osd":6,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52000000000000002},"min":{"1min":0.40200000000000002,"5min":0.33800000000000002,"15min":0.33600000000000002},"max":{"1min":0.71699999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.51900000000000002},"min":{"1min":0.41999999999999998,"5min":0.377,"15min":0.34499999999999997},"max":{"1min":0.81699999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.41699999999999998}]},{"osd":7,"last update":"Wed Dec 13 00:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69399999999999995,"5min":0.746,"15min":0.79500000000000004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":0.54100000000000004},"min":{"1min":0.371,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.44900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575199,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88748,"kb_used_data":17316,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94283092,"statfs":{"total":96636764160,"available":96545886208,"internally_reserved":0,"allocated":17731584,"data_stored":17541418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.307,"5min":0.255,"15min":0.20200000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.70399999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41399999999999998,"15min":0.40699999999999997},"min":{"1min":0.30099999999999999,"5min":0.28000000000000003,"15min":0.23999999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.67300000000000004},"last":0.56699999999999995}]},{"osd":1,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.434,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.249},"max":{"1min":0.61499999999999999,"5min":0.625,"15min":0.67300000000000004},"last":0.628},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.33300000000000002,"5min":0.28999999999999998,"15min":0.247},"max":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.73399999999999999},"last":0.38900000000000001}]},{"osd":2,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.42999999999999999,"15min":0.42299999999999999},"min":{"1min":0.317,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.628,"5min":0.628,"15min":0.68700000000000006},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41599999999999998,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.65900000000000003},"last":0.52300000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44600000000000001,"15min":0.436},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.27300000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.68999999999999995},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.44800000000000001},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.69099999999999995},"last":0.48899999999999999}]},{"osd":4,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38800000000000001,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.215},"max":{"1min":0.58599999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40100000000000002,"15min":0.38600000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.22900000000000001},"max":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.65000000000000002},"last":0.55500000000000005}]},{"osd":6,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.374,"15min":0.36499999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.22500000000000001},"max":{"1min":0.48299999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.42299999999999999,"15min":0.41799999999999998},"min":{"1min":0.26100000000000001,"5min":0.25800000000000001,"15min":0.24399999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.77400000000000002},"last":0.53900000000000003}]},{"osd":7,"last update":"Wed Dec 13 00:27:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.41899999999999998},"min":{"1min":0.29999999999999999,"5min":0.27400000000000002,"15min":0.22900000000000001},"max":{"1min":0.60099999999999998,"5min":0.61099999999999999,"15min":0.68899999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.433},"min":{"1min":0.36699999999999999,"5min":0.27000000000000002,"15min":0.26700000000000002},"max":{"1min":0.64500000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.47499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6098944,"data_stored":6080128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21516288,"data_stored":21502359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9707520,"data_stored":9668733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16855040,"data_stored":16835576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16879616,"data_stored":16869931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8491008,"data_stored":8462749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T00:29:02.146 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.146 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.147 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.147 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.147 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.147 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.147 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.148 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.148 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.148 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.148 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.148 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.148 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.148 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.149 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.149 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.149 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.149 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.149 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.149 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.150 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.150 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.150 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.150 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.150 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.150 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.151 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.151 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.151 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.151 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-13T00:00:29.745646+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=29, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:02.151 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-13T00:29:07.981 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:29:07.983 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:29:12.281 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:29:36.821 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:29:12.286 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:29:36.827 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:29:12.292 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:29:36.826 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:29:12.294 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:29:36.828 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:29:12.295 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:29:36.829 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:29:12.297 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:29:36.831 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:29:12.367 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:29:36.908 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:29:12.379 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:29:36.913 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:29:12.381 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:29:36.915 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:29:22.152 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T00:29:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.264+0000 7f080a056640 1 Processor -- start 2023-12-13T00:29:22.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.264+0000 7f080a056640 1 -- start start 2023-12-13T00:29:22.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.264+0000 7f080a056640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f08040cc420 0x7f0804159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:22.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.264+0000 7f080a056640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08040cbda0 con 0x7f08040cda70 2023-12-13T00:29:22.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.265+0000 7f080a056640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08040cea60 con 0x7f0804159b50 2023-12-13T00:29:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.265+0000 7f080a056640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08040cc230 con 0x7f08040cc420 2023-12-13T00:29:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.265+0000 7f08037fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f08040cda70 0x7f08040ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43640/0 (socket says 172.21.15.72:43640) 2023-12-13T00:29:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.265+0000 7f08037fe640 1 -- 172.21.15.72:0/3606546523 learned_addr learned my addr 172.21.15.72:0/3606546523 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:29:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.266+0000 7f0802ffd640 1 --2- 172.21.15.72:0/3606546523 >> v2:172.21.15.176:3300/0 conn(0x7f08040cc420 0x7f0804159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:22.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.267+0000 7f08027fc640 1 -- 172.21.15.72:0/3606546523 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526935672 0 0) 0x7f08040cbda0 con 0x7f08040cda70 2023-12-13T00:29:22.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.267+0000 7f08027fc640 1 -- 172.21.15.72:0/3606546523 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07ec003520 con 0x7f08040cda70 2023-12-13T00:29:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.269+0000 7f08027fc640 1 -- 172.21.15.72:0/3606546523 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117465905 0 0) 0x7f08040cea60 con 0x7f0804159b50 2023-12-13T00:29:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.269+0000 7f08027fc640 1 -- 172.21.15.72:0/3606546523 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08040cbda0 con 0x7f0804159b50 2023-12-13T00:29:22.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.271+0000 7f08027fc640 1 -- 172.21.15.72:0/3606546523 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3294959815 0 0) 0x7f07ec003520 con 0x7f08040cda70 2023-12-13T00:29:22.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.271+0000 7f08027fc640 1 -- 172.21.15.72:0/3606546523 >> v2:172.21.15.176:3300/0 conn(0x7f08040cc420 msgr2=0x7f0804159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:29:22.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.271+0000 7f08027fc640 1 --2- 172.21.15.72:0/3606546523 >> v2:172.21.15.176:3300/0 conn(0x7f08040cc420 0x7f0804159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:22.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.271+0000 7f08027fc640 1 -- 172.21.15.72:0/3606546523 >> v1:172.21.15.176:6789/0 conn(0x7f0804159b50 legacy=0x7f08040c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:22.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.271+0000 7f08027fc640 1 -- 172.21.15.72:0/3606546523 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08040cb4e0 con 0x7f08040cda70 2023-12-13T00:29:22.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.271+0000 7f08027fc640 1 -- 172.21.15.72:0/3606546523 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1233568696 0 0) 0x7f07f4001670 con 0x7f08040cda70 2023-12-13T00:29:22.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.271+0000 7f08027fc640 1 -- 172.21.15.72:0/3606546523 >> v1:172.21.15.72:6789/0 conn(0x7f08040cda70 legacy=0x7f08040ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:22.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.271+0000 7f08027fc640 1 --2- 172.21.15.72:0/3606546523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07ec003bc0 0x7f07ec003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:22.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.271+0000 7f08027fc640 1 --2- 172.21.15.72:0/3606546523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07ec0047c0 0x7f07ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:22.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.271+0000 7f08027fc640 1 --2- 172.21.15.72:0/3606546523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07ec005180 0x7f07ec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:22.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.271+0000 7f08027fc640 1 -- 172.21.15.72:0/3606546523 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08040cc230 con 0x7f07ec003bc0 2023-12-13T00:29:22.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.271+0000 7f08027fc640 1 -- 172.21.15.72:0/3606546523 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec00c070 con 0x7f07ec005180 2023-12-13T00:29:22.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.271+0000 7f08027fc640 1 -- 172.21.15.72:0/3606546523 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec00c230 con 0x7f07ec0047c0 2023-12-13T00:29:22.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.272+0000 7f0802ffd640 1 --2- 172.21.15.72:0/3606546523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07ec0047c0 0x7f07ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:22.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.274+0000 7f08037fe640 1 --2- 172.21.15.72:0/3606546523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07ec003bc0 0x7f07ec003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:22.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.275+0000 7f0802ffd640 1 -- 172.21.15.72:0/3606546523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07ec005180 msgr2=0x7f07ec00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:29:22.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.275+0000 7f0802ffd640 1 --2- 172.21.15.72:0/3606546523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07ec005180 0x7f07ec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:22.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.275+0000 7f0802ffd640 1 -- 172.21.15.72:0/3606546523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07ec003bc0 msgr2=0x7f07ec003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:29:22.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.275+0000 7f0802ffd640 1 --2- 172.21.15.72:0/3606546523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07ec003bc0 0x7f07ec003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:22.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.275+0000 7f0802ffd640 1 -- 172.21.15.72:0/3606546523 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec003520 con 0x7f07ec0047c0 2023-12-13T00:29:22.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.275+0000 7f0803fff640 1 -- 172.21.15.72:0/3606546523 reap_dead start 2023-12-13T00:29:22.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.278+0000 7f0802ffd640 1 --2- 172.21.15.72:0/3606546523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07ec0047c0 0x7f07ec004c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009a90 tx=0x7f07ec0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f6a062ed5d4d63 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:22.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.282+0000 7f08027fc640 1 -- 172.21.15.72:0/3606546523 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f802c680 con 0x7f07ec0047c0 2023-12-13T00:29:22.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.282+0000 7f08027fc640 1 -- 172.21.15.72:0/3606546523 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f802c7e0 con 0x7f07ec0047c0 2023-12-13T00:29:22.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.282+0000 7f08027fc640 1 -- 172.21.15.72:0/3606546523 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f802cb70 con 0x7f07ec0047c0 2023-12-13T00:29:22.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.282+0000 7f080a056640 1 -- 172.21.15.72:0/3606546523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07ec0047c0 msgr2=0x7f07ec004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:22.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.282+0000 7f080a056640 1 --2- 172.21.15.72:0/3606546523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07ec0047c0 0x7f07ec004c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009a90 tx=0x7f07ec0057f0 comp rx=0 tx=0).stop 2023-12-13T00:29:22.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.282+0000 7f080a056640 1 -- 172.21.15.72:0/3606546523 shutdown_connections 2023-12-13T00:29:22.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.283+0000 7f080a056640 1 --2- 172.21.15.72:0/3606546523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07ec0047c0 0x7f07ec004c40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.283+0000 7f080a056640 1 -- 172.21.15.72:0/3606546523 >> 172.21.15.72:0/3606546523 conn(0x7f08040b07b0 msgr2=0x7f08040b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.283+0000 7f080a056640 1 -- 172.21.15.72:0/3606546523 shutdown_connections 2023-12-13T00:29:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.283+0000 7f080a056640 1 -- 172.21.15.72:0/3606546523 wait complete. 2023-12-13T00:29:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.284+0000 7f080a056640 1 Processor -- start 2023-12-13T00:29:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.284+0000 7f080a056640 1 -- start start 2023-12-13T00:29:22.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.285+0000 7f080a056640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07ec0047c0 0x7f0804152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:22.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.285+0000 7f080a056640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0804152fe0 0x7f08041f0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:22.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.285+0000 7f080a056640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08040b47b0 0x7f08041f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:22.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.285+0000 7f080a056640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08040c4df0 con 0x7f08040b47b0 2023-12-13T00:29:22.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.285+0000 7f080a056640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08040c42b0 con 0x7f07ec0047c0 2023-12-13T00:29:22.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.285+0000 7f080a056640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08040ca410 con 0x7f0804152fe0 2023-12-13T00:29:22.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.285+0000 7f0803fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08040b47b0 0x7f08041f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:22.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.285+0000 7f08037fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07ec0047c0 0x7f0804152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:22.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.285+0000 7f0802ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0804152fe0 0x7f08041f0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:22.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.285+0000 7f0803fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08040b47b0 0x7f08041f0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58278/0 (socket says 172.21.15.72:58278) 2023-12-13T00:29:22.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.285+0000 7f0803fff640 1 -- 172.21.15.72:0/978238823 learned_addr learned my addr 172.21.15.72:0/978238823 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:29:22.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.289+0000 7f0803fff640 1 -- 172.21.15.72:0/978238823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0804152fe0 msgr2=0x7f08041f0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:22.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.289+0000 7f0803fff640 1 --2- 172.21.15.72:0/978238823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0804152fe0 0x7f08041f0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.289+0000 7f0803fff640 1 -- 172.21.15.72:0/978238823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07ec0047c0 msgr2=0x7f0804152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.289+0000 7f0803fff640 1 --2- 172.21.15.72:0/978238823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07ec0047c0 0x7f0804152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.289+0000 7f0803fff640 1 -- 172.21.15.72:0/978238823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08040c4550 con 0x7f08040b47b0 2023-12-13T00:29:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.291+0000 7f0803fff640 1 --2- 172.21.15.72:0/978238823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08040b47b0 0x7f08041f0f70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f08040c2450 tx=0x7f07fc00ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:22.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.295+0000 7f07ebfff640 1 -- 172.21.15.72:0/978238823 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc007070 con 0x7f08040b47b0 2023-12-13T00:29:22.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.295+0000 7f07ebfff640 1 -- 172.21.15.72:0/978238823 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc0071d0 con 0x7f08040b47b0 2023-12-13T00:29:22.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.295+0000 7f07ebfff640 1 -- 172.21.15.72:0/978238823 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc007580 con 0x7f08040b47b0 2023-12-13T00:29:22.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.295+0000 7f080a056640 1 -- 172.21.15.72:0/978238823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08040c4830 con 0x7f08040b47b0 2023-12-13T00:29:22.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.295+0000 7f080a056640 1 -- 172.21.15.72:0/978238823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08041f0510 con 0x7f08040b47b0 2023-12-13T00:29:22.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.296+0000 7f080a056640 1 -- 172.21.15.72:0/978238823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08041f0370 con 0x7f08040b47b0 2023-12-13T00:29:22.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.315+0000 7f07ebfff640 1 -- 172.21.15.72:0/978238823 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f07fc0076e0 con 0x7f08040b47b0 2023-12-13T00:29:22.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.315+0000 7f07ebfff640 1 --2- 172.21.15.72:0/978238823 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f07f006b240 0x7f07f006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:22.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.316+0000 7f08037fe640 1 --2- 172.21.15.72:0/978238823 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f07f006b240 0x7f07f006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:22.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.316+0000 7f08037fe640 1 --2- 172.21.15.72:0/978238823 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f07f006b240 0x7f07f006d700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f07f4000c00 tx=0x7f07f4000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:22.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.318+0000 7f07ebfff640 1 -- 172.21.15.72:0/978238823 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f07fc057ae0 con 0x7f08040b47b0 2023-12-13T00:29:22.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.556+0000 7f07ebfff640 1 -- 172.21.15.72:0/978238823 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f07fc053e20 con 0x7f08040b47b0 2023-12-13T00:29:22.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.742+0000 7f080a056640 1 -- 172.21.15.72:0/978238823 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08040ce4b0 con 0x7f07f006b240 2023-12-13T00:29:22.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.751+0000 7f07ebfff640 1 -- 172.21.15.72:0/978238823 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373278 (secure 0 0 0) 0x7f08040ce4b0 con 0x7f07f006b240 2023-12-13T00:29:22.756 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:29:22.759 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-12-13T00:29:22.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.755+0000 7f080a056640 1 -- 172.21.15.72:0/978238823 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f07f006b240 msgr2=0x7f07f006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:22.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.755+0000 7f080a056640 1 --2- 172.21.15.72:0/978238823 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f07f006b240 0x7f07f006d700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f07f4000c00 tx=0x7f07f4000ed0 comp rx=0 tx=0).stop 2023-12-13T00:29:22.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.755+0000 7f080a056640 1 -- 172.21.15.72:0/978238823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08040b47b0 msgr2=0x7f08041f0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:22.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.755+0000 7f080a056640 1 --2- 172.21.15.72:0/978238823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08040b47b0 0x7f08041f0f70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f08040c2450 tx=0x7f07fc00ca50 comp rx=0 tx=0).stop 2023-12-13T00:29:22.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.755+0000 7f080a056640 1 -- 172.21.15.72:0/978238823 shutdown_connections 2023-12-13T00:29:22.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.755+0000 7f080a056640 1 --2- 172.21.15.72:0/978238823 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f07f006b240 0x7f07f006d700 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:22.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.755+0000 7f080a056640 1 --2- 172.21.15.72:0/978238823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08040b47b0 0x7f08041f0f70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:22.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.755+0000 7f080a056640 1 --2- 172.21.15.72:0/978238823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0804152fe0 0x7f08041f0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:22.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.755+0000 7f080a056640 1 --2- 172.21.15.72:0/978238823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07ec0047c0 0x7f0804152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:22.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.755+0000 7f080a056640 1 -- 172.21.15.72:0/978238823 >> 172.21.15.72:0/978238823 conn(0x7f08040b07b0 msgr2=0x7f08040af110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:22.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.755+0000 7f080a056640 1 -- 172.21.15.72:0/978238823 shutdown_connections 2023-12-13T00:29:22.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:22.755+0000 7f080a056640 1 -- 172.21.15.72:0/978238823 wait complete. 2023-12-13T00:29:22.767 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":898,"stamp":"2023-12-13T00:29:20.926088+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44494843,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1597,"num_read_kb":1872,"num_write":18961,"num_write_kb":384585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22567,"ondisk_log_size":22567,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":544112,"kb_used_data":89264,"kb_used_omap":12,"kb_used_meta":454771,"kb_avail":754430608,"statfs":{"total":773094113280,"available":772536942592,"internally_reserved":0,"allocated":91406336,"data_stored":89913478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":465686066},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003489"},"pg_stats":[{"pgid":"2.1f","version":"27'893","reported_seq":933,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:29.139599+0000","last_change":"2023-12-13T00:28:29.139661+0000","last_active":"2023-12-13T00:28:29.139599+0000","last_peered":"2023-12-13T00:28:29.139599+0000","last_clean":"2023-12-13T00:28:29.139599+0000","last_became_active":"2023-12-13T00:00:29.997381+0000","last_became_peered":"2023-12-13T00:00:29.997381+0000","last_unstale":"2023-12-13T00:28:29.139599+0000","last_undegraded":"2023-12-13T00:28:29.139599+0000","last_fullsized":"2023-12-13T00:28:29.139599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'893","last_scrub_stamp":"2023-12-13T00:28:29.139513+0000","last_deep_scrub":"27'893","last_deep_scrub_stamp":"2023-12-13T00:28:29.139513+0000","last_clean_scrub_stamp":"2023-12-13T00:28:29.139513+0000","objects_scrubbed":5,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:42:10.924829+0000","scrub_duration":0.013572704,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":4535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'54","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:08.413391+0000","last_change":"2023-12-13T00:29:08.413432+0000","last_active":"2023-12-13T00:29:08.413391+0000","last_peered":"2023-12-13T00:29:08.413391+0000","last_clean":"2023-12-13T00:29:08.413391+0000","last_became_active":"2023-12-13T00:00:31.138242+0000","last_became_peered":"2023-12-13T00:00:31.138242+0000","last_unstale":"2023-12-13T00:29:08.413391+0000","last_undegraded":"2023-12-13T00:29:08.413391+0000","last_fullsized":"2023-12-13T00:29:08.413391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2023-12-13T00:29:08.413277+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2023-12-13T00:29:08.413277+0000","last_clean_scrub_stamp":"2023-12-13T00:29:08.413277+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:15:53.242647+0000","scrub_duration":0.0013730999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'155","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:50.063447+0000","last_change":"2023-12-13T00:28:50.063484+0000","last_active":"2023-12-13T00:28:50.063447+0000","last_peered":"2023-12-13T00:28:50.063447+0000","last_clean":"2023-12-13T00:28:50.063447+0000","last_became_active":"2023-12-13T00:00:35.667498+0000","last_became_peered":"2023-12-13T00:00:35.667498+0000","last_unstale":"2023-12-13T00:28:50.063447+0000","last_undegraded":"2023-12-13T00:28:50.063447+0000","last_fullsized":"2023-12-13T00:28:50.063447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'155","last_scrub_stamp":"2023-12-13T00:28:50.063365+0000","last_deep_scrub":"27'155","last_deep_scrub_stamp":"2023-12-13T00:28:50.063365+0000","last_clean_scrub_stamp":"2023-12-13T00:28:50.063365+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:47:54.554846+0000","scrub_duration":0.0015139660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'847","reported_seq":888,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:47.534975+0000","last_change":"2023-12-13T00:28:47.534996+0000","last_active":"2023-12-13T00:28:47.534975+0000","last_peered":"2023-12-13T00:28:47.534975+0000","last_clean":"2023-12-13T00:28:47.534975+0000","last_became_active":"2023-12-13T00:00:30.001628+0000","last_became_peered":"2023-12-13T00:00:30.001628+0000","last_unstale":"2023-12-13T00:28:47.534975+0000","last_undegraded":"2023-12-13T00:28:47.534975+0000","last_fullsized":"2023-12-13T00:28:47.534975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'847","last_scrub_stamp":"2023-12-13T00:28:47.534918+0000","last_deep_scrub":"27'847","last_deep_scrub_stamp":"2023-12-13T00:28:47.534918+0000","last_clean_scrub_stamp":"2023-12-13T00:28:47.534918+0000","objects_scrubbed":1,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:36:14.144385+0000","scrub_duration":0.011101267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'62","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:23.425898+0000","last_change":"2023-12-13T00:28:23.425921+0000","last_active":"2023-12-13T00:28:23.425898+0000","last_peered":"2023-12-13T00:28:23.425898+0000","last_clean":"2023-12-13T00:28:23.425898+0000","last_became_active":"2023-12-13T00:00:31.036197+0000","last_became_peered":"2023-12-13T00:00:31.036197+0000","last_unstale":"2023-12-13T00:28:23.425898+0000","last_undegraded":"2023-12-13T00:28:23.425898+0000","last_fullsized":"2023-12-13T00:28:23.425898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'62","last_scrub_stamp":"2023-12-13T00:28:23.425813+0000","last_deep_scrub":"27'62","last_deep_scrub_stamp":"2023-12-13T00:28:23.425813+0000","last_clean_scrub_stamp":"2023-12-13T00:28:23.425813+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:33:18.747179+0000","scrub_duration":0.001921973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'165","reported_seq":204,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:48.150794+0000","last_change":"2023-12-13T00:28:48.150817+0000","last_active":"2023-12-13T00:28:48.150794+0000","last_peered":"2023-12-13T00:28:48.150794+0000","last_clean":"2023-12-13T00:28:48.150794+0000","last_became_active":"2023-12-13T00:00:35.664981+0000","last_became_peered":"2023-12-13T00:00:35.664981+0000","last_unstale":"2023-12-13T00:28:48.150794+0000","last_undegraded":"2023-12-13T00:28:48.150794+0000","last_fullsized":"2023-12-13T00:28:48.150794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'165","last_scrub_stamp":"2023-12-13T00:28:48.150719+0000","last_deep_scrub":"27'165","last_deep_scrub_stamp":"2023-12-13T00:28:48.150719+0000","last_clean_scrub_stamp":"2023-12-13T00:28:48.150719+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:34:39.892054+0000","scrub_duration":0.0020656839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":248,"num_write":136,"num_write_kb":7125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:33.302643+0000","last_change":"2023-12-13T00:28:33.302667+0000","last_active":"2023-12-13T00:28:33.302643+0000","last_peered":"2023-12-13T00:28:33.302643+0000","last_clean":"2023-12-13T00:28:33.302643+0000","last_became_active":"2023-12-13T00:00:30.009724+0000","last_became_peered":"2023-12-13T00:00:30.009724+0000","last_unstale":"2023-12-13T00:28:33.302643+0000","last_undegraded":"2023-12-13T00:28:33.302643+0000","last_fullsized":"2023-12-13T00:28:33.302643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2023-12-13T00:28:33.302572+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2023-12-13T00:28:33.302572+0000","last_clean_scrub_stamp":"2023-12-13T00:28:33.302572+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:09:03.008018+0000","scrub_duration":0.0025511840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'58","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:28.924075+0000","last_change":"2023-12-13T00:28:28.924111+0000","last_active":"2023-12-13T00:28:28.924075+0000","last_peered":"2023-12-13T00:28:28.924075+0000","last_clean":"2023-12-13T00:28:28.924075+0000","last_became_active":"2023-12-13T00:00:31.150735+0000","last_became_peered":"2023-12-13T00:00:31.150735+0000","last_unstale":"2023-12-13T00:28:28.924075+0000","last_undegraded":"2023-12-13T00:28:28.924075+0000","last_fullsized":"2023-12-13T00:28:28.924075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-12-13T00:28:28.923981+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-12-13T00:28:28.923981+0000","last_clean_scrub_stamp":"2023-12-13T00:28:28.923981+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:40:47.032764+0000","scrub_duration":0.0010969529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'163","reported_seq":198,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:51.197798+0000","last_change":"2023-12-13T00:28:51.197818+0000","last_active":"2023-12-13T00:28:51.197798+0000","last_peered":"2023-12-13T00:28:51.197798+0000","last_clean":"2023-12-13T00:28:51.197798+0000","last_became_active":"2023-12-13T00:00:35.668361+0000","last_became_peered":"2023-12-13T00:00:35.668361+0000","last_unstale":"2023-12-13T00:28:51.197798+0000","last_undegraded":"2023-12-13T00:28:51.197798+0000","last_fullsized":"2023-12-13T00:28:51.197798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'163","last_scrub_stamp":"2023-12-13T00:28:51.197729+0000","last_deep_scrub":"27'163","last_deep_scrub_stamp":"2023-12-13T00:28:51.197729+0000","last_clean_scrub_stamp":"2023-12-13T00:28:51.197729+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:49:56.958095+0000","scrub_duration":0.001643537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":10445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:39.170459+0000","last_change":"2023-12-13T00:28:39.170483+0000","last_active":"2023-12-13T00:28:39.170459+0000","last_peered":"2023-12-13T00:28:39.170459+0000","last_clean":"2023-12-13T00:28:39.170459+0000","last_became_active":"2023-12-13T00:00:30.009644+0000","last_became_peered":"2023-12-13T00:00:30.009644+0000","last_unstale":"2023-12-13T00:28:39.170459+0000","last_undegraded":"2023-12-13T00:28:39.170459+0000","last_fullsized":"2023-12-13T00:28:39.170459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:39.170392+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:39.170392+0000","last_clean_scrub_stamp":"2023-12-13T00:28:39.170392+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:30:48.680502+0000","scrub_duration":0.001730407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'63","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:28.257980+0000","last_change":"2023-12-13T00:28:28.257999+0000","last_active":"2023-12-13T00:28:28.257980+0000","last_peered":"2023-12-13T00:28:28.257980+0000","last_clean":"2023-12-13T00:28:28.257980+0000","last_became_active":"2023-12-13T00:00:31.146516+0000","last_became_peered":"2023-12-13T00:00:31.146516+0000","last_unstale":"2023-12-13T00:28:28.257980+0000","last_undegraded":"2023-12-13T00:28:28.257980+0000","last_fullsized":"2023-12-13T00:28:28.257980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'63","last_scrub_stamp":"2023-12-13T00:28:28.257908+0000","last_deep_scrub":"27'63","last_deep_scrub_stamp":"2023-12-13T00:28:28.257908+0000","last_clean_scrub_stamp":"2023-12-13T00:28:28.257908+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:55:00.846548+0000","scrub_duration":0.00097492599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'175","reported_seq":210,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:50.183496+0000","last_change":"2023-12-13T00:28:50.183516+0000","last_active":"2023-12-13T00:28:50.183496+0000","last_peered":"2023-12-13T00:28:50.183496+0000","last_clean":"2023-12-13T00:28:50.183496+0000","last_became_active":"2023-12-13T00:00:35.668298+0000","last_became_peered":"2023-12-13T00:00:35.668298+0000","last_unstale":"2023-12-13T00:28:50.183496+0000","last_undegraded":"2023-12-13T00:28:50.183496+0000","last_fullsized":"2023-12-13T00:28:50.183496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'175","last_scrub_stamp":"2023-12-13T00:28:50.183430+0000","last_deep_scrub":"27'175","last_deep_scrub_stamp":"2023-12-13T00:28:50.183430+0000","last_clean_scrub_stamp":"2023-12-13T00:28:50.183430+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:16:52.106250+0000","scrub_duration":0.001845415,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'50","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:31.257801+0000","last_change":"2023-12-13T00:28:31.257801+0000","last_active":"2023-12-13T00:28:31.257801+0000","last_peered":"2023-12-13T00:28:31.257801+0000","last_clean":"2023-12-13T00:28:31.257801+0000","last_became_active":"2023-12-13T00:00:31.036062+0000","last_became_peered":"2023-12-13T00:00:31.036062+0000","last_unstale":"2023-12-13T00:28:31.257801+0000","last_undegraded":"2023-12-13T00:28:31.257801+0000","last_fullsized":"2023-12-13T00:28:31.257801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-13T00:28:31.257707+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-13T00:28:31.257707+0000","last_clean_scrub_stamp":"2023-12-13T00:28:31.257707+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:17:04.269503+0000","scrub_duration":0.001111849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'852","reported_seq":891,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:52.378285+0000","last_change":"2023-12-13T00:28:52.378314+0000","last_active":"2023-12-13T00:28:52.378285+0000","last_peered":"2023-12-13T00:28:52.378285+0000","last_clean":"2023-12-13T00:28:52.378285+0000","last_became_active":"2023-12-13T00:00:30.000782+0000","last_became_peered":"2023-12-13T00:00:30.000782+0000","last_unstale":"2023-12-13T00:28:52.378285+0000","last_undegraded":"2023-12-13T00:28:52.378285+0000","last_fullsized":"2023-12-13T00:28:52.378285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'852","last_scrub_stamp":"2023-12-13T00:28:52.378221+0000","last_deep_scrub":"27'852","last_deep_scrub_stamp":"2023-12-13T00:28:52.378221+0000","last_clean_scrub_stamp":"2023-12-13T00:28:52.378221+0000","objects_scrubbed":3,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:22:35.711609+0000","scrub_duration":0.014447793,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":4547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'149","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:02.332534+0000","last_change":"2023-12-13T00:29:02.332573+0000","last_active":"2023-12-13T00:29:02.332534+0000","last_peered":"2023-12-13T00:29:02.332534+0000","last_clean":"2023-12-13T00:29:02.332534+0000","last_became_active":"2023-12-13T00:00:35.661458+0000","last_became_peered":"2023-12-13T00:00:35.661458+0000","last_unstale":"2023-12-13T00:29:02.332534+0000","last_undegraded":"2023-12-13T00:29:02.332534+0000","last_fullsized":"2023-12-13T00:29:02.332534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'149","last_scrub_stamp":"2023-12-13T00:29:02.332432+0000","last_deep_scrub":"27'149","last_deep_scrub_stamp":"2023-12-13T00:29:02.332432+0000","last_clean_scrub_stamp":"2023-12-13T00:29:02.332432+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:39:33.583239+0000","scrub_duration":0.0022387319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":11179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'55","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:33.071406+0000","last_change":"2023-12-13T00:28:33.071426+0000","last_active":"2023-12-13T00:28:33.071406+0000","last_peered":"2023-12-13T00:28:33.071406+0000","last_clean":"2023-12-13T00:28:33.071406+0000","last_became_active":"2023-12-13T00:00:31.119447+0000","last_became_peered":"2023-12-13T00:00:31.119447+0000","last_unstale":"2023-12-13T00:28:33.071406+0000","last_undegraded":"2023-12-13T00:28:33.071406+0000","last_fullsized":"2023-12-13T00:28:33.071406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2023-12-13T00:28:33.071296+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2023-12-13T00:28:33.071296+0000","last_clean_scrub_stamp":"2023-12-13T00:28:33.071296+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:32:09.634850+0000","scrub_duration":0.001330962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'215","reported_seq":255,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:22.122493+0000","last_change":"2023-12-13T00:28:22.122493+0000","last_active":"2023-12-13T00:28:22.122493+0000","last_peered":"2023-12-13T00:28:22.122493+0000","last_clean":"2023-12-13T00:28:22.122493+0000","last_became_active":"2023-12-13T00:00:29.967929+0000","last_became_peered":"2023-12-13T00:00:29.967929+0000","last_unstale":"2023-12-13T00:28:22.122493+0000","last_undegraded":"2023-12-13T00:28:22.122493+0000","last_fullsized":"2023-12-13T00:28:22.122493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'215","last_scrub_stamp":"2023-12-13T00:28:22.122378+0000","last_deep_scrub":"27'215","last_deep_scrub_stamp":"2023-12-13T00:28:22.122378+0000","last_clean_scrub_stamp":"2023-12-13T00:28:22.122378+0000","objects_scrubbed":1,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:35:04.951172+0000","scrub_duration":0.001579186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":581,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'167","reported_seq":203,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:11.758421+0000","last_change":"2023-12-13T00:29:11.758443+0000","last_active":"2023-12-13T00:29:11.758421+0000","last_peered":"2023-12-13T00:29:11.758421+0000","last_clean":"2023-12-13T00:29:11.758421+0000","last_became_active":"2023-12-13T00:00:35.662469+0000","last_became_peered":"2023-12-13T00:00:35.662469+0000","last_unstale":"2023-12-13T00:29:11.758421+0000","last_undegraded":"2023-12-13T00:29:11.758421+0000","last_fullsized":"2023-12-13T00:29:11.758421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'167","last_scrub_stamp":"2023-12-13T00:29:11.758348+0000","last_deep_scrub":"27'167","last_deep_scrub_stamp":"2023-12-13T00:29:11.758348+0000","last_clean_scrub_stamp":"2023-12-13T00:29:11.758348+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:09:36.489651+0000","scrub_duration":0.0018809429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":19086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:46.938387+0000","last_change":"2023-12-13T00:28:46.938408+0000","last_active":"2023-12-13T00:28:46.938387+0000","last_peered":"2023-12-13T00:28:46.938387+0000","last_clean":"2023-12-13T00:28:46.938387+0000","last_became_active":"2023-12-13T00:00:31.142847+0000","last_became_peered":"2023-12-13T00:00:31.142847+0000","last_unstale":"2023-12-13T00:28:46.938387+0000","last_undegraded":"2023-12-13T00:28:46.938387+0000","last_fullsized":"2023-12-13T00:28:46.938387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:46.938316+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:46.938316+0000","last_clean_scrub_stamp":"2023-12-13T00:28:46.938316+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:53:47.130643+0000","scrub_duration":0.00094867900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'376","reported_seq":416,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:35.081637+0000","last_change":"2023-12-13T00:28:35.081637+0000","last_active":"2023-12-13T00:28:35.081637+0000","last_peered":"2023-12-13T00:28:35.081637+0000","last_clean":"2023-12-13T00:28:35.081637+0000","last_became_active":"2023-12-13T00:00:30.004195+0000","last_became_peered":"2023-12-13T00:00:30.004195+0000","last_unstale":"2023-12-13T00:28:35.081637+0000","last_undegraded":"2023-12-13T00:28:35.081637+0000","last_fullsized":"2023-12-13T00:28:35.081637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'376","last_scrub_stamp":"2023-12-13T00:28:35.081548+0000","last_deep_scrub":"27'376","last_deep_scrub_stamp":"2023-12-13T00:28:35.081548+0000","last_clean_scrub_stamp":"2023-12-13T00:28:35.081548+0000","objects_scrubbed":2,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:19:25.297573+0000","scrub_duration":0.0030443100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":373,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'154","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:54.009659+0000","last_change":"2023-12-13T00:28:54.009680+0000","last_active":"2023-12-13T00:28:54.009659+0000","last_peered":"2023-12-13T00:28:54.009659+0000","last_clean":"2023-12-13T00:28:54.009659+0000","last_became_active":"2023-12-13T00:00:35.659637+0000","last_became_peered":"2023-12-13T00:00:35.659637+0000","last_unstale":"2023-12-13T00:28:54.009659+0000","last_undegraded":"2023-12-13T00:28:54.009659+0000","last_fullsized":"2023-12-13T00:28:54.009659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'154","last_scrub_stamp":"2023-12-13T00:28:54.009591+0000","last_deep_scrub":"27'154","last_deep_scrub_stamp":"2023-12-13T00:28:54.009591+0000","last_clean_scrub_stamp":"2023-12-13T00:28:54.009591+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:33:48.756870+0000","scrub_duration":0.001554557,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":10280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'45","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:39.199140+0000","last_change":"2023-12-13T00:28:39.199140+0000","last_active":"2023-12-13T00:28:39.199140+0000","last_peered":"2023-12-13T00:28:39.199140+0000","last_clean":"2023-12-13T00:28:39.199140+0000","last_became_active":"2023-12-13T00:00:31.143673+0000","last_became_peered":"2023-12-13T00:00:31.143673+0000","last_unstale":"2023-12-13T00:28:39.199140+0000","last_undegraded":"2023-12-13T00:28:39.199140+0000","last_fullsized":"2023-12-13T00:28:39.199140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-13T00:28:39.199060+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-13T00:28:39.199060+0000","last_clean_scrub_stamp":"2023-12-13T00:28:39.199060+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:18:51.888473+0000","scrub_duration":0.00096585599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'7","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:30.333618+0000","last_change":"2023-12-13T00:28:30.333618+0000","last_active":"2023-12-13T00:28:30.333618+0000","last_peered":"2023-12-13T00:28:30.333618+0000","last_clean":"2023-12-13T00:28:30.333618+0000","last_became_active":"2023-12-13T00:00:30.005740+0000","last_became_peered":"2023-12-13T00:00:30.005740+0000","last_unstale":"2023-12-13T00:28:30.333618+0000","last_undegraded":"2023-12-13T00:28:30.333618+0000","last_fullsized":"2023-12-13T00:28:30.333618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:30.333541+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:30.333541+0000","last_clean_scrub_stamp":"2023-12-13T00:28:30.333541+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:00:50.961984+0000","scrub_duration":0.001992972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'170","reported_seq":206,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:54.149919+0000","last_change":"2023-12-13T00:28:54.149938+0000","last_active":"2023-12-13T00:28:54.149919+0000","last_peered":"2023-12-13T00:28:54.149919+0000","last_clean":"2023-12-13T00:28:54.149919+0000","last_became_active":"2023-12-13T00:00:35.665670+0000","last_became_peered":"2023-12-13T00:00:35.665670+0000","last_unstale":"2023-12-13T00:28:54.149919+0000","last_undegraded":"2023-12-13T00:28:54.149919+0000","last_fullsized":"2023-12-13T00:28:54.149919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'170","last_scrub_stamp":"2023-12-13T00:28:54.149855+0000","last_deep_scrub":"27'170","last_deep_scrub_stamp":"2023-12-13T00:28:54.149855+0000","last_clean_scrub_stamp":"2023-12-13T00:28:54.149855+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:19:36.272242+0000","scrub_duration":0.001524921,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'51","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:51.957464+0000","last_change":"2023-12-13T00:28:51.957483+0000","last_active":"2023-12-13T00:28:51.957464+0000","last_peered":"2023-12-13T00:28:51.957464+0000","last_clean":"2023-12-13T00:28:51.957464+0000","last_became_active":"2023-12-13T00:00:31.146435+0000","last_became_peered":"2023-12-13T00:00:31.146435+0000","last_unstale":"2023-12-13T00:28:51.957464+0000","last_undegraded":"2023-12-13T00:28:51.957464+0000","last_fullsized":"2023-12-13T00:28:51.957464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2023-12-13T00:28:51.957397+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2023-12-13T00:28:51.957397+0000","last_clean_scrub_stamp":"2023-12-13T00:28:51.957397+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:15:54.366317+0000","scrub_duration":0.00097599899999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'10","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:41.210535+0000","last_change":"2023-12-13T00:28:41.210570+0000","last_active":"2023-12-13T00:28:41.210535+0000","last_peered":"2023-12-13T00:28:41.210535+0000","last_clean":"2023-12-13T00:28:41.210535+0000","last_became_active":"2023-12-13T00:00:30.005909+0000","last_became_peered":"2023-12-13T00:00:30.005909+0000","last_unstale":"2023-12-13T00:28:41.210535+0000","last_undegraded":"2023-12-13T00:28:41.210535+0000","last_fullsized":"2023-12-13T00:28:41.210535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2023-12-13T00:28:41.210455+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2023-12-13T00:28:41.210455+0000","last_clean_scrub_stamp":"2023-12-13T00:28:41.210455+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:53:50.670216+0000","scrub_duration":0.0021685620000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'164","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:45.110808+0000","last_change":"2023-12-13T00:28:45.110846+0000","last_active":"2023-12-13T00:28:45.110808+0000","last_peered":"2023-12-13T00:28:45.110808+0000","last_clean":"2023-12-13T00:28:45.110808+0000","last_became_active":"2023-12-13T00:00:35.665521+0000","last_became_peered":"2023-12-13T00:00:35.665521+0000","last_unstale":"2023-12-13T00:28:45.110808+0000","last_undegraded":"2023-12-13T00:28:45.110808+0000","last_fullsized":"2023-12-13T00:28:45.110808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'164","last_scrub_stamp":"2023-12-13T00:28:45.110706+0000","last_deep_scrub":"27'164","last_deep_scrub_stamp":"2023-12-13T00:28:45.110706+0000","last_clean_scrub_stamp":"2023-12-13T00:28:45.110706+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:12:17.829651+0000","scrub_duration":0.0021503999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:06.036222+0000","last_change":"2023-12-13T00:29:06.036243+0000","last_active":"2023-12-13T00:29:06.036222+0000","last_peered":"2023-12-13T00:29:06.036222+0000","last_clean":"2023-12-13T00:29:06.036222+0000","last_became_active":"2023-12-13T00:00:31.145115+0000","last_became_peered":"2023-12-13T00:00:31.145115+0000","last_unstale":"2023-12-13T00:29:06.036222+0000","last_undegraded":"2023-12-13T00:29:06.036222+0000","last_fullsized":"2023-12-13T00:29:06.036222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:29:06.036142+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:29:06.036142+0000","last_clean_scrub_stamp":"2023-12-13T00:29:06.036142+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:19:18.725554+0000","scrub_duration":0.001275207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'171","reported_seq":211,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:38.973198+0000","last_change":"2023-12-13T00:28:38.973220+0000","last_active":"2023-12-13T00:28:38.973198+0000","last_peered":"2023-12-13T00:28:38.973198+0000","last_clean":"2023-12-13T00:28:38.973198+0000","last_became_active":"2023-12-13T00:00:30.005988+0000","last_became_peered":"2023-12-13T00:00:30.005988+0000","last_unstale":"2023-12-13T00:28:38.973198+0000","last_undegraded":"2023-12-13T00:28:38.973198+0000","last_fullsized":"2023-12-13T00:28:38.973198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'171","last_scrub_stamp":"2023-12-13T00:28:38.973118+0000","last_deep_scrub":"27'171","last_deep_scrub_stamp":"2023-12-13T00:28:38.973118+0000","last_clean_scrub_stamp":"2023-12-13T00:28:38.973118+0000","objects_scrubbed":2,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:10.652676+0000","scrub_duration":0.0034998709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'165","reported_seq":203,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:17.071397+0000","last_change":"2023-12-13T00:29:17.071419+0000","last_active":"2023-12-13T00:29:17.071397+0000","last_peered":"2023-12-13T00:29:17.071397+0000","last_clean":"2023-12-13T00:29:17.071397+0000","last_became_active":"2023-12-13T00:00:35.662612+0000","last_became_peered":"2023-12-13T00:00:35.662612+0000","last_unstale":"2023-12-13T00:29:17.071397+0000","last_undegraded":"2023-12-13T00:29:17.071397+0000","last_fullsized":"2023-12-13T00:29:17.071397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'165","last_scrub_stamp":"2023-12-13T00:29:17.071309+0000","last_deep_scrub":"27'165","last_deep_scrub_stamp":"2023-12-13T00:29:17.071309+0000","last_clean_scrub_stamp":"2023-12-13T00:29:17.071309+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:31:42.379169+0000","scrub_duration":0.001979625,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":14176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:44.147372+0000","last_change":"2023-12-13T00:28:44.147393+0000","last_active":"2023-12-13T00:28:44.147372+0000","last_peered":"2023-12-13T00:28:44.147372+0000","last_clean":"2023-12-13T00:28:44.147372+0000","last_became_active":"2023-12-13T00:00:31.117814+0000","last_became_peered":"2023-12-13T00:00:31.117814+0000","last_unstale":"2023-12-13T00:28:44.147372+0000","last_undegraded":"2023-12-13T00:28:44.147372+0000","last_fullsized":"2023-12-13T00:28:44.147372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:44.147296+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:44.147296+0000","last_clean_scrub_stamp":"2023-12-13T00:28:44.147296+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:50:07.776088+0000","scrub_duration":0.00099350000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'7","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:46.241923+0000","last_change":"2023-12-13T00:28:46.241945+0000","last_active":"2023-12-13T00:28:46.241923+0000","last_peered":"2023-12-13T00:28:46.241923+0000","last_clean":"2023-12-13T00:28:46.241923+0000","last_became_active":"2023-12-13T00:00:30.000755+0000","last_became_peered":"2023-12-13T00:00:30.000755+0000","last_unstale":"2023-12-13T00:28:46.241923+0000","last_undegraded":"2023-12-13T00:28:46.241923+0000","last_fullsized":"2023-12-13T00:28:46.241923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:46.241866+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:46.241866+0000","last_clean_scrub_stamp":"2023-12-13T00:28:46.241866+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:57:37.680204+0000","scrub_duration":0.0021721430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'145","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:53.389094+0000","last_change":"2023-12-13T00:28:53.389113+0000","last_active":"2023-12-13T00:28:53.389094+0000","last_peered":"2023-12-13T00:28:53.389094+0000","last_clean":"2023-12-13T00:28:53.389094+0000","last_became_active":"2023-12-13T00:01:00.544906+0000","last_became_peered":"2023-12-13T00:01:00.544906+0000","last_unstale":"2023-12-13T00:28:53.389094+0000","last_undegraded":"2023-12-13T00:28:53.389094+0000","last_fullsized":"2023-12-13T00:28:53.389094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'145","last_scrub_stamp":"2023-12-13T00:28:53.389028+0000","last_deep_scrub":"27'145","last_deep_scrub_stamp":"2023-12-13T00:28:53.389028+0000","last_clean_scrub_stamp":"2023-12-13T00:28:53.389028+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:40:15.132704+0000","scrub_duration":0.0015357649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,5],"acting":[6,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:24.142032+0000","last_change":"2023-12-13T00:28:24.142076+0000","last_active":"2023-12-13T00:28:24.142032+0000","last_peered":"2023-12-13T00:28:24.142032+0000","last_clean":"2023-12-13T00:28:24.142032+0000","last_became_active":"2023-12-13T00:00:31.143182+0000","last_became_peered":"2023-12-13T00:00:31.143182+0000","last_unstale":"2023-12-13T00:28:24.142032+0000","last_undegraded":"2023-12-13T00:28:24.142032+0000","last_fullsized":"2023-12-13T00:28:24.142032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:24.141950+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:24.141950+0000","last_clean_scrub_stamp":"2023-12-13T00:28:24.141950+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:23:02.587212+0000","scrub_duration":0.0015258120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:35.452206+0000","last_change":"2023-12-13T00:28:35.452225+0000","last_active":"2023-12-13T00:28:35.452206+0000","last_peered":"2023-12-13T00:28:35.452206+0000","last_clean":"2023-12-13T00:28:35.452206+0000","last_became_active":"2023-12-13T00:00:29.968860+0000","last_became_peered":"2023-12-13T00:00:29.968860+0000","last_unstale":"2023-12-13T00:28:35.452206+0000","last_undegraded":"2023-12-13T00:28:35.452206+0000","last_fullsized":"2023-12-13T00:28:35.452206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-13T00:28:35.452139+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-13T00:28:35.452139+0000","last_clean_scrub_stamp":"2023-12-13T00:28:35.452139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:35:28.566025+0000","scrub_duration":0.00098817000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'163","reported_seq":200,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:49.276541+0000","last_change":"2023-12-13T00:28:49.276562+0000","last_active":"2023-12-13T00:28:49.276541+0000","last_peered":"2023-12-13T00:28:49.276541+0000","last_clean":"2023-12-13T00:28:49.276541+0000","last_became_active":"2023-12-13T00:00:35.642215+0000","last_became_peered":"2023-12-13T00:00:35.642215+0000","last_unstale":"2023-12-13T00:28:49.276541+0000","last_undegraded":"2023-12-13T00:28:49.276541+0000","last_fullsized":"2023-12-13T00:28:49.276541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'163","last_scrub_stamp":"2023-12-13T00:28:49.276460+0000","last_deep_scrub":"27'163","last_deep_scrub_stamp":"2023-12-13T00:28:49.276460+0000","last_clean_scrub_stamp":"2023-12-13T00:28:49.276460+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:40:36.202097+0000","scrub_duration":0.0018069290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":6488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'62","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:05.869200+0000","last_change":"2023-12-13T00:29:05.869234+0000","last_active":"2023-12-13T00:29:05.869200+0000","last_peered":"2023-12-13T00:29:05.869200+0000","last_clean":"2023-12-13T00:29:05.869200+0000","last_became_active":"2023-12-13T00:00:31.149587+0000","last_became_peered":"2023-12-13T00:00:31.149587+0000","last_unstale":"2023-12-13T00:29:05.869200+0000","last_undegraded":"2023-12-13T00:29:05.869200+0000","last_fullsized":"2023-12-13T00:29:05.869200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'62","last_scrub_stamp":"2023-12-13T00:29:05.869123+0000","last_deep_scrub":"27'62","last_deep_scrub_stamp":"2023-12-13T00:29:05.869123+0000","last_clean_scrub_stamp":"2023-12-13T00:29:05.869123+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:18:10.514215+0000","scrub_duration":0.00099296800000000011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'793","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:53.376052+0000","last_change":"2023-12-13T00:28:53.376075+0000","last_active":"2023-12-13T00:28:53.376052+0000","last_peered":"2023-12-13T00:28:53.376052+0000","last_clean":"2023-12-13T00:28:53.376052+0000","last_became_active":"2023-12-13T00:00:29.997848+0000","last_became_peered":"2023-12-13T00:00:29.997848+0000","last_unstale":"2023-12-13T00:28:53.376052+0000","last_undegraded":"2023-12-13T00:28:53.376052+0000","last_fullsized":"2023-12-13T00:28:53.376052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'793","last_scrub_stamp":"2023-12-13T00:28:53.375997+0000","last_deep_scrub":"27'793","last_deep_scrub_stamp":"2023-12-13T00:28:53.375997+0000","last_clean_scrub_stamp":"2023-12-13T00:28:53.375997+0000","objects_scrubbed":1,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:18:55.892407+0000","scrub_duration":0.010981958,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":4476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'121","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:45.165260+0000","last_change":"2023-12-13T00:28:45.165299+0000","last_active":"2023-12-13T00:28:45.165260+0000","last_peered":"2023-12-13T00:28:45.165260+0000","last_clean":"2023-12-13T00:28:45.165260+0000","last_became_active":"2023-12-13T00:00:35.651766+0000","last_became_peered":"2023-12-13T00:00:35.651766+0000","last_unstale":"2023-12-13T00:28:45.165260+0000","last_undegraded":"2023-12-13T00:28:45.165260+0000","last_fullsized":"2023-12-13T00:28:45.165260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'121","last_scrub_stamp":"2023-12-13T00:28:45.165150+0000","last_deep_scrub":"27'121","last_deep_scrub_stamp":"2023-12-13T00:28:45.165150+0000","last_clean_scrub_stamp":"2023-12-13T00:28:45.165150+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:14:35.008693+0000","scrub_duration":0.0018200479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":7468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'58","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:05.458952+0000","last_change":"2023-12-13T00:29:05.458975+0000","last_active":"2023-12-13T00:29:05.458952+0000","last_peered":"2023-12-13T00:29:05.458952+0000","last_clean":"2023-12-13T00:29:05.458952+0000","last_became_active":"2023-12-13T00:00:31.120330+0000","last_became_peered":"2023-12-13T00:00:31.120330+0000","last_unstale":"2023-12-13T00:29:05.458952+0000","last_undegraded":"2023-12-13T00:29:05.458952+0000","last_fullsized":"2023-12-13T00:29:05.458952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-12-13T00:29:05.458868+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-12-13T00:29:05.458868+0000","last_clean_scrub_stamp":"2023-12-13T00:29:05.458868+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:01:06.593897+0000","scrub_duration":0.0011108209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'412","reported_seq":758,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:26.117195+0000","last_change":"2023-12-13T00:28:26.117217+0000","last_active":"2023-12-13T00:28:26.117195+0000","last_peered":"2023-12-13T00:28:26.117195+0000","last_clean":"2023-12-13T00:28:26.117195+0000","last_became_active":"2023-12-13T00:00:30.000015+0000","last_became_peered":"2023-12-13T00:00:30.000015+0000","last_unstale":"2023-12-13T00:28:26.117195+0000","last_undegraded":"2023-12-13T00:28:26.117195+0000","last_fullsized":"2023-12-13T00:28:26.117195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'412","last_scrub_stamp":"2023-12-13T00:28:26.117130+0000","last_deep_scrub":"27'412","last_deep_scrub_stamp":"2023-12-13T00:28:26.117130+0000","last_clean_scrub_stamp":"2023-12-13T00:28:26.117130+0000","objects_scrubbed":3,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:30:24.978930+0000","scrub_duration":0.002759671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58234,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":306,"num_read_kb":318,"num_write":408,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'147","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:51.300520+0000","last_change":"2023-12-13T00:28:51.300541+0000","last_active":"2023-12-13T00:28:51.300520+0000","last_peered":"2023-12-13T00:28:51.300520+0000","last_clean":"2023-12-13T00:28:51.300520+0000","last_became_active":"2023-12-13T00:00:35.667028+0000","last_became_peered":"2023-12-13T00:00:35.667028+0000","last_unstale":"2023-12-13T00:28:51.300520+0000","last_undegraded":"2023-12-13T00:28:51.300520+0000","last_fullsized":"2023-12-13T00:28:51.300520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'147","last_scrub_stamp":"2023-12-13T00:28:51.300454+0000","last_deep_scrub":"27'147","last_deep_scrub_stamp":"2023-12-13T00:28:51.300454+0000","last_clean_scrub_stamp":"2023-12-13T00:28:51.300454+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:17:24.312250+0000","scrub_duration":0.001522614,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":5383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'60","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:43.144047+0000","last_change":"2023-12-13T00:28:43.144086+0000","last_active":"2023-12-13T00:28:43.144047+0000","last_peered":"2023-12-13T00:28:43.144047+0000","last_clean":"2023-12-13T00:28:43.144047+0000","last_became_active":"2023-12-13T00:00:31.140597+0000","last_became_peered":"2023-12-13T00:00:31.140597+0000","last_unstale":"2023-12-13T00:28:43.144047+0000","last_undegraded":"2023-12-13T00:28:43.144047+0000","last_fullsized":"2023-12-13T00:28:43.144047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'60","last_scrub_stamp":"2023-12-13T00:28:43.143962+0000","last_deep_scrub":"27'60","last_deep_scrub_stamp":"2023-12-13T00:28:43.143962+0000","last_clean_scrub_stamp":"2023-12-13T00:28:43.143962+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:22:40.210116+0000","scrub_duration":0.001118927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'7","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:48.319830+0000","last_change":"2023-12-13T00:28:48.319856+0000","last_active":"2023-12-13T00:28:48.319830+0000","last_peered":"2023-12-13T00:28:48.319830+0000","last_clean":"2023-12-13T00:28:48.319830+0000","last_became_active":"2023-12-13T00:00:29.998552+0000","last_became_peered":"2023-12-13T00:00:29.998552+0000","last_unstale":"2023-12-13T00:28:48.319830+0000","last_undegraded":"2023-12-13T00:28:48.319830+0000","last_fullsized":"2023-12-13T00:28:48.319830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:48.319762+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:48.319762+0000","last_clean_scrub_stamp":"2023-12-13T00:28:48.319762+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:56:31.750088+0000","scrub_duration":0.0023572189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'127","reported_seq":164,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:19.327289+0000","last_change":"2023-12-13T00:29:19.327314+0000","last_active":"2023-12-13T00:29:19.327289+0000","last_peered":"2023-12-13T00:29:19.327289+0000","last_clean":"2023-12-13T00:29:19.327289+0000","last_became_active":"2023-12-13T00:00:35.666135+0000","last_became_peered":"2023-12-13T00:00:35.666135+0000","last_unstale":"2023-12-13T00:29:19.327289+0000","last_undegraded":"2023-12-13T00:29:19.327289+0000","last_fullsized":"2023-12-13T00:29:19.327289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'127","last_scrub_stamp":"2023-12-13T00:29:19.327194+0000","last_deep_scrub":"27'127","last_deep_scrub_stamp":"2023-12-13T00:29:19.327194+0000","last_clean_scrub_stamp":"2023-12-13T00:29:19.327194+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:34:58.986327+0000","scrub_duration":0.0018964120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":7535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'49","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:04.015344+0000","last_change":"2023-12-13T00:29:04.015391+0000","last_active":"2023-12-13T00:29:04.015344+0000","last_peered":"2023-12-13T00:29:04.015344+0000","last_clean":"2023-12-13T00:29:04.015344+0000","last_became_active":"2023-12-13T00:00:31.148421+0000","last_became_peered":"2023-12-13T00:00:31.148421+0000","last_unstale":"2023-12-13T00:29:04.015344+0000","last_undegraded":"2023-12-13T00:29:04.015344+0000","last_fullsized":"2023-12-13T00:29:04.015344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2023-12-13T00:29:04.015270+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2023-12-13T00:29:04.015270+0000","last_clean_scrub_stamp":"2023-12-13T00:29:04.015270+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:40:25.758946+0000","scrub_duration":0.0011265330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'8","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:54.366080+0000","last_change":"2023-12-13T00:28:54.366124+0000","last_active":"2023-12-13T00:28:54.366080+0000","last_peered":"2023-12-13T00:28:54.366080+0000","last_clean":"2023-12-13T00:28:54.366080+0000","last_became_active":"2023-12-13T00:00:30.000854+0000","last_became_peered":"2023-12-13T00:00:30.000854+0000","last_unstale":"2023-12-13T00:28:54.366080+0000","last_undegraded":"2023-12-13T00:28:54.366080+0000","last_fullsized":"2023-12-13T00:28:54.366080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2023-12-13T00:28:54.365977+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2023-12-13T00:28:54.365977+0000","last_clean_scrub_stamp":"2023-12-13T00:28:54.365977+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:08:15.266525+0000","scrub_duration":0.0028323900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:15.904956+0000","last_change":"2023-12-13T00:28:15.904996+0000","last_active":"2023-12-13T00:28:15.904956+0000","last_peered":"2023-12-13T00:28:15.904956+0000","last_clean":"2023-12-13T00:28:15.904956+0000","last_became_active":"2023-12-13T00:00:08.574464+0000","last_became_peered":"2023-12-13T00:00:08.574464+0000","last_unstale":"2023-12-13T00:28:15.904956+0000","last_undegraded":"2023-12-13T00:28:15.904956+0000","last_fullsized":"2023-12-13T00:28:15.904956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2023-12-13T00:28:15.904877+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2023-12-13T00:28:15.904877+0000","last_clean_scrub_stamp":"2023-12-13T00:28:15.904877+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:36:22.553417+0000","scrub_duration":0.0040292729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'166","reported_seq":203,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:05.311054+0000","last_change":"2023-12-13T00:29:05.311076+0000","last_active":"2023-12-13T00:29:05.311054+0000","last_peered":"2023-12-13T00:29:05.311054+0000","last_clean":"2023-12-13T00:29:05.311054+0000","last_became_active":"2023-12-13T00:00:35.660976+0000","last_became_peered":"2023-12-13T00:00:35.660976+0000","last_unstale":"2023-12-13T00:29:05.311054+0000","last_undegraded":"2023-12-13T00:29:05.311054+0000","last_fullsized":"2023-12-13T00:29:05.311054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'166","last_scrub_stamp":"2023-12-13T00:29:05.310980+0000","last_deep_scrub":"27'166","last_deep_scrub_stamp":"2023-12-13T00:29:05.310980+0000","last_clean_scrub_stamp":"2023-12-13T00:29:05.310980+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:56:46.377786+0000","scrub_duration":0.0016033779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":12423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'58","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:58.323239+0000","last_change":"2023-12-13T00:28:58.323281+0000","last_active":"2023-12-13T00:28:58.323239+0000","last_peered":"2023-12-13T00:28:58.323239+0000","last_clean":"2023-12-13T00:28:58.323239+0000","last_became_active":"2023-12-13T00:00:31.036127+0000","last_became_peered":"2023-12-13T00:00:31.036127+0000","last_unstale":"2023-12-13T00:28:58.323239+0000","last_undegraded":"2023-12-13T00:28:58.323239+0000","last_fullsized":"2023-12-13T00:28:58.323239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-12-13T00:28:58.323160+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-12-13T00:28:58.323160+0000","last_clean_scrub_stamp":"2023-12-13T00:28:58.323160+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:25:14.317802+0000","scrub_duration":0.001107993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:32.127657+0000","last_change":"2023-12-13T00:28:32.127692+0000","last_active":"2023-12-13T00:28:32.127657+0000","last_peered":"2023-12-13T00:28:32.127657+0000","last_clean":"2023-12-13T00:28:32.127657+0000","last_became_active":"2023-12-13T00:00:30.005943+0000","last_became_peered":"2023-12-13T00:00:30.005943+0000","last_unstale":"2023-12-13T00:28:32.127657+0000","last_undegraded":"2023-12-13T00:28:32.127657+0000","last_fullsized":"2023-12-13T00:28:32.127657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2023-12-13T00:28:32.127578+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2023-12-13T00:28:32.127578+0000","last_clean_scrub_stamp":"2023-12-13T00:28:32.127578+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:51:20.859478+0000","scrub_duration":0.0026550509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'164","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:42.160309+0000","last_change":"2023-12-13T00:28:42.160309+0000","last_active":"2023-12-13T00:28:42.160309+0000","last_peered":"2023-12-13T00:28:42.160309+0000","last_clean":"2023-12-13T00:28:42.160309+0000","last_became_active":"2023-12-13T00:00:35.664071+0000","last_became_peered":"2023-12-13T00:00:35.664071+0000","last_unstale":"2023-12-13T00:28:42.160309+0000","last_undegraded":"2023-12-13T00:28:42.160309+0000","last_fullsized":"2023-12-13T00:28:42.160309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'164","last_scrub_stamp":"2023-12-13T00:28:42.160213+0000","last_deep_scrub":"27'164","last_deep_scrub_stamp":"2023-12-13T00:28:42.160213+0000","last_clean_scrub_stamp":"2023-12-13T00:28:42.160213+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:14:39.060151+0000","scrub_duration":0.0016151290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":5432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'59","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:07.858275+0000","last_change":"2023-12-13T00:29:07.858295+0000","last_active":"2023-12-13T00:29:07.858275+0000","last_peered":"2023-12-13T00:29:07.858275+0000","last_clean":"2023-12-13T00:29:07.858275+0000","last_became_active":"2023-12-13T00:00:31.147523+0000","last_became_peered":"2023-12-13T00:00:31.147523+0000","last_unstale":"2023-12-13T00:29:07.858275+0000","last_undegraded":"2023-12-13T00:29:07.858275+0000","last_fullsized":"2023-12-13T00:29:07.858275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'59","last_scrub_stamp":"2023-12-13T00:29:07.858203+0000","last_deep_scrub":"27'59","last_deep_scrub_stamp":"2023-12-13T00:29:07.858203+0000","last_clean_scrub_stamp":"2023-12-13T00:29:07.858203+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:25:05.617181+0000","scrub_duration":0.0011723599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:41.555126+0000","last_change":"2023-12-13T00:28:41.555161+0000","last_active":"2023-12-13T00:28:41.555126+0000","last_peered":"2023-12-13T00:28:41.555126+0000","last_clean":"2023-12-13T00:28:41.555126+0000","last_became_active":"2023-12-13T00:00:30.002427+0000","last_became_peered":"2023-12-13T00:00:30.002427+0000","last_unstale":"2023-12-13T00:28:41.555126+0000","last_undegraded":"2023-12-13T00:28:41.555126+0000","last_fullsized":"2023-12-13T00:28:41.555126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2023-12-13T00:28:41.555034+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2023-12-13T00:28:41.555034+0000","last_clean_scrub_stamp":"2023-12-13T00:28:41.555034+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:13:56.431900+0000","scrub_duration":0.0022469870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'177","reported_seq":213,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:18.345923+0000","last_change":"2023-12-13T00:29:18.345946+0000","last_active":"2023-12-13T00:29:18.345923+0000","last_peered":"2023-12-13T00:29:18.345923+0000","last_clean":"2023-12-13T00:29:18.345923+0000","last_became_active":"2023-12-13T00:00:35.660939+0000","last_became_peered":"2023-12-13T00:00:35.660939+0000","last_unstale":"2023-12-13T00:29:18.345923+0000","last_undegraded":"2023-12-13T00:29:18.345923+0000","last_fullsized":"2023-12-13T00:29:18.345923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'177","last_scrub_stamp":"2023-12-13T00:29:18.345838+0000","last_deep_scrub":"27'177","last_deep_scrub_stamp":"2023-12-13T00:29:18.345838+0000","last_clean_scrub_stamp":"2023-12-13T00:29:18.345838+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:29:06.263636+0000","scrub_duration":0.0020228920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":11316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'64","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:08.833041+0000","last_change":"2023-12-13T00:29:08.833063+0000","last_active":"2023-12-13T00:29:08.833041+0000","last_peered":"2023-12-13T00:29:08.833041+0000","last_clean":"2023-12-13T00:29:08.833041+0000","last_became_active":"2023-12-13T00:00:31.145997+0000","last_became_peered":"2023-12-13T00:00:31.145997+0000","last_unstale":"2023-12-13T00:29:08.833041+0000","last_undegraded":"2023-12-13T00:29:08.833041+0000","last_fullsized":"2023-12-13T00:29:08.833041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2023-12-13T00:29:08.832966+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2023-12-13T00:29:08.832966+0000","last_clean_scrub_stamp":"2023-12-13T00:29:08.832966+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:59:43.483893+0000","scrub_duration":0.001268595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'7","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:41.954922+0000","last_change":"2023-12-13T00:28:41.954942+0000","last_active":"2023-12-13T00:28:41.954922+0000","last_peered":"2023-12-13T00:28:41.954922+0000","last_clean":"2023-12-13T00:28:41.954922+0000","last_became_active":"2023-12-13T00:00:29.967916+0000","last_became_peered":"2023-12-13T00:00:29.967916+0000","last_unstale":"2023-12-13T00:28:41.954922+0000","last_undegraded":"2023-12-13T00:28:41.954922+0000","last_fullsized":"2023-12-13T00:28:41.954922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:41.954861+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:41.954861+0000","last_clean_scrub_stamp":"2023-12-13T00:28:41.954861+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:49:34.653049+0000","scrub_duration":0.0018726369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'137","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:01.307306+0000","last_change":"2023-12-13T00:29:01.307352+0000","last_active":"2023-12-13T00:29:01.307306+0000","last_peered":"2023-12-13T00:29:01.307306+0000","last_clean":"2023-12-13T00:29:01.307306+0000","last_became_active":"2023-12-13T00:00:35.666891+0000","last_became_peered":"2023-12-13T00:00:35.666891+0000","last_unstale":"2023-12-13T00:29:01.307306+0000","last_undegraded":"2023-12-13T00:29:01.307306+0000","last_fullsized":"2023-12-13T00:29:01.307306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'137","last_scrub_stamp":"2023-12-13T00:29:01.307221+0000","last_deep_scrub":"27'137","last_deep_scrub_stamp":"2023-12-13T00:29:01.307221+0000","last_clean_scrub_stamp":"2023-12-13T00:29:01.307221+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:11:03.895843+0000","scrub_duration":0.0017657079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":9622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'54","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:26.150820+0000","last_change":"2023-12-13T00:28:26.150842+0000","last_active":"2023-12-13T00:28:26.150820+0000","last_peered":"2023-12-13T00:28:26.150820+0000","last_clean":"2023-12-13T00:28:26.150820+0000","last_became_active":"2023-12-13T00:00:31.148016+0000","last_became_peered":"2023-12-13T00:00:31.148016+0000","last_unstale":"2023-12-13T00:28:26.150820+0000","last_undegraded":"2023-12-13T00:28:26.150820+0000","last_fullsized":"2023-12-13T00:28:26.150820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2023-12-13T00:28:26.150748+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2023-12-13T00:28:26.150748+0000","last_clean_scrub_stamp":"2023-12-13T00:28:26.150748+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:33:21.472115+0000","scrub_duration":0.00095305200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'291","reported_seq":330,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:42.164800+0000","last_change":"2023-12-13T00:28:42.164841+0000","last_active":"2023-12-13T00:28:42.164800+0000","last_peered":"2023-12-13T00:28:42.164800+0000","last_clean":"2023-12-13T00:28:42.164800+0000","last_became_active":"2023-12-13T00:00:30.007907+0000","last_became_peered":"2023-12-13T00:00:30.007907+0000","last_unstale":"2023-12-13T00:28:42.164800+0000","last_undegraded":"2023-12-13T00:28:42.164800+0000","last_fullsized":"2023-12-13T00:28:42.164800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'291","last_scrub_stamp":"2023-12-13T00:28:42.164728+0000","last_deep_scrub":"27'291","last_deep_scrub_stamp":"2023-12-13T00:28:42.164728+0000","last_clean_scrub_stamp":"2023-12-13T00:28:42.164728+0000","objects_scrubbed":2,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:34:33.906063+0000","scrub_duration":0.00265343,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'132","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:41.917153+0000","last_change":"2023-12-13T00:28:41.917153+0000","last_active":"2023-12-13T00:28:41.917153+0000","last_peered":"2023-12-13T00:28:41.917153+0000","last_clean":"2023-12-13T00:28:41.917153+0000","last_became_active":"2023-12-13T00:00:35.660627+0000","last_became_peered":"2023-12-13T00:00:35.660627+0000","last_unstale":"2023-12-13T00:28:41.917153+0000","last_undegraded":"2023-12-13T00:28:41.917153+0000","last_fullsized":"2023-12-13T00:28:41.917153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'132","last_scrub_stamp":"2023-12-13T00:28:41.916997+0000","last_deep_scrub":"27'132","last_deep_scrub_stamp":"2023-12-13T00:28:41.916997+0000","last_clean_scrub_stamp":"2023-12-13T00:28:41.916997+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:02:51.470194+0000","scrub_duration":0.0017199540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":10143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'55","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:19.224564+0000","last_change":"2023-12-13T00:28:19.224564+0000","last_active":"2023-12-13T00:28:19.224564+0000","last_peered":"2023-12-13T00:28:19.224564+0000","last_clean":"2023-12-13T00:28:19.224564+0000","last_became_active":"2023-12-13T00:00:31.142150+0000","last_became_peered":"2023-12-13T00:00:31.142150+0000","last_unstale":"2023-12-13T00:28:19.224564+0000","last_undegraded":"2023-12-13T00:28:19.224564+0000","last_fullsized":"2023-12-13T00:28:19.224564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2023-12-13T00:28:19.224487+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2023-12-13T00:28:19.224487+0000","last_clean_scrub_stamp":"2023-12-13T00:28:19.224487+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:22:16.290641+0000","scrub_duration":0.00092248000000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'806","reported_seq":845,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:40.006646+0000","last_change":"2023-12-13T00:28:40.006677+0000","last_active":"2023-12-13T00:28:40.006646+0000","last_peered":"2023-12-13T00:28:40.006646+0000","last_clean":"2023-12-13T00:28:40.006646+0000","last_became_active":"2023-12-13T00:00:30.000388+0000","last_became_peered":"2023-12-13T00:00:30.000388+0000","last_unstale":"2023-12-13T00:28:40.006646+0000","last_undegraded":"2023-12-13T00:28:40.006646+0000","last_fullsized":"2023-12-13T00:28:40.006646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'806","last_scrub_stamp":"2023-12-13T00:28:40.006581+0000","last_deep_scrub":"27'806","last_deep_scrub_stamp":"2023-12-13T00:28:40.006581+0000","last_clean_scrub_stamp":"2023-12-13T00:28:40.006581+0000","objects_scrubbed":9,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:33:57.889707+0000","scrub_duration":0.009767141,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277997,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'170","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:31.931405+0000","last_change":"2023-12-13T00:00:35.666659+0000","last_active":"2023-12-13T00:27:31.931405+0000","last_peered":"2023-12-13T00:27:31.931405+0000","last_clean":"2023-12-13T00:27:31.931405+0000","last_became_active":"2023-12-13T00:00:35.666304+0000","last_became_peered":"2023-12-13T00:00:35.666304+0000","last_unstale":"2023-12-13T00:27:31.931405+0000","last_undegraded":"2023-12-13T00:27:31.931405+0000","last_fullsized":"2023-12-13T00:27:31.931405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":11255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'48","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:34.826516+0000","last_change":"2023-12-13T00:28:34.826536+0000","last_active":"2023-12-13T00:28:34.826516+0000","last_peered":"2023-12-13T00:28:34.826516+0000","last_clean":"2023-12-13T00:28:34.826516+0000","last_became_active":"2023-12-13T00:00:31.037398+0000","last_became_peered":"2023-12-13T00:00:31.037398+0000","last_unstale":"2023-12-13T00:28:34.826516+0000","last_undegraded":"2023-12-13T00:28:34.826516+0000","last_fullsized":"2023-12-13T00:28:34.826516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2023-12-13T00:28:34.826451+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2023-12-13T00:28:34.826451+0000","last_clean_scrub_stamp":"2023-12-13T00:28:34.826451+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:59:15.682252+0000","scrub_duration":0.001357818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'1357","reported_seq":1396,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:41.198342+0000","last_change":"2023-12-13T00:28:41.198366+0000","last_active":"2023-12-13T00:28:41.198342+0000","last_peered":"2023-12-13T00:28:41.198342+0000","last_clean":"2023-12-13T00:28:41.198342+0000","last_became_active":"2023-12-13T00:00:30.005752+0000","last_became_peered":"2023-12-13T00:00:30.005752+0000","last_unstale":"2023-12-13T00:28:41.198342+0000","last_undegraded":"2023-12-13T00:28:41.198342+0000","last_fullsized":"2023-12-13T00:28:41.198342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1357","last_scrub_stamp":"2023-12-13T00:28:41.198286+0000","last_deep_scrub":"27'1357","last_deep_scrub_stamp":"2023-12-13T00:28:41.198286+0000","last_clean_scrub_stamp":"2023-12-13T00:28:41.198286+0000","objects_scrubbed":2,"log_size":1357,"log_dups_size":0,"ondisk_log_size":1357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:13:56.075151+0000","scrub_duration":0.012562190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1349,"num_write_kb":4734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'175","reported_seq":202,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:27:29.824402+0000","last_change":"2023-12-13T00:00:35.666467+0000","last_active":"2023-12-13T00:27:29.824402+0000","last_peered":"2023-12-13T00:27:29.824402+0000","last_clean":"2023-12-13T00:27:29.824402+0000","last_became_active":"2023-12-13T00:00:35.666061+0000","last_became_peered":"2023-12-13T00:00:35.666061+0000","last_unstale":"2023-12-13T00:27:29.824402+0000","last_undegraded":"2023-12-13T00:27:29.824402+0000","last_fullsized":"2023-12-13T00:27:29.824402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":9890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'68","reported_seq":113,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:38.158958+0000","last_change":"2023-12-13T00:28:38.158977+0000","last_active":"2023-12-13T00:28:38.158958+0000","last_peered":"2023-12-13T00:28:38.158958+0000","last_clean":"2023-12-13T00:28:38.158958+0000","last_became_active":"2023-12-13T00:01:00.702089+0000","last_became_peered":"2023-12-13T00:01:00.702089+0000","last_unstale":"2023-12-13T00:28:38.158958+0000","last_undegraded":"2023-12-13T00:28:38.158958+0000","last_fullsized":"2023-12-13T00:28:38.158958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'68","last_scrub_stamp":"2023-12-13T00:28:38.158895+0000","last_deep_scrub":"27'68","last_deep_scrub_stamp":"2023-12-13T00:28:38.158895+0000","last_clean_scrub_stamp":"2023-12-13T00:28:38.158895+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:39:59.902571+0000","scrub_duration":0.001233034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'395","reported_seq":434,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:49.337548+0000","last_change":"2023-12-13T00:28:49.337585+0000","last_active":"2023-12-13T00:28:49.337548+0000","last_peered":"2023-12-13T00:28:49.337548+0000","last_clean":"2023-12-13T00:28:49.337548+0000","last_became_active":"2023-12-13T00:00:30.000803+0000","last_became_peered":"2023-12-13T00:00:30.000803+0000","last_unstale":"2023-12-13T00:28:49.337548+0000","last_undegraded":"2023-12-13T00:28:49.337548+0000","last_fullsized":"2023-12-13T00:28:49.337548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'395","last_scrub_stamp":"2023-12-13T00:28:49.337458+0000","last_deep_scrub":"27'395","last_deep_scrub_stamp":"2023-12-13T00:28:49.337458+0000","last_clean_scrub_stamp":"2023-12-13T00:28:49.337458+0000","objects_scrubbed":2,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:21:10.689739+0000","scrub_duration":0.0083268639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2931508,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":386,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'176","reported_seq":212,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:46.186772+0000","last_change":"2023-12-13T00:28:46.186793+0000","last_active":"2023-12-13T00:28:46.186772+0000","last_peered":"2023-12-13T00:28:46.186772+0000","last_clean":"2023-12-13T00:28:46.186772+0000","last_became_active":"2023-12-13T00:00:35.649151+0000","last_became_peered":"2023-12-13T00:00:35.649151+0000","last_unstale":"2023-12-13T00:28:46.186772+0000","last_undegraded":"2023-12-13T00:28:46.186772+0000","last_fullsized":"2023-12-13T00:28:46.186772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'176","last_scrub_stamp":"2023-12-13T00:28:46.186698+0000","last_deep_scrub":"27'176","last_deep_scrub_stamp":"2023-12-13T00:28:46.186698+0000","last_clean_scrub_stamp":"2023-12-13T00:28:46.186698+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:03:58.809328+0000","scrub_duration":0.0016794010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'60","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:36.237979+0000","last_change":"2023-12-13T00:28:36.238000+0000","last_active":"2023-12-13T00:28:36.237979+0000","last_peered":"2023-12-13T00:28:36.237979+0000","last_clean":"2023-12-13T00:28:36.237979+0000","last_became_active":"2023-12-13T00:00:31.115678+0000","last_became_peered":"2023-12-13T00:00:31.115678+0000","last_unstale":"2023-12-13T00:28:36.237979+0000","last_undegraded":"2023-12-13T00:28:36.237979+0000","last_fullsized":"2023-12-13T00:28:36.237979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'60","last_scrub_stamp":"2023-12-13T00:28:36.237907+0000","last_deep_scrub":"27'60","last_deep_scrub_stamp":"2023-12-13T00:28:36.237907+0000","last_clean_scrub_stamp":"2023-12-13T00:28:36.237907+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:50:24.671743+0000","scrub_duration":0.001189753,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'15","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:32.043769+0000","last_change":"2023-12-13T00:28:32.043793+0000","last_active":"2023-12-13T00:28:32.043769+0000","last_peered":"2023-12-13T00:28:32.043769+0000","last_clean":"2023-12-13T00:28:32.043769+0000","last_became_active":"2023-12-13T00:00:30.004089+0000","last_became_peered":"2023-12-13T00:00:30.004089+0000","last_unstale":"2023-12-13T00:28:32.043769+0000","last_undegraded":"2023-12-13T00:28:32.043769+0000","last_fullsized":"2023-12-13T00:28:32.043769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2023-12-13T00:28:32.043698+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2023-12-13T00:28:32.043698+0000","last_clean_scrub_stamp":"2023-12-13T00:28:32.043698+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:59:12.899499+0000","scrub_duration":0.0033306949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'148","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:07.296657+0000","last_change":"2023-12-13T00:29:07.296678+0000","last_active":"2023-12-13T00:29:07.296657+0000","last_peered":"2023-12-13T00:29:07.296657+0000","last_clean":"2023-12-13T00:29:07.296657+0000","last_became_active":"2023-12-13T00:00:35.651907+0000","last_became_peered":"2023-12-13T00:00:35.651907+0000","last_unstale":"2023-12-13T00:29:07.296657+0000","last_undegraded":"2023-12-13T00:29:07.296657+0000","last_fullsized":"2023-12-13T00:29:07.296657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'148","last_scrub_stamp":"2023-12-13T00:29:07.296554+0000","last_deep_scrub":"27'148","last_deep_scrub_stamp":"2023-12-13T00:29:07.296554+0000","last_clean_scrub_stamp":"2023-12-13T00:29:07.296554+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:25:39.801678+0000","scrub_duration":0.001725875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":7909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'46","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:00.031661+0000","last_change":"2023-12-13T00:29:00.031682+0000","last_active":"2023-12-13T00:29:00.031661+0000","last_peered":"2023-12-13T00:29:00.031661+0000","last_clean":"2023-12-13T00:29:00.031661+0000","last_became_active":"2023-12-13T00:00:31.147846+0000","last_became_peered":"2023-12-13T00:00:31.147846+0000","last_unstale":"2023-12-13T00:29:00.031661+0000","last_undegraded":"2023-12-13T00:29:00.031661+0000","last_fullsized":"2023-12-13T00:29:00.031661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2023-12-13T00:29:00.031590+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2023-12-13T00:29:00.031590+0000","last_clean_scrub_stamp":"2023-12-13T00:29:00.031590+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:24:37.475363+0000","scrub_duration":0.0014236279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'1477","reported_seq":1516,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:19.181691+0000","last_change":"2023-12-13T00:28:19.181691+0000","last_active":"2023-12-13T00:28:19.181691+0000","last_peered":"2023-12-13T00:28:19.181691+0000","last_clean":"2023-12-13T00:28:19.181691+0000","last_became_active":"2023-12-13T00:00:30.001420+0000","last_became_peered":"2023-12-13T00:00:30.001420+0000","last_unstale":"2023-12-13T00:28:19.181691+0000","last_undegraded":"2023-12-13T00:28:19.181691+0000","last_fullsized":"2023-12-13T00:28:19.181691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1477","last_scrub_stamp":"2023-12-13T00:28:19.181611+0000","last_deep_scrub":"27'1477","last_deep_scrub_stamp":"2023-12-13T00:28:19.181611+0000","last_clean_scrub_stamp":"2023-12-13T00:28:19.181611+0000","objects_scrubbed":5,"log_size":1477,"log_dups_size":0,"ondisk_log_size":1477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:50:30.914232+0000","scrub_duration":0.013805400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1472,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'148","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.059832+0000","last_change":"2023-12-13T00:01:00.546607+0000","last_active":"2023-12-13T00:28:18.059832+0000","last_peered":"2023-12-13T00:28:18.059832+0000","last_clean":"2023-12-13T00:28:18.059832+0000","last_became_active":"2023-12-13T00:01:00.546264+0000","last_became_peered":"2023-12-13T00:01:00.546264+0000","last_unstale":"2023-12-13T00:28:18.059832+0000","last_undegraded":"2023-12-13T00:28:18.059832+0000","last_fullsized":"2023-12-13T00:28:18.059832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'60","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:27.237666+0000","last_change":"2023-12-13T00:28:27.237666+0000","last_active":"2023-12-13T00:28:27.237666+0000","last_peered":"2023-12-13T00:28:27.237666+0000","last_clean":"2023-12-13T00:28:27.237666+0000","last_became_active":"2023-12-13T00:00:31.138723+0000","last_became_peered":"2023-12-13T00:00:31.138723+0000","last_unstale":"2023-12-13T00:28:27.237666+0000","last_undegraded":"2023-12-13T00:28:27.237666+0000","last_fullsized":"2023-12-13T00:28:27.237666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'60","last_scrub_stamp":"2023-12-13T00:28:27.237585+0000","last_deep_scrub":"27'60","last_deep_scrub_stamp":"2023-12-13T00:28:27.237585+0000","last_clean_scrub_stamp":"2023-12-13T00:28:27.237585+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:53:27.429911+0000","scrub_duration":0.000960584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'220","reported_seq":258,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:30.078636+0000","last_change":"2023-12-13T00:28:30.078699+0000","last_active":"2023-12-13T00:28:30.078636+0000","last_peered":"2023-12-13T00:28:30.078636+0000","last_clean":"2023-12-13T00:28:30.078636+0000","last_became_active":"2023-12-13T00:00:30.002823+0000","last_became_peered":"2023-12-13T00:00:30.002823+0000","last_unstale":"2023-12-13T00:28:30.078636+0000","last_undegraded":"2023-12-13T00:28:30.078636+0000","last_fullsized":"2023-12-13T00:28:30.078636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'220","last_scrub_stamp":"2023-12-13T00:28:30.078552+0000","last_deep_scrub":"27'220","last_deep_scrub_stamp":"2023-12-13T00:28:30.078552+0000","last_clean_scrub_stamp":"2023-12-13T00:28:30.078552+0000","objects_scrubbed":3,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:40:48.187335+0000","scrub_duration":0.0037294989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'219","reported_seq":264,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:52.223877+0000","last_change":"2023-12-13T00:28:52.223898+0000","last_active":"2023-12-13T00:28:52.223877+0000","last_peered":"2023-12-13T00:28:52.223877+0000","last_clean":"2023-12-13T00:28:52.223877+0000","last_became_active":"2023-12-13T00:01:00.697231+0000","last_became_peered":"2023-12-13T00:01:00.697231+0000","last_unstale":"2023-12-13T00:28:52.223877+0000","last_undegraded":"2023-12-13T00:28:52.223877+0000","last_fullsized":"2023-12-13T00:28:52.223877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'219","last_scrub_stamp":"2023-12-13T00:28:52.223810+0000","last_deep_scrub":"27'219","last_deep_scrub_stamp":"2023-12-13T00:28:52.223810+0000","last_clean_scrub_stamp":"2023-12-13T00:28:52.223810+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:50:31.544246+0000","scrub_duration":0.00158483,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":195,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'66","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:33.389091+0000","last_change":"2023-12-13T00:28:33.389111+0000","last_active":"2023-12-13T00:28:33.389091+0000","last_peered":"2023-12-13T00:28:33.389091+0000","last_clean":"2023-12-13T00:28:33.389091+0000","last_became_active":"2023-12-13T00:00:31.027239+0000","last_became_peered":"2023-12-13T00:00:31.027239+0000","last_unstale":"2023-12-13T00:28:33.389091+0000","last_undegraded":"2023-12-13T00:28:33.389091+0000","last_fullsized":"2023-12-13T00:28:33.389091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2023-12-13T00:28:33.389025+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2023-12-13T00:28:33.389025+0000","last_clean_scrub_stamp":"2023-12-13T00:28:33.389025+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:09:03.094471+0000","scrub_duration":0.001342815,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:38.193475+0000","last_change":"2023-12-13T00:28:38.193497+0000","last_active":"2023-12-13T00:28:38.193475+0000","last_peered":"2023-12-13T00:28:38.193475+0000","last_clean":"2023-12-13T00:28:38.193475+0000","last_became_active":"2023-12-13T00:00:30.009351+0000","last_became_peered":"2023-12-13T00:00:30.009351+0000","last_unstale":"2023-12-13T00:28:38.193475+0000","last_undegraded":"2023-12-13T00:28:38.193475+0000","last_fullsized":"2023-12-13T00:28:38.193475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2023-12-13T00:28:38.193420+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2023-12-13T00:28:38.193420+0000","last_clean_scrub_stamp":"2023-12-13T00:28:38.193420+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:34:55.196705+0000","scrub_duration":0.0019863580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'190","reported_seq":223,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:13.810904+0000","last_change":"2023-12-13T00:29:13.810927+0000","last_active":"2023-12-13T00:29:13.810904+0000","last_peered":"2023-12-13T00:29:13.810904+0000","last_clean":"2023-12-13T00:29:13.810904+0000","last_became_active":"2023-12-13T00:01:00.717019+0000","last_became_peered":"2023-12-13T00:01:00.717019+0000","last_unstale":"2023-12-13T00:29:13.810904+0000","last_undegraded":"2023-12-13T00:29:13.810904+0000","last_fullsized":"2023-12-13T00:29:13.810904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'190","last_scrub_stamp":"2023-12-13T00:29:13.810822+0000","last_deep_scrub":"27'190","last_deep_scrub_stamp":"2023-12-13T00:29:13.810822+0000","last_clean_scrub_stamp":"2023-12-13T00:29:13.810822+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:17:05.151592+0000","scrub_duration":0.001588129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":9378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"27'64","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:30.200435+0000","last_change":"2023-12-13T00:28:30.200455+0000","last_active":"2023-12-13T00:28:30.200435+0000","last_peered":"2023-12-13T00:28:30.200435+0000","last_clean":"2023-12-13T00:28:30.200435+0000","last_became_active":"2023-12-13T00:00:31.139656+0000","last_became_peered":"2023-12-13T00:00:31.139656+0000","last_unstale":"2023-12-13T00:28:30.200435+0000","last_undegraded":"2023-12-13T00:28:30.200435+0000","last_fullsized":"2023-12-13T00:28:30.200435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2023-12-13T00:28:30.200368+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2023-12-13T00:28:30.200368+0000","last_clean_scrub_stamp":"2023-12-13T00:28:30.200368+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:05:42.786288+0000","scrub_duration":0.0010289330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'84","reported_seq":122,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:21.916919+0000","last_change":"2023-12-13T00:28:21.916941+0000","last_active":"2023-12-13T00:28:21.916919+0000","last_peered":"2023-12-13T00:28:21.916919+0000","last_clean":"2023-12-13T00:28:21.916919+0000","last_became_active":"2023-12-13T00:00:30.002630+0000","last_became_peered":"2023-12-13T00:00:30.002630+0000","last_unstale":"2023-12-13T00:28:21.916919+0000","last_undegraded":"2023-12-13T00:28:21.916919+0000","last_fullsized":"2023-12-13T00:28:21.916919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'84","last_scrub_stamp":"2023-12-13T00:28:21.916861+0000","last_deep_scrub":"27'84","last_deep_scrub_stamp":"2023-12-13T00:28:21.916861+0000","last_clean_scrub_stamp":"2023-12-13T00:28:21.916861+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:34:21.020077+0000","scrub_duration":0.002537564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'123","reported_seq":159,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:07.006972+0000","last_change":"2023-12-13T00:29:07.006996+0000","last_active":"2023-12-13T00:29:07.006972+0000","last_peered":"2023-12-13T00:29:07.006972+0000","last_clean":"2023-12-13T00:29:07.006972+0000","last_became_active":"2023-12-13T00:00:35.649401+0000","last_became_peered":"2023-12-13T00:00:35.649401+0000","last_unstale":"2023-12-13T00:29:07.006972+0000","last_undegraded":"2023-12-13T00:29:07.006972+0000","last_fullsized":"2023-12-13T00:29:07.006972+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'123","last_scrub_stamp":"2023-12-13T00:29:07.006884+0000","last_deep_scrub":"27'123","last_deep_scrub_stamp":"2023-12-13T00:29:07.006884+0000","last_clean_scrub_stamp":"2023-12-13T00:29:07.006884+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:29:34.291813+0000","scrub_duration":0.0016617940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":7272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'122","reported_seq":152,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:18.059886+0000","last_change":"2023-12-13T00:00:35.662790+0000","last_active":"2023-12-13T00:28:18.059886+0000","last_peered":"2023-12-13T00:28:18.059886+0000","last_clean":"2023-12-13T00:28:18.059886+0000","last_became_active":"2023-12-13T00:00:35.662406+0000","last_became_peered":"2023-12-13T00:00:35.662406+0000","last_unstale":"2023-12-13T00:28:18.059886+0000","last_undegraded":"2023-12-13T00:28:18.059886+0000","last_fullsized":"2023-12-13T00:28:18.059886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T00:00:34.296627+0000","last_clean_scrub_stamp":"2023-12-13T00:00:34.296627+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":7728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'66","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:42.928265+0000","last_change":"2023-12-13T00:28:42.928300+0000","last_active":"2023-12-13T00:28:42.928265+0000","last_peered":"2023-12-13T00:28:42.928265+0000","last_clean":"2023-12-13T00:28:42.928265+0000","last_became_active":"2023-12-13T00:00:31.142823+0000","last_became_peered":"2023-12-13T00:00:31.142823+0000","last_unstale":"2023-12-13T00:28:42.928265+0000","last_undegraded":"2023-12-13T00:28:42.928265+0000","last_fullsized":"2023-12-13T00:28:42.928265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2023-12-13T00:28:42.928203+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2023-12-13T00:28:42.928203+0000","last_clean_scrub_stamp":"2023-12-13T00:28:42.928203+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:50:06.556995+0000","scrub_duration":0.0010733419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:44.169296+0000","last_change":"2023-12-13T00:28:44.169330+0000","last_active":"2023-12-13T00:28:44.169296+0000","last_peered":"2023-12-13T00:28:44.169296+0000","last_clean":"2023-12-13T00:28:44.169296+0000","last_became_active":"2023-12-13T00:00:30.004496+0000","last_became_peered":"2023-12-13T00:00:30.004496+0000","last_unstale":"2023-12-13T00:28:44.169296+0000","last_undegraded":"2023-12-13T00:28:44.169296+0000","last_fullsized":"2023-12-13T00:28:44.169296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:44.169196+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:44.169196+0000","last_clean_scrub_stamp":"2023-12-13T00:28:44.169196+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:15:10.983277+0000","scrub_duration":0.0010496419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'188","reported_seq":225,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:03.329024+0000","last_change":"2023-12-13T00:29:03.329045+0000","last_active":"2023-12-13T00:29:03.329024+0000","last_peered":"2023-12-13T00:29:03.329024+0000","last_clean":"2023-12-13T00:29:03.329024+0000","last_became_active":"2023-12-13T00:00:35.666075+0000","last_became_peered":"2023-12-13T00:00:35.666075+0000","last_unstale":"2023-12-13T00:29:03.329024+0000","last_undegraded":"2023-12-13T00:29:03.329024+0000","last_fullsized":"2023-12-13T00:29:03.329024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'188","last_scrub_stamp":"2023-12-13T00:29:03.328949+0000","last_deep_scrub":"27'188","last_deep_scrub_stamp":"2023-12-13T00:29:03.328949+0000","last_clean_scrub_stamp":"2023-12-13T00:29:03.328949+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:54:19.087895+0000","scrub_duration":0.0016475299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":17531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'63","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:26.387168+0000","last_change":"2023-12-13T00:28:26.387186+0000","last_active":"2023-12-13T00:28:26.387168+0000","last_peered":"2023-12-13T00:28:26.387168+0000","last_clean":"2023-12-13T00:28:26.387168+0000","last_became_active":"2023-12-13T00:00:31.116209+0000","last_became_peered":"2023-12-13T00:00:31.116209+0000","last_unstale":"2023-12-13T00:28:26.387168+0000","last_undegraded":"2023-12-13T00:28:26.387168+0000","last_fullsized":"2023-12-13T00:28:26.387168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'63","last_scrub_stamp":"2023-12-13T00:28:26.387107+0000","last_deep_scrub":"27'63","last_deep_scrub_stamp":"2023-12-13T00:28:26.387107+0000","last_clean_scrub_stamp":"2023-12-13T00:28:26.387107+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:20:18.635398+0000","scrub_duration":0.00089511699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'486","reported_seq":1002,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:27.221032+0000","last_change":"2023-12-13T00:28:27.221072+0000","last_active":"2023-12-13T00:28:27.221032+0000","last_peered":"2023-12-13T00:28:27.221032+0000","last_clean":"2023-12-13T00:28:27.221032+0000","last_became_active":"2023-12-13T00:00:30.006026+0000","last_became_peered":"2023-12-13T00:00:30.006026+0000","last_unstale":"2023-12-13T00:28:27.221032+0000","last_undegraded":"2023-12-13T00:28:27.221032+0000","last_fullsized":"2023-12-13T00:28:27.221032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'486","last_scrub_stamp":"2023-12-13T00:28:27.220940+0000","last_deep_scrub":"27'486","last_deep_scrub_stamp":"2023-12-13T00:28:27.220940+0000","last_clean_scrub_stamp":"2023-12-13T00:28:27.220940+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:02:36.774137+0000","scrub_duration":0.003497904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92099,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":501,"num_write":481,"num_write_kb":501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'1033","reported_seq":1764,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:43.219768+0000","last_change":"2023-12-13T00:28:43.219796+0000","last_active":"2023-12-13T00:28:43.219768+0000","last_peered":"2023-12-13T00:28:43.219768+0000","last_clean":"2023-12-13T00:28:43.219768+0000","last_became_active":"2023-12-13T00:00:30.004214+0000","last_became_peered":"2023-12-13T00:00:30.004214+0000","last_unstale":"2023-12-13T00:28:43.219768+0000","last_undegraded":"2023-12-13T00:28:43.219768+0000","last_fullsized":"2023-12-13T00:28:43.219768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1033","last_scrub_stamp":"2023-12-13T00:28:43.219704+0000","last_deep_scrub":"27'1033","last_deep_scrub_stamp":"2023-12-13T00:28:43.219704+0000","last_clean_scrub_stamp":"2023-12-13T00:28:43.219704+0000","objects_scrubbed":3,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:57:11.700770+0000","scrub_duration":0.0078829299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1792997,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":693,"num_read_kb":705,"num_write":1026,"num_write_kb":2509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'68","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:48.916365+0000","last_change":"2023-12-13T00:28:48.916384+0000","last_active":"2023-12-13T00:28:48.916365+0000","last_peered":"2023-12-13T00:28:48.916365+0000","last_clean":"2023-12-13T00:28:48.916365+0000","last_became_active":"2023-12-13T00:00:31.146818+0000","last_became_peered":"2023-12-13T00:00:31.146818+0000","last_unstale":"2023-12-13T00:28:48.916365+0000","last_undegraded":"2023-12-13T00:28:48.916365+0000","last_fullsized":"2023-12-13T00:28:48.916365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'68","last_scrub_stamp":"2023-12-13T00:28:48.916293+0000","last_deep_scrub":"27'68","last_deep_scrub_stamp":"2023-12-13T00:28:48.916293+0000","last_clean_scrub_stamp":"2023-12-13T00:28:48.916293+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:55:21.504933+0000","scrub_duration":0.0013653420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'150","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:08.019877+0000","last_change":"2023-12-13T00:29:08.019914+0000","last_active":"2023-12-13T00:29:08.019877+0000","last_peered":"2023-12-13T00:29:08.019877+0000","last_clean":"2023-12-13T00:29:08.019877+0000","last_became_active":"2023-12-13T00:00:35.642114+0000","last_became_peered":"2023-12-13T00:00:35.642114+0000","last_unstale":"2023-12-13T00:29:08.019877+0000","last_undegraded":"2023-12-13T00:29:08.019877+0000","last_fullsized":"2023-12-13T00:29:08.019877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'150","last_scrub_stamp":"2023-12-13T00:29:08.019777+0000","last_deep_scrub":"27'150","last_deep_scrub_stamp":"2023-12-13T00:29:08.019777+0000","last_clean_scrub_stamp":"2023-12-13T00:29:08.019777+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:54:17.479538+0000","scrub_duration":0.0016483660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":10646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'2841","reported_seq":2879,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:37.492377+0000","last_change":"2023-12-13T00:28:37.492403+0000","last_active":"2023-12-13T00:28:37.492377+0000","last_peered":"2023-12-13T00:28:37.492377+0000","last_clean":"2023-12-13T00:28:37.492377+0000","last_became_active":"2023-12-13T00:00:29.972018+0000","last_became_peered":"2023-12-13T00:00:29.972018+0000","last_unstale":"2023-12-13T00:28:37.492377+0000","last_undegraded":"2023-12-13T00:28:37.492377+0000","last_fullsized":"2023-12-13T00:28:37.492377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2841","last_scrub_stamp":"2023-12-13T00:28:37.492311+0000","last_deep_scrub":"27'2841","last_deep_scrub_stamp":"2023-12-13T00:28:37.492311+0000","last_clean_scrub_stamp":"2023-12-13T00:28:37.492311+0000","objects_scrubbed":4,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:48:54.932186+0000","scrub_duration":0.032490435999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2827,"num_write_kb":13646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'70","reported_seq":107,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:36.841889+0000","last_change":"2023-12-13T00:28:36.841907+0000","last_active":"2023-12-13T00:28:36.841889+0000","last_peered":"2023-12-13T00:28:36.841889+0000","last_clean":"2023-12-13T00:28:36.841889+0000","last_became_active":"2023-12-13T00:00:31.037445+0000","last_became_peered":"2023-12-13T00:00:31.037445+0000","last_unstale":"2023-12-13T00:28:36.841889+0000","last_undegraded":"2023-12-13T00:28:36.841889+0000","last_fullsized":"2023-12-13T00:28:36.841889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'70","last_scrub_stamp":"2023-12-13T00:28:36.841827+0000","last_deep_scrub":"27'70","last_deep_scrub_stamp":"2023-12-13T00:28:36.841827+0000","last_clean_scrub_stamp":"2023-12-13T00:28:36.841827+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:32:13.405381+0000","scrub_duration":0.001030577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'116","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:52.979507+0000","last_change":"2023-12-13T00:28:52.979547+0000","last_active":"2023-12-13T00:28:52.979507+0000","last_peered":"2023-12-13T00:28:52.979507+0000","last_clean":"2023-12-13T00:28:52.979507+0000","last_became_active":"2023-12-13T00:00:35.660984+0000","last_became_peered":"2023-12-13T00:00:35.660984+0000","last_unstale":"2023-12-13T00:28:52.979507+0000","last_undegraded":"2023-12-13T00:28:52.979507+0000","last_fullsized":"2023-12-13T00:28:52.979507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'116","last_scrub_stamp":"2023-12-13T00:28:52.979429+0000","last_deep_scrub":"27'116","last_deep_scrub_stamp":"2023-12-13T00:28:52.979429+0000","last_clean_scrub_stamp":"2023-12-13T00:28:52.979429+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:42:34.764745+0000","scrub_duration":0.001495531,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":9076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:29.162461+0000","last_change":"2023-12-13T00:28:29.162479+0000","last_active":"2023-12-13T00:28:29.162461+0000","last_peered":"2023-12-13T00:28:29.162461+0000","last_clean":"2023-12-13T00:28:29.162461+0000","last_became_active":"2023-12-13T00:00:31.145225+0000","last_became_peered":"2023-12-13T00:00:31.145225+0000","last_unstale":"2023-12-13T00:28:29.162461+0000","last_undegraded":"2023-12-13T00:28:29.162461+0000","last_fullsized":"2023-12-13T00:28:29.162461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:29.162405+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:29.162405+0000","last_clean_scrub_stamp":"2023-12-13T00:28:29.162405+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:04:14.041159+0000","scrub_duration":0.001250794,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'66","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:39.122997+0000","last_change":"2023-12-13T00:28:39.123017+0000","last_active":"2023-12-13T00:28:39.122997+0000","last_peered":"2023-12-13T00:28:39.122997+0000","last_clean":"2023-12-13T00:28:39.122997+0000","last_became_active":"2023-12-13T00:00:31.119474+0000","last_became_peered":"2023-12-13T00:00:31.119474+0000","last_unstale":"2023-12-13T00:28:39.122997+0000","last_undegraded":"2023-12-13T00:28:39.122997+0000","last_fullsized":"2023-12-13T00:28:39.122997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2023-12-13T00:28:39.122931+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2023-12-13T00:28:39.122931+0000","last_clean_scrub_stamp":"2023-12-13T00:28:39.122931+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:35:21.951724+0000","scrub_duration":0.0011100109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'62","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:22.188610+0000","last_change":"2023-12-13T00:28:22.188630+0000","last_active":"2023-12-13T00:28:22.188610+0000","last_peered":"2023-12-13T00:28:22.188610+0000","last_clean":"2023-12-13T00:28:22.188610+0000","last_became_active":"2023-12-13T00:00:31.026922+0000","last_became_peered":"2023-12-13T00:00:31.026922+0000","last_unstale":"2023-12-13T00:28:22.188610+0000","last_undegraded":"2023-12-13T00:28:22.188610+0000","last_fullsized":"2023-12-13T00:28:22.188610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'62","last_scrub_stamp":"2023-12-13T00:28:22.188548+0000","last_deep_scrub":"27'62","last_deep_scrub_stamp":"2023-12-13T00:28:22.188548+0000","last_clean_scrub_stamp":"2023-12-13T00:28:22.188548+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:49:45.817340+0000","scrub_duration":0.00098737400000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'58","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:53.450911+0000","last_change":"2023-12-13T00:28:53.450930+0000","last_active":"2023-12-13T00:28:53.450911+0000","last_peered":"2023-12-13T00:28:53.450911+0000","last_clean":"2023-12-13T00:28:53.450911+0000","last_became_active":"2023-12-13T00:00:31.119685+0000","last_became_peered":"2023-12-13T00:00:31.119685+0000","last_unstale":"2023-12-13T00:28:53.450911+0000","last_undegraded":"2023-12-13T00:28:53.450911+0000","last_fullsized":"2023-12-13T00:28:53.450911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-12-13T00:28:53.450847+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-12-13T00:28:53.450847+0000","last_clean_scrub_stamp":"2023-12-13T00:28:53.450847+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:44:37.656495+0000","scrub_duration":0.0010318650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'45","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:40.262577+0000","last_change":"2023-12-13T00:28:40.262577+0000","last_active":"2023-12-13T00:28:40.262577+0000","last_peered":"2023-12-13T00:28:40.262577+0000","last_clean":"2023-12-13T00:28:40.262577+0000","last_became_active":"2023-12-13T00:00:31.150275+0000","last_became_peered":"2023-12-13T00:00:31.150275+0000","last_unstale":"2023-12-13T00:28:40.262577+0000","last_undegraded":"2023-12-13T00:28:40.262577+0000","last_fullsized":"2023-12-13T00:28:40.262577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-13T00:28:40.262455+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-13T00:28:40.262455+0000","last_clean_scrub_stamp":"2023-12-13T00:28:40.262455+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:33:58.145582+0000","scrub_duration":0.00145042,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'47","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:37.199211+0000","last_change":"2023-12-13T00:28:37.199211+0000","last_active":"2023-12-13T00:28:37.199211+0000","last_peered":"2023-12-13T00:28:37.199211+0000","last_clean":"2023-12-13T00:28:37.199211+0000","last_became_active":"2023-12-13T00:00:31.117409+0000","last_became_peered":"2023-12-13T00:00:31.117409+0000","last_unstale":"2023-12-13T00:28:37.199211+0000","last_undegraded":"2023-12-13T00:28:37.199211+0000","last_fullsized":"2023-12-13T00:28:37.199211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2023-12-13T00:28:37.199129+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2023-12-13T00:28:37.199129+0000","last_clean_scrub_stamp":"2023-12-13T00:28:37.199129+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:01:50.944562+0000","scrub_duration":0.0012582509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'59","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:36.226175+0000","last_change":"2023-12-13T00:28:36.226175+0000","last_active":"2023-12-13T00:28:36.226175+0000","last_peered":"2023-12-13T00:28:36.226175+0000","last_clean":"2023-12-13T00:28:36.226175+0000","last_became_active":"2023-12-13T00:00:31.141656+0000","last_became_peered":"2023-12-13T00:00:31.141656+0000","last_unstale":"2023-12-13T00:28:36.226175+0000","last_undegraded":"2023-12-13T00:28:36.226175+0000","last_fullsized":"2023-12-13T00:28:36.226175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'59","last_scrub_stamp":"2023-12-13T00:28:36.226090+0000","last_deep_scrub":"27'59","last_deep_scrub_stamp":"2023-12-13T00:28:36.226090+0000","last_clean_scrub_stamp":"2023-12-13T00:28:36.226090+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:49:10.922803+0000","scrub_duration":0.00088218499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'47","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:15.342381+0000","last_change":"2023-12-13T00:29:15.342401+0000","last_active":"2023-12-13T00:29:15.342381+0000","last_peered":"2023-12-13T00:29:15.342381+0000","last_clean":"2023-12-13T00:29:15.342381+0000","last_became_active":"2023-12-13T00:00:31.036113+0000","last_became_peered":"2023-12-13T00:00:31.036113+0000","last_unstale":"2023-12-13T00:29:15.342381+0000","last_undegraded":"2023-12-13T00:29:15.342381+0000","last_fullsized":"2023-12-13T00:29:15.342381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2023-12-13T00:29:15.342298+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2023-12-13T00:29:15.342298+0000","last_clean_scrub_stamp":"2023-12-13T00:29:15.342298+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:45:30.541172+0000","scrub_duration":0.0012070410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:29.241422+0000","last_change":"2023-12-13T00:28:29.241422+0000","last_active":"2023-12-13T00:28:29.241422+0000","last_peered":"2023-12-13T00:28:29.241422+0000","last_clean":"2023-12-13T00:28:29.241422+0000","last_became_active":"2023-12-13T00:00:31.026968+0000","last_became_peered":"2023-12-13T00:00:31.026968+0000","last_unstale":"2023-12-13T00:28:29.241422+0000","last_undegraded":"2023-12-13T00:28:29.241422+0000","last_fullsized":"2023-12-13T00:28:29.241422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:29.241340+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:29.241340+0000","last_clean_scrub_stamp":"2023-12-13T00:28:29.241340+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:15:31.650259+0000","scrub_duration":0.001146413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'71","reported_seq":109,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:51.503257+0000","last_change":"2023-12-13T00:28:51.503292+0000","last_active":"2023-12-13T00:28:51.503257+0000","last_peered":"2023-12-13T00:28:51.503257+0000","last_clean":"2023-12-13T00:28:51.503257+0000","last_became_active":"2023-12-13T00:00:31.138869+0000","last_became_peered":"2023-12-13T00:00:31.138869+0000","last_unstale":"2023-12-13T00:28:51.503257+0000","last_undegraded":"2023-12-13T00:28:51.503257+0000","last_fullsized":"2023-12-13T00:28:51.503257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'71","last_scrub_stamp":"2023-12-13T00:28:51.503181+0000","last_deep_scrub":"27'71","last_deep_scrub_stamp":"2023-12-13T00:28:51.503181+0000","last_clean_scrub_stamp":"2023-12-13T00:28:51.503181+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:08:04.701204+0000","scrub_duration":0.001225117,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'64","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:23.891788+0000","last_change":"2023-12-13T00:28:23.891810+0000","last_active":"2023-12-13T00:28:23.891788+0000","last_peered":"2023-12-13T00:28:23.891788+0000","last_clean":"2023-12-13T00:28:23.891788+0000","last_became_active":"2023-12-13T00:00:31.146264+0000","last_became_peered":"2023-12-13T00:00:31.146264+0000","last_unstale":"2023-12-13T00:28:23.891788+0000","last_undegraded":"2023-12-13T00:28:23.891788+0000","last_fullsized":"2023-12-13T00:28:23.891788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2023-12-13T00:28:23.891712+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2023-12-13T00:28:23.891712+0000","last_clean_scrub_stamp":"2023-12-13T00:28:23.891712+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:51:29.227897+0000","scrub_duration":0.001254544,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'68","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:21.053596+0000","last_change":"2023-12-13T00:28:21.053631+0000","last_active":"2023-12-13T00:28:21.053596+0000","last_peered":"2023-12-13T00:28:21.053596+0000","last_clean":"2023-12-13T00:28:21.053596+0000","last_became_active":"2023-12-13T00:00:31.143472+0000","last_became_peered":"2023-12-13T00:00:31.143472+0000","last_unstale":"2023-12-13T00:28:21.053596+0000","last_undegraded":"2023-12-13T00:28:21.053596+0000","last_fullsized":"2023-12-13T00:28:21.053596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'68","last_scrub_stamp":"2023-12-13T00:28:21.053523+0000","last_deep_scrub":"27'68","last_deep_scrub_stamp":"2023-12-13T00:28:21.053523+0000","last_clean_scrub_stamp":"2023-12-13T00:28:21.053523+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:02:30.606720+0000","scrub_duration":0.0014989020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'52","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:27.382187+0000","last_change":"2023-12-13T00:28:27.382226+0000","last_active":"2023-12-13T00:28:27.382187+0000","last_peered":"2023-12-13T00:28:27.382187+0000","last_clean":"2023-12-13T00:28:27.382187+0000","last_became_active":"2023-12-13T00:00:31.146159+0000","last_became_peered":"2023-12-13T00:00:31.146159+0000","last_unstale":"2023-12-13T00:28:27.382187+0000","last_undegraded":"2023-12-13T00:28:27.382187+0000","last_fullsized":"2023-12-13T00:28:27.382187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2023-12-13T00:28:27.382098+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2023-12-13T00:28:27.382098+0000","last_clean_scrub_stamp":"2023-12-13T00:28:27.382098+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:04:12.260853+0000","scrub_duration":0.001152623,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'67","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:57.334099+0000","last_change":"2023-12-13T00:28:57.334118+0000","last_active":"2023-12-13T00:28:57.334099+0000","last_peered":"2023-12-13T00:28:57.334099+0000","last_clean":"2023-12-13T00:28:57.334099+0000","last_became_active":"2023-12-13T00:00:31.143663+0000","last_became_peered":"2023-12-13T00:00:31.143663+0000","last_unstale":"2023-12-13T00:28:57.334099+0000","last_undegraded":"2023-12-13T00:28:57.334099+0000","last_fullsized":"2023-12-13T00:28:57.334099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'67","last_scrub_stamp":"2023-12-13T00:28:57.334032+0000","last_deep_scrub":"27'67","last_deep_scrub_stamp":"2023-12-13T00:28:57.334032+0000","last_clean_scrub_stamp":"2023-12-13T00:28:57.334032+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:56:51.246356+0000","scrub_duration":0.0013995189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'69","reported_seq":107,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:47.073022+0000","last_change":"2023-12-13T00:28:47.073043+0000","last_active":"2023-12-13T00:28:47.073022+0000","last_peered":"2023-12-13T00:28:47.073022+0000","last_clean":"2023-12-13T00:28:47.073022+0000","last_became_active":"2023-12-13T00:00:31.142067+0000","last_became_peered":"2023-12-13T00:00:31.142067+0000","last_unstale":"2023-12-13T00:28:47.073022+0000","last_undegraded":"2023-12-13T00:28:47.073022+0000","last_fullsized":"2023-12-13T00:28:47.073022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'69","last_scrub_stamp":"2023-12-13T00:28:47.072960+0000","last_deep_scrub":"27'69","last_deep_scrub_stamp":"2023-12-13T00:28:47.072960+0000","last_clean_scrub_stamp":"2023-12-13T00:28:47.072960+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:05:33.159119+0000","scrub_duration":0.0013398869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'51","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:59.316687+0000","last_change":"2023-12-13T00:28:59.316706+0000","last_active":"2023-12-13T00:28:59.316687+0000","last_peered":"2023-12-13T00:28:59.316687+0000","last_clean":"2023-12-13T00:28:59.316687+0000","last_became_active":"2023-12-13T00:00:31.146501+0000","last_became_peered":"2023-12-13T00:00:31.146501+0000","last_unstale":"2023-12-13T00:28:59.316687+0000","last_undegraded":"2023-12-13T00:28:59.316687+0000","last_fullsized":"2023-12-13T00:28:59.316687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2023-12-13T00:28:59.316627+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2023-12-13T00:28:59.316627+0000","last_clean_scrub_stamp":"2023-12-13T00:28:59.316627+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:19:06.190921+0000","scrub_duration":0.001138153,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'67","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:40.189909+0000","last_change":"2023-12-13T00:28:40.189927+0000","last_active":"2023-12-13T00:28:40.189909+0000","last_peered":"2023-12-13T00:28:40.189909+0000","last_clean":"2023-12-13T00:28:40.189909+0000","last_became_active":"2023-12-13T00:00:31.138738+0000","last_became_peered":"2023-12-13T00:00:31.138738+0000","last_unstale":"2023-12-13T00:28:40.189909+0000","last_undegraded":"2023-12-13T00:28:40.189909+0000","last_fullsized":"2023-12-13T00:28:40.189909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'67","last_scrub_stamp":"2023-12-13T00:28:40.189828+0000","last_deep_scrub":"27'67","last_deep_scrub_stamp":"2023-12-13T00:28:40.189828+0000","last_clean_scrub_stamp":"2023-12-13T00:28:40.189828+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:29:07.474756+0000","scrub_duration":0.00095464400000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'52","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:50.518152+0000","last_change":"2023-12-13T00:28:50.518190+0000","last_active":"2023-12-13T00:28:50.518152+0000","last_peered":"2023-12-13T00:28:50.518152+0000","last_clean":"2023-12-13T00:28:50.518152+0000","last_became_active":"2023-12-13T00:00:31.148251+0000","last_became_peered":"2023-12-13T00:00:31.148251+0000","last_unstale":"2023-12-13T00:28:50.518152+0000","last_undegraded":"2023-12-13T00:28:50.518152+0000","last_fullsized":"2023-12-13T00:28:50.518152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2023-12-13T00:28:50.518079+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2023-12-13T00:28:50.518079+0000","last_clean_scrub_stamp":"2023-12-13T00:28:50.518079+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:24:22.899572+0000","scrub_duration":0.0010737329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'58","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:38.176733+0000","last_change":"2023-12-13T00:28:38.176733+0000","last_active":"2023-12-13T00:28:38.176733+0000","last_peered":"2023-12-13T00:28:38.176733+0000","last_clean":"2023-12-13T00:28:38.176733+0000","last_became_active":"2023-12-13T00:00:31.117423+0000","last_became_peered":"2023-12-13T00:00:31.117423+0000","last_unstale":"2023-12-13T00:28:38.176733+0000","last_undegraded":"2023-12-13T00:28:38.176733+0000","last_fullsized":"2023-12-13T00:28:38.176733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-12-13T00:28:38.176651+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-12-13T00:28:38.176651+0000","last_clean_scrub_stamp":"2023-12-13T00:28:38.176651+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:31:57.197976+0000","scrub_duration":0.00092640599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'67","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:33.115979+0000","last_change":"2023-12-13T00:28:33.116013+0000","last_active":"2023-12-13T00:28:33.115979+0000","last_peered":"2023-12-13T00:28:33.115979+0000","last_clean":"2023-12-13T00:28:33.115979+0000","last_became_active":"2023-12-13T00:00:31.150324+0000","last_became_peered":"2023-12-13T00:00:31.150324+0000","last_unstale":"2023-12-13T00:28:33.115979+0000","last_undegraded":"2023-12-13T00:28:33.115979+0000","last_fullsized":"2023-12-13T00:28:33.115979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'67","last_scrub_stamp":"2023-12-13T00:28:33.115863+0000","last_deep_scrub":"27'67","last_deep_scrub_stamp":"2023-12-13T00:28:33.115863+0000","last_clean_scrub_stamp":"2023-12-13T00:28:33.115863+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:07:24.061579+0000","scrub_duration":0.001322997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'63","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:02.938114+0000","last_change":"2023-12-13T00:29:02.938132+0000","last_active":"2023-12-13T00:29:02.938114+0000","last_peered":"2023-12-13T00:29:02.938114+0000","last_clean":"2023-12-13T00:29:02.938114+0000","last_became_active":"2023-12-13T00:00:31.146444+0000","last_became_peered":"2023-12-13T00:00:31.146444+0000","last_unstale":"2023-12-13T00:29:02.938114+0000","last_undegraded":"2023-12-13T00:29:02.938114+0000","last_fullsized":"2023-12-13T00:29:02.938114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'63","last_scrub_stamp":"2023-12-13T00:29:02.938049+0000","last_deep_scrub":"27'63","last_deep_scrub_stamp":"2023-12-13T00:29:02.938049+0000","last_clean_scrub_stamp":"2023-12-13T00:29:02.938049+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:15:47.767419+0000","scrub_duration":0.00097593500000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'67","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:25.363437+0000","last_change":"2023-12-13T00:28:25.363455+0000","last_active":"2023-12-13T00:28:25.363437+0000","last_peered":"2023-12-13T00:28:25.363437+0000","last_clean":"2023-12-13T00:28:25.363437+0000","last_became_active":"2023-12-13T00:00:31.148529+0000","last_became_peered":"2023-12-13T00:00:31.148529+0000","last_unstale":"2023-12-13T00:28:25.363437+0000","last_undegraded":"2023-12-13T00:28:25.363437+0000","last_fullsized":"2023-12-13T00:28:25.363437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'67","last_scrub_stamp":"2023-12-13T00:28:25.363359+0000","last_deep_scrub":"27'67","last_deep_scrub_stamp":"2023-12-13T00:28:25.363359+0000","last_clean_scrub_stamp":"2023-12-13T00:28:25.363359+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:30:26.094520+0000","scrub_duration":0.0010738740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'59","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:50.981134+0000","last_change":"2023-12-13T00:28:50.981152+0000","last_active":"2023-12-13T00:28:50.981134+0000","last_peered":"2023-12-13T00:28:50.981134+0000","last_clean":"2023-12-13T00:28:50.981134+0000","last_became_active":"2023-12-13T00:00:31.149685+0000","last_became_peered":"2023-12-13T00:00:31.149685+0000","last_unstale":"2023-12-13T00:28:50.981134+0000","last_undegraded":"2023-12-13T00:28:50.981134+0000","last_fullsized":"2023-12-13T00:28:50.981134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'59","last_scrub_stamp":"2023-12-13T00:28:50.981064+0000","last_deep_scrub":"27'59","last_deep_scrub_stamp":"2023-12-13T00:28:50.981064+0000","last_clean_scrub_stamp":"2023-12-13T00:28:50.981064+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:44:35.186712+0000","scrub_duration":0.00088980899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'62","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:39.871025+0000","last_change":"2023-12-13T00:28:39.871044+0000","last_active":"2023-12-13T00:28:39.871025+0000","last_peered":"2023-12-13T00:28:39.871025+0000","last_clean":"2023-12-13T00:28:39.871025+0000","last_became_active":"2023-12-13T00:00:31.035672+0000","last_became_peered":"2023-12-13T00:00:31.035672+0000","last_unstale":"2023-12-13T00:28:39.871025+0000","last_undegraded":"2023-12-13T00:28:39.871025+0000","last_fullsized":"2023-12-13T00:28:39.871025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'62","last_scrub_stamp":"2023-12-13T00:28:39.870953+0000","last_deep_scrub":"27'62","last_deep_scrub_stamp":"2023-12-13T00:28:39.870953+0000","last_clean_scrub_stamp":"2023-12-13T00:28:39.870953+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:35:22.699747+0000","scrub_duration":0.0011428779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'65","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:14.316691+0000","last_change":"2023-12-13T00:29:14.316728+0000","last_active":"2023-12-13T00:29:14.316691+0000","last_peered":"2023-12-13T00:29:14.316691+0000","last_clean":"2023-12-13T00:29:14.316691+0000","last_became_active":"2023-12-13T00:00:31.146186+0000","last_became_peered":"2023-12-13T00:00:31.146186+0000","last_unstale":"2023-12-13T00:29:14.316691+0000","last_undegraded":"2023-12-13T00:29:14.316691+0000","last_fullsized":"2023-12-13T00:29:14.316691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'65","last_scrub_stamp":"2023-12-13T00:29:14.316583+0000","last_deep_scrub":"27'65","last_deep_scrub_stamp":"2023-12-13T00:29:14.316583+0000","last_clean_scrub_stamp":"2023-12-13T00:29:14.316583+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:25:12.075561+0000","scrub_duration":0.001412551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'52","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:43.136951+0000","last_change":"2023-12-13T00:28:43.136970+0000","last_active":"2023-12-13T00:28:43.136951+0000","last_peered":"2023-12-13T00:28:43.136951+0000","last_clean":"2023-12-13T00:28:43.136951+0000","last_became_active":"2023-12-13T00:00:31.144458+0000","last_became_peered":"2023-12-13T00:00:31.144458+0000","last_unstale":"2023-12-13T00:28:43.136951+0000","last_undegraded":"2023-12-13T00:28:43.136951+0000","last_fullsized":"2023-12-13T00:28:43.136951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2023-12-13T00:28:43.136884+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2023-12-13T00:28:43.136884+0000","last_clean_scrub_stamp":"2023-12-13T00:28:43.136884+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:16:45.059703+0000","scrub_duration":0.0010172639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'57","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:20.190360+0000","last_change":"2023-12-13T00:28:20.190377+0000","last_active":"2023-12-13T00:28:20.190360+0000","last_peered":"2023-12-13T00:28:20.190360+0000","last_clean":"2023-12-13T00:28:20.190360+0000","last_became_active":"2023-12-13T00:00:31.144792+0000","last_became_peered":"2023-12-13T00:00:31.144792+0000","last_unstale":"2023-12-13T00:28:20.190360+0000","last_undegraded":"2023-12-13T00:28:20.190360+0000","last_fullsized":"2023-12-13T00:28:20.190360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:20.190304+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:20.190304+0000","last_clean_scrub_stamp":"2023-12-13T00:28:20.190304+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:16:25.962310+0000","scrub_duration":0.0010028070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'50","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:24.347581+0000","last_change":"2023-12-13T00:28:24.347618+0000","last_active":"2023-12-13T00:28:24.347581+0000","last_peered":"2023-12-13T00:28:24.347581+0000","last_clean":"2023-12-13T00:28:24.347581+0000","last_became_active":"2023-12-13T00:00:31.148875+0000","last_became_peered":"2023-12-13T00:00:31.148875+0000","last_unstale":"2023-12-13T00:28:24.347581+0000","last_undegraded":"2023-12-13T00:28:24.347581+0000","last_fullsized":"2023-12-13T00:28:24.347581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-13T00:28:24.347486+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-13T00:28:24.347486+0000","last_clean_scrub_stamp":"2023-12-13T00:28:24.347486+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:41:33.521746+0000","scrub_duration":0.001393895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'66","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:25.176823+0000","last_change":"2023-12-13T00:28:25.176823+0000","last_active":"2023-12-13T00:28:25.176823+0000","last_peered":"2023-12-13T00:28:25.176823+0000","last_clean":"2023-12-13T00:28:25.176823+0000","last_became_active":"2023-12-13T00:00:31.144174+0000","last_became_peered":"2023-12-13T00:00:31.144174+0000","last_unstale":"2023-12-13T00:28:25.176823+0000","last_undegraded":"2023-12-13T00:28:25.176823+0000","last_fullsized":"2023-12-13T00:28:25.176823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2023-12-13T00:28:25.176745+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2023-12-13T00:28:25.176745+0000","last_clean_scrub_stamp":"2023-12-13T00:28:25.176745+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:36:46.260217+0000","scrub_duration":0.0010312170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:10.373235+0000","last_change":"2023-12-13T00:29:10.373269+0000","last_active":"2023-12-13T00:29:10.373235+0000","last_peered":"2023-12-13T00:29:10.373235+0000","last_clean":"2023-12-13T00:29:10.373235+0000","last_became_active":"2023-12-13T00:00:31.143809+0000","last_became_peered":"2023-12-13T00:00:31.143809+0000","last_unstale":"2023-12-13T00:29:10.373235+0000","last_undegraded":"2023-12-13T00:29:10.373235+0000","last_fullsized":"2023-12-13T00:29:10.373235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:29:10.373147+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:29:10.373147+0000","last_clean_scrub_stamp":"2023-12-13T00:29:10.373147+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:32:53.324077+0000","scrub_duration":0.001165351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'47","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:27.432298+0000","last_change":"2023-12-13T00:28:27.432315+0000","last_active":"2023-12-13T00:28:27.432298+0000","last_peered":"2023-12-13T00:28:27.432298+0000","last_clean":"2023-12-13T00:28:27.432298+0000","last_became_active":"2023-12-13T00:00:31.116230+0000","last_became_peered":"2023-12-13T00:00:31.116230+0000","last_unstale":"2023-12-13T00:28:27.432298+0000","last_undegraded":"2023-12-13T00:28:27.432298+0000","last_fullsized":"2023-12-13T00:28:27.432298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2023-12-13T00:28:27.432235+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2023-12-13T00:28:27.432235+0000","last_clean_scrub_stamp":"2023-12-13T00:28:27.432235+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:43:11.126576+0000","scrub_duration":0.00088450200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'66","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:10.806231+0000","last_change":"2023-12-13T00:29:10.806250+0000","last_active":"2023-12-13T00:29:10.806231+0000","last_peered":"2023-12-13T00:29:10.806231+0000","last_clean":"2023-12-13T00:29:10.806231+0000","last_became_active":"2023-12-13T00:00:31.149410+0000","last_became_peered":"2023-12-13T00:00:31.149410+0000","last_unstale":"2023-12-13T00:29:10.806231+0000","last_undegraded":"2023-12-13T00:29:10.806231+0000","last_fullsized":"2023-12-13T00:29:10.806231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2023-12-13T00:29:10.806157+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2023-12-13T00:29:10.806157+0000","last_clean_scrub_stamp":"2023-12-13T00:29:10.806157+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:01:54.967195+0000","scrub_duration":0.0010937690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":248,"num_write":4193,"num_write_kb":331487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5031,"ondisk_log_size":5031,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3759,"ondisk_log_size":3759,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":43904475,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":1477,"num_read_kb":1524,"num_write":14609,"num_write_kb":50682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87957504,"data_stored":87808950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13658,"ondisk_log_size":13658,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509795,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53632,"kb_used_data":8568,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318208,"statfs":{"total":96636764160,"available":96581844992,"internally_reserved":0,"allocated":8773632,"data_stored":8578223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:29:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.40699999999999997},"min":{"1min":0.39500000000000002,"5min":0.25800000000000001,"15min":0.25},"max":{"1min":0.629,"5min":0.629,"15min":0.65800000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.45300000000000001,"15min":0.437},"min":{"1min":0.433,"5min":0.253,"15min":0.253},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.45900000000000002}]},{"osd":1,"last update":"Wed Dec 13 00:29:18 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.45500000000000002,"15min":0.44400000000000001},"min":{"1min":0.40999999999999998,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.439,"15min":0.42499999999999999},"min":{"1min":0.44400000000000001,"5min":0.29799999999999999,"15min":0.28199999999999997},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61699999999999999},"last":0.61399999999999999}]},{"osd":2,"last update":"Wed Dec 13 00:29:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.44700000000000001,"15min":0.43099999999999999},"min":{"1min":0.41799999999999998,"5min":0.29499999999999998,"15min":0.27100000000000002},"max":{"1min":0.63900000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.502},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.45800000000000002,"15min":0.436},"min":{"1min":0.39700000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.39700000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:29:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.45600000000000002,"15min":0.443},"min":{"1min":0.39400000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.442},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47099999999999997,"15min":0.47199999999999998},"min":{"1min":0.35599999999999998,"5min":0.32000000000000001,"15min":0.309},"max":{"1min":0.61699999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.35599999999999998}]},{"osd":4,"last update":"Wed Dec 13 00:29:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.371,"15min":0.374},"min":{"1min":0.27400000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56000000000000005,"5min":0.753,"15min":0.753},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.39500000000000002},"min":{"1min":0.29899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.56899999999999995,"5min":0.64100000000000001,"15min":0.64500000000000002},"last":0.40999999999999998}]},{"osd":5,"last update":"Wed Dec 13 00:29:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.22900000000000001},"max":{"1min":0.68400000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.44,"5min":0.435,"15min":0.439},"min":{"1min":0.312,"5min":0.29799999999999999,"15min":0.23100000000000001},"max":{"1min":0.61899999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.51800000000000002}]},{"osd":6,"last update":"Wed Dec 13 00:29:18 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45700000000000002,"15min":0.45900000000000002},"min":{"1min":0.32800000000000001,"5min":0.26900000000000002,"15min":0.23999999999999999},"max":{"1min":0.65300000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.71799999999999997},"last":0.53100000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509794,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88192,"kb_used_data":16760,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94283648,"statfs":{"total":96636764160,"available":96546455552,"internally_reserved":0,"allocated":17162240,"data_stored":16985405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.41199999999999998},"min":{"1min":0.32200000000000001,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.71399999999999997,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.432},"min":{"1min":0.35499999999999998,"5min":0.27900000000000003,"15min":0.23100000000000001},"max":{"1min":0.75800000000000001,"5min":0.877,"15min":0.877},"last":0.56499999999999995}]},{"osd":1,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.42999999999999999,"15min":0.41699999999999998},"min":{"1min":0.35799999999999998,"5min":0.28599999999999998,"15min":0.252},"max":{"1min":0.74199999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.437,"15min":0.41999999999999998},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":0.77100000000000002,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.57699999999999996}]},{"osd":2,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.44800000000000001,"15min":0.41399999999999998},"min":{"1min":0.36399999999999999,"5min":0.315,"15min":0.247},"max":{"1min":0.67500000000000004,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.45600000000000002,"15min":0.439},"min":{"1min":0.375,"5min":0.28999999999999998,"15min":0.26500000000000001},"max":{"1min":0.78000000000000003,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.54800000000000004}]},{"osd":3,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47099999999999997,"15min":0.45700000000000002},"min":{"1min":0.375,"5min":0.32600000000000001,"15min":0.28999999999999998},"max":{"1min":0.75900000000000001,"5min":1.173,"15min":1.173},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.40000000000000002,"5min":0.33400000000000002,"15min":0.32300000000000001},"max":{"1min":0.79700000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.58699999999999997}]},{"osd":4,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39100000000000001,"15min":0.38200000000000001},"min":{"1min":0.26400000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.57399999999999995,"5min":1.595,"15min":1.595},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29999999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.72099999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.34799999999999998}]},{"osd":5,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39000000000000001,"15min":0.38100000000000001},"min":{"1min":0.28199999999999997,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.67600000000000005,"5min":1.115,"15min":1.115},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45600000000000002,"15min":0.439},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.249},"max":{"1min":0.623,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.312}]},{"osd":7,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45400000000000001,"15min":0.443},"min":{"1min":0.30499999999999999,"5min":0.27700000000000002,"15min":0.26000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.378},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44800000000000001,"15min":0.442},"min":{"1min":0.32200000000000001,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.70899999999999996,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.38800000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509796,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58980,"kb_used_data":9756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312860,"statfs":{"total":96636764160,"available":96576368640,"internally_reserved":0,"allocated":9990144,"data_stored":9784207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.27800000000000002,"5min":0.216,"15min":0.20499999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.627},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.41599999999999998,"15min":0.41399999999999998},"min":{"1min":0.30399999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.61599999999999999}]},{"osd":1,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.42799999999999999,"15min":0.41499999999999998},"min":{"1min":0.33300000000000002,"5min":0.248,"15min":0.224},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.379,"5min":0.29899999999999999,"15min":0.251},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.68000000000000005}]},{"osd":2,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.442,"15min":0.436},"min":{"1min":0.36499999999999999,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.435,"15min":0.433},"min":{"1min":0.32600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.65600000000000003}]},{"osd":3,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.442,"15min":0.432},"min":{"1min":0.34999999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59599999999999997,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.47499999999999998,"15min":0.46400000000000002},"min":{"1min":0.34300000000000003,"5min":0.33200000000000002,"15min":0.316},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.39300000000000002,"15min":0.38600000000000001},"min":{"1min":0.30499999999999999,"5min":0.224,"15min":0.221},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.438,"5min":0.39800000000000002,"15min":0.38400000000000001},"min":{"1min":0.26600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.48299999999999998}]},{"osd":6,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.247},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.71999999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46200000000000002,"15min":0.442},"min":{"1min":0.34799999999999998,"5min":0.27300000000000002,"15min":0.23899999999999999},"max":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.71899999999999997},"last":0.52200000000000002}]},{"osd":7,"last update":"Wed Dec 13 00:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.441,"15min":0.42899999999999999},"min":{"1min":0.36199999999999999,"5min":0.26300000000000001,"15min":0.25600000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.498,"5min":0.47599999999999998,"15min":0.46500000000000002},"min":{"1min":0.32700000000000001,"5min":0.316,"15min":0.28999999999999998},"max":{"1min":0.71099999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53900000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509796,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96880,"kb_used_data":21288,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94274960,"statfs":{"total":96636764160,"available":96537559040,"internally_reserved":0,"allocated":21798912,"data_stored":21617833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.32000000000000001,"15min":0.317},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.19500000000000001},"max":{"1min":0.51800000000000002,"5min":0.53200000000000003,"15min":0.64000000000000001},"last":0.443},{"interface":"front","average":{"1min":0.314,"5min":0.312,"15min":0.314},"min":{"1min":0.245,"5min":0.19600000000000001,"15min":0.192},"max":{"1min":0.48099999999999998,"5min":0.54200000000000004,"15min":0.57899999999999996},"last":0.48499999999999999}]},{"osd":1,"last update":"Wed Dec 13 00:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.33600000000000002,"15min":0.33200000000000002},"min":{"1min":0.25,"5min":0.24199999999999999,"15min":0.21099999999999999},"max":{"1min":0.495,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.38100000000000001,"15min":0.372},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.21199999999999999},"max":{"1min":0.52200000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Wed Dec 13 00:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38400000000000001,"15min":0.374},"min":{"1min":0.32300000000000001,"5min":0.249,"15min":0.22800000000000001},"max":{"1min":0.53200000000000003,"5min":0.59899999999999998,"15min":0.69399999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.39300000000000002,"15min":0.39700000000000002},"min":{"1min":0.28299999999999997,"5min":0.26800000000000002,"15min":0.23799999999999999},"max":{"1min":0.57699999999999996,"5min":0.59699999999999998,"15min":0.66300000000000003},"last":0.57499999999999996}]},{"osd":4,"last update":"Wed Dec 13 00:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.496,"15min":0.496},"min":{"1min":0.39200000000000002,"5min":0.312,"15min":0.311},"max":{"1min":0.66400000000000003,"5min":0.80100000000000005,"15min":0.90700000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.503,"15min":0.48899999999999999},"min":{"1min":0.42399999999999999,"5min":0.34100000000000003,"15min":0.32000000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.84199999999999997},"last":0.65600000000000003}]},{"osd":5,"last update":"Wed Dec 13 00:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.41599999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.74199999999999999,"5min":0.75600000000000001,"15min":0.83199999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36899999999999999,"5min":0.33600000000000002,"15min":0.33200000000000002},"max":{"1min":0.73699999999999999,"5min":0.76000000000000001,"15min":0.81999999999999995},"last":0.67300000000000004}]},{"osd":6,"last update":"Wed Dec 13 00:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.42199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.69499999999999995,"5min":0.78600000000000003,"15min":0.80600000000000005},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55900000000000005,"15min":0.54100000000000004},"min":{"1min":0.46800000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.755,"5min":0.77800000000000002,"15min":0.79300000000000004},"last":0.623}]},{"osd":7,"last update":"Wed Dec 13 00:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70599999999999996,"5min":0.75800000000000001,"15min":0.78800000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56000000000000005,"15min":0.53900000000000003},"min":{"1min":0.47899999999999998,"5min":0.42899999999999999,"15min":0.39500000000000002},"max":{"1min":0.79800000000000004,"5min":0.80800000000000005,"15min":0.85799999999999998},"last":0.75}]}]},{"osd":1,"up_from":15,"seq":64424509794,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36200,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335640,"statfs":{"total":96636764160,"available":96599695360,"internally_reserved":0,"allocated":884736,"data_stored":706002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.307,"15min":0.30099999999999999},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.47599999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.32200000000000001,"15min":0.32900000000000001},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.63600000000000001},"last":0.47599999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33200000000000002,"15min":0.32700000000000001},"min":{"1min":0.26100000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.498,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35299999999999998,"15min":0.35199999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51700000000000002,"5min":0.53100000000000003,"15min":0.55000000000000004},"last":0.49099999999999999}]},{"osd":3,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38,"15min":0.376},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.59599999999999997,"5min":0.60599999999999998,"15min":0.60799999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.25600000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.505,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.50800000000000001}]},{"osd":4,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.48999999999999999,"15min":0.47399999999999998},"min":{"1min":0.29499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65300000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.495,"15min":0.48199999999999998},"min":{"1min":0.35799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.72199999999999998,"5min":0.79500000000000004,"15min":0.84699999999999998},"last":0.70999999999999996}]},{"osd":5,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.69499999999999995,"5min":0.78500000000000003,"15min":0.81999999999999995},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.505,"15min":0.49199999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.32000000000000001},"max":{"1min":0.628,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.67200000000000004}]},{"osd":6,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.29099999999999998},"max":{"1min":0.73499999999999999,"5min":0.79000000000000004,"15min":0.89300000000000002},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.39600000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66900000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Wed Dec 13 00:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77500000000000002,"5min":0.78400000000000003,"15min":0.83899999999999997},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.54200000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.71499999999999997,"5min":0.82699999999999996,"15min":0.85799999999999998},"last":0.77700000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542498,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53544,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318296,"statfs":{"total":96636764160,"available":96581935104,"internally_reserved":0,"allocated":8683520,"data_stored":8504788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.314,"15min":0.308},"min":{"1min":0.22900000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.46400000000000002,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32900000000000001},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.19},"max":{"1min":0.443,"5min":0.53200000000000003,"15min":0.54700000000000004},"last":0.63100000000000001}]},{"osd":1,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33400000000000002,"15min":0.33200000000000002},"min":{"1min":0.221,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.48499999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.496},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.34999999999999998,"15min":0.34699999999999998},"min":{"1min":0.27100000000000002,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.57699999999999996,"5min":0.65100000000000002,"15min":0.746},"last":0.61599999999999999}]},{"osd":3,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36099999999999999,"15min":0.36899999999999999},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.496,"5min":0.57399999999999995,"15min":1.03},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.375,"15min":0.38400000000000001},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.23499999999999999},"max":{"1min":0.47599999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.39800000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.85399999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.503,"15min":0.49099999999999999},"min":{"1min":0.38300000000000001,"5min":0.32900000000000001,"15min":0.28499999999999998},"max":{"1min":0.71299999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.745}]},{"osd":5,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.317},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.82099999999999995},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.51500000000000001,"15min":0.498},"min":{"1min":0.36899999999999999,"5min":0.33700000000000002,"15min":0.316},"max":{"1min":0.749,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.79200000000000004}]},{"osd":6,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.36199999999999999,"15min":0.34499999999999997},"max":{"1min":0.748,"5min":0.748,"15min":0.79800000000000004},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.496,"15min":0.504},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60999999999999999,"5min":0.75800000000000001,"15min":0.78200000000000003},"last":0.73299999999999998}]},{"osd":7,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.34499999999999997},"max":{"1min":0.61599999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.36399999999999999},"max":{"1min":0.72499999999999998,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.82799999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542498,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67936,"kb_used_data":6232,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94303904,"statfs":{"total":96636764160,"available":96567197696,"internally_reserved":0,"allocated":6381568,"data_stored":6195602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 00:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20499999999999999},"max":{"1min":0.499,"5min":0.57299999999999995,"15min":0.66900000000000004},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.32900000000000001,"15min":0.316},"min":{"1min":0.23799999999999999,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":0.52700000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.40200000000000002}]},{"osd":2,"last update":"Wed Dec 13 00:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32900000000000001,"15min":0.32600000000000001},"min":{"1min":0.253,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.47599999999999998,"5min":0.57999999999999996,"15min":0.64600000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.36299999999999999,"15min":0.35699999999999998},"min":{"1min":0.26400000000000001,"5min":0.24299999999999999,"15min":0.23100000000000001},"max":{"1min":0.51200000000000001,"5min":0.61299999999999999,"15min":0.72299999999999998},"last":0.32000000000000001}]},{"osd":3,"last update":"Wed Dec 13 00:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36099999999999999,"15min":0.35499999999999998},"min":{"1min":0.27000000000000002,"5min":0.24099999999999999,"15min":0.22900000000000001},"max":{"1min":0.45500000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.378,"15min":0.36899999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23300000000000001},"max":{"1min":0.48299999999999998,"5min":0.57199999999999995,"15min":0.65400000000000003},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed Dec 13 00:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.5,"15min":0.47499999999999998},"min":{"1min":0.37,"5min":0.30499999999999999,"15min":0.25800000000000001},"max":{"1min":0.58799999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51600000000000001,"15min":0.48199999999999998},"min":{"1min":0.372,"5min":0.35899999999999999,"15min":0.27200000000000002},"max":{"1min":0.68999999999999995,"5min":0.877,"15min":0.877},"last":0.47499999999999998}]},{"osd":5,"last update":"Wed Dec 13 00:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52200000000000002,"15min":0.48699999999999999},"min":{"1min":0.379,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.78700000000000003,"5min":1.133,"15min":1.133},"last":0.443},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.51500000000000001,"15min":0.504},"min":{"1min":0.38,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.755,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.432}]},{"osd":6,"last update":"Wed Dec 13 00:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.53300000000000003,"15min":0.52100000000000002},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33600000000000002},"max":{"1min":0.72799999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.501},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.52100000000000002},"min":{"1min":0.38900000000000001,"5min":0.377,"15min":0.35899999999999999},"max":{"1min":0.76600000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.45500000000000002}]},{"osd":7,"last update":"Wed Dec 13 00:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56899999999999995,"15min":0.54500000000000004},"min":{"1min":0.44,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575203,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88748,"kb_used_data":17316,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94283092,"statfs":{"total":96636764160,"available":96545886208,"internally_reserved":0,"allocated":17731584,"data_stored":17541418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.41299999999999998,"15min":0.40999999999999998},"min":{"1min":0.32600000000000001,"5min":0.255,"15min":0.20200000000000001},"max":{"1min":0.56899999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.41899999999999998,"15min":0.40699999999999997},"min":{"1min":0.35699999999999998,"5min":0.28000000000000003,"15min":0.23999999999999999},"max":{"1min":0.56699999999999995,"5min":0.58999999999999997,"15min":0.67300000000000004},"last":0.41299999999999998}]},{"osd":1,"last update":"Wed Dec 13 00:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.442,"15min":0.432},"min":{"1min":0.34100000000000003,"5min":0.27600000000000002,"15min":0.249},"max":{"1min":0.628,"5min":0.628,"15min":0.63400000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.41499999999999998,"15min":0.41299999999999998},"min":{"1min":0.316,"5min":0.28999999999999998,"15min":0.247},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.65400000000000003},"last":0.46899999999999997}]},{"osd":2,"last update":"Wed Dec 13 00:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.438,"15min":0.42399999999999999},"min":{"1min":0.33500000000000002,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.52800000000000002,"5min":0.628,"15min":0.68700000000000006},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41199999999999998},"min":{"1min":0.32500000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.56000000000000005,"5min":0.59299999999999997,"15min":0.64900000000000002},"last":0.39400000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44400000000000001,"15min":0.437},"min":{"1min":0.32700000000000001,"5min":0.312,"15min":0.27300000000000002},"max":{"1min":0.57699999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.499},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45300000000000001,"15min":0.44600000000000001},"min":{"1min":0.309,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.62,"5min":0.63700000000000001,"15min":0.67300000000000004},"last":0.45900000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.377,"15min":0.37},"min":{"1min":0.251,"5min":0.23300000000000001,"15min":0.215},"max":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40500000000000003,"15min":0.38800000000000001},"min":{"1min":0.27400000000000002,"5min":0.23599999999999999,"15min":0.22900000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.65000000000000002},"last":0.32800000000000001}]},{"osd":6,"last update":"Wed Dec 13 00:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.375,"15min":0.36599999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.22500000000000001},"max":{"1min":0.505,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.42699999999999999,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.26100000000000001,"15min":0.24399999999999999},"max":{"1min":0.58799999999999997,"5min":0.66400000000000003,"15min":0.70699999999999996},"last":0.53700000000000003}]},{"osd":7,"last update":"Wed Dec 13 00:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.433,"15min":0.41999999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.22900000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.63200000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.45000000000000001,"15min":0.434},"min":{"1min":0.29799999999999999,"5min":0.27000000000000002,"15min":0.26700000000000002},"max":{"1min":0.60799999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.55600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6098944,"data_stored":6080128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21516288,"data_stored":21502359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9707520,"data_stored":9668733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16855040,"data_stored":16835576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16879616,"data_stored":16869931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8491008,"data_stored":8462749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T00:29:22.775 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:22.775 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:22.775 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:22.775 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-13T00:00:34.296627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=0, tm_sec=34, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T00:29:22.776 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-13T00:29:38.128 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:29:38.131 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:29:42.779 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T00:29:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.884+0000 7fbae96cf640 1 Processor -- start 2023-12-13T00:29:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.884+0000 7fbae96cf640 1 -- start start 2023-12-13T00:29:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.885+0000 7fbae96cf640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbae40cda70 0x7fbae40ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.885+0000 7fbae96cf640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbae40cc420 0x7fbae4159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.885+0000 7fbae96cf640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae40cbda0 con 0x7fbae4159b50 2023-12-13T00:29:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.885+0000 7fbae96cf640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae40cc230 con 0x7fbae40cda70 2023-12-13T00:29:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.885+0000 7fbae96cf640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae40cb4e0 con 0x7fbae40cc420 2023-12-13T00:29:42.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.886+0000 7fbae27fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbae40cc420 0x7fbae4159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:42.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.886+0000 7fbae2ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbae40cda70 0x7fbae40ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:42.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.886+0000 7fbae37fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbae4159b50 0x7fbae40c9620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34928/0 (socket says 172.21.15.72:34928) 2023-12-13T00:29:42.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.886+0000 7fbae37fe640 1 -- 172.21.15.72:0/214689503 learned_addr learned my addr 172.21.15.72:0/214689503 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:29:42.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.889+0000 7fbae27fc640 1 -- 172.21.15.72:0/214689503 >> v2:172.21.15.72:3300/0 conn(0x7fbae40cda70 msgr2=0x7fbae40ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:29:42.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.889+0000 7fbae27fc640 1 --2- 172.21.15.72:0/214689503 >> v2:172.21.15.72:3300/0 conn(0x7fbae40cda70 0x7fbae40ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:42.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.889+0000 7fbae27fc640 1 -- 172.21.15.72:0/214689503 >> v1:172.21.15.72:6789/0 conn(0x7fbae4159b50 legacy=0x7fbae40c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:42.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.889+0000 7fbae27fc640 1 -- 172.21.15.72:0/214689503 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae40cce00 con 0x7fbae40cc420 2023-12-13T00:29:42.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.891+0000 7fbae27fc640 1 --2- 172.21.15.72:0/214689503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbae40cc420 0x7fbae4159610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbae40cfda0 tx=0x7fbad402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a78186ca336d0d66 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:42.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.895+0000 7fbae1ffb640 1 -- 172.21.15.72:0/214689503 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4030610 con 0x7fbae40cc420 2023-12-13T00:29:42.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.895+0000 7fbae1ffb640 1 -- 172.21.15.72:0/214689503 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad4030770 con 0x7fbae40cc420 2023-12-13T00:29:42.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.895+0000 7fbae1ffb640 1 -- 172.21.15.72:0/214689503 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4030b00 con 0x7fbae40cc420 2023-12-13T00:29:42.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.896+0000 7fbae96cf640 1 -- 172.21.15.72:0/214689503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbae40cc420 msgr2=0x7fbae4159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:42.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.896+0000 7fbae96cf640 1 --2- 172.21.15.72:0/214689503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbae40cc420 0x7fbae4159610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbae40cfda0 tx=0x7fbad402b960 comp rx=0 tx=0).stop 2023-12-13T00:29:42.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.896+0000 7fbae96cf640 1 -- 172.21.15.72:0/214689503 shutdown_connections 2023-12-13T00:29:42.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.896+0000 7fbae96cf640 1 --2- 172.21.15.72:0/214689503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbae40cc420 0x7fbae4159610 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:42.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.896+0000 7fbae96cf640 1 --2- 172.21.15.72:0/214689503 >> v2:172.21.15.72:3300/0 conn(0x7fbae40cda70 0x7fbae40ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:42.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.896+0000 7fbae96cf640 1 -- 172.21.15.72:0/214689503 >> 172.21.15.72:0/214689503 conn(0x7fbae40b07b0 msgr2=0x7fbae40b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:42.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.896+0000 7fbae96cf640 1 -- 172.21.15.72:0/214689503 shutdown_connections 2023-12-13T00:29:42.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.896+0000 7fbae96cf640 1 -- 172.21.15.72:0/214689503 wait complete. 2023-12-13T00:29:42.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.898+0000 7fbae96cf640 1 Processor -- start 2023-12-13T00:29:42.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.898+0000 7fbae96cf640 1 -- start start 2023-12-13T00:29:42.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.898+0000 7fbae96cf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbae40cc420 0x7fbae40c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:42.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.898+0000 7fbae96cf640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbae40cda70 0x7fbae40ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:42.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.898+0000 7fbae96cf640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbae4159b50 0x7fbae4150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:42.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.898+0000 7fbae96cf640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae40c4650 con 0x7fbae40cc420 2023-12-13T00:29:42.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.898+0000 7fbae96cf640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae40c3720 con 0x7fbae40cda70 2023-12-13T00:29:42.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.898+0000 7fbae96cf640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae41efad0 con 0x7fbae4159b50 2023-12-13T00:29:42.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.899+0000 7fbae2ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbae40cc420 0x7fbae40c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:42.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.899+0000 7fbae27fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbae40cda70 0x7fbae40ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:42.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.899+0000 7fbae2ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbae40cc420 0x7fbae40c31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58514/0 (socket says 172.21.15.72:58514) 2023-12-13T00:29:42.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.899+0000 7fbae2ffd640 1 -- 172.21.15.72:0/3334128613 learned_addr learned my addr 172.21.15.72:0/3334128613 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:29:42.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.899+0000 7fbae37fe640 1 --2- 172.21.15.72:0/3334128613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbae4159b50 0x7fbae4150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:42.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.902+0000 7fbae2ffd640 1 -- 172.21.15.72:0/3334128613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbae4159b50 msgr2=0x7fbae4150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:42.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.902+0000 7fbae2ffd640 1 --2- 172.21.15.72:0/3334128613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbae4159b50 0x7fbae4150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:42.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.902+0000 7fbae2ffd640 1 -- 172.21.15.72:0/3334128613 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbae40cda70 msgr2=0x7fbae40ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:42.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.902+0000 7fbae2ffd640 1 --2- 172.21.15.72:0/3334128613 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbae40cda70 0x7fbae40ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:42.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.902+0000 7fbae2ffd640 1 -- 172.21.15.72:0/3334128613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad4009400 con 0x7fbae40cc420 2023-12-13T00:29:42.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.905+0000 7fbae2ffd640 1 --2- 172.21.15.72:0/3334128613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbae40cc420 0x7fbae40c31e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbad800e9e0 tx=0x7fbad800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:42.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.908+0000 7fbacb7fe640 1 -- 172.21.15.72:0/3334128613 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8009670 con 0x7fbae40cc420 2023-12-13T00:29:42.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.908+0000 7fbacb7fe640 1 -- 172.21.15.72:0/3334128613 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad800c9d0 con 0x7fbae40cc420 2023-12-13T00:29:42.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.908+0000 7fbae96cf640 1 -- 172.21.15.72:0/3334128613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae41efdb0 con 0x7fbae40cc420 2023-12-13T00:29:42.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.908+0000 7fbacb7fe640 1 -- 172.21.15.72:0/3334128613 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800cd80 con 0x7fbae40cc420 2023-12-13T00:29:42.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.908+0000 7fbae96cf640 1 -- 172.21.15.72:0/3334128613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae40b1cc0 con 0x7fbae40cc420 2023-12-13T00:29:42.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.909+0000 7fbae96cf640 1 -- 172.21.15.72:0/3334128613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae40b1840 con 0x7fbae40cc420 2023-12-13T00:29:42.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.928+0000 7fbacb7fe640 1 -- 172.21.15.72:0/3334128613 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbad8013470 con 0x7fbae40cc420 2023-12-13T00:29:42.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.928+0000 7fbacb7fe640 1 --2- 172.21.15.72:0/3334128613 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbad006b210 0x7fbad006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:42.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.929+0000 7fbae27fc640 1 --2- 172.21.15.72:0/3334128613 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbad006b210 0x7fbad006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:42.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:42.929+0000 7fbae27fc640 1 --2- 172.21.15.72:0/3334128613 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbad006b210 0x7fbad006d6d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbad4036000 tx=0x7fbad4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:43.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.169+0000 7fbacb7fe640 1 -- 172.21.15.72:0/3334128613 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fbad8058c80 con 0x7fbae40cc420 2023-12-13T00:29:43.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.169+0000 7fbacb7fe640 1 -- 172.21.15.72:0/3334128613 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbad8054fc0 con 0x7fbae40cc420 2023-12-13T00:29:43.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.335+0000 7fbae96cf640 1 -- 172.21.15.72:0/3334128613 --> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbae40cba30 con 0x7fbad006b210 2023-12-13T00:29:43.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.344+0000 7fbacb7fe640 1 -- 172.21.15.72:0/3334128613 <== mgr.4105 v2:172.21.15.72:6800/3427715460 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373581 (secure 0 0 0) 0x7fbad4030960 con 0x7fbad006b210 2023-12-13T00:29:43.349 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:29:43.351 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-12-13T00:29:43.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.348+0000 7fbae96cf640 1 -- 172.21.15.72:0/3334128613 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbad006b210 msgr2=0x7fbad006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:43.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.348+0000 7fbae96cf640 1 --2- 172.21.15.72:0/3334128613 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbad006b210 0x7fbad006d6d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbad4036000 tx=0x7fbad4008030 comp rx=0 tx=0).stop 2023-12-13T00:29:43.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.348+0000 7fbae96cf640 1 -- 172.21.15.72:0/3334128613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbae40cc420 msgr2=0x7fbae40c31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:43.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.348+0000 7fbae96cf640 1 --2- 172.21.15.72:0/3334128613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbae40cc420 0x7fbae40c31e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbad800e9e0 tx=0x7fbad800eea0 comp rx=0 tx=0).stop 2023-12-13T00:29:43.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.348+0000 7fbae96cf640 1 -- 172.21.15.72:0/3334128613 shutdown_connections 2023-12-13T00:29:43.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.348+0000 7fbae96cf640 1 --2- 172.21.15.72:0/3334128613 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbad006b210 0x7fbad006d6d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:43.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.348+0000 7fbae96cf640 1 --2- 172.21.15.72:0/3334128613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbae4159b50 0x7fbae4150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:43.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.348+0000 7fbae96cf640 1 --2- 172.21.15.72:0/3334128613 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbae40cda70 0x7fbae40ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:43.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.348+0000 7fbae96cf640 1 --2- 172.21.15.72:0/3334128613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbae40cc420 0x7fbae40c31e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:43.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.348+0000 7fbae96cf640 1 -- 172.21.15.72:0/3334128613 >> 172.21.15.72:0/3334128613 conn(0x7fbae40b07b0 msgr2=0x7fbae40b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:43.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.348+0000 7fbae96cf640 1 -- 172.21.15.72:0/3334128613 shutdown_connections 2023-12-13T00:29:43.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.348+0000 7fbae96cf640 1 -- 172.21.15.72:0/3334128613 wait complete. 2023-12-13T00:29:43.359 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":909,"stamp":"2023-12-13T00:29:42.931979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44494843,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1597,"num_read_kb":1872,"num_write":18961,"num_write_kb":384585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22567,"ondisk_log_size":22567,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":544112,"kb_used_data":89264,"kb_used_omap":12,"kb_used_meta":454771,"kb_avail":754430608,"statfs":{"total":773094113280,"available":772536942592,"internally_reserved":0,"allocated":91406336,"data_stored":89913478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":465686066},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003307"},"pg_stats":[{"pgid":"2.1f","version":"27'893","reported_seq":934,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:29.139661+0000","last_change":"2023-12-13T00:28:29.139661+0000","last_active":"2023-12-13T00:28:29.139661+0000","last_peered":"2023-12-13T00:28:29.139661+0000","last_clean":"2023-12-13T00:28:29.139661+0000","last_became_active":"2023-12-13T00:00:29.997381+0000","last_became_peered":"2023-12-13T00:00:29.997381+0000","last_unstale":"2023-12-13T00:28:29.139661+0000","last_undegraded":"2023-12-13T00:28:29.139661+0000","last_fullsized":"2023-12-13T00:28:29.139661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'893","last_scrub_stamp":"2023-12-13T00:28:29.139513+0000","last_deep_scrub":"27'893","last_deep_scrub_stamp":"2023-12-13T00:28:29.139513+0000","last_clean_scrub_stamp":"2023-12-13T00:28:29.139513+0000","objects_scrubbed":5,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:42:10.924829+0000","scrub_duration":0.013572704,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":4535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'54","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:08.413391+0000","last_change":"2023-12-13T00:29:08.413432+0000","last_active":"2023-12-13T00:29:08.413391+0000","last_peered":"2023-12-13T00:29:08.413391+0000","last_clean":"2023-12-13T00:29:08.413391+0000","last_became_active":"2023-12-13T00:00:31.138242+0000","last_became_peered":"2023-12-13T00:00:31.138242+0000","last_unstale":"2023-12-13T00:29:08.413391+0000","last_undegraded":"2023-12-13T00:29:08.413391+0000","last_fullsized":"2023-12-13T00:29:08.413391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2023-12-13T00:29:08.413277+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2023-12-13T00:29:08.413277+0000","last_clean_scrub_stamp":"2023-12-13T00:29:08.413277+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:15:53.242647+0000","scrub_duration":0.0013730999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'155","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:50.063447+0000","last_change":"2023-12-13T00:28:50.063484+0000","last_active":"2023-12-13T00:28:50.063447+0000","last_peered":"2023-12-13T00:28:50.063447+0000","last_clean":"2023-12-13T00:28:50.063447+0000","last_became_active":"2023-12-13T00:00:35.667498+0000","last_became_peered":"2023-12-13T00:00:35.667498+0000","last_unstale":"2023-12-13T00:28:50.063447+0000","last_undegraded":"2023-12-13T00:28:50.063447+0000","last_fullsized":"2023-12-13T00:28:50.063447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'155","last_scrub_stamp":"2023-12-13T00:28:50.063365+0000","last_deep_scrub":"27'155","last_deep_scrub_stamp":"2023-12-13T00:28:50.063365+0000","last_clean_scrub_stamp":"2023-12-13T00:28:50.063365+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:47:54.554846+0000","scrub_duration":0.0015139660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'847","reported_seq":888,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:47.534975+0000","last_change":"2023-12-13T00:28:47.534996+0000","last_active":"2023-12-13T00:28:47.534975+0000","last_peered":"2023-12-13T00:28:47.534975+0000","last_clean":"2023-12-13T00:28:47.534975+0000","last_became_active":"2023-12-13T00:00:30.001628+0000","last_became_peered":"2023-12-13T00:00:30.001628+0000","last_unstale":"2023-12-13T00:28:47.534975+0000","last_undegraded":"2023-12-13T00:28:47.534975+0000","last_fullsized":"2023-12-13T00:28:47.534975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'847","last_scrub_stamp":"2023-12-13T00:28:47.534918+0000","last_deep_scrub":"27'847","last_deep_scrub_stamp":"2023-12-13T00:28:47.534918+0000","last_clean_scrub_stamp":"2023-12-13T00:28:47.534918+0000","objects_scrubbed":1,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:36:14.144385+0000","scrub_duration":0.011101267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'62","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:23.425921+0000","last_change":"2023-12-13T00:28:23.425921+0000","last_active":"2023-12-13T00:28:23.425921+0000","last_peered":"2023-12-13T00:28:23.425921+0000","last_clean":"2023-12-13T00:28:23.425921+0000","last_became_active":"2023-12-13T00:00:31.036197+0000","last_became_peered":"2023-12-13T00:00:31.036197+0000","last_unstale":"2023-12-13T00:28:23.425921+0000","last_undegraded":"2023-12-13T00:28:23.425921+0000","last_fullsized":"2023-12-13T00:28:23.425921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'62","last_scrub_stamp":"2023-12-13T00:28:23.425813+0000","last_deep_scrub":"27'62","last_deep_scrub_stamp":"2023-12-13T00:28:23.425813+0000","last_clean_scrub_stamp":"2023-12-13T00:28:23.425813+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:33:18.747179+0000","scrub_duration":0.001921973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'165","reported_seq":205,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:48.150817+0000","last_change":"2023-12-13T00:28:48.150817+0000","last_active":"2023-12-13T00:28:48.150817+0000","last_peered":"2023-12-13T00:28:48.150817+0000","last_clean":"2023-12-13T00:28:48.150817+0000","last_became_active":"2023-12-13T00:00:35.664981+0000","last_became_peered":"2023-12-13T00:00:35.664981+0000","last_unstale":"2023-12-13T00:28:48.150817+0000","last_undegraded":"2023-12-13T00:28:48.150817+0000","last_fullsized":"2023-12-13T00:28:48.150817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'165","last_scrub_stamp":"2023-12-13T00:28:48.150719+0000","last_deep_scrub":"27'165","last_deep_scrub_stamp":"2023-12-13T00:28:48.150719+0000","last_clean_scrub_stamp":"2023-12-13T00:28:48.150719+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:34:39.892054+0000","scrub_duration":0.0020656839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":248,"num_write":136,"num_write_kb":7125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:33.302643+0000","last_change":"2023-12-13T00:28:33.302667+0000","last_active":"2023-12-13T00:28:33.302643+0000","last_peered":"2023-12-13T00:28:33.302643+0000","last_clean":"2023-12-13T00:28:33.302643+0000","last_became_active":"2023-12-13T00:00:30.009724+0000","last_became_peered":"2023-12-13T00:00:30.009724+0000","last_unstale":"2023-12-13T00:28:33.302643+0000","last_undegraded":"2023-12-13T00:28:33.302643+0000","last_fullsized":"2023-12-13T00:28:33.302643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2023-12-13T00:28:33.302572+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2023-12-13T00:28:33.302572+0000","last_clean_scrub_stamp":"2023-12-13T00:28:33.302572+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:09:03.008018+0000","scrub_duration":0.0025511840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'58","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:28.924075+0000","last_change":"2023-12-13T00:28:28.924111+0000","last_active":"2023-12-13T00:28:28.924075+0000","last_peered":"2023-12-13T00:28:28.924075+0000","last_clean":"2023-12-13T00:28:28.924075+0000","last_became_active":"2023-12-13T00:00:31.150735+0000","last_became_peered":"2023-12-13T00:00:31.150735+0000","last_unstale":"2023-12-13T00:28:28.924075+0000","last_undegraded":"2023-12-13T00:28:28.924075+0000","last_fullsized":"2023-12-13T00:28:28.924075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-12-13T00:28:28.923981+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-12-13T00:28:28.923981+0000","last_clean_scrub_stamp":"2023-12-13T00:28:28.923981+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:40:47.032764+0000","scrub_duration":0.0010969529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'163","reported_seq":198,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:51.197798+0000","last_change":"2023-12-13T00:28:51.197818+0000","last_active":"2023-12-13T00:28:51.197798+0000","last_peered":"2023-12-13T00:28:51.197798+0000","last_clean":"2023-12-13T00:28:51.197798+0000","last_became_active":"2023-12-13T00:00:35.668361+0000","last_became_peered":"2023-12-13T00:00:35.668361+0000","last_unstale":"2023-12-13T00:28:51.197798+0000","last_undegraded":"2023-12-13T00:28:51.197798+0000","last_fullsized":"2023-12-13T00:28:51.197798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'163","last_scrub_stamp":"2023-12-13T00:28:51.197729+0000","last_deep_scrub":"27'163","last_deep_scrub_stamp":"2023-12-13T00:28:51.197729+0000","last_clean_scrub_stamp":"2023-12-13T00:28:51.197729+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:49:56.958095+0000","scrub_duration":0.001643537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":10445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:39.170459+0000","last_change":"2023-12-13T00:28:39.170483+0000","last_active":"2023-12-13T00:28:39.170459+0000","last_peered":"2023-12-13T00:28:39.170459+0000","last_clean":"2023-12-13T00:28:39.170459+0000","last_became_active":"2023-12-13T00:00:30.009644+0000","last_became_peered":"2023-12-13T00:00:30.009644+0000","last_unstale":"2023-12-13T00:28:39.170459+0000","last_undegraded":"2023-12-13T00:28:39.170459+0000","last_fullsized":"2023-12-13T00:28:39.170459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:39.170392+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:39.170392+0000","last_clean_scrub_stamp":"2023-12-13T00:28:39.170392+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:30:48.680502+0000","scrub_duration":0.001730407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'63","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:28.257980+0000","last_change":"2023-12-13T00:28:28.257999+0000","last_active":"2023-12-13T00:28:28.257980+0000","last_peered":"2023-12-13T00:28:28.257980+0000","last_clean":"2023-12-13T00:28:28.257980+0000","last_became_active":"2023-12-13T00:00:31.146516+0000","last_became_peered":"2023-12-13T00:00:31.146516+0000","last_unstale":"2023-12-13T00:28:28.257980+0000","last_undegraded":"2023-12-13T00:28:28.257980+0000","last_fullsized":"2023-12-13T00:28:28.257980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'63","last_scrub_stamp":"2023-12-13T00:28:28.257908+0000","last_deep_scrub":"27'63","last_deep_scrub_stamp":"2023-12-13T00:28:28.257908+0000","last_clean_scrub_stamp":"2023-12-13T00:28:28.257908+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:55:00.846548+0000","scrub_duration":0.00097492599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'175","reported_seq":210,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:50.183496+0000","last_change":"2023-12-13T00:28:50.183516+0000","last_active":"2023-12-13T00:28:50.183496+0000","last_peered":"2023-12-13T00:28:50.183496+0000","last_clean":"2023-12-13T00:28:50.183496+0000","last_became_active":"2023-12-13T00:00:35.668298+0000","last_became_peered":"2023-12-13T00:00:35.668298+0000","last_unstale":"2023-12-13T00:28:50.183496+0000","last_undegraded":"2023-12-13T00:28:50.183496+0000","last_fullsized":"2023-12-13T00:28:50.183496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'175","last_scrub_stamp":"2023-12-13T00:28:50.183430+0000","last_deep_scrub":"27'175","last_deep_scrub_stamp":"2023-12-13T00:28:50.183430+0000","last_clean_scrub_stamp":"2023-12-13T00:28:50.183430+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:16:52.106250+0000","scrub_duration":0.001845415,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'50","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:31.257801+0000","last_change":"2023-12-13T00:28:31.257801+0000","last_active":"2023-12-13T00:28:31.257801+0000","last_peered":"2023-12-13T00:28:31.257801+0000","last_clean":"2023-12-13T00:28:31.257801+0000","last_became_active":"2023-12-13T00:00:31.036062+0000","last_became_peered":"2023-12-13T00:00:31.036062+0000","last_unstale":"2023-12-13T00:28:31.257801+0000","last_undegraded":"2023-12-13T00:28:31.257801+0000","last_fullsized":"2023-12-13T00:28:31.257801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-13T00:28:31.257707+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-13T00:28:31.257707+0000","last_clean_scrub_stamp":"2023-12-13T00:28:31.257707+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:17:04.269503+0000","scrub_duration":0.001111849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'852","reported_seq":891,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:52.378285+0000","last_change":"2023-12-13T00:28:52.378314+0000","last_active":"2023-12-13T00:28:52.378285+0000","last_peered":"2023-12-13T00:28:52.378285+0000","last_clean":"2023-12-13T00:28:52.378285+0000","last_became_active":"2023-12-13T00:00:30.000782+0000","last_became_peered":"2023-12-13T00:00:30.000782+0000","last_unstale":"2023-12-13T00:28:52.378285+0000","last_undegraded":"2023-12-13T00:28:52.378285+0000","last_fullsized":"2023-12-13T00:28:52.378285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'852","last_scrub_stamp":"2023-12-13T00:28:52.378221+0000","last_deep_scrub":"27'852","last_deep_scrub_stamp":"2023-12-13T00:28:52.378221+0000","last_clean_scrub_stamp":"2023-12-13T00:28:52.378221+0000","objects_scrubbed":3,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:22:35.711609+0000","scrub_duration":0.014447793,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":4547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'149","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:02.332534+0000","last_change":"2023-12-13T00:29:02.332573+0000","last_active":"2023-12-13T00:29:02.332534+0000","last_peered":"2023-12-13T00:29:02.332534+0000","last_clean":"2023-12-13T00:29:02.332534+0000","last_became_active":"2023-12-13T00:00:35.661458+0000","last_became_peered":"2023-12-13T00:00:35.661458+0000","last_unstale":"2023-12-13T00:29:02.332534+0000","last_undegraded":"2023-12-13T00:29:02.332534+0000","last_fullsized":"2023-12-13T00:29:02.332534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'149","last_scrub_stamp":"2023-12-13T00:29:02.332432+0000","last_deep_scrub":"27'149","last_deep_scrub_stamp":"2023-12-13T00:29:02.332432+0000","last_clean_scrub_stamp":"2023-12-13T00:29:02.332432+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:39:33.583239+0000","scrub_duration":0.0022387319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":11179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'55","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:33.071406+0000","last_change":"2023-12-13T00:28:33.071426+0000","last_active":"2023-12-13T00:28:33.071406+0000","last_peered":"2023-12-13T00:28:33.071406+0000","last_clean":"2023-12-13T00:28:33.071406+0000","last_became_active":"2023-12-13T00:00:31.119447+0000","last_became_peered":"2023-12-13T00:00:31.119447+0000","last_unstale":"2023-12-13T00:28:33.071406+0000","last_undegraded":"2023-12-13T00:28:33.071406+0000","last_fullsized":"2023-12-13T00:28:33.071406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2023-12-13T00:28:33.071296+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2023-12-13T00:28:33.071296+0000","last_clean_scrub_stamp":"2023-12-13T00:28:33.071296+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:32:09.634850+0000","scrub_duration":0.001330962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'215","reported_seq":255,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:22.122493+0000","last_change":"2023-12-13T00:28:22.122493+0000","last_active":"2023-12-13T00:28:22.122493+0000","last_peered":"2023-12-13T00:28:22.122493+0000","last_clean":"2023-12-13T00:28:22.122493+0000","last_became_active":"2023-12-13T00:00:29.967929+0000","last_became_peered":"2023-12-13T00:00:29.967929+0000","last_unstale":"2023-12-13T00:28:22.122493+0000","last_undegraded":"2023-12-13T00:28:22.122493+0000","last_fullsized":"2023-12-13T00:28:22.122493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'215","last_scrub_stamp":"2023-12-13T00:28:22.122378+0000","last_deep_scrub":"27'215","last_deep_scrub_stamp":"2023-12-13T00:28:22.122378+0000","last_clean_scrub_stamp":"2023-12-13T00:28:22.122378+0000","objects_scrubbed":1,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:35:04.951172+0000","scrub_duration":0.001579186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":581,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'167","reported_seq":203,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:11.758421+0000","last_change":"2023-12-13T00:29:11.758443+0000","last_active":"2023-12-13T00:29:11.758421+0000","last_peered":"2023-12-13T00:29:11.758421+0000","last_clean":"2023-12-13T00:29:11.758421+0000","last_became_active":"2023-12-13T00:00:35.662469+0000","last_became_peered":"2023-12-13T00:00:35.662469+0000","last_unstale":"2023-12-13T00:29:11.758421+0000","last_undegraded":"2023-12-13T00:29:11.758421+0000","last_fullsized":"2023-12-13T00:29:11.758421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'167","last_scrub_stamp":"2023-12-13T00:29:11.758348+0000","last_deep_scrub":"27'167","last_deep_scrub_stamp":"2023-12-13T00:29:11.758348+0000","last_clean_scrub_stamp":"2023-12-13T00:29:11.758348+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:09:36.489651+0000","scrub_duration":0.0018809429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":19086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:46.938387+0000","last_change":"2023-12-13T00:28:46.938408+0000","last_active":"2023-12-13T00:28:46.938387+0000","last_peered":"2023-12-13T00:28:46.938387+0000","last_clean":"2023-12-13T00:28:46.938387+0000","last_became_active":"2023-12-13T00:00:31.142847+0000","last_became_peered":"2023-12-13T00:00:31.142847+0000","last_unstale":"2023-12-13T00:28:46.938387+0000","last_undegraded":"2023-12-13T00:28:46.938387+0000","last_fullsized":"2023-12-13T00:28:46.938387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:46.938316+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:46.938316+0000","last_clean_scrub_stamp":"2023-12-13T00:28:46.938316+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:53:47.130643+0000","scrub_duration":0.00094867900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'376","reported_seq":416,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:35.081637+0000","last_change":"2023-12-13T00:28:35.081637+0000","last_active":"2023-12-13T00:28:35.081637+0000","last_peered":"2023-12-13T00:28:35.081637+0000","last_clean":"2023-12-13T00:28:35.081637+0000","last_became_active":"2023-12-13T00:00:30.004195+0000","last_became_peered":"2023-12-13T00:00:30.004195+0000","last_unstale":"2023-12-13T00:28:35.081637+0000","last_undegraded":"2023-12-13T00:28:35.081637+0000","last_fullsized":"2023-12-13T00:28:35.081637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'376","last_scrub_stamp":"2023-12-13T00:28:35.081548+0000","last_deep_scrub":"27'376","last_deep_scrub_stamp":"2023-12-13T00:28:35.081548+0000","last_clean_scrub_stamp":"2023-12-13T00:28:35.081548+0000","objects_scrubbed":2,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:19:25.297573+0000","scrub_duration":0.0030443100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":373,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'154","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:54.009659+0000","last_change":"2023-12-13T00:28:54.009680+0000","last_active":"2023-12-13T00:28:54.009659+0000","last_peered":"2023-12-13T00:28:54.009659+0000","last_clean":"2023-12-13T00:28:54.009659+0000","last_became_active":"2023-12-13T00:00:35.659637+0000","last_became_peered":"2023-12-13T00:00:35.659637+0000","last_unstale":"2023-12-13T00:28:54.009659+0000","last_undegraded":"2023-12-13T00:28:54.009659+0000","last_fullsized":"2023-12-13T00:28:54.009659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'154","last_scrub_stamp":"2023-12-13T00:28:54.009591+0000","last_deep_scrub":"27'154","last_deep_scrub_stamp":"2023-12-13T00:28:54.009591+0000","last_clean_scrub_stamp":"2023-12-13T00:28:54.009591+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:33:48.756870+0000","scrub_duration":0.001554557,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":10280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'45","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:39.199140+0000","last_change":"2023-12-13T00:28:39.199140+0000","last_active":"2023-12-13T00:28:39.199140+0000","last_peered":"2023-12-13T00:28:39.199140+0000","last_clean":"2023-12-13T00:28:39.199140+0000","last_became_active":"2023-12-13T00:00:31.143673+0000","last_became_peered":"2023-12-13T00:00:31.143673+0000","last_unstale":"2023-12-13T00:28:39.199140+0000","last_undegraded":"2023-12-13T00:28:39.199140+0000","last_fullsized":"2023-12-13T00:28:39.199140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-13T00:28:39.199060+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-13T00:28:39.199060+0000","last_clean_scrub_stamp":"2023-12-13T00:28:39.199060+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:18:51.888473+0000","scrub_duration":0.00096585599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'7","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:30.333618+0000","last_change":"2023-12-13T00:28:30.333618+0000","last_active":"2023-12-13T00:28:30.333618+0000","last_peered":"2023-12-13T00:28:30.333618+0000","last_clean":"2023-12-13T00:28:30.333618+0000","last_became_active":"2023-12-13T00:00:30.005740+0000","last_became_peered":"2023-12-13T00:00:30.005740+0000","last_unstale":"2023-12-13T00:28:30.333618+0000","last_undegraded":"2023-12-13T00:28:30.333618+0000","last_fullsized":"2023-12-13T00:28:30.333618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:30.333541+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:30.333541+0000","last_clean_scrub_stamp":"2023-12-13T00:28:30.333541+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:00:50.961984+0000","scrub_duration":0.001992972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'170","reported_seq":206,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:54.149919+0000","last_change":"2023-12-13T00:28:54.149938+0000","last_active":"2023-12-13T00:28:54.149919+0000","last_peered":"2023-12-13T00:28:54.149919+0000","last_clean":"2023-12-13T00:28:54.149919+0000","last_became_active":"2023-12-13T00:00:35.665670+0000","last_became_peered":"2023-12-13T00:00:35.665670+0000","last_unstale":"2023-12-13T00:28:54.149919+0000","last_undegraded":"2023-12-13T00:28:54.149919+0000","last_fullsized":"2023-12-13T00:28:54.149919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'170","last_scrub_stamp":"2023-12-13T00:28:54.149855+0000","last_deep_scrub":"27'170","last_deep_scrub_stamp":"2023-12-13T00:28:54.149855+0000","last_clean_scrub_stamp":"2023-12-13T00:28:54.149855+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:19:36.272242+0000","scrub_duration":0.001524921,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'51","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:51.957464+0000","last_change":"2023-12-13T00:28:51.957483+0000","last_active":"2023-12-13T00:28:51.957464+0000","last_peered":"2023-12-13T00:28:51.957464+0000","last_clean":"2023-12-13T00:28:51.957464+0000","last_became_active":"2023-12-13T00:00:31.146435+0000","last_became_peered":"2023-12-13T00:00:31.146435+0000","last_unstale":"2023-12-13T00:28:51.957464+0000","last_undegraded":"2023-12-13T00:28:51.957464+0000","last_fullsized":"2023-12-13T00:28:51.957464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2023-12-13T00:28:51.957397+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2023-12-13T00:28:51.957397+0000","last_clean_scrub_stamp":"2023-12-13T00:28:51.957397+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:15:54.366317+0000","scrub_duration":0.00097599899999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'10","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:41.210535+0000","last_change":"2023-12-13T00:28:41.210570+0000","last_active":"2023-12-13T00:28:41.210535+0000","last_peered":"2023-12-13T00:28:41.210535+0000","last_clean":"2023-12-13T00:28:41.210535+0000","last_became_active":"2023-12-13T00:00:30.005909+0000","last_became_peered":"2023-12-13T00:00:30.005909+0000","last_unstale":"2023-12-13T00:28:41.210535+0000","last_undegraded":"2023-12-13T00:28:41.210535+0000","last_fullsized":"2023-12-13T00:28:41.210535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2023-12-13T00:28:41.210455+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2023-12-13T00:28:41.210455+0000","last_clean_scrub_stamp":"2023-12-13T00:28:41.210455+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:53:50.670216+0000","scrub_duration":0.0021685620000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'164","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:45.110808+0000","last_change":"2023-12-13T00:28:45.110846+0000","last_active":"2023-12-13T00:28:45.110808+0000","last_peered":"2023-12-13T00:28:45.110808+0000","last_clean":"2023-12-13T00:28:45.110808+0000","last_became_active":"2023-12-13T00:00:35.665521+0000","last_became_peered":"2023-12-13T00:00:35.665521+0000","last_unstale":"2023-12-13T00:28:45.110808+0000","last_undegraded":"2023-12-13T00:28:45.110808+0000","last_fullsized":"2023-12-13T00:28:45.110808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'164","last_scrub_stamp":"2023-12-13T00:28:45.110706+0000","last_deep_scrub":"27'164","last_deep_scrub_stamp":"2023-12-13T00:28:45.110706+0000","last_clean_scrub_stamp":"2023-12-13T00:28:45.110706+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:12:17.829651+0000","scrub_duration":0.0021503999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:06.036222+0000","last_change":"2023-12-13T00:29:06.036243+0000","last_active":"2023-12-13T00:29:06.036222+0000","last_peered":"2023-12-13T00:29:06.036222+0000","last_clean":"2023-12-13T00:29:06.036222+0000","last_became_active":"2023-12-13T00:00:31.145115+0000","last_became_peered":"2023-12-13T00:00:31.145115+0000","last_unstale":"2023-12-13T00:29:06.036222+0000","last_undegraded":"2023-12-13T00:29:06.036222+0000","last_fullsized":"2023-12-13T00:29:06.036222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:29:06.036142+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:29:06.036142+0000","last_clean_scrub_stamp":"2023-12-13T00:29:06.036142+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:19:18.725554+0000","scrub_duration":0.001275207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'171","reported_seq":211,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:38.973198+0000","last_change":"2023-12-13T00:28:38.973220+0000","last_active":"2023-12-13T00:28:38.973198+0000","last_peered":"2023-12-13T00:28:38.973198+0000","last_clean":"2023-12-13T00:28:38.973198+0000","last_became_active":"2023-12-13T00:00:30.005988+0000","last_became_peered":"2023-12-13T00:00:30.005988+0000","last_unstale":"2023-12-13T00:28:38.973198+0000","last_undegraded":"2023-12-13T00:28:38.973198+0000","last_fullsized":"2023-12-13T00:28:38.973198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'171","last_scrub_stamp":"2023-12-13T00:28:38.973118+0000","last_deep_scrub":"27'171","last_deep_scrub_stamp":"2023-12-13T00:28:38.973118+0000","last_clean_scrub_stamp":"2023-12-13T00:28:38.973118+0000","objects_scrubbed":2,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:41:10.652676+0000","scrub_duration":0.0034998709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'165","reported_seq":203,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:17.071397+0000","last_change":"2023-12-13T00:29:17.071419+0000","last_active":"2023-12-13T00:29:17.071397+0000","last_peered":"2023-12-13T00:29:17.071397+0000","last_clean":"2023-12-13T00:29:17.071397+0000","last_became_active":"2023-12-13T00:00:35.662612+0000","last_became_peered":"2023-12-13T00:00:35.662612+0000","last_unstale":"2023-12-13T00:29:17.071397+0000","last_undegraded":"2023-12-13T00:29:17.071397+0000","last_fullsized":"2023-12-13T00:29:17.071397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'165","last_scrub_stamp":"2023-12-13T00:29:17.071309+0000","last_deep_scrub":"27'165","last_deep_scrub_stamp":"2023-12-13T00:29:17.071309+0000","last_clean_scrub_stamp":"2023-12-13T00:29:17.071309+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:31:42.379169+0000","scrub_duration":0.001979625,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":14176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:44.147372+0000","last_change":"2023-12-13T00:28:44.147393+0000","last_active":"2023-12-13T00:28:44.147372+0000","last_peered":"2023-12-13T00:28:44.147372+0000","last_clean":"2023-12-13T00:28:44.147372+0000","last_became_active":"2023-12-13T00:00:31.117814+0000","last_became_peered":"2023-12-13T00:00:31.117814+0000","last_unstale":"2023-12-13T00:28:44.147372+0000","last_undegraded":"2023-12-13T00:28:44.147372+0000","last_fullsized":"2023-12-13T00:28:44.147372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:44.147296+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:44.147296+0000","last_clean_scrub_stamp":"2023-12-13T00:28:44.147296+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:50:07.776088+0000","scrub_duration":0.00099350000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'7","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:46.241923+0000","last_change":"2023-12-13T00:28:46.241945+0000","last_active":"2023-12-13T00:28:46.241923+0000","last_peered":"2023-12-13T00:28:46.241923+0000","last_clean":"2023-12-13T00:28:46.241923+0000","last_became_active":"2023-12-13T00:00:30.000755+0000","last_became_peered":"2023-12-13T00:00:30.000755+0000","last_unstale":"2023-12-13T00:28:46.241923+0000","last_undegraded":"2023-12-13T00:28:46.241923+0000","last_fullsized":"2023-12-13T00:28:46.241923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:46.241866+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:46.241866+0000","last_clean_scrub_stamp":"2023-12-13T00:28:46.241866+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:57:37.680204+0000","scrub_duration":0.0021721430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'145","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:53.389094+0000","last_change":"2023-12-13T00:28:53.389113+0000","last_active":"2023-12-13T00:28:53.389094+0000","last_peered":"2023-12-13T00:28:53.389094+0000","last_clean":"2023-12-13T00:28:53.389094+0000","last_became_active":"2023-12-13T00:01:00.544906+0000","last_became_peered":"2023-12-13T00:01:00.544906+0000","last_unstale":"2023-12-13T00:28:53.389094+0000","last_undegraded":"2023-12-13T00:28:53.389094+0000","last_fullsized":"2023-12-13T00:28:53.389094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'145","last_scrub_stamp":"2023-12-13T00:28:53.389028+0000","last_deep_scrub":"27'145","last_deep_scrub_stamp":"2023-12-13T00:28:53.389028+0000","last_clean_scrub_stamp":"2023-12-13T00:28:53.389028+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:40:15.132704+0000","scrub_duration":0.0015357649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,5],"acting":[6,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:24.142032+0000","last_change":"2023-12-13T00:28:24.142076+0000","last_active":"2023-12-13T00:28:24.142032+0000","last_peered":"2023-12-13T00:28:24.142032+0000","last_clean":"2023-12-13T00:28:24.142032+0000","last_became_active":"2023-12-13T00:00:31.143182+0000","last_became_peered":"2023-12-13T00:00:31.143182+0000","last_unstale":"2023-12-13T00:28:24.142032+0000","last_undegraded":"2023-12-13T00:28:24.142032+0000","last_fullsized":"2023-12-13T00:28:24.142032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:24.141950+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:24.141950+0000","last_clean_scrub_stamp":"2023-12-13T00:28:24.141950+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:23:02.587212+0000","scrub_duration":0.0015258120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'2","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:35.452225+0000","last_change":"2023-12-13T00:28:35.452225+0000","last_active":"2023-12-13T00:28:35.452225+0000","last_peered":"2023-12-13T00:28:35.452225+0000","last_clean":"2023-12-13T00:28:35.452225+0000","last_became_active":"2023-12-13T00:00:29.968860+0000","last_became_peered":"2023-12-13T00:00:29.968860+0000","last_unstale":"2023-12-13T00:28:35.452225+0000","last_undegraded":"2023-12-13T00:28:35.452225+0000","last_fullsized":"2023-12-13T00:28:35.452225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-13T00:28:35.452139+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-13T00:28:35.452139+0000","last_clean_scrub_stamp":"2023-12-13T00:28:35.452139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:35:28.566025+0000","scrub_duration":0.00098817000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'163","reported_seq":200,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:49.276541+0000","last_change":"2023-12-13T00:28:49.276562+0000","last_active":"2023-12-13T00:28:49.276541+0000","last_peered":"2023-12-13T00:28:49.276541+0000","last_clean":"2023-12-13T00:28:49.276541+0000","last_became_active":"2023-12-13T00:00:35.642215+0000","last_became_peered":"2023-12-13T00:00:35.642215+0000","last_unstale":"2023-12-13T00:28:49.276541+0000","last_undegraded":"2023-12-13T00:28:49.276541+0000","last_fullsized":"2023-12-13T00:28:49.276541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'163","last_scrub_stamp":"2023-12-13T00:28:49.276460+0000","last_deep_scrub":"27'163","last_deep_scrub_stamp":"2023-12-13T00:28:49.276460+0000","last_clean_scrub_stamp":"2023-12-13T00:28:49.276460+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:40:36.202097+0000","scrub_duration":0.0018069290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":6488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'62","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:05.869234+0000","last_change":"2023-12-13T00:29:05.869234+0000","last_active":"2023-12-13T00:29:05.869234+0000","last_peered":"2023-12-13T00:29:05.869234+0000","last_clean":"2023-12-13T00:29:05.869234+0000","last_became_active":"2023-12-13T00:00:31.149587+0000","last_became_peered":"2023-12-13T00:00:31.149587+0000","last_unstale":"2023-12-13T00:29:05.869234+0000","last_undegraded":"2023-12-13T00:29:05.869234+0000","last_fullsized":"2023-12-13T00:29:05.869234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'62","last_scrub_stamp":"2023-12-13T00:29:05.869123+0000","last_deep_scrub":"27'62","last_deep_scrub_stamp":"2023-12-13T00:29:05.869123+0000","last_clean_scrub_stamp":"2023-12-13T00:29:05.869123+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:18:10.514215+0000","scrub_duration":0.00099296800000000011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'793","reported_seq":834,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:53.376075+0000","last_change":"2023-12-13T00:28:53.376075+0000","last_active":"2023-12-13T00:28:53.376075+0000","last_peered":"2023-12-13T00:28:53.376075+0000","last_clean":"2023-12-13T00:28:53.376075+0000","last_became_active":"2023-12-13T00:00:29.997848+0000","last_became_peered":"2023-12-13T00:00:29.997848+0000","last_unstale":"2023-12-13T00:28:53.376075+0000","last_undegraded":"2023-12-13T00:28:53.376075+0000","last_fullsized":"2023-12-13T00:28:53.376075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'793","last_scrub_stamp":"2023-12-13T00:28:53.375997+0000","last_deep_scrub":"27'793","last_deep_scrub_stamp":"2023-12-13T00:28:53.375997+0000","last_clean_scrub_stamp":"2023-12-13T00:28:53.375997+0000","objects_scrubbed":1,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:18:55.892407+0000","scrub_duration":0.010981958,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":4476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'121","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:45.165260+0000","last_change":"2023-12-13T00:28:45.165299+0000","last_active":"2023-12-13T00:28:45.165260+0000","last_peered":"2023-12-13T00:28:45.165260+0000","last_clean":"2023-12-13T00:28:45.165260+0000","last_became_active":"2023-12-13T00:00:35.651766+0000","last_became_peered":"2023-12-13T00:00:35.651766+0000","last_unstale":"2023-12-13T00:28:45.165260+0000","last_undegraded":"2023-12-13T00:28:45.165260+0000","last_fullsized":"2023-12-13T00:28:45.165260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'121","last_scrub_stamp":"2023-12-13T00:28:45.165150+0000","last_deep_scrub":"27'121","last_deep_scrub_stamp":"2023-12-13T00:28:45.165150+0000","last_clean_scrub_stamp":"2023-12-13T00:28:45.165150+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:14:35.008693+0000","scrub_duration":0.0018200479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":7468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'58","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:05.458952+0000","last_change":"2023-12-13T00:29:05.458975+0000","last_active":"2023-12-13T00:29:05.458952+0000","last_peered":"2023-12-13T00:29:05.458952+0000","last_clean":"2023-12-13T00:29:05.458952+0000","last_became_active":"2023-12-13T00:00:31.120330+0000","last_became_peered":"2023-12-13T00:00:31.120330+0000","last_unstale":"2023-12-13T00:29:05.458952+0000","last_undegraded":"2023-12-13T00:29:05.458952+0000","last_fullsized":"2023-12-13T00:29:05.458952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-12-13T00:29:05.458868+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-12-13T00:29:05.458868+0000","last_clean_scrub_stamp":"2023-12-13T00:29:05.458868+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:01:06.593897+0000","scrub_duration":0.0011108209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'412","reported_seq":759,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:26.117217+0000","last_change":"2023-12-13T00:28:26.117217+0000","last_active":"2023-12-13T00:28:26.117217+0000","last_peered":"2023-12-13T00:28:26.117217+0000","last_clean":"2023-12-13T00:28:26.117217+0000","last_became_active":"2023-12-13T00:00:30.000015+0000","last_became_peered":"2023-12-13T00:00:30.000015+0000","last_unstale":"2023-12-13T00:28:26.117217+0000","last_undegraded":"2023-12-13T00:28:26.117217+0000","last_fullsized":"2023-12-13T00:28:26.117217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'412","last_scrub_stamp":"2023-12-13T00:28:26.117130+0000","last_deep_scrub":"27'412","last_deep_scrub_stamp":"2023-12-13T00:28:26.117130+0000","last_clean_scrub_stamp":"2023-12-13T00:28:26.117130+0000","objects_scrubbed":3,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:30:24.978930+0000","scrub_duration":0.002759671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58234,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":306,"num_read_kb":318,"num_write":408,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'147","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:51.300520+0000","last_change":"2023-12-13T00:28:51.300541+0000","last_active":"2023-12-13T00:28:51.300520+0000","last_peered":"2023-12-13T00:28:51.300520+0000","last_clean":"2023-12-13T00:28:51.300520+0000","last_became_active":"2023-12-13T00:00:35.667028+0000","last_became_peered":"2023-12-13T00:00:35.667028+0000","last_unstale":"2023-12-13T00:28:51.300520+0000","last_undegraded":"2023-12-13T00:28:51.300520+0000","last_fullsized":"2023-12-13T00:28:51.300520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'147","last_scrub_stamp":"2023-12-13T00:28:51.300454+0000","last_deep_scrub":"27'147","last_deep_scrub_stamp":"2023-12-13T00:28:51.300454+0000","last_clean_scrub_stamp":"2023-12-13T00:28:51.300454+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:17:24.312250+0000","scrub_duration":0.001522614,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":5383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'60","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:43.144047+0000","last_change":"2023-12-13T00:28:43.144086+0000","last_active":"2023-12-13T00:28:43.144047+0000","last_peered":"2023-12-13T00:28:43.144047+0000","last_clean":"2023-12-13T00:28:43.144047+0000","last_became_active":"2023-12-13T00:00:31.140597+0000","last_became_peered":"2023-12-13T00:00:31.140597+0000","last_unstale":"2023-12-13T00:28:43.144047+0000","last_undegraded":"2023-12-13T00:28:43.144047+0000","last_fullsized":"2023-12-13T00:28:43.144047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'60","last_scrub_stamp":"2023-12-13T00:28:43.143962+0000","last_deep_scrub":"27'60","last_deep_scrub_stamp":"2023-12-13T00:28:43.143962+0000","last_clean_scrub_stamp":"2023-12-13T00:28:43.143962+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:22:40.210116+0000","scrub_duration":0.001118927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'7","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:48.319830+0000","last_change":"2023-12-13T00:28:48.319856+0000","last_active":"2023-12-13T00:28:48.319830+0000","last_peered":"2023-12-13T00:28:48.319830+0000","last_clean":"2023-12-13T00:28:48.319830+0000","last_became_active":"2023-12-13T00:00:29.998552+0000","last_became_peered":"2023-12-13T00:00:29.998552+0000","last_unstale":"2023-12-13T00:28:48.319830+0000","last_undegraded":"2023-12-13T00:28:48.319830+0000","last_fullsized":"2023-12-13T00:28:48.319830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:48.319762+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:48.319762+0000","last_clean_scrub_stamp":"2023-12-13T00:28:48.319762+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:56:31.750088+0000","scrub_duration":0.0023572189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'127","reported_seq":164,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:19.327289+0000","last_change":"2023-12-13T00:29:19.327314+0000","last_active":"2023-12-13T00:29:19.327289+0000","last_peered":"2023-12-13T00:29:19.327289+0000","last_clean":"2023-12-13T00:29:19.327289+0000","last_became_active":"2023-12-13T00:00:35.666135+0000","last_became_peered":"2023-12-13T00:00:35.666135+0000","last_unstale":"2023-12-13T00:29:19.327289+0000","last_undegraded":"2023-12-13T00:29:19.327289+0000","last_fullsized":"2023-12-13T00:29:19.327289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'127","last_scrub_stamp":"2023-12-13T00:29:19.327194+0000","last_deep_scrub":"27'127","last_deep_scrub_stamp":"2023-12-13T00:29:19.327194+0000","last_clean_scrub_stamp":"2023-12-13T00:29:19.327194+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:34:58.986327+0000","scrub_duration":0.0018964120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":7535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'49","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:04.015344+0000","last_change":"2023-12-13T00:29:04.015391+0000","last_active":"2023-12-13T00:29:04.015344+0000","last_peered":"2023-12-13T00:29:04.015344+0000","last_clean":"2023-12-13T00:29:04.015344+0000","last_became_active":"2023-12-13T00:00:31.148421+0000","last_became_peered":"2023-12-13T00:00:31.148421+0000","last_unstale":"2023-12-13T00:29:04.015344+0000","last_undegraded":"2023-12-13T00:29:04.015344+0000","last_fullsized":"2023-12-13T00:29:04.015344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2023-12-13T00:29:04.015270+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2023-12-13T00:29:04.015270+0000","last_clean_scrub_stamp":"2023-12-13T00:29:04.015270+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:40:25.758946+0000","scrub_duration":0.0011265330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'8","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:54.366124+0000","last_change":"2023-12-13T00:28:54.366124+0000","last_active":"2023-12-13T00:28:54.366124+0000","last_peered":"2023-12-13T00:28:54.366124+0000","last_clean":"2023-12-13T00:28:54.366124+0000","last_became_active":"2023-12-13T00:00:30.000854+0000","last_became_peered":"2023-12-13T00:00:30.000854+0000","last_unstale":"2023-12-13T00:28:54.366124+0000","last_undegraded":"2023-12-13T00:28:54.366124+0000","last_fullsized":"2023-12-13T00:28:54.366124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2023-12-13T00:28:54.365977+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2023-12-13T00:28:54.365977+0000","last_clean_scrub_stamp":"2023-12-13T00:28:54.365977+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:08:15.266525+0000","scrub_duration":0.0028323900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:15.904956+0000","last_change":"2023-12-13T00:28:15.904996+0000","last_active":"2023-12-13T00:28:15.904956+0000","last_peered":"2023-12-13T00:28:15.904956+0000","last_clean":"2023-12-13T00:28:15.904956+0000","last_became_active":"2023-12-13T00:00:08.574464+0000","last_became_peered":"2023-12-13T00:00:08.574464+0000","last_unstale":"2023-12-13T00:28:15.904956+0000","last_undegraded":"2023-12-13T00:28:15.904956+0000","last_fullsized":"2023-12-13T00:28:15.904956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2023-12-13T00:28:15.904877+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2023-12-13T00:28:15.904877+0000","last_clean_scrub_stamp":"2023-12-13T00:28:15.904877+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:36:22.553417+0000","scrub_duration":0.0040292729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'166","reported_seq":203,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:05.311054+0000","last_change":"2023-12-13T00:29:05.311076+0000","last_active":"2023-12-13T00:29:05.311054+0000","last_peered":"2023-12-13T00:29:05.311054+0000","last_clean":"2023-12-13T00:29:05.311054+0000","last_became_active":"2023-12-13T00:00:35.660976+0000","last_became_peered":"2023-12-13T00:00:35.660976+0000","last_unstale":"2023-12-13T00:29:05.311054+0000","last_undegraded":"2023-12-13T00:29:05.311054+0000","last_fullsized":"2023-12-13T00:29:05.311054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'166","last_scrub_stamp":"2023-12-13T00:29:05.310980+0000","last_deep_scrub":"27'166","last_deep_scrub_stamp":"2023-12-13T00:29:05.310980+0000","last_clean_scrub_stamp":"2023-12-13T00:29:05.310980+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:56:46.377786+0000","scrub_duration":0.0016033779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":12423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'58","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:58.323239+0000","last_change":"2023-12-13T00:28:58.323281+0000","last_active":"2023-12-13T00:28:58.323239+0000","last_peered":"2023-12-13T00:28:58.323239+0000","last_clean":"2023-12-13T00:28:58.323239+0000","last_became_active":"2023-12-13T00:00:31.036127+0000","last_became_peered":"2023-12-13T00:00:31.036127+0000","last_unstale":"2023-12-13T00:28:58.323239+0000","last_undegraded":"2023-12-13T00:28:58.323239+0000","last_fullsized":"2023-12-13T00:28:58.323239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-12-13T00:28:58.323160+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-12-13T00:28:58.323160+0000","last_clean_scrub_stamp":"2023-12-13T00:28:58.323160+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:25:14.317802+0000","scrub_duration":0.001107993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:32.127657+0000","last_change":"2023-12-13T00:28:32.127692+0000","last_active":"2023-12-13T00:28:32.127657+0000","last_peered":"2023-12-13T00:28:32.127657+0000","last_clean":"2023-12-13T00:28:32.127657+0000","last_became_active":"2023-12-13T00:00:30.005943+0000","last_became_peered":"2023-12-13T00:00:30.005943+0000","last_unstale":"2023-12-13T00:28:32.127657+0000","last_undegraded":"2023-12-13T00:28:32.127657+0000","last_fullsized":"2023-12-13T00:28:32.127657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2023-12-13T00:28:32.127578+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2023-12-13T00:28:32.127578+0000","last_clean_scrub_stamp":"2023-12-13T00:28:32.127578+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:51:20.859478+0000","scrub_duration":0.0026550509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'164","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:42.160309+0000","last_change":"2023-12-13T00:28:42.160309+0000","last_active":"2023-12-13T00:28:42.160309+0000","last_peered":"2023-12-13T00:28:42.160309+0000","last_clean":"2023-12-13T00:28:42.160309+0000","last_became_active":"2023-12-13T00:00:35.664071+0000","last_became_peered":"2023-12-13T00:00:35.664071+0000","last_unstale":"2023-12-13T00:28:42.160309+0000","last_undegraded":"2023-12-13T00:28:42.160309+0000","last_fullsized":"2023-12-13T00:28:42.160309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'164","last_scrub_stamp":"2023-12-13T00:28:42.160213+0000","last_deep_scrub":"27'164","last_deep_scrub_stamp":"2023-12-13T00:28:42.160213+0000","last_clean_scrub_stamp":"2023-12-13T00:28:42.160213+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:14:39.060151+0000","scrub_duration":0.0016151290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":5432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'59","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:07.858275+0000","last_change":"2023-12-13T00:29:07.858295+0000","last_active":"2023-12-13T00:29:07.858275+0000","last_peered":"2023-12-13T00:29:07.858275+0000","last_clean":"2023-12-13T00:29:07.858275+0000","last_became_active":"2023-12-13T00:00:31.147523+0000","last_became_peered":"2023-12-13T00:00:31.147523+0000","last_unstale":"2023-12-13T00:29:07.858275+0000","last_undegraded":"2023-12-13T00:29:07.858275+0000","last_fullsized":"2023-12-13T00:29:07.858275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'59","last_scrub_stamp":"2023-12-13T00:29:07.858203+0000","last_deep_scrub":"27'59","last_deep_scrub_stamp":"2023-12-13T00:29:07.858203+0000","last_clean_scrub_stamp":"2023-12-13T00:29:07.858203+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:25:05.617181+0000","scrub_duration":0.0011723599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:41.555126+0000","last_change":"2023-12-13T00:28:41.555161+0000","last_active":"2023-12-13T00:28:41.555126+0000","last_peered":"2023-12-13T00:28:41.555126+0000","last_clean":"2023-12-13T00:28:41.555126+0000","last_became_active":"2023-12-13T00:00:30.002427+0000","last_became_peered":"2023-12-13T00:00:30.002427+0000","last_unstale":"2023-12-13T00:28:41.555126+0000","last_undegraded":"2023-12-13T00:28:41.555126+0000","last_fullsized":"2023-12-13T00:28:41.555126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2023-12-13T00:28:41.555034+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2023-12-13T00:28:41.555034+0000","last_clean_scrub_stamp":"2023-12-13T00:28:41.555034+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:13:56.431900+0000","scrub_duration":0.0022469870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'177","reported_seq":213,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:18.345923+0000","last_change":"2023-12-13T00:29:18.345946+0000","last_active":"2023-12-13T00:29:18.345923+0000","last_peered":"2023-12-13T00:29:18.345923+0000","last_clean":"2023-12-13T00:29:18.345923+0000","last_became_active":"2023-12-13T00:00:35.660939+0000","last_became_peered":"2023-12-13T00:00:35.660939+0000","last_unstale":"2023-12-13T00:29:18.345923+0000","last_undegraded":"2023-12-13T00:29:18.345923+0000","last_fullsized":"2023-12-13T00:29:18.345923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'177","last_scrub_stamp":"2023-12-13T00:29:18.345838+0000","last_deep_scrub":"27'177","last_deep_scrub_stamp":"2023-12-13T00:29:18.345838+0000","last_clean_scrub_stamp":"2023-12-13T00:29:18.345838+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:29:06.263636+0000","scrub_duration":0.0020228920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":11316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'64","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:08.833041+0000","last_change":"2023-12-13T00:29:08.833063+0000","last_active":"2023-12-13T00:29:08.833041+0000","last_peered":"2023-12-13T00:29:08.833041+0000","last_clean":"2023-12-13T00:29:08.833041+0000","last_became_active":"2023-12-13T00:00:31.145997+0000","last_became_peered":"2023-12-13T00:00:31.145997+0000","last_unstale":"2023-12-13T00:29:08.833041+0000","last_undegraded":"2023-12-13T00:29:08.833041+0000","last_fullsized":"2023-12-13T00:29:08.833041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2023-12-13T00:29:08.832966+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2023-12-13T00:29:08.832966+0000","last_clean_scrub_stamp":"2023-12-13T00:29:08.832966+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:59:43.483893+0000","scrub_duration":0.001268595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'7","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:41.954922+0000","last_change":"2023-12-13T00:28:41.954942+0000","last_active":"2023-12-13T00:28:41.954922+0000","last_peered":"2023-12-13T00:28:41.954922+0000","last_clean":"2023-12-13T00:28:41.954922+0000","last_became_active":"2023-12-13T00:00:29.967916+0000","last_became_peered":"2023-12-13T00:00:29.967916+0000","last_unstale":"2023-12-13T00:28:41.954922+0000","last_undegraded":"2023-12-13T00:28:41.954922+0000","last_fullsized":"2023-12-13T00:28:41.954922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:41.954861+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:41.954861+0000","last_clean_scrub_stamp":"2023-12-13T00:28:41.954861+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:49:34.653049+0000","scrub_duration":0.0018726369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'137","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:01.307306+0000","last_change":"2023-12-13T00:29:01.307352+0000","last_active":"2023-12-13T00:29:01.307306+0000","last_peered":"2023-12-13T00:29:01.307306+0000","last_clean":"2023-12-13T00:29:01.307306+0000","last_became_active":"2023-12-13T00:00:35.666891+0000","last_became_peered":"2023-12-13T00:00:35.666891+0000","last_unstale":"2023-12-13T00:29:01.307306+0000","last_undegraded":"2023-12-13T00:29:01.307306+0000","last_fullsized":"2023-12-13T00:29:01.307306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'137","last_scrub_stamp":"2023-12-13T00:29:01.307221+0000","last_deep_scrub":"27'137","last_deep_scrub_stamp":"2023-12-13T00:29:01.307221+0000","last_clean_scrub_stamp":"2023-12-13T00:29:01.307221+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:11:03.895843+0000","scrub_duration":0.0017657079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":9622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'54","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:26.150820+0000","last_change":"2023-12-13T00:28:26.150842+0000","last_active":"2023-12-13T00:28:26.150820+0000","last_peered":"2023-12-13T00:28:26.150820+0000","last_clean":"2023-12-13T00:28:26.150820+0000","last_became_active":"2023-12-13T00:00:31.148016+0000","last_became_peered":"2023-12-13T00:00:31.148016+0000","last_unstale":"2023-12-13T00:28:26.150820+0000","last_undegraded":"2023-12-13T00:28:26.150820+0000","last_fullsized":"2023-12-13T00:28:26.150820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2023-12-13T00:28:26.150748+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2023-12-13T00:28:26.150748+0000","last_clean_scrub_stamp":"2023-12-13T00:28:26.150748+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:33:21.472115+0000","scrub_duration":0.00095305200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'291","reported_seq":330,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:42.164800+0000","last_change":"2023-12-13T00:28:42.164841+0000","last_active":"2023-12-13T00:28:42.164800+0000","last_peered":"2023-12-13T00:28:42.164800+0000","last_clean":"2023-12-13T00:28:42.164800+0000","last_became_active":"2023-12-13T00:00:30.007907+0000","last_became_peered":"2023-12-13T00:00:30.007907+0000","last_unstale":"2023-12-13T00:28:42.164800+0000","last_undegraded":"2023-12-13T00:28:42.164800+0000","last_fullsized":"2023-12-13T00:28:42.164800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'291","last_scrub_stamp":"2023-12-13T00:28:42.164728+0000","last_deep_scrub":"27'291","last_deep_scrub_stamp":"2023-12-13T00:28:42.164728+0000","last_clean_scrub_stamp":"2023-12-13T00:28:42.164728+0000","objects_scrubbed":2,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:34:33.906063+0000","scrub_duration":0.00265343,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'132","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:41.917153+0000","last_change":"2023-12-13T00:28:41.917153+0000","last_active":"2023-12-13T00:28:41.917153+0000","last_peered":"2023-12-13T00:28:41.917153+0000","last_clean":"2023-12-13T00:28:41.917153+0000","last_became_active":"2023-12-13T00:00:35.660627+0000","last_became_peered":"2023-12-13T00:00:35.660627+0000","last_unstale":"2023-12-13T00:28:41.917153+0000","last_undegraded":"2023-12-13T00:28:41.917153+0000","last_fullsized":"2023-12-13T00:28:41.917153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'132","last_scrub_stamp":"2023-12-13T00:28:41.916997+0000","last_deep_scrub":"27'132","last_deep_scrub_stamp":"2023-12-13T00:28:41.916997+0000","last_clean_scrub_stamp":"2023-12-13T00:28:41.916997+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:02:51.470194+0000","scrub_duration":0.0017199540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":10143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'55","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:19.224564+0000","last_change":"2023-12-13T00:28:19.224564+0000","last_active":"2023-12-13T00:28:19.224564+0000","last_peered":"2023-12-13T00:28:19.224564+0000","last_clean":"2023-12-13T00:28:19.224564+0000","last_became_active":"2023-12-13T00:00:31.142150+0000","last_became_peered":"2023-12-13T00:00:31.142150+0000","last_unstale":"2023-12-13T00:28:19.224564+0000","last_undegraded":"2023-12-13T00:28:19.224564+0000","last_fullsized":"2023-12-13T00:28:19.224564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2023-12-13T00:28:19.224487+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2023-12-13T00:28:19.224487+0000","last_clean_scrub_stamp":"2023-12-13T00:28:19.224487+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:22:16.290641+0000","scrub_duration":0.00092248000000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'806","reported_seq":845,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:40.006646+0000","last_change":"2023-12-13T00:28:40.006677+0000","last_active":"2023-12-13T00:28:40.006646+0000","last_peered":"2023-12-13T00:28:40.006646+0000","last_clean":"2023-12-13T00:28:40.006646+0000","last_became_active":"2023-12-13T00:00:30.000388+0000","last_became_peered":"2023-12-13T00:00:30.000388+0000","last_unstale":"2023-12-13T00:28:40.006646+0000","last_undegraded":"2023-12-13T00:28:40.006646+0000","last_fullsized":"2023-12-13T00:28:40.006646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'806","last_scrub_stamp":"2023-12-13T00:28:40.006581+0000","last_deep_scrub":"27'806","last_deep_scrub_stamp":"2023-12-13T00:28:40.006581+0000","last_clean_scrub_stamp":"2023-12-13T00:28:40.006581+0000","objects_scrubbed":9,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:33:57.889707+0000","scrub_duration":0.009767141,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277997,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'170","reported_seq":206,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:28.255916+0000","last_change":"2023-12-13T00:29:28.255916+0000","last_active":"2023-12-13T00:29:28.255916+0000","last_peered":"2023-12-13T00:29:28.255916+0000","last_clean":"2023-12-13T00:29:28.255916+0000","last_became_active":"2023-12-13T00:00:35.666304+0000","last_became_peered":"2023-12-13T00:00:35.666304+0000","last_unstale":"2023-12-13T00:29:28.255916+0000","last_undegraded":"2023-12-13T00:29:28.255916+0000","last_fullsized":"2023-12-13T00:29:28.255916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'170","last_scrub_stamp":"2023-12-13T00:29:28.255751+0000","last_deep_scrub":"27'170","last_deep_scrub_stamp":"2023-12-13T00:29:28.255751+0000","last_clean_scrub_stamp":"2023-12-13T00:29:28.255751+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:22:50.333833+0000","scrub_duration":0.0020177300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":11255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'48","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:34.826516+0000","last_change":"2023-12-13T00:28:34.826536+0000","last_active":"2023-12-13T00:28:34.826516+0000","last_peered":"2023-12-13T00:28:34.826516+0000","last_clean":"2023-12-13T00:28:34.826516+0000","last_became_active":"2023-12-13T00:00:31.037398+0000","last_became_peered":"2023-12-13T00:00:31.037398+0000","last_unstale":"2023-12-13T00:28:34.826516+0000","last_undegraded":"2023-12-13T00:28:34.826516+0000","last_fullsized":"2023-12-13T00:28:34.826516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2023-12-13T00:28:34.826451+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2023-12-13T00:28:34.826451+0000","last_clean_scrub_stamp":"2023-12-13T00:28:34.826451+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:59:15.682252+0000","scrub_duration":0.001357818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'1357","reported_seq":1396,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:41.198342+0000","last_change":"2023-12-13T00:28:41.198366+0000","last_active":"2023-12-13T00:28:41.198342+0000","last_peered":"2023-12-13T00:28:41.198342+0000","last_clean":"2023-12-13T00:28:41.198342+0000","last_became_active":"2023-12-13T00:00:30.005752+0000","last_became_peered":"2023-12-13T00:00:30.005752+0000","last_unstale":"2023-12-13T00:28:41.198342+0000","last_undegraded":"2023-12-13T00:28:41.198342+0000","last_fullsized":"2023-12-13T00:28:41.198342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1357","last_scrub_stamp":"2023-12-13T00:28:41.198286+0000","last_deep_scrub":"27'1357","last_deep_scrub_stamp":"2023-12-13T00:28:41.198286+0000","last_clean_scrub_stamp":"2023-12-13T00:28:41.198286+0000","objects_scrubbed":2,"log_size":1357,"log_dups_size":0,"ondisk_log_size":1357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:13:56.075151+0000","scrub_duration":0.012562190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1349,"num_write_kb":4734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'175","reported_seq":211,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:21.322726+0000","last_change":"2023-12-13T00:29:21.322726+0000","last_active":"2023-12-13T00:29:21.322726+0000","last_peered":"2023-12-13T00:29:21.322726+0000","last_clean":"2023-12-13T00:29:21.322726+0000","last_became_active":"2023-12-13T00:00:35.666061+0000","last_became_peered":"2023-12-13T00:00:35.666061+0000","last_unstale":"2023-12-13T00:29:21.322726+0000","last_undegraded":"2023-12-13T00:29:21.322726+0000","last_fullsized":"2023-12-13T00:29:21.322726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'175","last_scrub_stamp":"2023-12-13T00:29:21.322618+0000","last_deep_scrub":"27'175","last_deep_scrub_stamp":"2023-12-13T00:29:21.322618+0000","last_clean_scrub_stamp":"2023-12-13T00:29:21.322618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:01:37.640313+0000","scrub_duration":0.001920817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":9890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'68","reported_seq":113,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:38.158958+0000","last_change":"2023-12-13T00:28:38.158977+0000","last_active":"2023-12-13T00:28:38.158958+0000","last_peered":"2023-12-13T00:28:38.158958+0000","last_clean":"2023-12-13T00:28:38.158958+0000","last_became_active":"2023-12-13T00:01:00.702089+0000","last_became_peered":"2023-12-13T00:01:00.702089+0000","last_unstale":"2023-12-13T00:28:38.158958+0000","last_undegraded":"2023-12-13T00:28:38.158958+0000","last_fullsized":"2023-12-13T00:28:38.158958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'68","last_scrub_stamp":"2023-12-13T00:28:38.158895+0000","last_deep_scrub":"27'68","last_deep_scrub_stamp":"2023-12-13T00:28:38.158895+0000","last_clean_scrub_stamp":"2023-12-13T00:28:38.158895+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:39:59.902571+0000","scrub_duration":0.001233034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'395","reported_seq":434,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:49.337548+0000","last_change":"2023-12-13T00:28:49.337585+0000","last_active":"2023-12-13T00:28:49.337548+0000","last_peered":"2023-12-13T00:28:49.337548+0000","last_clean":"2023-12-13T00:28:49.337548+0000","last_became_active":"2023-12-13T00:00:30.000803+0000","last_became_peered":"2023-12-13T00:00:30.000803+0000","last_unstale":"2023-12-13T00:28:49.337548+0000","last_undegraded":"2023-12-13T00:28:49.337548+0000","last_fullsized":"2023-12-13T00:28:49.337548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'395","last_scrub_stamp":"2023-12-13T00:28:49.337458+0000","last_deep_scrub":"27'395","last_deep_scrub_stamp":"2023-12-13T00:28:49.337458+0000","last_clean_scrub_stamp":"2023-12-13T00:28:49.337458+0000","objects_scrubbed":2,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:21:10.689739+0000","scrub_duration":0.0083268639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2931508,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":386,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'176","reported_seq":212,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:46.186772+0000","last_change":"2023-12-13T00:28:46.186793+0000","last_active":"2023-12-13T00:28:46.186772+0000","last_peered":"2023-12-13T00:28:46.186772+0000","last_clean":"2023-12-13T00:28:46.186772+0000","last_became_active":"2023-12-13T00:00:35.649151+0000","last_became_peered":"2023-12-13T00:00:35.649151+0000","last_unstale":"2023-12-13T00:28:46.186772+0000","last_undegraded":"2023-12-13T00:28:46.186772+0000","last_fullsized":"2023-12-13T00:28:46.186772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'176","last_scrub_stamp":"2023-12-13T00:28:46.186698+0000","last_deep_scrub":"27'176","last_deep_scrub_stamp":"2023-12-13T00:28:46.186698+0000","last_clean_scrub_stamp":"2023-12-13T00:28:46.186698+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:03:58.809328+0000","scrub_duration":0.0016794010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'60","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:36.237979+0000","last_change":"2023-12-13T00:28:36.238000+0000","last_active":"2023-12-13T00:28:36.237979+0000","last_peered":"2023-12-13T00:28:36.237979+0000","last_clean":"2023-12-13T00:28:36.237979+0000","last_became_active":"2023-12-13T00:00:31.115678+0000","last_became_peered":"2023-12-13T00:00:31.115678+0000","last_unstale":"2023-12-13T00:28:36.237979+0000","last_undegraded":"2023-12-13T00:28:36.237979+0000","last_fullsized":"2023-12-13T00:28:36.237979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'60","last_scrub_stamp":"2023-12-13T00:28:36.237907+0000","last_deep_scrub":"27'60","last_deep_scrub_stamp":"2023-12-13T00:28:36.237907+0000","last_clean_scrub_stamp":"2023-12-13T00:28:36.237907+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:50:24.671743+0000","scrub_duration":0.001189753,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'15","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:32.043769+0000","last_change":"2023-12-13T00:28:32.043793+0000","last_active":"2023-12-13T00:28:32.043769+0000","last_peered":"2023-12-13T00:28:32.043769+0000","last_clean":"2023-12-13T00:28:32.043769+0000","last_became_active":"2023-12-13T00:00:30.004089+0000","last_became_peered":"2023-12-13T00:00:30.004089+0000","last_unstale":"2023-12-13T00:28:32.043769+0000","last_undegraded":"2023-12-13T00:28:32.043769+0000","last_fullsized":"2023-12-13T00:28:32.043769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2023-12-13T00:28:32.043698+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2023-12-13T00:28:32.043698+0000","last_clean_scrub_stamp":"2023-12-13T00:28:32.043698+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:59:12.899499+0000","scrub_duration":0.0033306949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'148","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:07.296678+0000","last_change":"2023-12-13T00:29:07.296678+0000","last_active":"2023-12-13T00:29:07.296678+0000","last_peered":"2023-12-13T00:29:07.296678+0000","last_clean":"2023-12-13T00:29:07.296678+0000","last_became_active":"2023-12-13T00:00:35.651907+0000","last_became_peered":"2023-12-13T00:00:35.651907+0000","last_unstale":"2023-12-13T00:29:07.296678+0000","last_undegraded":"2023-12-13T00:29:07.296678+0000","last_fullsized":"2023-12-13T00:29:07.296678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'148","last_scrub_stamp":"2023-12-13T00:29:07.296554+0000","last_deep_scrub":"27'148","last_deep_scrub_stamp":"2023-12-13T00:29:07.296554+0000","last_clean_scrub_stamp":"2023-12-13T00:29:07.296554+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:25:39.801678+0000","scrub_duration":0.001725875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":7909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'46","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:00.031682+0000","last_change":"2023-12-13T00:29:00.031682+0000","last_active":"2023-12-13T00:29:00.031682+0000","last_peered":"2023-12-13T00:29:00.031682+0000","last_clean":"2023-12-13T00:29:00.031682+0000","last_became_active":"2023-12-13T00:00:31.147846+0000","last_became_peered":"2023-12-13T00:00:31.147846+0000","last_unstale":"2023-12-13T00:29:00.031682+0000","last_undegraded":"2023-12-13T00:29:00.031682+0000","last_fullsized":"2023-12-13T00:29:00.031682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2023-12-13T00:29:00.031590+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2023-12-13T00:29:00.031590+0000","last_clean_scrub_stamp":"2023-12-13T00:29:00.031590+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:24:37.475363+0000","scrub_duration":0.0014236279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'1477","reported_seq":1516,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:19.181691+0000","last_change":"2023-12-13T00:28:19.181691+0000","last_active":"2023-12-13T00:28:19.181691+0000","last_peered":"2023-12-13T00:28:19.181691+0000","last_clean":"2023-12-13T00:28:19.181691+0000","last_became_active":"2023-12-13T00:00:30.001420+0000","last_became_peered":"2023-12-13T00:00:30.001420+0000","last_unstale":"2023-12-13T00:28:19.181691+0000","last_undegraded":"2023-12-13T00:28:19.181691+0000","last_fullsized":"2023-12-13T00:28:19.181691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1477","last_scrub_stamp":"2023-12-13T00:28:19.181611+0000","last_deep_scrub":"27'1477","last_deep_scrub_stamp":"2023-12-13T00:28:19.181611+0000","last_clean_scrub_stamp":"2023-12-13T00:28:19.181611+0000","objects_scrubbed":5,"log_size":1477,"log_dups_size":0,"ondisk_log_size":1477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:50:30.914232+0000","scrub_duration":0.013805400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1472,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'148","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:20.098387+0000","last_change":"2023-12-13T00:29:20.098412+0000","last_active":"2023-12-13T00:29:20.098387+0000","last_peered":"2023-12-13T00:29:20.098387+0000","last_clean":"2023-12-13T00:29:20.098387+0000","last_became_active":"2023-12-13T00:01:00.546264+0000","last_became_peered":"2023-12-13T00:01:00.546264+0000","last_unstale":"2023-12-13T00:29:20.098387+0000","last_undegraded":"2023-12-13T00:29:20.098387+0000","last_fullsized":"2023-12-13T00:29:20.098387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'148","last_scrub_stamp":"2023-12-13T00:29:20.098291+0000","last_deep_scrub":"27'148","last_deep_scrub_stamp":"2023-12-13T00:29:20.098291+0000","last_clean_scrub_stamp":"2023-12-13T00:29:20.098291+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:07:00.182538+0000","scrub_duration":0.0018898809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'60","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:27.237666+0000","last_change":"2023-12-13T00:28:27.237666+0000","last_active":"2023-12-13T00:28:27.237666+0000","last_peered":"2023-12-13T00:28:27.237666+0000","last_clean":"2023-12-13T00:28:27.237666+0000","last_became_active":"2023-12-13T00:00:31.138723+0000","last_became_peered":"2023-12-13T00:00:31.138723+0000","last_unstale":"2023-12-13T00:28:27.237666+0000","last_undegraded":"2023-12-13T00:28:27.237666+0000","last_fullsized":"2023-12-13T00:28:27.237666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'60","last_scrub_stamp":"2023-12-13T00:28:27.237585+0000","last_deep_scrub":"27'60","last_deep_scrub_stamp":"2023-12-13T00:28:27.237585+0000","last_clean_scrub_stamp":"2023-12-13T00:28:27.237585+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T00:53:27.429911+0000","scrub_duration":0.000960584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'220","reported_seq":259,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:30.078699+0000","last_change":"2023-12-13T00:28:30.078699+0000","last_active":"2023-12-13T00:28:30.078699+0000","last_peered":"2023-12-13T00:28:30.078699+0000","last_clean":"2023-12-13T00:28:30.078699+0000","last_became_active":"2023-12-13T00:00:30.002823+0000","last_became_peered":"2023-12-13T00:00:30.002823+0000","last_unstale":"2023-12-13T00:28:30.078699+0000","last_undegraded":"2023-12-13T00:28:30.078699+0000","last_fullsized":"2023-12-13T00:28:30.078699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'220","last_scrub_stamp":"2023-12-13T00:28:30.078552+0000","last_deep_scrub":"27'220","last_deep_scrub_stamp":"2023-12-13T00:28:30.078552+0000","last_clean_scrub_stamp":"2023-12-13T00:28:30.078552+0000","objects_scrubbed":3,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:40:48.187335+0000","scrub_duration":0.0037294989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'219","reported_seq":264,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:52.223877+0000","last_change":"2023-12-13T00:28:52.223898+0000","last_active":"2023-12-13T00:28:52.223877+0000","last_peered":"2023-12-13T00:28:52.223877+0000","last_clean":"2023-12-13T00:28:52.223877+0000","last_became_active":"2023-12-13T00:01:00.697231+0000","last_became_peered":"2023-12-13T00:01:00.697231+0000","last_unstale":"2023-12-13T00:28:52.223877+0000","last_undegraded":"2023-12-13T00:28:52.223877+0000","last_fullsized":"2023-12-13T00:28:52.223877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'219","last_scrub_stamp":"2023-12-13T00:28:52.223810+0000","last_deep_scrub":"27'219","last_deep_scrub_stamp":"2023-12-13T00:28:52.223810+0000","last_clean_scrub_stamp":"2023-12-13T00:28:52.223810+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:50:31.544246+0000","scrub_duration":0.00158483,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":195,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'66","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:33.389111+0000","last_change":"2023-12-13T00:28:33.389111+0000","last_active":"2023-12-13T00:28:33.389111+0000","last_peered":"2023-12-13T00:28:33.389111+0000","last_clean":"2023-12-13T00:28:33.389111+0000","last_became_active":"2023-12-13T00:00:31.027239+0000","last_became_peered":"2023-12-13T00:00:31.027239+0000","last_unstale":"2023-12-13T00:28:33.389111+0000","last_undegraded":"2023-12-13T00:28:33.389111+0000","last_fullsized":"2023-12-13T00:28:33.389111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2023-12-13T00:28:33.389025+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2023-12-13T00:28:33.389025+0000","last_clean_scrub_stamp":"2023-12-13T00:28:33.389025+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:09:03.094471+0000","scrub_duration":0.001342815,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:38.193497+0000","last_change":"2023-12-13T00:28:38.193497+0000","last_active":"2023-12-13T00:28:38.193497+0000","last_peered":"2023-12-13T00:28:38.193497+0000","last_clean":"2023-12-13T00:28:38.193497+0000","last_became_active":"2023-12-13T00:00:30.009351+0000","last_became_peered":"2023-12-13T00:00:30.009351+0000","last_unstale":"2023-12-13T00:28:38.193497+0000","last_undegraded":"2023-12-13T00:28:38.193497+0000","last_fullsized":"2023-12-13T00:28:38.193497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2023-12-13T00:28:38.193420+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2023-12-13T00:28:38.193420+0000","last_clean_scrub_stamp":"2023-12-13T00:28:38.193420+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:34:55.196705+0000","scrub_duration":0.0019863580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'190","reported_seq":223,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:13.810904+0000","last_change":"2023-12-13T00:29:13.810927+0000","last_active":"2023-12-13T00:29:13.810904+0000","last_peered":"2023-12-13T00:29:13.810904+0000","last_clean":"2023-12-13T00:29:13.810904+0000","last_became_active":"2023-12-13T00:01:00.717019+0000","last_became_peered":"2023-12-13T00:01:00.717019+0000","last_unstale":"2023-12-13T00:29:13.810904+0000","last_undegraded":"2023-12-13T00:29:13.810904+0000","last_fullsized":"2023-12-13T00:29:13.810904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'190","last_scrub_stamp":"2023-12-13T00:29:13.810822+0000","last_deep_scrub":"27'190","last_deep_scrub_stamp":"2023-12-13T00:29:13.810822+0000","last_clean_scrub_stamp":"2023-12-13T00:29:13.810822+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:17:05.151592+0000","scrub_duration":0.001588129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":9378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"27'64","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:30.200455+0000","last_change":"2023-12-13T00:28:30.200455+0000","last_active":"2023-12-13T00:28:30.200455+0000","last_peered":"2023-12-13T00:28:30.200455+0000","last_clean":"2023-12-13T00:28:30.200455+0000","last_became_active":"2023-12-13T00:00:31.139656+0000","last_became_peered":"2023-12-13T00:00:31.139656+0000","last_unstale":"2023-12-13T00:28:30.200455+0000","last_undegraded":"2023-12-13T00:28:30.200455+0000","last_fullsized":"2023-12-13T00:28:30.200455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2023-12-13T00:28:30.200368+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2023-12-13T00:28:30.200368+0000","last_clean_scrub_stamp":"2023-12-13T00:28:30.200368+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:05:42.786288+0000","scrub_duration":0.0010289330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'84","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:21.916941+0000","last_change":"2023-12-13T00:28:21.916941+0000","last_active":"2023-12-13T00:28:21.916941+0000","last_peered":"2023-12-13T00:28:21.916941+0000","last_clean":"2023-12-13T00:28:21.916941+0000","last_became_active":"2023-12-13T00:00:30.002630+0000","last_became_peered":"2023-12-13T00:00:30.002630+0000","last_unstale":"2023-12-13T00:28:21.916941+0000","last_undegraded":"2023-12-13T00:28:21.916941+0000","last_fullsized":"2023-12-13T00:28:21.916941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'84","last_scrub_stamp":"2023-12-13T00:28:21.916861+0000","last_deep_scrub":"27'84","last_deep_scrub_stamp":"2023-12-13T00:28:21.916861+0000","last_clean_scrub_stamp":"2023-12-13T00:28:21.916861+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:34:21.020077+0000","scrub_duration":0.002537564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'123","reported_seq":159,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:07.006972+0000","last_change":"2023-12-13T00:29:07.006996+0000","last_active":"2023-12-13T00:29:07.006972+0000","last_peered":"2023-12-13T00:29:07.006972+0000","last_clean":"2023-12-13T00:29:07.006972+0000","last_became_active":"2023-12-13T00:00:35.649401+0000","last_became_peered":"2023-12-13T00:00:35.649401+0000","last_unstale":"2023-12-13T00:29:07.006972+0000","last_undegraded":"2023-12-13T00:29:07.006972+0000","last_fullsized":"2023-12-13T00:29:07.006972+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'123","last_scrub_stamp":"2023-12-13T00:29:07.006884+0000","last_deep_scrub":"27'123","last_deep_scrub_stamp":"2023-12-13T00:29:07.006884+0000","last_clean_scrub_stamp":"2023-12-13T00:29:07.006884+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:29:34.291813+0000","scrub_duration":0.0016617940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":7272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'122","reported_seq":160,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:19.056943+0000","last_change":"2023-12-13T00:29:19.056966+0000","last_active":"2023-12-13T00:29:19.056943+0000","last_peered":"2023-12-13T00:29:19.056943+0000","last_clean":"2023-12-13T00:29:19.056943+0000","last_became_active":"2023-12-13T00:00:35.662406+0000","last_became_peered":"2023-12-13T00:00:35.662406+0000","last_unstale":"2023-12-13T00:29:19.056943+0000","last_undegraded":"2023-12-13T00:29:19.056943+0000","last_fullsized":"2023-12-13T00:29:19.056943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'122","last_scrub_stamp":"2023-12-13T00:29:19.056851+0000","last_deep_scrub":"27'122","last_deep_scrub_stamp":"2023-12-13T00:29:19.056851+0000","last_clean_scrub_stamp":"2023-12-13T00:29:19.056851+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:58:10.495189+0000","scrub_duration":0.001937303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":7728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'66","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:42.928300+0000","last_change":"2023-12-13T00:28:42.928300+0000","last_active":"2023-12-13T00:28:42.928300+0000","last_peered":"2023-12-13T00:28:42.928300+0000","last_clean":"2023-12-13T00:28:42.928300+0000","last_became_active":"2023-12-13T00:00:31.142823+0000","last_became_peered":"2023-12-13T00:00:31.142823+0000","last_unstale":"2023-12-13T00:28:42.928300+0000","last_undegraded":"2023-12-13T00:28:42.928300+0000","last_fullsized":"2023-12-13T00:28:42.928300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2023-12-13T00:28:42.928203+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2023-12-13T00:28:42.928203+0000","last_clean_scrub_stamp":"2023-12-13T00:28:42.928203+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:50:06.556995+0000","scrub_duration":0.0010733419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'7","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:44.169330+0000","last_change":"2023-12-13T00:28:44.169330+0000","last_active":"2023-12-13T00:28:44.169330+0000","last_peered":"2023-12-13T00:28:44.169330+0000","last_clean":"2023-12-13T00:28:44.169330+0000","last_became_active":"2023-12-13T00:00:30.004496+0000","last_became_peered":"2023-12-13T00:00:30.004496+0000","last_unstale":"2023-12-13T00:28:44.169330+0000","last_undegraded":"2023-12-13T00:28:44.169330+0000","last_fullsized":"2023-12-13T00:28:44.169330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-13T00:28:44.169196+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-13T00:28:44.169196+0000","last_clean_scrub_stamp":"2023-12-13T00:28:44.169196+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:15:10.983277+0000","scrub_duration":0.0010496419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'188","reported_seq":225,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:03.329024+0000","last_change":"2023-12-13T00:29:03.329045+0000","last_active":"2023-12-13T00:29:03.329024+0000","last_peered":"2023-12-13T00:29:03.329024+0000","last_clean":"2023-12-13T00:29:03.329024+0000","last_became_active":"2023-12-13T00:00:35.666075+0000","last_became_peered":"2023-12-13T00:00:35.666075+0000","last_unstale":"2023-12-13T00:29:03.329024+0000","last_undegraded":"2023-12-13T00:29:03.329024+0000","last_fullsized":"2023-12-13T00:29:03.329024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'188","last_scrub_stamp":"2023-12-13T00:29:03.328949+0000","last_deep_scrub":"27'188","last_deep_scrub_stamp":"2023-12-13T00:29:03.328949+0000","last_clean_scrub_stamp":"2023-12-13T00:29:03.328949+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:54:19.087895+0000","scrub_duration":0.0016475299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":17531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'63","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:26.387186+0000","last_change":"2023-12-13T00:28:26.387186+0000","last_active":"2023-12-13T00:28:26.387186+0000","last_peered":"2023-12-13T00:28:26.387186+0000","last_clean":"2023-12-13T00:28:26.387186+0000","last_became_active":"2023-12-13T00:00:31.116209+0000","last_became_peered":"2023-12-13T00:00:31.116209+0000","last_unstale":"2023-12-13T00:28:26.387186+0000","last_undegraded":"2023-12-13T00:28:26.387186+0000","last_fullsized":"2023-12-13T00:28:26.387186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'63","last_scrub_stamp":"2023-12-13T00:28:26.387107+0000","last_deep_scrub":"27'63","last_deep_scrub_stamp":"2023-12-13T00:28:26.387107+0000","last_clean_scrub_stamp":"2023-12-13T00:28:26.387107+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T05:20:18.635398+0000","scrub_duration":0.00089511699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'486","reported_seq":1003,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:27.221072+0000","last_change":"2023-12-13T00:28:27.221072+0000","last_active":"2023-12-13T00:28:27.221072+0000","last_peered":"2023-12-13T00:28:27.221072+0000","last_clean":"2023-12-13T00:28:27.221072+0000","last_became_active":"2023-12-13T00:00:30.006026+0000","last_became_peered":"2023-12-13T00:00:30.006026+0000","last_unstale":"2023-12-13T00:28:27.221072+0000","last_undegraded":"2023-12-13T00:28:27.221072+0000","last_fullsized":"2023-12-13T00:28:27.221072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'486","last_scrub_stamp":"2023-12-13T00:28:27.220940+0000","last_deep_scrub":"27'486","last_deep_scrub_stamp":"2023-12-13T00:28:27.220940+0000","last_clean_scrub_stamp":"2023-12-13T00:28:27.220940+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:02:36.774137+0000","scrub_duration":0.003497904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92099,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":501,"num_write":481,"num_write_kb":501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'1033","reported_seq":1764,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:43.219768+0000","last_change":"2023-12-13T00:28:43.219796+0000","last_active":"2023-12-13T00:28:43.219768+0000","last_peered":"2023-12-13T00:28:43.219768+0000","last_clean":"2023-12-13T00:28:43.219768+0000","last_became_active":"2023-12-13T00:00:30.004214+0000","last_became_peered":"2023-12-13T00:00:30.004214+0000","last_unstale":"2023-12-13T00:28:43.219768+0000","last_undegraded":"2023-12-13T00:28:43.219768+0000","last_fullsized":"2023-12-13T00:28:43.219768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1033","last_scrub_stamp":"2023-12-13T00:28:43.219704+0000","last_deep_scrub":"27'1033","last_deep_scrub_stamp":"2023-12-13T00:28:43.219704+0000","last_clean_scrub_stamp":"2023-12-13T00:28:43.219704+0000","objects_scrubbed":3,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:57:11.700770+0000","scrub_duration":0.0078829299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1792997,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":693,"num_read_kb":705,"num_write":1026,"num_write_kb":2509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'68","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:48.916365+0000","last_change":"2023-12-13T00:28:48.916384+0000","last_active":"2023-12-13T00:28:48.916365+0000","last_peered":"2023-12-13T00:28:48.916365+0000","last_clean":"2023-12-13T00:28:48.916365+0000","last_became_active":"2023-12-13T00:00:31.146818+0000","last_became_peered":"2023-12-13T00:00:31.146818+0000","last_unstale":"2023-12-13T00:28:48.916365+0000","last_undegraded":"2023-12-13T00:28:48.916365+0000","last_fullsized":"2023-12-13T00:28:48.916365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'68","last_scrub_stamp":"2023-12-13T00:28:48.916293+0000","last_deep_scrub":"27'68","last_deep_scrub_stamp":"2023-12-13T00:28:48.916293+0000","last_clean_scrub_stamp":"2023-12-13T00:28:48.916293+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:55:21.504933+0000","scrub_duration":0.0013653420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'150","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:08.019877+0000","last_change":"2023-12-13T00:29:08.019914+0000","last_active":"2023-12-13T00:29:08.019877+0000","last_peered":"2023-12-13T00:29:08.019877+0000","last_clean":"2023-12-13T00:29:08.019877+0000","last_became_active":"2023-12-13T00:00:35.642114+0000","last_became_peered":"2023-12-13T00:00:35.642114+0000","last_unstale":"2023-12-13T00:29:08.019877+0000","last_undegraded":"2023-12-13T00:29:08.019877+0000","last_fullsized":"2023-12-13T00:29:08.019877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'150","last_scrub_stamp":"2023-12-13T00:29:08.019777+0000","last_deep_scrub":"27'150","last_deep_scrub_stamp":"2023-12-13T00:29:08.019777+0000","last_clean_scrub_stamp":"2023-12-13T00:29:08.019777+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:54:17.479538+0000","scrub_duration":0.0016483660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":10646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'2841","reported_seq":2879,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:37.492377+0000","last_change":"2023-12-13T00:28:37.492403+0000","last_active":"2023-12-13T00:28:37.492377+0000","last_peered":"2023-12-13T00:28:37.492377+0000","last_clean":"2023-12-13T00:28:37.492377+0000","last_became_active":"2023-12-13T00:00:29.972018+0000","last_became_peered":"2023-12-13T00:00:29.972018+0000","last_unstale":"2023-12-13T00:28:37.492377+0000","last_undegraded":"2023-12-13T00:28:37.492377+0000","last_fullsized":"2023-12-13T00:28:37.492377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2841","last_scrub_stamp":"2023-12-13T00:28:37.492311+0000","last_deep_scrub":"27'2841","last_deep_scrub_stamp":"2023-12-13T00:28:37.492311+0000","last_clean_scrub_stamp":"2023-12-13T00:28:37.492311+0000","objects_scrubbed":4,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:48:54.932186+0000","scrub_duration":0.032490435999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2827,"num_write_kb":13646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'70","reported_seq":107,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:36.841889+0000","last_change":"2023-12-13T00:28:36.841907+0000","last_active":"2023-12-13T00:28:36.841889+0000","last_peered":"2023-12-13T00:28:36.841889+0000","last_clean":"2023-12-13T00:28:36.841889+0000","last_became_active":"2023-12-13T00:00:31.037445+0000","last_became_peered":"2023-12-13T00:00:31.037445+0000","last_unstale":"2023-12-13T00:28:36.841889+0000","last_undegraded":"2023-12-13T00:28:36.841889+0000","last_fullsized":"2023-12-13T00:28:36.841889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'70","last_scrub_stamp":"2023-12-13T00:28:36.841827+0000","last_deep_scrub":"27'70","last_deep_scrub_stamp":"2023-12-13T00:28:36.841827+0000","last_clean_scrub_stamp":"2023-12-13T00:28:36.841827+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T04:32:13.405381+0000","scrub_duration":0.001030577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'116","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:52.979507+0000","last_change":"2023-12-13T00:28:52.979547+0000","last_active":"2023-12-13T00:28:52.979507+0000","last_peered":"2023-12-13T00:28:52.979507+0000","last_clean":"2023-12-13T00:28:52.979507+0000","last_became_active":"2023-12-13T00:00:35.660984+0000","last_became_peered":"2023-12-13T00:00:35.660984+0000","last_unstale":"2023-12-13T00:28:52.979507+0000","last_undegraded":"2023-12-13T00:28:52.979507+0000","last_fullsized":"2023-12-13T00:28:52.979507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'116","last_scrub_stamp":"2023-12-13T00:28:52.979429+0000","last_deep_scrub":"27'116","last_deep_scrub_stamp":"2023-12-13T00:28:52.979429+0000","last_clean_scrub_stamp":"2023-12-13T00:28:52.979429+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:42:34.764745+0000","scrub_duration":0.001495531,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":9076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'57","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:29.162479+0000","last_change":"2023-12-13T00:28:29.162479+0000","last_active":"2023-12-13T00:28:29.162479+0000","last_peered":"2023-12-13T00:28:29.162479+0000","last_clean":"2023-12-13T00:28:29.162479+0000","last_became_active":"2023-12-13T00:00:31.145225+0000","last_became_peered":"2023-12-13T00:00:31.145225+0000","last_unstale":"2023-12-13T00:28:29.162479+0000","last_undegraded":"2023-12-13T00:28:29.162479+0000","last_fullsized":"2023-12-13T00:28:29.162479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:29.162405+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:29.162405+0000","last_clean_scrub_stamp":"2023-12-13T00:28:29.162405+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:04:14.041159+0000","scrub_duration":0.001250794,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'66","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:39.122997+0000","last_change":"2023-12-13T00:28:39.123017+0000","last_active":"2023-12-13T00:28:39.122997+0000","last_peered":"2023-12-13T00:28:39.122997+0000","last_clean":"2023-12-13T00:28:39.122997+0000","last_became_active":"2023-12-13T00:00:31.119474+0000","last_became_peered":"2023-12-13T00:00:31.119474+0000","last_unstale":"2023-12-13T00:28:39.122997+0000","last_undegraded":"2023-12-13T00:28:39.122997+0000","last_fullsized":"2023-12-13T00:28:39.122997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2023-12-13T00:28:39.122931+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2023-12-13T00:28:39.122931+0000","last_clean_scrub_stamp":"2023-12-13T00:28:39.122931+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:35:21.951724+0000","scrub_duration":0.0011100109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'62","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:22.188610+0000","last_change":"2023-12-13T00:28:22.188630+0000","last_active":"2023-12-13T00:28:22.188610+0000","last_peered":"2023-12-13T00:28:22.188610+0000","last_clean":"2023-12-13T00:28:22.188610+0000","last_became_active":"2023-12-13T00:00:31.026922+0000","last_became_peered":"2023-12-13T00:00:31.026922+0000","last_unstale":"2023-12-13T00:28:22.188610+0000","last_undegraded":"2023-12-13T00:28:22.188610+0000","last_fullsized":"2023-12-13T00:28:22.188610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'62","last_scrub_stamp":"2023-12-13T00:28:22.188548+0000","last_deep_scrub":"27'62","last_deep_scrub_stamp":"2023-12-13T00:28:22.188548+0000","last_clean_scrub_stamp":"2023-12-13T00:28:22.188548+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:49:45.817340+0000","scrub_duration":0.00098737400000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'58","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:53.450911+0000","last_change":"2023-12-13T00:28:53.450930+0000","last_active":"2023-12-13T00:28:53.450911+0000","last_peered":"2023-12-13T00:28:53.450911+0000","last_clean":"2023-12-13T00:28:53.450911+0000","last_became_active":"2023-12-13T00:00:31.119685+0000","last_became_peered":"2023-12-13T00:00:31.119685+0000","last_unstale":"2023-12-13T00:28:53.450911+0000","last_undegraded":"2023-12-13T00:28:53.450911+0000","last_fullsized":"2023-12-13T00:28:53.450911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-12-13T00:28:53.450847+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-12-13T00:28:53.450847+0000","last_clean_scrub_stamp":"2023-12-13T00:28:53.450847+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:44:37.656495+0000","scrub_duration":0.0010318650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'45","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:40.262577+0000","last_change":"2023-12-13T00:28:40.262577+0000","last_active":"2023-12-13T00:28:40.262577+0000","last_peered":"2023-12-13T00:28:40.262577+0000","last_clean":"2023-12-13T00:28:40.262577+0000","last_became_active":"2023-12-13T00:00:31.150275+0000","last_became_peered":"2023-12-13T00:00:31.150275+0000","last_unstale":"2023-12-13T00:28:40.262577+0000","last_undegraded":"2023-12-13T00:28:40.262577+0000","last_fullsized":"2023-12-13T00:28:40.262577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-13T00:28:40.262455+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-13T00:28:40.262455+0000","last_clean_scrub_stamp":"2023-12-13T00:28:40.262455+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:33:58.145582+0000","scrub_duration":0.00145042,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'47","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:37.199211+0000","last_change":"2023-12-13T00:28:37.199211+0000","last_active":"2023-12-13T00:28:37.199211+0000","last_peered":"2023-12-13T00:28:37.199211+0000","last_clean":"2023-12-13T00:28:37.199211+0000","last_became_active":"2023-12-13T00:00:31.117409+0000","last_became_peered":"2023-12-13T00:00:31.117409+0000","last_unstale":"2023-12-13T00:28:37.199211+0000","last_undegraded":"2023-12-13T00:28:37.199211+0000","last_fullsized":"2023-12-13T00:28:37.199211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2023-12-13T00:28:37.199129+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2023-12-13T00:28:37.199129+0000","last_clean_scrub_stamp":"2023-12-13T00:28:37.199129+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:01:50.944562+0000","scrub_duration":0.0012582509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'59","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:36.226175+0000","last_change":"2023-12-13T00:28:36.226175+0000","last_active":"2023-12-13T00:28:36.226175+0000","last_peered":"2023-12-13T00:28:36.226175+0000","last_clean":"2023-12-13T00:28:36.226175+0000","last_became_active":"2023-12-13T00:00:31.141656+0000","last_became_peered":"2023-12-13T00:00:31.141656+0000","last_unstale":"2023-12-13T00:28:36.226175+0000","last_undegraded":"2023-12-13T00:28:36.226175+0000","last_fullsized":"2023-12-13T00:28:36.226175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'59","last_scrub_stamp":"2023-12-13T00:28:36.226090+0000","last_deep_scrub":"27'59","last_deep_scrub_stamp":"2023-12-13T00:28:36.226090+0000","last_clean_scrub_stamp":"2023-12-13T00:28:36.226090+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:49:10.922803+0000","scrub_duration":0.00088218499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'47","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:15.342381+0000","last_change":"2023-12-13T00:29:15.342401+0000","last_active":"2023-12-13T00:29:15.342381+0000","last_peered":"2023-12-13T00:29:15.342381+0000","last_clean":"2023-12-13T00:29:15.342381+0000","last_became_active":"2023-12-13T00:00:31.036113+0000","last_became_peered":"2023-12-13T00:00:31.036113+0000","last_unstale":"2023-12-13T00:29:15.342381+0000","last_undegraded":"2023-12-13T00:29:15.342381+0000","last_fullsized":"2023-12-13T00:29:15.342381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2023-12-13T00:29:15.342298+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2023-12-13T00:29:15.342298+0000","last_clean_scrub_stamp":"2023-12-13T00:29:15.342298+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:45:30.541172+0000","scrub_duration":0.0012070410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'57","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:29.241422+0000","last_change":"2023-12-13T00:28:29.241422+0000","last_active":"2023-12-13T00:28:29.241422+0000","last_peered":"2023-12-13T00:28:29.241422+0000","last_clean":"2023-12-13T00:28:29.241422+0000","last_became_active":"2023-12-13T00:00:31.026968+0000","last_became_peered":"2023-12-13T00:00:31.026968+0000","last_unstale":"2023-12-13T00:28:29.241422+0000","last_undegraded":"2023-12-13T00:28:29.241422+0000","last_fullsized":"2023-12-13T00:28:29.241422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:29.241340+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:29.241340+0000","last_clean_scrub_stamp":"2023-12-13T00:28:29.241340+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:15:31.650259+0000","scrub_duration":0.001146413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'71","reported_seq":109,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:51.503257+0000","last_change":"2023-12-13T00:28:51.503292+0000","last_active":"2023-12-13T00:28:51.503257+0000","last_peered":"2023-12-13T00:28:51.503257+0000","last_clean":"2023-12-13T00:28:51.503257+0000","last_became_active":"2023-12-13T00:00:31.138869+0000","last_became_peered":"2023-12-13T00:00:31.138869+0000","last_unstale":"2023-12-13T00:28:51.503257+0000","last_undegraded":"2023-12-13T00:28:51.503257+0000","last_fullsized":"2023-12-13T00:28:51.503257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'71","last_scrub_stamp":"2023-12-13T00:28:51.503181+0000","last_deep_scrub":"27'71","last_deep_scrub_stamp":"2023-12-13T00:28:51.503181+0000","last_clean_scrub_stamp":"2023-12-13T00:28:51.503181+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:08:04.701204+0000","scrub_duration":0.001225117,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'64","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:23.891788+0000","last_change":"2023-12-13T00:28:23.891810+0000","last_active":"2023-12-13T00:28:23.891788+0000","last_peered":"2023-12-13T00:28:23.891788+0000","last_clean":"2023-12-13T00:28:23.891788+0000","last_became_active":"2023-12-13T00:00:31.146264+0000","last_became_peered":"2023-12-13T00:00:31.146264+0000","last_unstale":"2023-12-13T00:28:23.891788+0000","last_undegraded":"2023-12-13T00:28:23.891788+0000","last_fullsized":"2023-12-13T00:28:23.891788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2023-12-13T00:28:23.891712+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2023-12-13T00:28:23.891712+0000","last_clean_scrub_stamp":"2023-12-13T00:28:23.891712+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:51:29.227897+0000","scrub_duration":0.001254544,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'68","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:21.053596+0000","last_change":"2023-12-13T00:28:21.053631+0000","last_active":"2023-12-13T00:28:21.053596+0000","last_peered":"2023-12-13T00:28:21.053596+0000","last_clean":"2023-12-13T00:28:21.053596+0000","last_became_active":"2023-12-13T00:00:31.143472+0000","last_became_peered":"2023-12-13T00:00:31.143472+0000","last_unstale":"2023-12-13T00:28:21.053596+0000","last_undegraded":"2023-12-13T00:28:21.053596+0000","last_fullsized":"2023-12-13T00:28:21.053596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'68","last_scrub_stamp":"2023-12-13T00:28:21.053523+0000","last_deep_scrub":"27'68","last_deep_scrub_stamp":"2023-12-13T00:28:21.053523+0000","last_clean_scrub_stamp":"2023-12-13T00:28:21.053523+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:02:30.606720+0000","scrub_duration":0.0014989020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'52","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:27.382187+0000","last_change":"2023-12-13T00:28:27.382226+0000","last_active":"2023-12-13T00:28:27.382187+0000","last_peered":"2023-12-13T00:28:27.382187+0000","last_clean":"2023-12-13T00:28:27.382187+0000","last_became_active":"2023-12-13T00:00:31.146159+0000","last_became_peered":"2023-12-13T00:00:31.146159+0000","last_unstale":"2023-12-13T00:28:27.382187+0000","last_undegraded":"2023-12-13T00:28:27.382187+0000","last_fullsized":"2023-12-13T00:28:27.382187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2023-12-13T00:28:27.382098+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2023-12-13T00:28:27.382098+0000","last_clean_scrub_stamp":"2023-12-13T00:28:27.382098+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:04:12.260853+0000","scrub_duration":0.001152623,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'67","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:57.334099+0000","last_change":"2023-12-13T00:28:57.334118+0000","last_active":"2023-12-13T00:28:57.334099+0000","last_peered":"2023-12-13T00:28:57.334099+0000","last_clean":"2023-12-13T00:28:57.334099+0000","last_became_active":"2023-12-13T00:00:31.143663+0000","last_became_peered":"2023-12-13T00:00:31.143663+0000","last_unstale":"2023-12-13T00:28:57.334099+0000","last_undegraded":"2023-12-13T00:28:57.334099+0000","last_fullsized":"2023-12-13T00:28:57.334099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'67","last_scrub_stamp":"2023-12-13T00:28:57.334032+0000","last_deep_scrub":"27'67","last_deep_scrub_stamp":"2023-12-13T00:28:57.334032+0000","last_clean_scrub_stamp":"2023-12-13T00:28:57.334032+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:56:51.246356+0000","scrub_duration":0.0013995189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'69","reported_seq":107,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:47.073022+0000","last_change":"2023-12-13T00:28:47.073043+0000","last_active":"2023-12-13T00:28:47.073022+0000","last_peered":"2023-12-13T00:28:47.073022+0000","last_clean":"2023-12-13T00:28:47.073022+0000","last_became_active":"2023-12-13T00:00:31.142067+0000","last_became_peered":"2023-12-13T00:00:31.142067+0000","last_unstale":"2023-12-13T00:28:47.073022+0000","last_undegraded":"2023-12-13T00:28:47.073022+0000","last_fullsized":"2023-12-13T00:28:47.073022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'69","last_scrub_stamp":"2023-12-13T00:28:47.072960+0000","last_deep_scrub":"27'69","last_deep_scrub_stamp":"2023-12-13T00:28:47.072960+0000","last_clean_scrub_stamp":"2023-12-13T00:28:47.072960+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:05:33.159119+0000","scrub_duration":0.0013398869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'51","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:59.316687+0000","last_change":"2023-12-13T00:28:59.316706+0000","last_active":"2023-12-13T00:28:59.316687+0000","last_peered":"2023-12-13T00:28:59.316687+0000","last_clean":"2023-12-13T00:28:59.316687+0000","last_became_active":"2023-12-13T00:00:31.146501+0000","last_became_peered":"2023-12-13T00:00:31.146501+0000","last_unstale":"2023-12-13T00:28:59.316687+0000","last_undegraded":"2023-12-13T00:28:59.316687+0000","last_fullsized":"2023-12-13T00:28:59.316687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2023-12-13T00:28:59.316627+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2023-12-13T00:28:59.316627+0000","last_clean_scrub_stamp":"2023-12-13T00:28:59.316627+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:19:06.190921+0000","scrub_duration":0.001138153,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'67","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:40.189909+0000","last_change":"2023-12-13T00:28:40.189927+0000","last_active":"2023-12-13T00:28:40.189909+0000","last_peered":"2023-12-13T00:28:40.189909+0000","last_clean":"2023-12-13T00:28:40.189909+0000","last_became_active":"2023-12-13T00:00:31.138738+0000","last_became_peered":"2023-12-13T00:00:31.138738+0000","last_unstale":"2023-12-13T00:28:40.189909+0000","last_undegraded":"2023-12-13T00:28:40.189909+0000","last_fullsized":"2023-12-13T00:28:40.189909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'67","last_scrub_stamp":"2023-12-13T00:28:40.189828+0000","last_deep_scrub":"27'67","last_deep_scrub_stamp":"2023-12-13T00:28:40.189828+0000","last_clean_scrub_stamp":"2023-12-13T00:28:40.189828+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:29:07.474756+0000","scrub_duration":0.00095464400000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'52","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:50.518152+0000","last_change":"2023-12-13T00:28:50.518190+0000","last_active":"2023-12-13T00:28:50.518152+0000","last_peered":"2023-12-13T00:28:50.518152+0000","last_clean":"2023-12-13T00:28:50.518152+0000","last_became_active":"2023-12-13T00:00:31.148251+0000","last_became_peered":"2023-12-13T00:00:31.148251+0000","last_unstale":"2023-12-13T00:28:50.518152+0000","last_undegraded":"2023-12-13T00:28:50.518152+0000","last_fullsized":"2023-12-13T00:28:50.518152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2023-12-13T00:28:50.518079+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2023-12-13T00:28:50.518079+0000","last_clean_scrub_stamp":"2023-12-13T00:28:50.518079+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:24:22.899572+0000","scrub_duration":0.0010737329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'58","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:38.176733+0000","last_change":"2023-12-13T00:28:38.176733+0000","last_active":"2023-12-13T00:28:38.176733+0000","last_peered":"2023-12-13T00:28:38.176733+0000","last_clean":"2023-12-13T00:28:38.176733+0000","last_became_active":"2023-12-13T00:00:31.117423+0000","last_became_peered":"2023-12-13T00:00:31.117423+0000","last_unstale":"2023-12-13T00:28:38.176733+0000","last_undegraded":"2023-12-13T00:28:38.176733+0000","last_fullsized":"2023-12-13T00:28:38.176733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-12-13T00:28:38.176651+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-12-13T00:28:38.176651+0000","last_clean_scrub_stamp":"2023-12-13T00:28:38.176651+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:31:57.197976+0000","scrub_duration":0.00092640599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'67","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:33.116013+0000","last_change":"2023-12-13T00:28:33.116013+0000","last_active":"2023-12-13T00:28:33.116013+0000","last_peered":"2023-12-13T00:28:33.116013+0000","last_clean":"2023-12-13T00:28:33.116013+0000","last_became_active":"2023-12-13T00:00:31.150324+0000","last_became_peered":"2023-12-13T00:00:31.150324+0000","last_unstale":"2023-12-13T00:28:33.116013+0000","last_undegraded":"2023-12-13T00:28:33.116013+0000","last_fullsized":"2023-12-13T00:28:33.116013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'67","last_scrub_stamp":"2023-12-13T00:28:33.115863+0000","last_deep_scrub":"27'67","last_deep_scrub_stamp":"2023-12-13T00:28:33.115863+0000","last_clean_scrub_stamp":"2023-12-13T00:28:33.115863+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T01:07:24.061579+0000","scrub_duration":0.001322997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'63","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:02.938132+0000","last_change":"2023-12-13T00:29:02.938132+0000","last_active":"2023-12-13T00:29:02.938132+0000","last_peered":"2023-12-13T00:29:02.938132+0000","last_clean":"2023-12-13T00:29:02.938132+0000","last_became_active":"2023-12-13T00:00:31.146444+0000","last_became_peered":"2023-12-13T00:00:31.146444+0000","last_unstale":"2023-12-13T00:29:02.938132+0000","last_undegraded":"2023-12-13T00:29:02.938132+0000","last_fullsized":"2023-12-13T00:29:02.938132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'63","last_scrub_stamp":"2023-12-13T00:29:02.938049+0000","last_deep_scrub":"27'63","last_deep_scrub_stamp":"2023-12-13T00:29:02.938049+0000","last_clean_scrub_stamp":"2023-12-13T00:29:02.938049+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:15:47.767419+0000","scrub_duration":0.00097593500000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'67","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:25.363455+0000","last_change":"2023-12-13T00:28:25.363455+0000","last_active":"2023-12-13T00:28:25.363455+0000","last_peered":"2023-12-13T00:28:25.363455+0000","last_clean":"2023-12-13T00:28:25.363455+0000","last_became_active":"2023-12-13T00:00:31.148529+0000","last_became_peered":"2023-12-13T00:00:31.148529+0000","last_unstale":"2023-12-13T00:28:25.363455+0000","last_undegraded":"2023-12-13T00:28:25.363455+0000","last_fullsized":"2023-12-13T00:28:25.363455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'67","last_scrub_stamp":"2023-12-13T00:28:25.363359+0000","last_deep_scrub":"27'67","last_deep_scrub_stamp":"2023-12-13T00:28:25.363359+0000","last_clean_scrub_stamp":"2023-12-13T00:28:25.363359+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T11:30:26.094520+0000","scrub_duration":0.0010738740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'59","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:50.981152+0000","last_change":"2023-12-13T00:28:50.981152+0000","last_active":"2023-12-13T00:28:50.981152+0000","last_peered":"2023-12-13T00:28:50.981152+0000","last_clean":"2023-12-13T00:28:50.981152+0000","last_became_active":"2023-12-13T00:00:31.149685+0000","last_became_peered":"2023-12-13T00:00:31.149685+0000","last_unstale":"2023-12-13T00:28:50.981152+0000","last_undegraded":"2023-12-13T00:28:50.981152+0000","last_fullsized":"2023-12-13T00:28:50.981152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'59","last_scrub_stamp":"2023-12-13T00:28:50.981064+0000","last_deep_scrub":"27'59","last_deep_scrub_stamp":"2023-12-13T00:28:50.981064+0000","last_clean_scrub_stamp":"2023-12-13T00:28:50.981064+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T08:44:35.186712+0000","scrub_duration":0.00088980899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'62","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:39.871044+0000","last_change":"2023-12-13T00:28:39.871044+0000","last_active":"2023-12-13T00:28:39.871044+0000","last_peered":"2023-12-13T00:28:39.871044+0000","last_clean":"2023-12-13T00:28:39.871044+0000","last_became_active":"2023-12-13T00:00:31.035672+0000","last_became_peered":"2023-12-13T00:00:31.035672+0000","last_unstale":"2023-12-13T00:28:39.871044+0000","last_undegraded":"2023-12-13T00:28:39.871044+0000","last_fullsized":"2023-12-13T00:28:39.871044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'62","last_scrub_stamp":"2023-12-13T00:28:39.870953+0000","last_deep_scrub":"27'62","last_deep_scrub_stamp":"2023-12-13T00:28:39.870953+0000","last_clean_scrub_stamp":"2023-12-13T00:28:39.870953+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:35:22.699747+0000","scrub_duration":0.0011428779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'65","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:14.316691+0000","last_change":"2023-12-13T00:29:14.316728+0000","last_active":"2023-12-13T00:29:14.316691+0000","last_peered":"2023-12-13T00:29:14.316691+0000","last_clean":"2023-12-13T00:29:14.316691+0000","last_became_active":"2023-12-13T00:00:31.146186+0000","last_became_peered":"2023-12-13T00:00:31.146186+0000","last_unstale":"2023-12-13T00:29:14.316691+0000","last_undegraded":"2023-12-13T00:29:14.316691+0000","last_fullsized":"2023-12-13T00:29:14.316691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'65","last_scrub_stamp":"2023-12-13T00:29:14.316583+0000","last_deep_scrub":"27'65","last_deep_scrub_stamp":"2023-12-13T00:29:14.316583+0000","last_clean_scrub_stamp":"2023-12-13T00:29:14.316583+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:25:12.075561+0000","scrub_duration":0.001412551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'52","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:43.136951+0000","last_change":"2023-12-13T00:28:43.136970+0000","last_active":"2023-12-13T00:28:43.136951+0000","last_peered":"2023-12-13T00:28:43.136951+0000","last_clean":"2023-12-13T00:28:43.136951+0000","last_became_active":"2023-12-13T00:00:31.144458+0000","last_became_peered":"2023-12-13T00:00:31.144458+0000","last_unstale":"2023-12-13T00:28:43.136951+0000","last_undegraded":"2023-12-13T00:28:43.136951+0000","last_fullsized":"2023-12-13T00:28:43.136951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2023-12-13T00:28:43.136884+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2023-12-13T00:28:43.136884+0000","last_clean_scrub_stamp":"2023-12-13T00:28:43.136884+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T09:16:45.059703+0000","scrub_duration":0.0010172639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'57","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:20.190360+0000","last_change":"2023-12-13T00:28:20.190377+0000","last_active":"2023-12-13T00:28:20.190360+0000","last_peered":"2023-12-13T00:28:20.190360+0000","last_clean":"2023-12-13T00:28:20.190360+0000","last_became_active":"2023-12-13T00:00:31.144792+0000","last_became_peered":"2023-12-13T00:00:31.144792+0000","last_unstale":"2023-12-13T00:28:20.190360+0000","last_undegraded":"2023-12-13T00:28:20.190360+0000","last_fullsized":"2023-12-13T00:28:20.190360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:28:20.190304+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:28:20.190304+0000","last_clean_scrub_stamp":"2023-12-13T00:28:20.190304+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:16:25.962310+0000","scrub_duration":0.0010028070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'50","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:24.347581+0000","last_change":"2023-12-13T00:28:24.347618+0000","last_active":"2023-12-13T00:28:24.347581+0000","last_peered":"2023-12-13T00:28:24.347581+0000","last_clean":"2023-12-13T00:28:24.347581+0000","last_became_active":"2023-12-13T00:00:31.148875+0000","last_became_peered":"2023-12-13T00:00:31.148875+0000","last_unstale":"2023-12-13T00:28:24.347581+0000","last_undegraded":"2023-12-13T00:28:24.347581+0000","last_fullsized":"2023-12-13T00:28:24.347581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-13T00:28:24.347486+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-13T00:28:24.347486+0000","last_clean_scrub_stamp":"2023-12-13T00:28:24.347486+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T03:41:33.521746+0000","scrub_duration":0.001393895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'66","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:25.176823+0000","last_change":"2023-12-13T00:28:25.176823+0000","last_active":"2023-12-13T00:28:25.176823+0000","last_peered":"2023-12-13T00:28:25.176823+0000","last_clean":"2023-12-13T00:28:25.176823+0000","last_became_active":"2023-12-13T00:00:31.144174+0000","last_became_peered":"2023-12-13T00:00:31.144174+0000","last_unstale":"2023-12-13T00:28:25.176823+0000","last_undegraded":"2023-12-13T00:28:25.176823+0000","last_fullsized":"2023-12-13T00:28:25.176823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2023-12-13T00:28:25.176745+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2023-12-13T00:28:25.176745+0000","last_clean_scrub_stamp":"2023-12-13T00:28:25.176745+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T06:36:46.260217+0000","scrub_duration":0.0010312170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'57","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:10.373269+0000","last_change":"2023-12-13T00:29:10.373269+0000","last_active":"2023-12-13T00:29:10.373269+0000","last_peered":"2023-12-13T00:29:10.373269+0000","last_clean":"2023-12-13T00:29:10.373269+0000","last_became_active":"2023-12-13T00:00:31.143809+0000","last_became_peered":"2023-12-13T00:00:31.143809+0000","last_unstale":"2023-12-13T00:29:10.373269+0000","last_undegraded":"2023-12-13T00:29:10.373269+0000","last_fullsized":"2023-12-13T00:29:10.373269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2023-12-13T00:29:10.373147+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2023-12-13T00:29:10.373147+0000","last_clean_scrub_stamp":"2023-12-13T00:29:10.373147+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T02:32:53.324077+0000","scrub_duration":0.001165351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'47","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:28:27.432315+0000","last_change":"2023-12-13T00:28:27.432315+0000","last_active":"2023-12-13T00:28:27.432315+0000","last_peered":"2023-12-13T00:28:27.432315+0000","last_clean":"2023-12-13T00:28:27.432315+0000","last_became_active":"2023-12-13T00:00:31.116230+0000","last_became_peered":"2023-12-13T00:00:31.116230+0000","last_unstale":"2023-12-13T00:28:27.432315+0000","last_undegraded":"2023-12-13T00:28:27.432315+0000","last_fullsized":"2023-12-13T00:28:27.432315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2023-12-13T00:28:27.432235+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2023-12-13T00:28:27.432235+0000","last_clean_scrub_stamp":"2023-12-13T00:28:27.432235+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T07:43:11.126576+0000","scrub_duration":0.00088450200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'66","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-13T00:29:10.806250+0000","last_change":"2023-12-13T00:29:10.806250+0000","last_active":"2023-12-13T00:29:10.806250+0000","last_peered":"2023-12-13T00:29:10.806250+0000","last_clean":"2023-12-13T00:29:10.806250+0000","last_became_active":"2023-12-13T00:00:31.149410+0000","last_became_peered":"2023-12-13T00:00:31.149410+0000","last_unstale":"2023-12-13T00:29:10.806250+0000","last_undegraded":"2023-12-13T00:29:10.806250+0000","last_fullsized":"2023-12-13T00:29:10.806250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2023-12-13T00:29:10.806157+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2023-12-13T00:29:10.806157+0000","last_clean_scrub_stamp":"2023-12-13T00:29:10.806157+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T10:01:54.967195+0000","scrub_duration":0.0010937690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":248,"num_write":4193,"num_write_kb":331487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5031,"ondisk_log_size":5031,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3759,"ondisk_log_size":3759,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":43904475,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":1477,"num_read_kb":1524,"num_write":14609,"num_write_kb":50682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87957504,"data_stored":87808950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13658,"ondisk_log_size":13658,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509799,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53632,"kb_used_data":8568,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318208,"statfs":{"total":96636764160,"available":96581844992,"internally_reserved":0,"allocated":8773632,"data_stored":8578223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:29:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.40699999999999997},"min":{"1min":0.39500000000000002,"5min":0.25800000000000001,"15min":0.25},"max":{"1min":0.629,"5min":0.629,"15min":0.65800000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.45300000000000001,"15min":0.437},"min":{"1min":0.433,"5min":0.253,"15min":0.253},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.48299999999999998}]},{"osd":1,"last update":"Wed Dec 13 00:29:18 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.45500000000000002,"15min":0.44400000000000001},"min":{"1min":0.40999999999999998,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.439,"15min":0.42499999999999999},"min":{"1min":0.44400000000000001,"5min":0.29799999999999999,"15min":0.28199999999999997},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61699999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Wed Dec 13 00:29:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.44700000000000001,"15min":0.43099999999999999},"min":{"1min":0.41799999999999998,"5min":0.29499999999999998,"15min":0.27100000000000002},"max":{"1min":0.63900000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.45800000000000002,"15min":0.436},"min":{"1min":0.39700000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.56200000000000006}]},{"osd":3,"last update":"Wed Dec 13 00:29:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.45600000000000002,"15min":0.443},"min":{"1min":0.39400000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47099999999999997,"15min":0.47199999999999998},"min":{"1min":0.35599999999999998,"5min":0.32000000000000001,"15min":0.309},"max":{"1min":0.61699999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.52200000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:29:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.371,"15min":0.374},"min":{"1min":0.27400000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56000000000000005,"5min":0.753,"15min":0.753},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.39500000000000002},"min":{"1min":0.29899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.56899999999999995,"5min":0.64100000000000001,"15min":0.64500000000000002},"last":0.40799999999999997}]},{"osd":5,"last update":"Wed Dec 13 00:29:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.22900000000000001},"max":{"1min":0.68400000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.435,"15min":0.439},"min":{"1min":0.312,"5min":0.29799999999999999,"15min":0.23100000000000001},"max":{"1min":0.61899999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.438}]},{"osd":6,"last update":"Wed Dec 13 00:29:18 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45700000000000002,"15min":0.45900000000000002},"min":{"1min":0.32800000000000001,"5min":0.26900000000000002,"15min":0.23999999999999999},"max":{"1min":0.65300000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.71799999999999997},"last":0.50900000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509798,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88192,"kb_used_data":16760,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94283648,"statfs":{"total":96636764160,"available":96546455552,"internally_reserved":0,"allocated":17162240,"data_stored":16985405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.41199999999999998},"min":{"1min":0.32200000000000001,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.71399999999999997,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.432},"min":{"1min":0.35499999999999998,"5min":0.27900000000000003,"15min":0.23100000000000001},"max":{"1min":0.75800000000000001,"5min":0.877,"15min":0.877},"last":0.57199999999999995}]},{"osd":1,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.42999999999999999,"15min":0.41699999999999998},"min":{"1min":0.35799999999999998,"5min":0.28599999999999998,"15min":0.252},"max":{"1min":0.74199999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.437,"15min":0.41999999999999998},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":0.77100000000000002,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.47499999999999998}]},{"osd":2,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.44800000000000001,"15min":0.41399999999999998},"min":{"1min":0.36399999999999999,"5min":0.315,"15min":0.247},"max":{"1min":0.67500000000000004,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.45600000000000002,"15min":0.439},"min":{"1min":0.375,"5min":0.28999999999999998,"15min":0.26500000000000001},"max":{"1min":0.78000000000000003,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.52700000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47099999999999997,"15min":0.45700000000000002},"min":{"1min":0.375,"5min":0.32600000000000001,"15min":0.28999999999999998},"max":{"1min":0.75900000000000001,"5min":1.173,"15min":1.173},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.40000000000000002,"5min":0.33400000000000002,"15min":0.32300000000000001},"max":{"1min":0.79700000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.501}]},{"osd":4,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39100000000000001,"15min":0.38200000000000001},"min":{"1min":0.26400000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.57399999999999995,"5min":1.595,"15min":1.595},"last":0.437},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29999999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.72099999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.33200000000000002}]},{"osd":5,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39000000000000001,"15min":0.38100000000000001},"min":{"1min":0.28199999999999997,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.67600000000000005,"5min":1.115,"15min":1.115},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45600000000000002,"15min":0.439},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.249},"max":{"1min":0.623,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.35299999999999998}]},{"osd":7,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45400000000000001,"15min":0.443},"min":{"1min":0.30499999999999999,"5min":0.27700000000000002,"15min":0.26000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44800000000000001,"15min":0.442},"min":{"1min":0.32200000000000001,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.70899999999999996,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.48399999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509800,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58980,"kb_used_data":9756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312860,"statfs":{"total":96636764160,"available":96576368640,"internally_reserved":0,"allocated":9990144,"data_stored":9784207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.44600000000000001,"15min":0.42899999999999999},"min":{"1min":0.25600000000000001,"5min":0.216,"15min":0.20499999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.438,"15min":0.42399999999999999},"min":{"1min":0.40899999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.50800000000000001}]},{"osd":1,"last update":"Wed Dec 13 00:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.45400000000000001,"15min":0.42299999999999999},"min":{"1min":0.35999999999999999,"5min":0.248,"15min":0.224},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.46300000000000002,"15min":0.44600000000000001},"min":{"1min":0.32600000000000001,"5min":0.29899999999999999,"15min":0.251},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.54000000000000004}]},{"osd":2,"last update":"Wed Dec 13 00:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.46600000000000003,"15min":0.44400000000000001},"min":{"1min":0.40600000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.45700000000000002,"15min":0.441},"min":{"1min":0.38500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.68799999999999994,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.496}]},{"osd":3,"last update":"Wed Dec 13 00:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.46700000000000003,"15min":0.439},"min":{"1min":0.312,"5min":0.31,"15min":0.28699999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.49099999999999999,"15min":0.47199999999999998},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.316},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51600000000000001}]},{"osd":5,"last update":"Wed Dec 13 00:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.40899999999999997,"15min":0.39200000000000002},"min":{"1min":0.29199999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.70499999999999996,"5min":0.747,"15min":0.747},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.41399999999999998,"15min":0.39000000000000001},"min":{"1min":0.27700000000000002,"5min":0.251,"15min":0.23400000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.46800000000000003}]},{"osd":6,"last update":"Wed Dec 13 00:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.40300000000000002,"15min":0.39200000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.247},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.47299999999999998,"15min":0.44700000000000001},"min":{"1min":0.34000000000000002,"5min":0.27300000000000002,"15min":0.23899999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41699999999999998}]},{"osd":7,"last update":"Wed Dec 13 00:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.45800000000000002,"15min":0.435},"min":{"1min":0.312,"5min":0.28899999999999998,"15min":0.25600000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48199999999999998,"15min":0.46700000000000003},"min":{"1min":0.32300000000000001,"5min":0.32200000000000001,"15min":0.28999999999999998},"max":{"1min":0.76100000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.441}]}]},{"osd":3,"up_from":15,"seq":64424509800,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96880,"kb_used_data":21288,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94274960,"statfs":{"total":96636764160,"available":96537559040,"internally_reserved":0,"allocated":21798912,"data_stored":21617833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.32000000000000001,"15min":0.317},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.19500000000000001},"max":{"1min":0.51800000000000002,"5min":0.53200000000000003,"15min":0.64000000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.314,"5min":0.312,"15min":0.314},"min":{"1min":0.245,"5min":0.19600000000000001,"15min":0.192},"max":{"1min":0.48099999999999998,"5min":0.54200000000000004,"15min":0.57899999999999996},"last":0.36199999999999999}]},{"osd":1,"last update":"Wed Dec 13 00:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.33600000000000002,"15min":0.33200000000000002},"min":{"1min":0.25,"5min":0.24199999999999999,"15min":0.21099999999999999},"max":{"1min":0.495,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.38100000000000001,"15min":0.372},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.21199999999999999},"max":{"1min":0.52200000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.33600000000000002}]},{"osd":2,"last update":"Wed Dec 13 00:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38400000000000001,"15min":0.374},"min":{"1min":0.32300000000000001,"5min":0.249,"15min":0.22800000000000001},"max":{"1min":0.53200000000000003,"5min":0.59899999999999998,"15min":0.69399999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.39300000000000002,"15min":0.39700000000000002},"min":{"1min":0.28299999999999997,"5min":0.26800000000000002,"15min":0.23799999999999999},"max":{"1min":0.57699999999999996,"5min":0.59699999999999998,"15min":0.66300000000000003},"last":0.38100000000000001}]},{"osd":4,"last update":"Wed Dec 13 00:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.496,"15min":0.496},"min":{"1min":0.39200000000000002,"5min":0.312,"15min":0.311},"max":{"1min":0.66400000000000003,"5min":0.80100000000000005,"15min":0.90700000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.503,"15min":0.48899999999999999},"min":{"1min":0.42399999999999999,"5min":0.34100000000000003,"15min":0.32000000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.84199999999999997},"last":0.56899999999999995}]},{"osd":5,"last update":"Wed Dec 13 00:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.41599999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.74199999999999999,"5min":0.75600000000000001,"15min":0.83199999999999996},"last":0.501},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36899999999999999,"5min":0.33600000000000002,"15min":0.33200000000000002},"max":{"1min":0.73699999999999999,"5min":0.76000000000000001,"15min":0.81999999999999995},"last":0.51200000000000001}]},{"osd":6,"last update":"Wed Dec 13 00:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.42199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.69499999999999995,"5min":0.78600000000000003,"15min":0.80600000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55900000000000005,"15min":0.54100000000000004},"min":{"1min":0.46800000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.755,"5min":0.77800000000000002,"15min":0.79300000000000004},"last":0.46999999999999997}]},{"osd":7,"last update":"Wed Dec 13 00:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70599999999999996,"5min":0.75800000000000001,"15min":0.78800000000000003},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56000000000000005,"15min":0.53900000000000003},"min":{"1min":0.47899999999999998,"5min":0.42899999999999999,"15min":0.39500000000000002},"max":{"1min":0.79800000000000004,"5min":0.80800000000000005,"15min":0.85799999999999998},"last":0.54300000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509799,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36200,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335640,"statfs":{"total":96636764160,"available":96599695360,"internally_reserved":0,"allocated":884736,"data_stored":706002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:29:32 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.311,"15min":0.30099999999999999},"min":{"1min":0.22800000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.46400000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.32700000000000001,"15min":0.33100000000000002},"min":{"1min":0.254,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.55500000000000005,"5min":0.61099999999999999,"15min":0.63600000000000001},"last":0.32100000000000001}]},{"osd":2,"last update":"Wed Dec 13 00:29:32 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.32700000000000001,"15min":0.32800000000000001},"min":{"1min":0.22500000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.67700000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.35299999999999998,"15min":0.35399999999999998},"min":{"1min":0.26700000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.33900000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:29:32 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38,"15min":0.378},"min":{"1min":0.247,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58299999999999996,"5min":0.60599999999999998,"15min":0.60799999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.376,"15min":0.38700000000000001},"min":{"1min":0.26700000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.85899999999999999},"last":0.39600000000000002}]},{"osd":4,"last update":"Wed Dec 13 00:29:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.47999999999999998},"min":{"1min":0.376,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76300000000000001,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.623},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.50600000000000001,"15min":0.48699999999999999},"min":{"1min":0.42499999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.70999999999999996,"5min":0.79500000000000004,"15min":0.84699999999999998},"last":0.70399999999999996}]},{"osd":5,"last update":"Wed Dec 13 00:29:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.40200000000000002,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.81999999999999995},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.505,"15min":0.498},"min":{"1min":0.435,"5min":0.34999999999999998,"15min":0.32800000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.59199999999999997}]},{"osd":6,"last update":"Wed Dec 13 00:29:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.39300000000000002,"5min":0.34000000000000002,"15min":0.29099999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.89300000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.42199999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.71699999999999997}]},{"osd":7,"last update":"Wed Dec 13 00:29:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52900000000000003,"15min":0.52400000000000002},"min":{"1min":0.40799999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.83899999999999997},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.439,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.66000000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542503,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53544,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318296,"statfs":{"total":96636764160,"available":96581935104,"internally_reserved":0,"allocated":8683520,"data_stored":8504788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.314,"15min":0.308},"min":{"1min":0.22900000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.46400000000000002,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32900000000000001},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.19},"max":{"1min":0.443,"5min":0.53200000000000003,"15min":0.54700000000000004},"last":0.34599999999999997}]},{"osd":1,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33400000000000002,"15min":0.33200000000000002},"min":{"1min":0.221,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.48499999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.34999999999999998,"15min":0.34699999999999998},"min":{"1min":0.27100000000000002,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.57699999999999996,"5min":0.65100000000000002,"15min":0.746},"last":0.33300000000000002}]},{"osd":3,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36099999999999999,"15min":0.36899999999999999},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.496,"5min":0.57399999999999995,"15min":1.03},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.375,"15min":0.38400000000000001},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.23499999999999999},"max":{"1min":0.47599999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.40799999999999997}]},{"osd":4,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.39800000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.85399999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.503,"15min":0.49099999999999999},"min":{"1min":0.38300000000000001,"5min":0.32900000000000001,"15min":0.28499999999999998},"max":{"1min":0.71299999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.48599999999999999}]},{"osd":5,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.317},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.82099999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.51500000000000001,"15min":0.498},"min":{"1min":0.36899999999999999,"5min":0.33700000000000002,"15min":0.316},"max":{"1min":0.749,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45600000000000002}]},{"osd":6,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.36199999999999999,"15min":0.34499999999999997},"max":{"1min":0.748,"5min":0.748,"15min":0.79800000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.496,"15min":0.504},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60999999999999999,"5min":0.75800000000000001,"15min":0.78200000000000003},"last":0.501}]},{"osd":7,"last update":"Wed Dec 13 00:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.34499999999999997},"max":{"1min":0.61599999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.36399999999999999},"max":{"1min":0.72499999999999998,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.51500000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542503,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67936,"kb_used_data":6232,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94303904,"statfs":{"total":96636764160,"available":96567197696,"internally_reserved":0,"allocated":6381568,"data_stored":6195602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 00:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20499999999999999},"max":{"1min":0.499,"5min":0.57299999999999995,"15min":0.66900000000000004},"last":0.44},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.32900000000000001,"15min":0.316},"min":{"1min":0.23799999999999999,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":0.52700000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.497}]},{"osd":2,"last update":"Wed Dec 13 00:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32900000000000001,"15min":0.32600000000000001},"min":{"1min":0.253,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.47599999999999998,"5min":0.57999999999999996,"15min":0.64600000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.36299999999999999,"15min":0.35699999999999998},"min":{"1min":0.26400000000000001,"5min":0.24299999999999999,"15min":0.23100000000000001},"max":{"1min":0.51200000000000001,"5min":0.61299999999999999,"15min":0.72299999999999998},"last":0.53100000000000003}]},{"osd":3,"last update":"Wed Dec 13 00:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36099999999999999,"15min":0.35499999999999998},"min":{"1min":0.27000000000000002,"5min":0.24099999999999999,"15min":0.22900000000000001},"max":{"1min":0.45500000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.378,"15min":0.36899999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23300000000000001},"max":{"1min":0.48299999999999998,"5min":0.57199999999999995,"15min":0.65400000000000003},"last":0.32500000000000001}]},{"osd":4,"last update":"Wed Dec 13 00:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.5,"15min":0.47499999999999998},"min":{"1min":0.37,"5min":0.30499999999999999,"15min":0.25800000000000001},"max":{"1min":0.58799999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51600000000000001,"15min":0.48199999999999998},"min":{"1min":0.372,"5min":0.35899999999999999,"15min":0.27200000000000002},"max":{"1min":0.68999999999999995,"5min":0.877,"15min":0.877},"last":0.55600000000000005}]},{"osd":5,"last update":"Wed Dec 13 00:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52200000000000002,"15min":0.48699999999999999},"min":{"1min":0.379,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.78700000000000003,"5min":1.133,"15min":1.133},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.51500000000000001,"15min":0.504},"min":{"1min":0.38,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.755,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48199999999999998}]},{"osd":6,"last update":"Wed Dec 13 00:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.53300000000000003,"15min":0.52100000000000002},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33600000000000002},"max":{"1min":0.72799999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.52100000000000002},"min":{"1min":0.38900000000000001,"5min":0.377,"15min":0.35899999999999999},"max":{"1min":0.76600000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.76400000000000001}]},{"osd":7,"last update":"Wed Dec 13 00:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56899999999999995,"15min":0.54500000000000004},"min":{"1min":0.44,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.80600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575207,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88748,"kb_used_data":17316,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94283092,"statfs":{"total":96636764160,"available":96545886208,"internally_reserved":0,"allocated":17731584,"data_stored":17541418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 00:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.41299999999999998,"15min":0.40999999999999998},"min":{"1min":0.32600000000000001,"5min":0.255,"15min":0.20200000000000001},"max":{"1min":0.56899999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.41899999999999998,"15min":0.40699999999999997},"min":{"1min":0.35699999999999998,"5min":0.28000000000000003,"15min":0.23999999999999999},"max":{"1min":0.56699999999999995,"5min":0.58999999999999997,"15min":0.67300000000000004},"last":0.68600000000000005}]},{"osd":1,"last update":"Wed Dec 13 00:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.442,"15min":0.432},"min":{"1min":0.34100000000000003,"5min":0.27600000000000002,"15min":0.249},"max":{"1min":0.628,"5min":0.628,"15min":0.63400000000000001},"last":0.624},{"interface":"front","average":{"1min":0.436,"5min":0.41499999999999998,"15min":0.41299999999999998},"min":{"1min":0.316,"5min":0.28999999999999998,"15min":0.247},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.65400000000000003},"last":0.65700000000000003}]},{"osd":2,"last update":"Wed Dec 13 00:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.438,"15min":0.42399999999999999},"min":{"1min":0.33500000000000002,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.52800000000000002,"5min":0.628,"15min":0.68700000000000006},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41199999999999998},"min":{"1min":0.32500000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.56000000000000005,"5min":0.59299999999999997,"15min":0.64900000000000002},"last":0.67200000000000004}]},{"osd":3,"last update":"Wed Dec 13 00:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44400000000000001,"15min":0.437},"min":{"1min":0.32700000000000001,"5min":0.312,"15min":0.27300000000000002},"max":{"1min":0.57699999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45300000000000001,"15min":0.44600000000000001},"min":{"1min":0.309,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.62,"5min":0.63700000000000001,"15min":0.67300000000000004},"last":0.71999999999999997}]},{"osd":4,"last update":"Wed Dec 13 00:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.377,"15min":0.37},"min":{"1min":0.251,"5min":0.23300000000000001,"15min":0.215},"max":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.437},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40500000000000003,"15min":0.38800000000000001},"min":{"1min":0.27400000000000002,"5min":0.23599999999999999,"15min":0.22900000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.65000000000000002},"last":0.52400000000000002}]},{"osd":6,"last update":"Wed Dec 13 00:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.375,"15min":0.36599999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.22500000000000001},"max":{"1min":0.505,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.437,"5min":0.42699999999999999,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.26100000000000001,"15min":0.24399999999999999},"max":{"1min":0.58799999999999997,"5min":0.66400000000000003,"15min":0.70699999999999996},"last":0.54600000000000004}]},{"osd":7,"last update":"Wed Dec 13 00:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.433,"15min":0.41999999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.22900000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.63200000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.45000000000000001,"15min":0.434},"min":{"1min":0.29799999999999999,"5min":0.27000000000000002,"15min":0.26700000000000002},"max":{"1min":0.60799999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.48199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6098944,"data_stored":6080128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21516288,"data_stored":21502359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9707520,"data_stored":9668733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16855040,"data_stored":16835576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16879616,"data_stored":16869931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8491008,"data_stored":8462749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T00:29:43.368 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-13T00:29:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.498+0000 7f2e27652640 1 Processor -- start 2023-12-13T00:29:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.499+0000 7f2e27652640 1 -- start start 2023-12-13T00:29:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.499+0000 7f2e27652640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e200c6000 0x7f2e2016a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.499+0000 7f2e27652640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e20070bc0 con 0x7f2e200c1680 2023-12-13T00:29:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.499+0000 7f2e27652640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2016a6e0 con 0x7f2e200c5aa0 2023-12-13T00:29:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.499+0000 7f2e27652640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e200715b0 con 0x7f2e200c6000 2023-12-13T00:29:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.500+0000 7f2e24bed640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f2e200c5aa0 0x7f2e200c7450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:48274/0 (socket says 172.21.15.72:48274) 2023-12-13T00:29:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.500+0000 7f2e24bed640 1 -- 172.21.15.72:0/3991671872 learned_addr learned my addr 172.21.15.72:0/3991671872 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:29:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.500+0000 7f2e25bef640 1 --2- 172.21.15.72:0/3991671872 >> v2:172.21.15.72:3300/0 conn(0x7f2e200c6000 0x7f2e2016a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.503+0000 7f2e1ffff640 1 -- 172.21.15.72:0/3991671872 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1467514636 0 0) 0x7f2e20070bc0 con 0x7f2e200c1680 2023-12-13T00:29:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.509+0000 7f2e1ffff640 1 -- 172.21.15.72:0/3991671872 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e08003500 con 0x7f2e200c1680 2023-12-13T00:29:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.509+0000 7f2e1ffff640 1 -- 172.21.15.72:0/3991671872 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056335556 0 0) 0x7f2e14001110 con 0x7f2e200c5aa0 2023-12-13T00:29:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.509+0000 7f2e1ffff640 1 -- 172.21.15.72:0/3991671872 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e20070bc0 con 0x7f2e200c5aa0 2023-12-13T00:29:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.512+0000 7f2e1ffff640 1 -- 172.21.15.72:0/3991671872 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3460794104 0 0) 0x7f2e08003500 con 0x7f2e200c1680 2023-12-13T00:29:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.512+0000 7f2e1ffff640 1 -- 172.21.15.72:0/3991671872 >> v2:172.21.15.72:3300/0 conn(0x7f2e200c6000 msgr2=0x7f2e2016a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:29:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.512+0000 7f2e1ffff640 1 --2- 172.21.15.72:0/3991671872 >> v2:172.21.15.72:3300/0 conn(0x7f2e200c6000 0x7f2e2016a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.512+0000 7f2e1ffff640 1 -- 172.21.15.72:0/3991671872 >> v1:172.21.15.176:6789/0 conn(0x7f2e200c5aa0 legacy=0x7f2e200c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.512+0000 7f2e1ffff640 1 -- 172.21.15.72:0/3991671872 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e201664a0 con 0x7f2e200c1680 2023-12-13T00:29:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.512+0000 7f2e1ffff640 1 -- 172.21.15.72:0/3991671872 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1233568696 0 0) 0x7f2e18001670 con 0x7f2e200c1680 2023-12-13T00:29:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.512+0000 7f2e1ffff640 1 -- 172.21.15.72:0/3991671872 >> v1:172.21.15.72:6789/0 conn(0x7f2e200c1680 legacy=0x7f2e20166930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.512+0000 7f2e1ffff640 1 --2- 172.21.15.72:0/3991671872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e08003cd0 0x7f2e080040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.512+0000 7f2e1ffff640 1 --2- 172.21.15.72:0/3991671872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e08004610 0x7f2e0800d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.513+0000 7f2e1ffff640 1 --2- 172.21.15.72:0/3991671872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0800d950 0x7f2e0800fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.513+0000 7f2e1ffff640 1 -- 172.21.15.72:0/3991671872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e08010410 con 0x7f2e08004610 2023-12-13T00:29:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.513+0000 7f2e1ffff640 1 -- 172.21.15.72:0/3991671872 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e08010580 con 0x7f2e08003cd0 2023-12-13T00:29:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.513+0000 7f2e1ffff640 1 -- 172.21.15.72:0/3991671872 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e08010740 con 0x7f2e0800d950 2023-12-13T00:29:43.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.513+0000 7f2e25bef640 1 --2- 172.21.15.72:0/3991671872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0800d950 0x7f2e0800fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:43.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.515+0000 7f2e253ee640 1 --2- 172.21.15.72:0/3991671872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e08003cd0 0x7f2e080040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:43.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.516+0000 7f2e25bef640 1 -- 172.21.15.72:0/3991671872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e08003cd0 msgr2=0x7f2e080040d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:29:43.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.516+0000 7f2e25bef640 1 --2- 172.21.15.72:0/3991671872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e08003cd0 0x7f2e080040d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:43.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.516+0000 7f2e25bef640 1 -- 172.21.15.72:0/3991671872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e08004610 msgr2=0x7f2e0800d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:29:43.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.516+0000 7f2e25bef640 1 --2- 172.21.15.72:0/3991671872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e08004610 0x7f2e0800d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:43.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.516+0000 7f2e25bef640 1 -- 172.21.15.72:0/3991671872 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e08003500 con 0x7f2e0800d950 2023-12-13T00:29:43.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.517+0000 7f2e25bef640 1 -- 172.21.15.72:0/3991671872 reap_dead start 2023-12-13T00:29:43.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.519+0000 7f2e25bef640 1 --2- 172.21.15.72:0/3991671872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0800d950 0x7f2e0800fd40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009fc0 tx=0x7f2e08004d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e6a7dac491a0767 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:43.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.523+0000 7f2e1ffff640 1 -- 172.21.15.72:0/3991671872 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1002cc60 con 0x7f2e0800d950 2023-12-13T00:29:43.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.523+0000 7f2e1ffff640 1 -- 172.21.15.72:0/3991671872 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1000f040 con 0x7f2e0800d950 2023-12-13T00:29:43.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.523+0000 7f2e1ffff640 1 -- 172.21.15.72:0/3991671872 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100090d0 con 0x7f2e0800d950 2023-12-13T00:29:43.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.524+0000 7f2e27652640 1 -- 172.21.15.72:0/3991671872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0800d950 msgr2=0x7f2e0800fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:43.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.524+0000 7f2e27652640 1 --2- 172.21.15.72:0/3991671872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0800d950 0x7f2e0800fd40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009fc0 tx=0x7f2e08004d50 comp rx=0 tx=0).stop 2023-12-13T00:29:43.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.524+0000 7f2e27652640 1 -- 172.21.15.72:0/3991671872 shutdown_connections 2023-12-13T00:29:43.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.524+0000 7f2e27652640 1 --2- 172.21.15.72:0/3991671872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e0800d950 0x7f2e0800fd40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:43.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.524+0000 7f2e27652640 1 -- 172.21.15.72:0/3991671872 >> 172.21.15.72:0/3991671872 conn(0x7f2e2006c5f0 msgr2=0x7f2e2006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:43.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.524+0000 7f2e27652640 1 -- 172.21.15.72:0/3991671872 shutdown_connections 2023-12-13T00:29:43.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.524+0000 7f2e27652640 1 -- 172.21.15.72:0/3991671872 wait complete. 2023-12-13T00:29:43.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.525+0000 7f2e27652640 1 Processor -- start 2023-12-13T00:29:43.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.526+0000 7f2e27652640 1 -- start start 2023-12-13T00:29:43.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.526+0000 7f2e27652640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e0800d950 0x7f2e2015edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:43.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.526+0000 7f2e27652640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e2008a600 0x7f2e20167380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:43.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.526+0000 7f2e27652640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e201678c0 0x7f2e2015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:43.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.526+0000 7f2e27652640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e201fcb00 con 0x7f2e201678c0 2023-12-13T00:29:43.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.526+0000 7f2e27652640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2015aeb0 con 0x7f2e0800d950 2023-12-13T00:29:43.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.526+0000 7f2e27652640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e201fc560 con 0x7f2e2008a600 2023-12-13T00:29:43.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.527+0000 7f2e253ee640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e0800d950 0x7f2e2015edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:43.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.527+0000 7f2e24bed640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e2008a600 0x7f2e20167380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:43.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.527+0000 7f2e253ee640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e0800d950 0x7f2e2015edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:51950/0 (socket says 172.21.15.72:51950) 2023-12-13T00:29:43.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.527+0000 7f2e253ee640 1 -- 172.21.15.72:0/1396238417 learned_addr learned my addr 172.21.15.72:0/1396238417 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:29:43.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.531+0000 7f2e253ee640 1 -- 172.21.15.72:0/1396238417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e2008a600 msgr2=0x7f2e20167380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:43.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.531+0000 7f2e253ee640 1 --2- 172.21.15.72:0/1396238417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e2008a600 0x7f2e20167380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:43.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.531+0000 7f2e253ee640 1 -- 172.21.15.72:0/1396238417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e201678c0 msgr2=0x7f2e2015b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:43.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.531+0000 7f2e253ee640 1 --2- 172.21.15.72:0/1396238417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e201678c0 0x7f2e2015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:43.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.531+0000 7f2e253ee640 1 -- 172.21.15.72:0/1396238417 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e20165d30 con 0x7f2e0800d950 2023-12-13T00:29:43.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.534+0000 7f2e253ee640 1 --2- 172.21.15.72:0/1396238417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e0800d950 0x7f2e2015edd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800f7a0 tx=0x7f2e1800fc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:43.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.538+0000 7f2e1dffb640 1 -- 172.21.15.72:0/1396238417 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e180052e0 con 0x7f2e0800d950 2023-12-13T00:29:43.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.538+0000 7f2e1dffb640 1 -- 172.21.15.72:0/1396238417 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e18005440 con 0x7f2e0800d950 2023-12-13T00:29:43.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.538+0000 7f2e1dffb640 1 -- 172.21.15.72:0/1396238417 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18003810 con 0x7f2e0800d950 2023-12-13T00:29:43.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.538+0000 7f2e27652640 1 -- 172.21.15.72:0/1396238417 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e20166010 con 0x7f2e0800d950 2023-12-13T00:29:43.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.538+0000 7f2e27652640 1 -- 172.21.15.72:0/1396238417 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2015a990 con 0x7f2e0800d950 2023-12-13T00:29:43.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.539+0000 7f2e27652640 1 -- 172.21.15.72:0/1396238417 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2015a7f0 con 0x7f2e0800d950 2023-12-13T00:29:43.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.558+0000 7f2e1dffb640 1 -- 172.21.15.72:0/1396238417 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2e18003970 con 0x7f2e0800d950 2023-12-13T00:29:43.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.559+0000 7f2e1dffb640 1 --2- 172.21.15.72:0/1396238417 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f2e0c06b210 0x7f2e0c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:43.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.559+0000 7f2e24bed640 1 --2- 172.21.15.72:0/1396238417 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f2e0c06b210 0x7f2e0c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:43.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.559+0000 7f2e24bed640 1 --2- 172.21.15.72:0/1396238417 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f2e0c06b210 0x7f2e0c06d6d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2e2006f430 tx=0x7f2e14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:43.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.561+0000 7f2e1dffb640 1 -- 172.21.15.72:0/1396238417 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f2e180593f0 con 0x7f2e0800d950 2023-12-13T00:29:43.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.797+0000 7f2e1dffb640 1 -- 172.21.15.72:0/1396238417 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2e18055030 con 0x7f2e0800d950 2023-12-13T00:29:43.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:43.971+0000 7f2e27652640 1 -- 172.21.15.72:0/1396238417 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f2e2015a7f0 con 0x7f2e0800d950 2023-12-13T00:29:44.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.185+0000 7f2e1dffb640 1 -- 172.21.15.72:0/1396238417 <== mon.1 v2:172.21.15.176:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2e18055030 con 0x7f2e0800d950 2023-12-13T00:29:44.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.185+0000 7f2e1dffb640 1 -- 172.21.15.72:0/1396238417 <== mon.1 v2:172.21.15.176:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2e2015a7f0 con 0x7f2e0800d950 2023-12-13T00:29:44.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.188+0000 7f2e27652640 1 -- 172.21.15.72:0/1396238417 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f2e0c06b210 msgr2=0x7f2e0c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:44.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.188+0000 7f2e27652640 1 --2- 172.21.15.72:0/1396238417 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f2e0c06b210 0x7f2e0c06d6d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2e2006f430 tx=0x7f2e14009040 comp rx=0 tx=0).stop 2023-12-13T00:29:44.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.188+0000 7f2e27652640 1 -- 172.21.15.72:0/1396238417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e0800d950 msgr2=0x7f2e2015edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:44.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.188+0000 7f2e27652640 1 --2- 172.21.15.72:0/1396238417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e0800d950 0x7f2e2015edd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800f7a0 tx=0x7f2e1800fc60 comp rx=0 tx=0).stop 2023-12-13T00:29:44.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.188+0000 7f2e27652640 1 -- 172.21.15.72:0/1396238417 shutdown_connections 2023-12-13T00:29:44.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.188+0000 7f2e27652640 1 --2- 172.21.15.72:0/1396238417 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f2e0c06b210 0x7f2e0c06d6d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.188+0000 7f2e27652640 1 --2- 172.21.15.72:0/1396238417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e201678c0 0x7f2e2015b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.188+0000 7f2e27652640 1 --2- 172.21.15.72:0/1396238417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e2008a600 0x7f2e20167380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.188+0000 7f2e27652640 1 --2- 172.21.15.72:0/1396238417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e0800d950 0x7f2e2015edd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.188+0000 7f2e27652640 1 -- 172.21.15.72:0/1396238417 >> 172.21.15.72:0/1396238417 conn(0x7f2e2006c5f0 msgr2=0x7f2e200c89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:44.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.188+0000 7f2e27652640 1 -- 172.21.15.72:0/1396238417 shutdown_connections 2023-12-13T00:29:44.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.188+0000 7f2e27652640 1 -- 172.21.15.72:0/1396238417 wait complete. 2023-12-13T00:29:44.200 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-13T00:29:44.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T00:29:44.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.298+0000 7f64e9d53640 1 Processor -- start 2023-12-13T00:29:44.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.298+0000 7f64e9d53640 1 -- start start 2023-12-13T00:29:44.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.300+0000 7f64e9d53640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e40c7650 0x7f64e415a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:44.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.300+0000 7f64e9d53640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64e40c7a30 0x7f64e41560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:44.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.300+0000 7f64e9d53640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e4159dd0 con 0x7f64e40c6c40 2023-12-13T00:29:44.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.300+0000 7f64e9d53640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e40c5ad0 con 0x7f64e40c7a30 2023-12-13T00:29:44.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.300+0000 7f64e9d53640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40c5cc0 con 0x7f64e40c7650 2023-12-13T00:29:44.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.300+0000 7f64e37fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e40c7650 0x7f64e415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:44.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.300+0000 7f64e2ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64e40c7a30 0x7f64e41560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:44.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.300+0000 7f64e3fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f64e40c6c40 0x7f64e40c53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34940/0 (socket says 172.21.15.72:34940) 2023-12-13T00:29:44.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.300+0000 7f64e3fff640 1 -- 172.21.15.72:0/1006577518 learned_addr learned my addr 172.21.15.72:0/1006577518 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:29:44.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.303+0000 7f64e37fe640 1 -- 172.21.15.72:0/1006577518 >> v2:172.21.15.72:3300/0 conn(0x7f64e40c7a30 msgr2=0x7f64e41560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:29:44.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.303+0000 7f64e37fe640 1 --2- 172.21.15.72:0/1006577518 >> v2:172.21.15.72:3300/0 conn(0x7f64e40c7a30 0x7f64e41560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.303+0000 7f64e37fe640 1 -- 172.21.15.72:0/1006577518 >> v1:172.21.15.72:6789/0 conn(0x7f64e40c6c40 legacy=0x7f64e40c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:44.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.303+0000 7f64e37fe640 1 -- 172.21.15.72:0/1006577518 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e40c6260 con 0x7f64e40c7650 2023-12-13T00:29:44.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.304+0000 7f64e37fe640 1 --2- 172.21.15.72:0/1006577518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e40c7650 0x7f64e415a260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f64d40097d0 tx=0x7f64d402b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cef7ecceb1db83fa server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:44.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.308+0000 7f64e27fc640 1 -- 172.21.15.72:0/1006577518 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4031770 con 0x7f64e40c7650 2023-12-13T00:29:44.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.308+0000 7f64e27fc640 1 -- 172.21.15.72:0/1006577518 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f64d40318d0 con 0x7f64e40c7650 2023-12-13T00:29:44.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.308+0000 7f64e27fc640 1 -- 172.21.15.72:0/1006577518 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4031c80 con 0x7f64e40c7650 2023-12-13T00:29:44.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.308+0000 7f64e9d53640 1 -- 172.21.15.72:0/1006577518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e40c7650 msgr2=0x7f64e415a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:44.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.308+0000 7f64e9d53640 1 --2- 172.21.15.72:0/1006577518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e40c7650 0x7f64e415a260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f64d40097d0 tx=0x7f64d402b810 comp rx=0 tx=0).stop 2023-12-13T00:29:44.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.308+0000 7f64e9d53640 1 -- 172.21.15.72:0/1006577518 shutdown_connections 2023-12-13T00:29:44.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.308+0000 7f64e9d53640 1 --2- 172.21.15.72:0/1006577518 >> v2:172.21.15.72:3300/0 conn(0x7f64e40c7a30 0x7f64e41560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.308+0000 7f64e9d53640 1 --2- 172.21.15.72:0/1006577518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e40c7650 0x7f64e415a260 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.308+0000 7f64e9d53640 1 -- 172.21.15.72:0/1006577518 >> 172.21.15.72:0/1006577518 conn(0x7f64e406c5f0 msgr2=0x7f64e406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:44.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.308+0000 7f64e9d53640 1 -- 172.21.15.72:0/1006577518 shutdown_connections 2023-12-13T00:29:44.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.308+0000 7f64e9d53640 1 -- 172.21.15.72:0/1006577518 wait complete. 2023-12-13T00:29:44.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.309+0000 7f64e9d53640 1 Processor -- start 2023-12-13T00:29:44.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.310+0000 7f64e9d53640 1 -- start start 2023-12-13T00:29:44.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.310+0000 7f64e9d53640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e40c6c40 0x7f64e40c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:44.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.310+0000 7f64e9d53640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e40c7650 0x7f64e40c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:44.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.310+0000 7f64e9d53640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e40c7a30 0x7f64e4071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:44.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.310+0000 7f64e9d53640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e4156b60 con 0x7f64e40c6c40 2023-12-13T00:29:44.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.310+0000 7f64e9d53640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40c96e0 con 0x7f64e40c7650 2023-12-13T00:29:44.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.310+0000 7f64e9d53640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40c9fa0 con 0x7f64e40c7a30 2023-12-13T00:29:44.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.311+0000 7f64e37fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e40c6c40 0x7f64e40c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:44.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.311+0000 7f64e37fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e40c6c40 0x7f64e40c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58552/0 (socket says 172.21.15.72:58552) 2023-12-13T00:29:44.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.311+0000 7f64e37fe640 1 -- 172.21.15.72:0/2773381114 learned_addr learned my addr 172.21.15.72:0/2773381114 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:29:44.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.311+0000 7f64e2ffd640 1 --2- 172.21.15.72:0/2773381114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e40c7650 0x7f64e40c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:44.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.311+0000 7f64e3fff640 1 --2- 172.21.15.72:0/2773381114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e40c7a30 0x7f64e4071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:44.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.314+0000 7f64e37fe640 1 -- 172.21.15.72:0/2773381114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e40c7a30 msgr2=0x7f64e4071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:44.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.314+0000 7f64e37fe640 1 --2- 172.21.15.72:0/2773381114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e40c7a30 0x7f64e4071cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.314+0000 7f64e37fe640 1 -- 172.21.15.72:0/2773381114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e40c7650 msgr2=0x7f64e40c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:44.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.314+0000 7f64e37fe640 1 --2- 172.21.15.72:0/2773381114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e40c7650 0x7f64e40c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.314+0000 7f64e37fe640 1 -- 172.21.15.72:0/2773381114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d4009400 con 0x7f64e40c6c40 2023-12-13T00:29:44.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.317+0000 7f64e37fe640 1 --2- 172.21.15.72:0/2773381114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e40c6c40 0x7f64e40c98f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f64d4000c00 tx=0x7f64d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:44.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.320+0000 7f64cbfff640 1 -- 172.21.15.72:0/2773381114 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4032810 con 0x7f64e40c6c40 2023-12-13T00:29:44.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.320+0000 7f64cbfff640 1 -- 172.21.15.72:0/2773381114 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f64d4032990 con 0x7f64e40c6c40 2023-12-13T00:29:44.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.320+0000 7f64cbfff640 1 -- 172.21.15.72:0/2773381114 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4032d60 con 0x7f64e40c6c40 2023-12-13T00:29:44.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.321+0000 7f64e9d53640 1 -- 172.21.15.72:0/2773381114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e40ca280 con 0x7f64e40c6c40 2023-12-13T00:29:44.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.321+0000 7f64e9d53640 1 -- 172.21.15.72:0/2773381114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e41f0760 con 0x7f64e40c6c40 2023-12-13T00:29:44.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.321+0000 7f64e9d53640 1 -- 172.21.15.72:0/2773381114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e4067470 con 0x7f64e40c6c40 2023-12-13T00:29:44.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.561+0000 7f64cbfff640 1 -- 172.21.15.72:0/2773381114 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f64d404e440 con 0x7f64e40c6c40 2023-12-13T00:29:44.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.562+0000 7f64cbfff640 1 --2- 172.21.15.72:0/2773381114 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f64d006b1c0 0x7f64d006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:44.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.562+0000 7f64e2ffd640 1 --2- 172.21.15.72:0/2773381114 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f64d006b1c0 0x7f64d006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:44.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.562+0000 7f64e2ffd640 1 --2- 172.21.15.72:0/2773381114 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f64d006b1c0 0x7f64d006d680 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f64e41469b0 tx=0x7f64d8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:44.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.575+0000 7f64cbfff640 1 -- 172.21.15.72:0/2773381114 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f64d403ce20 con 0x7f64e40c6c40 2023-12-13T00:29:44.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.575+0000 7f64cbfff640 1 -- 172.21.15.72:0/2773381114 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f64d4076ef0 con 0x7f64e40c6c40 2023-12-13T00:29:44.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.788+0000 7f64e9d53640 1 -- 172.21.15.72:0/2773381114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64e41462b0 con 0x7f64e40c6c40 2023-12-13T00:29:44.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.801+0000 7f64cbfff640 1 -- 172.21.15.72:0/2773381114 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+6536 (secure 0 0 0) 0x7f64d4078e20 con 0x7f64e40c6c40 2023-12-13T00:29:44.801 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:29:44.801 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/541435124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":541435124},{"type":"v1","addr":"172.21.15.72:6837","nonce":541435124}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4190692049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4190692049},{"type":"v1","addr":"172.21.15.176:6835","nonce":4190692049}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1780646034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1780646034},{"type":"v1","addr":"172.21.15.176:6833","nonce":1780646034}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-13T00:00:30.722325+0000","modified":"2023-12-13T00:29:23.272281+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4266,"mds_1":4264,"mds_2":4259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":13,"addr":"172.21.15.72:6839/3632161953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":3632161953},{"type":"v1","addr":"172.21.15.72:6839","nonce":3632161953}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4264":{"gid":4264,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6835/3954648997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3954648997},{"type":"v1","addr":"172.21.15.72:6835","nonce":3954648997}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4266":{"gid":4266,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6837/3968747607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":3968747607},{"type":"v1","addr":"172.21.15.176:6837","nonce":3968747607}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-13T00:29:44.802 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 42 2023-12-13T00:29:44.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.803+0000 7f64e9d53640 1 -- 172.21.15.72:0/2773381114 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f64d006b1c0 msgr2=0x7f64d006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:44.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.803+0000 7f64e9d53640 1 --2- 172.21.15.72:0/2773381114 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f64d006b1c0 0x7f64d006d680 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f64e41469b0 tx=0x7f64d8009190 comp rx=0 tx=0).stop 2023-12-13T00:29:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.803+0000 7f64e9d53640 1 -- 172.21.15.72:0/2773381114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e40c6c40 msgr2=0x7f64e40c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.803+0000 7f64e9d53640 1 --2- 172.21.15.72:0/2773381114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e40c6c40 0x7f64e40c98f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f64d4000c00 tx=0x7f64d40046c0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.803+0000 7f64e9d53640 1 -- 172.21.15.72:0/2773381114 shutdown_connections 2023-12-13T00:29:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.803+0000 7f64e9d53640 1 --2- 172.21.15.72:0/2773381114 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f64d006b1c0 0x7f64d006d680 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.803+0000 7f64e9d53640 1 --2- 172.21.15.72:0/2773381114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e40c7a30 0x7f64e4071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.803+0000 7f64e9d53640 1 --2- 172.21.15.72:0/2773381114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e40c7650 0x7f64e40c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.803+0000 7f64e9d53640 1 --2- 172.21.15.72:0/2773381114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e40c6c40 0x7f64e40c98f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.803+0000 7f64e9d53640 1 -- 172.21.15.72:0/2773381114 >> 172.21.15.72:0/2773381114 conn(0x7f64e406c5f0 msgr2=0x7f64e414d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.803+0000 7f64e9d53640 1 -- 172.21.15.72:0/2773381114 shutdown_connections 2023-12-13T00:29:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.803+0000 7f64e9d53640 1 -- 172.21.15.72:0/2773381114 wait complete. 2023-12-13T00:29:44.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T00:29:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.925+0000 7fbf1a65c640 1 Processor -- start 2023-12-13T00:29:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.925+0000 7fbf1a65c640 1 -- start start 2023-12-13T00:29:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.926+0000 7fbf1a65c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbf14151220 0x7fbf1406ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.926+0000 7fbf1a65c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf14157240 0x7fbf140c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.926+0000 7fbf1a65c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf141577f0 con 0x7fbf140c4610 2023-12-13T00:29:44.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.926+0000 7fbf1a65c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf14157a90 con 0x7fbf14151220 2023-12-13T00:29:44.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.926+0000 7fbf1a65c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf14157d30 con 0x7fbf14157240 2023-12-13T00:29:44.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.926+0000 7fbf137fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf14157240 0x7fbf140c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:44.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.927+0000 7fbf13fff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbf14151220 0x7fbf1406ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:44.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.927+0000 7fbf137fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf14157240 0x7fbf140c40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:41584/0 (socket says 172.21.15.72:41584) 2023-12-13T00:29:44.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.927+0000 7fbf137fe640 1 -- 172.21.15.72:0/800734612 learned_addr learned my addr 172.21.15.72:0/800734612 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:29:44.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.929+0000 7fbf137fe640 1 -- 172.21.15.72:0/800734612 >> v2:172.21.15.176:3300/0 conn(0x7fbf14151220 msgr2=0x7fbf1406ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:29:44.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.929+0000 7fbf137fe640 1 --2- 172.21.15.72:0/800734612 >> v2:172.21.15.176:3300/0 conn(0x7fbf14151220 0x7fbf1406ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.929+0000 7fbf137fe640 1 -- 172.21.15.72:0/800734612 >> v1:172.21.15.176:6789/0 conn(0x7fbf140c4610 legacy=0x7fbf140710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:44.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.929+0000 7fbf137fe640 1 -- 172.21.15.72:0/800734612 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf14157ff0 con 0x7fbf14157240 2023-12-13T00:29:44.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.931+0000 7fbf137fe640 1 --2- 172.21.15.72:0/800734612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf14157240 0x7fbf140c40d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbf08009870 tx=0x7fbf0802ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45936a038bddbd7a server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:44.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.935+0000 7fbf12ffd640 1 -- 172.21.15.72:0/800734612 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0802f840 con 0x7fbf14157240 2023-12-13T00:29:44.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.935+0000 7fbf12ffd640 1 -- 172.21.15.72:0/800734612 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbf0802f9a0 con 0x7fbf14157240 2023-12-13T00:29:44.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.935+0000 7fbf12ffd640 1 -- 172.21.15.72:0/800734612 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0802fd50 con 0x7fbf14157240 2023-12-13T00:29:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.936+0000 7fbf1a65c640 1 -- 172.21.15.72:0/800734612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf14157240 msgr2=0x7fbf140c40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.936+0000 7fbf1a65c640 1 --2- 172.21.15.72:0/800734612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf14157240 0x7fbf140c40d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbf08009870 tx=0x7fbf0802ba20 comp rx=0 tx=0).stop 2023-12-13T00:29:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.936+0000 7fbf1a65c640 1 -- 172.21.15.72:0/800734612 shutdown_connections 2023-12-13T00:29:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.936+0000 7fbf1a65c640 1 --2- 172.21.15.72:0/800734612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf14157240 0x7fbf140c40d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.936+0000 7fbf1a65c640 1 --2- 172.21.15.72:0/800734612 >> v2:172.21.15.176:3300/0 conn(0x7fbf14151220 0x7fbf1406ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.936+0000 7fbf1a65c640 1 -- 172.21.15.72:0/800734612 >> 172.21.15.72:0/800734612 conn(0x7fbf1406c5f0 msgr2=0x7fbf1406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.936+0000 7fbf1a65c640 1 -- 172.21.15.72:0/800734612 shutdown_connections 2023-12-13T00:29:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.936+0000 7fbf1a65c640 1 -- 172.21.15.72:0/800734612 wait complete. 2023-12-13T00:29:44.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.937+0000 7fbf1a65c640 1 Processor -- start 2023-12-13T00:29:44.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.937+0000 7fbf1a65c640 1 -- start start 2023-12-13T00:29:44.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.938+0000 7fbf1a65c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf140c4610 0x7fbf141ecc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.938+0000 7fbf1a65c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf14151220 0x7fbf1413dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.938+0000 7fbf1a65c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf14157240 0x7fbf14144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.938+0000 7fbf1a65c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf141f0a70 con 0x7fbf14157240 2023-12-13T00:29:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.938+0000 7fbf1a65c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf14152770 con 0x7fbf14151220 2023-12-13T00:29:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.938+0000 7fbf1a65c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf141f0180 con 0x7fbf140c4610 2023-12-13T00:29:44.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.938+0000 7fbf18bf9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf14157240 0x7fbf14144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:44.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.939+0000 7fbf13fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf140c4610 0x7fbf141ecc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:44.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.939+0000 7fbf137fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf14151220 0x7fbf1413dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:44.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.939+0000 7fbf13fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf140c4610 0x7fbf141ecc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:41590/0 (socket says 172.21.15.72:41590) 2023-12-13T00:29:44.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.939+0000 7fbf13fff640 1 -- 172.21.15.72:0/3882377347 learned_addr learned my addr 172.21.15.72:0/3882377347 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:29:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.943+0000 7fbf13fff640 1 -- 172.21.15.72:0/3882377347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf14151220 msgr2=0x7fbf1413dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.943+0000 7fbf13fff640 1 --2- 172.21.15.72:0/3882377347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf14151220 0x7fbf1413dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.943+0000 7fbf13fff640 1 -- 172.21.15.72:0/3882377347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf14157240 msgr2=0x7fbf14144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:44.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.943+0000 7fbf13fff640 1 --2- 172.21.15.72:0/3882377347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf14157240 0x7fbf14144e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:44.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.943+0000 7fbf13fff640 1 -- 172.21.15.72:0/3882377347 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf080094d0 con 0x7fbf140c4610 2023-12-13T00:29:44.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.945+0000 7fbf13fff640 1 --2- 172.21.15.72:0/3882377347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf140c4610 0x7fbf141ecc10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400e9b0 tx=0x7fbf0400ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.949+0000 7fbf10ff9640 1 -- 172.21.15.72:0/3882377347 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04009670 con 0x7fbf140c4610 2023-12-13T00:29:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.949+0000 7fbf10ff9640 1 -- 172.21.15.72:0/3882377347 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbf0400c9a0 con 0x7fbf140c4610 2023-12-13T00:29:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.949+0000 7fbf10ff9640 1 -- 172.21.15.72:0/3882377347 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0400cd70 con 0x7fbf140c4610 2023-12-13T00:29:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.949+0000 7fbf1a65c640 1 -- 172.21.15.72:0/3882377347 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf140c71c0 con 0x7fbf140c4610 2023-12-13T00:29:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.949+0000 7fbf1a65c640 1 -- 172.21.15.72:0/3882377347 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf141f0420 con 0x7fbf140c4610 2023-12-13T00:29:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.950+0000 7fbf1a65c640 1 -- 172.21.15.72:0/3882377347 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf14072020 con 0x7fbf140c4610 2023-12-13T00:29:44.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.969+0000 7fbf10ff9640 1 -- 172.21.15.72:0/3882377347 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbf04013470 con 0x7fbf140c4610 2023-12-13T00:29:44.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.969+0000 7fbf10ff9640 1 --2- 172.21.15.72:0/3882377347 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbf0006b240 0x7fbf0006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:44.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.969+0000 7fbf137fe640 1 --2- 172.21.15.72:0/3882377347 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbf0006b240 0x7fbf0006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:44.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.970+0000 7fbf137fe640 1 --2- 172.21.15.72:0/3882377347 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbf0006b240 0x7fbf0006d700 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbf08036000 tx=0x7fbf08008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:44.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:44.972+0000 7fbf10ff9640 1 -- 172.21.15.72:0/3882377347 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fbf04058e10 con 0x7fbf140c4610 2023-12-13T00:29:45.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.207+0000 7fbf10ff9640 1 -- 172.21.15.72:0/3882377347 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbf04055150 con 0x7fbf140c4610 2023-12-13T00:29:45.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.423+0000 7fbf1a65c640 1 -- 172.21.15.72:0/3882377347 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf140c1ba0 con 0x7fbf140c4610 2023-12-13T00:29:45.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.436+0000 7fbf10ff9640 1 -- 172.21.15.72:0/3882377347 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+6536 (secure 0 0 0) 0x7fbf04021020 con 0x7fbf140c4610 2023-12-13T00:29:45.436 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:29:45.436 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/541435124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":541435124},{"type":"v1","addr":"172.21.15.72:6837","nonce":541435124}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4190692049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4190692049},{"type":"v1","addr":"172.21.15.176:6835","nonce":4190692049}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1780646034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1780646034},{"type":"v1","addr":"172.21.15.176:6833","nonce":1780646034}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-13T00:00:30.722325+0000","modified":"2023-12-13T00:29:23.272281+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4266,"mds_1":4264,"mds_2":4259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":13,"addr":"172.21.15.72:6839/3632161953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":3632161953},{"type":"v1","addr":"172.21.15.72:6839","nonce":3632161953}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4264":{"gid":4264,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6835/3954648997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3954648997},{"type":"v1","addr":"172.21.15.72:6835","nonce":3954648997}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4266":{"gid":4266,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6837/3968747607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":3968747607},{"type":"v1","addr":"172.21.15.176:6837","nonce":3968747607}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-13T00:29:45.436 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 42 2023-12-13T00:29:45.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.438+0000 7fbf1a65c640 1 -- 172.21.15.72:0/3882377347 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbf0006b240 msgr2=0x7fbf0006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:45.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.438+0000 7fbf1a65c640 1 --2- 172.21.15.72:0/3882377347 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbf0006b240 0x7fbf0006d700 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbf08036000 tx=0x7fbf08008030 comp rx=0 tx=0).stop 2023-12-13T00:29:45.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.438+0000 7fbf1a65c640 1 -- 172.21.15.72:0/3882377347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf140c4610 msgr2=0x7fbf141ecc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:45.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.438+0000 7fbf1a65c640 1 --2- 172.21.15.72:0/3882377347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf140c4610 0x7fbf141ecc10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400e9b0 tx=0x7fbf0400ee70 comp rx=0 tx=0).stop 2023-12-13T00:29:45.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.438+0000 7fbf1a65c640 1 -- 172.21.15.72:0/3882377347 shutdown_connections 2023-12-13T00:29:45.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.438+0000 7fbf1a65c640 1 --2- 172.21.15.72:0/3882377347 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fbf0006b240 0x7fbf0006d700 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:45.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.438+0000 7fbf1a65c640 1 --2- 172.21.15.72:0/3882377347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf14157240 0x7fbf14144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:45.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.438+0000 7fbf1a65c640 1 --2- 172.21.15.72:0/3882377347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf14151220 0x7fbf1413dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:45.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.438+0000 7fbf1a65c640 1 --2- 172.21.15.72:0/3882377347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf140c4610 0x7fbf141ecc10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:45.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.438+0000 7fbf1a65c640 1 -- 172.21.15.72:0/3882377347 >> 172.21.15.72:0/3882377347 conn(0x7fbf1406c5f0 msgr2=0x7fbf141e3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:45.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.438+0000 7fbf1a65c640 1 -- 172.21.15.72:0/3882377347 shutdown_connections 2023-12-13T00:29:45.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.438+0000 7fbf1a65c640 1 -- 172.21.15.72:0/3882377347 wait complete. 2023-12-13T00:29:45.449 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T00:29:45.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.549+0000 7fae776bb640 1 Processor -- start 2023-12-13T00:29:45.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.549+0000 7fae776bb640 1 -- start start 2023-12-13T00:29:45.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.550+0000 7fae776bb640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fae700cc420 0x7fae70159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:45.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.550+0000 7fae776bb640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae700cbda0 con 0x7fae70159b50 2023-12-13T00:29:45.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.550+0000 7fae776bb640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae700cea60 con 0x7fae700cda70 2023-12-13T00:29:45.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.550+0000 7fae776bb640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae700cc230 con 0x7fae700cc420 2023-12-13T00:29:45.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.551+0000 7fae75c58640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fae70159b50 0x7fae700c9620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34956/0 (socket says 172.21.15.72:34956) 2023-12-13T00:29:45.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.551+0000 7fae75c58640 1 -- 172.21.15.72:0/388733026 learned_addr learned my addr 172.21.15.72:0/388733026 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:29:45.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.551+0000 7fae74c56640 1 --2- 172.21.15.72:0/388733026 >> v2:172.21.15.176:3300/0 conn(0x7fae700cc420 0x7fae70159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:45.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.553+0000 7fae67fff640 1 -- 172.21.15.72:0/388733026 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 326991335 0 0) 0x7fae700cbda0 con 0x7fae70159b50 2023-12-13T00:29:45.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.553+0000 7fae67fff640 1 -- 172.21.15.72:0/388733026 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae5c003520 con 0x7fae70159b50 2023-12-13T00:29:45.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.554+0000 7fae74c56640 1 -- 172.21.15.72:0/388733026 >> v1:172.21.15.176:6789/0 conn(0x7fae700cda70 legacy=0x7fae700ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:45.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.554+0000 7fae74c56640 1 -- 172.21.15.72:0/388733026 >> v1:172.21.15.72:6789/0 conn(0x7fae70159b50 legacy=0x7fae700c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:45.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.554+0000 7fae74c56640 1 -- 172.21.15.72:0/388733026 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae700cb4e0 con 0x7fae700cc420 2023-12-13T00:29:45.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.558+0000 7fae74c56640 1 --2- 172.21.15.72:0/388733026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae700cc420 0x7fae70159610 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fae600097a0 tx=0x7fae6002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52c8812d0810b985 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:45.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.562+0000 7fae67fff640 1 -- 172.21.15.72:0/388733026 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6002f810 con 0x7fae700cc420 2023-12-13T00:29:45.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.562+0000 7fae67fff640 1 -- 172.21.15.72:0/388733026 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fae6002f970 con 0x7fae700cc420 2023-12-13T00:29:45.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.562+0000 7fae67fff640 1 -- 172.21.15.72:0/388733026 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6002fd20 con 0x7fae700cc420 2023-12-13T00:29:45.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.563+0000 7fae776bb640 1 -- 172.21.15.72:0/388733026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae700cc420 msgr2=0x7fae70159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:45.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.563+0000 7fae776bb640 1 --2- 172.21.15.72:0/388733026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae700cc420 0x7fae70159610 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fae600097a0 tx=0x7fae6002b9f0 comp rx=0 tx=0).stop 2023-12-13T00:29:45.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.563+0000 7fae776bb640 1 -- 172.21.15.72:0/388733026 shutdown_connections 2023-12-13T00:29:45.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.563+0000 7fae776bb640 1 --2- 172.21.15.72:0/388733026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae700cc420 0x7fae70159610 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:45.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.563+0000 7fae776bb640 1 -- 172.21.15.72:0/388733026 >> 172.21.15.72:0/388733026 conn(0x7fae700b07b0 msgr2=0x7fae700b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:45.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.563+0000 7fae776bb640 1 -- 172.21.15.72:0/388733026 shutdown_connections 2023-12-13T00:29:45.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.563+0000 7fae776bb640 1 -- 172.21.15.72:0/388733026 wait complete. 2023-12-13T00:29:45.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.564+0000 7fae776bb640 1 Processor -- start 2023-12-13T00:29:45.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.564+0000 7fae776bb640 1 -- start start 2023-12-13T00:29:45.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.564+0000 7fae776bb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae700cc420 0x7fae701ef000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:45.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.564+0000 7fae776bb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae700cda70 0x7fae700b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:45.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.565+0000 7fae776bb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae70159b50 0x7fae701591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:45.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.565+0000 7fae776bb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae700b2560 con 0x7fae700cc420 2023-12-13T00:29:45.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.565+0000 7fae776bb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae700b2840 con 0x7fae700cda70 2023-12-13T00:29:45.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.565+0000 7fae776bb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae700b2b20 con 0x7fae70159b50 2023-12-13T00:29:45.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.565+0000 7fae75457640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae700cc420 0x7fae701ef000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:45.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.565+0000 7fae74c56640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae700cda70 0x7fae700b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:45.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.565+0000 7fae75c58640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae70159b50 0x7fae701591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:45.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.565+0000 7fae75457640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae700cc420 0x7fae701ef000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58566/0 (socket says 172.21.15.72:58566) 2023-12-13T00:29:45.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.565+0000 7fae75457640 1 -- 172.21.15.72:0/1675264277 learned_addr learned my addr 172.21.15.72:0/1675264277 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:29:45.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.569+0000 7fae74c56640 1 -- 172.21.15.72:0/1675264277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae70159b50 msgr2=0x7fae701591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:45.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.569+0000 7fae74c56640 1 --2- 172.21.15.72:0/1675264277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae70159b50 0x7fae701591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:45.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.569+0000 7fae74c56640 1 -- 172.21.15.72:0/1675264277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae700cc420 msgr2=0x7fae701ef000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:45.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.569+0000 7fae74c56640 1 --2- 172.21.15.72:0/1675264277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae700cc420 0x7fae701ef000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:45.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.569+0000 7fae74c56640 1 -- 172.21.15.72:0/1675264277 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae60009400 con 0x7fae700cda70 2023-12-13T00:29:45.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.569+0000 7fae75457640 1 --2- 172.21.15.72:0/1675264277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae700cc420 0x7fae701ef000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T00:29:45.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.572+0000 7fae74c56640 1 --2- 172.21.15.72:0/1675264277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae700cda70 0x7fae700b38e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fae60033000 tx=0x7fae600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:45.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.575+0000 7fae65ffb640 1 -- 172.21.15.72:0/1675264277 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6003b040 con 0x7fae700cda70 2023-12-13T00:29:45.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.575+0000 7fae65ffb640 1 -- 172.21.15.72:0/1675264277 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fae60037970 con 0x7fae700cda70 2023-12-13T00:29:45.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.576+0000 7fae776bb640 1 -- 172.21.15.72:0/1675264277 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae700b2e00 con 0x7fae700cda70 2023-12-13T00:29:45.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.576+0000 7fae65ffb640 1 -- 172.21.15.72:0/1675264277 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60037d40 con 0x7fae700cda70 2023-12-13T00:29:45.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.576+0000 7fae776bb640 1 -- 172.21.15.72:0/1675264277 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae700b33c0 con 0x7fae700cda70 2023-12-13T00:29:45.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.577+0000 7fae776bb640 1 -- 172.21.15.72:0/1675264277 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae700b3e20 con 0x7fae700cda70 2023-12-13T00:29:45.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.820+0000 7fae65ffb640 1 -- 172.21.15.72:0/1675264277 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fae600413e0 con 0x7fae700cda70 2023-12-13T00:29:45.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.820+0000 7fae65ffb640 1 --2- 172.21.15.72:0/1675264277 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fae5406b210 0x7fae5406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:45.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.821+0000 7fae75457640 1 --2- 172.21.15.72:0/1675264277 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fae5406b210 0x7fae5406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:45.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.821+0000 7fae75457640 1 --2- 172.21.15.72:0/1675264277 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fae5406b210 0x7fae5406d6d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fae6c007fd0 tx=0x7fae6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:45.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.824+0000 7fae65ffb640 1 -- 172.21.15.72:0/1675264277 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fae6007ad50 con 0x7fae700cda70 2023-12-13T00:29:45.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:45.835+0000 7fae65ffb640 1 -- 172.21.15.72:0/1675264277 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fae60077000 con 0x7fae700cda70 2023-12-13T00:29:46.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.008+0000 7fae776bb640 1 -- 172.21.15.72:0/1675264277 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae70067470 con 0x7fae700cda70 2023-12-13T00:29:46.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.065+0000 7fae65ffb640 1 -- 172.21.15.72:0/1675264277 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18563 (secure 0 0 0) 0x7fae60046070 con 0x7fae700cda70 2023-12-13T00:29:46.065 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-13T00:29:46.065 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"37ac29c2-2f1f-4ddd-beff-82b1dbe6fd0d","created":"2023-12-12T23:59:52.622761+0000","modified":"2023-12-13T00:01:00.435991+0000","last_up_change":"2023-12-13T00:00:07.226606+0000","last_in_change":"2023-12-12T23:59:57.846142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T00:00:06.839153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T00:00:27.701252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T00:00:29.324356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T00:00:33.363089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b50be7d6-a064-484b-8f53-59e2aadea9f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6819","nonce":46778518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6821","nonce":46778518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6825","nonce":46778518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":46778518},{"type":"v1","addr":"172.21.15.72:6823","nonce":46778518}]},"public_addr":"172.21.15.72:6819/46778518","cluster_addr":"172.21.15.72:6821/46778518","heartbeat_back_addr":"172.21.15.72:6825/46778518","heartbeat_front_addr":"172.21.15.72:6823/46778518","state":["exists","up"]},{"osd":1,"uuid":"277ed5f0-a6a5-4987-955a-bbfd38c9d230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6827","nonce":602713131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6829","nonce":602713131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6833","nonce":602713131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":602713131},{"type":"v1","addr":"172.21.15.72:6831","nonce":602713131}]},"public_addr":"172.21.15.72:6827/602713131","cluster_addr":"172.21.15.72:6829/602713131","heartbeat_back_addr":"172.21.15.72:6833/602713131","heartbeat_front_addr":"172.21.15.72:6831/602713131","state":["exists","up"]},{"osd":2,"uuid":"ad2105a9-8fe8-4121-a234-51a442670f0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6803","nonce":1644978744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6805","nonce":1644978744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6809","nonce":1644978744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1644978744},{"type":"v1","addr":"172.21.15.72:6807","nonce":1644978744}]},"public_addr":"172.21.15.72:6803/1644978744","cluster_addr":"172.21.15.72:6805/1644978744","heartbeat_back_addr":"172.21.15.72:6809/1644978744","heartbeat_front_addr":"172.21.15.72:6807/1644978744","state":["exists","up"]},{"osd":3,"uuid":"366d47c2-de6f-4c5f-9f9b-182c33ca75d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6811","nonce":1022561321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6813","nonce":1022561321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6817","nonce":1022561321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1022561321},{"type":"v1","addr":"172.21.15.72:6815","nonce":1022561321}]},"public_addr":"172.21.15.72:6811/1022561321","cluster_addr":"172.21.15.72:6813/1022561321","heartbeat_back_addr":"172.21.15.72:6817/1022561321","heartbeat_front_addr":"172.21.15.72:6815/1022561321","state":["exists","up"]},{"osd":4,"uuid":"4a3e9d90-c8ac-4f4d-886e-1b2d80dc85bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6809","nonce":1197403965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6811","nonce":1197403965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6815","nonce":1197403965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1197403965},{"type":"v1","addr":"172.21.15.176:6813","nonce":1197403965}]},"public_addr":"172.21.15.176:6809/1197403965","cluster_addr":"172.21.15.176:6811/1197403965","heartbeat_back_addr":"172.21.15.176:6815/1197403965","heartbeat_front_addr":"172.21.15.176:6813/1197403965","state":["exists","up"]},{"osd":5,"uuid":"5bef04ae-8b8c-4033-b92e-af2f2287e462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6801","nonce":3937462058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6803","nonce":3937462058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6807","nonce":3937462058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3937462058},{"type":"v1","addr":"172.21.15.176:6805","nonce":3937462058}]},"public_addr":"172.21.15.176:6801/3937462058","cluster_addr":"172.21.15.176:6803/3937462058","heartbeat_back_addr":"172.21.15.176:6807/3937462058","heartbeat_front_addr":"172.21.15.176:6805/3937462058","state":["exists","up"]},{"osd":6,"uuid":"269c276f-130b-4e32-96f9-026acf7eed06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6825","nonce":2380480963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6827","nonce":2380480963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6831","nonce":2380480963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2380480963},{"type":"v1","addr":"172.21.15.176:6829","nonce":2380480963}]},"public_addr":"172.21.15.176:6825/2380480963","cluster_addr":"172.21.15.176:6827/2380480963","heartbeat_back_addr":"172.21.15.176:6831/2380480963","heartbeat_front_addr":"172.21.15.176:6829/2380480963","state":["exists","up"]},{"osd":7,"uuid":"e3ae5768-010b-46d0-9637-8ecc58a87ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6817","nonce":2976728609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6819","nonce":2976728609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6823","nonce":2976728609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2976728609},{"type":"v1","addr":"172.21.15.176:6821","nonce":2976728609}]},"public_addr":"172.21.15.176:6817/2976728609","cluster_addr":"172.21.15.176:6819/2976728609","heartbeat_back_addr":"172.21.15.176:6823/2976728609","heartbeat_front_addr":"172.21.15.176:6821/2976728609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.007354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.077523+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:02.985766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.065484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.083470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.036158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.058111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T00:00:03.082296+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.3","mappings":[{"from":7,"to":5}]},{"pgid":"4.10","mappings":[{"from":7,"to":0}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T00:29:46.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.067+0000 7fae776bb640 1 -- 172.21.15.72:0/1675264277 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fae5406b210 msgr2=0x7fae5406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:46.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.067+0000 7fae776bb640 1 --2- 172.21.15.72:0/1675264277 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fae5406b210 0x7fae5406d6d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fae6c007fd0 tx=0x7fae6c009040 comp rx=0 tx=0).stop 2023-12-13T00:29:46.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.067+0000 7fae776bb640 1 -- 172.21.15.72:0/1675264277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae700cda70 msgr2=0x7fae700b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:46.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.067+0000 7fae776bb640 1 --2- 172.21.15.72:0/1675264277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae700cda70 0x7fae700b38e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fae60033000 tx=0x7fae600046c0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.067+0000 7fae776bb640 1 -- 172.21.15.72:0/1675264277 shutdown_connections 2023-12-13T00:29:46.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.067+0000 7fae776bb640 1 --2- 172.21.15.72:0/1675264277 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fae5406b210 0x7fae5406d6d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.067+0000 7fae776bb640 1 --2- 172.21.15.72:0/1675264277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae70159b50 0x7fae701591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.067+0000 7fae776bb640 1 --2- 172.21.15.72:0/1675264277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae700cda70 0x7fae700b38e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.067+0000 7fae776bb640 1 --2- 172.21.15.72:0/1675264277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae700cc420 0x7fae701ef000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.067+0000 7fae776bb640 1 -- 172.21.15.72:0/1675264277 >> 172.21.15.72:0/1675264277 conn(0x7fae700b07b0 msgr2=0x7fae700af7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:46.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.068+0000 7fae776bb640 1 -- 172.21.15.72:0/1675264277 shutdown_connections 2023-12-13T00:29:46.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.068+0000 7fae776bb640 1 -- 172.21.15.72:0/1675264277 wait complete. 2023-12-13T00:29:46.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-13T00:29:46.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.180+0000 7faae2ce5640 1 Processor -- start 2023-12-13T00:29:46.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.181+0000 7faae2ce5640 1 -- start start 2023-12-13T00:29:46.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.181+0000 7faae2ce5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faadc0cda70 0x7faadc0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:46.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.181+0000 7faae2ce5640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faadc0cc420 0x7faadc159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:46.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.181+0000 7faae2ce5640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faadc0cbda0 con 0x7faadc159b50 2023-12-13T00:29:46.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.181+0000 7faae2ce5640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faadc0cc230 con 0x7faadc0cc420 2023-12-13T00:29:46.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.181+0000 7faae2ce5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0cb4e0 con 0x7faadc0cda70 2023-12-13T00:29:46.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.182+0000 7faae0a81640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faadc0cda70 0x7faadc0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:46.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.182+0000 7faadbfff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faadc0cc420 0x7faadc159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:46.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.182+0000 7faae1282640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7faadc159b50 0x7faadc0c9620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34964/0 (socket says 172.21.15.72:34964) 2023-12-13T00:29:46.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.182+0000 7faae1282640 1 -- 172.21.15.72:0/3106148888 learned_addr learned my addr 172.21.15.72:0/3106148888 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:29:46.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.185+0000 7faae0a81640 1 -- 172.21.15.72:0/3106148888 >> v2:172.21.15.72:3300/0 conn(0x7faadc0cc420 msgr2=0x7faadc159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:29:46.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.185+0000 7faae0a81640 1 --2- 172.21.15.72:0/3106148888 >> v2:172.21.15.72:3300/0 conn(0x7faadc0cc420 0x7faadc159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.185+0000 7faae0a81640 1 -- 172.21.15.72:0/3106148888 >> v1:172.21.15.72:6789/0 conn(0x7faadc159b50 legacy=0x7faadc0c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:46.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.185+0000 7faae0a81640 1 -- 172.21.15.72:0/3106148888 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc0cce00 con 0x7faadc0cda70 2023-12-13T00:29:46.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.187+0000 7faae0a81640 1 --2- 172.21.15.72:0/3106148888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faadc0cda70 0x7faadc0ce350 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faad00097a0 tx=0x7faad002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5169f3a0404ce801 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:46.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.190+0000 7faadb7fe640 1 -- 172.21.15.72:0/3106148888 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0030610 con 0x7faadc0cda70 2023-12-13T00:29:46.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.190+0000 7faadb7fe640 1 -- 172.21.15.72:0/3106148888 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faad0030770 con 0x7faadc0cda70 2023-12-13T00:29:46.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.190+0000 7faadb7fe640 1 -- 172.21.15.72:0/3106148888 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0030b20 con 0x7faadc0cda70 2023-12-13T00:29:46.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.191+0000 7faae2ce5640 1 -- 172.21.15.72:0/3106148888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faadc0cda70 msgr2=0x7faadc0ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:46.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.191+0000 7faae2ce5640 1 --2- 172.21.15.72:0/3106148888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faadc0cda70 0x7faadc0ce350 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faad00097a0 tx=0x7faad002b960 comp rx=0 tx=0).stop 2023-12-13T00:29:46.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.191+0000 7faae2ce5640 1 -- 172.21.15.72:0/3106148888 shutdown_connections 2023-12-13T00:29:46.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.191+0000 7faae2ce5640 1 --2- 172.21.15.72:0/3106148888 >> v2:172.21.15.72:3300/0 conn(0x7faadc0cc420 0x7faadc159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.191+0000 7faae2ce5640 1 --2- 172.21.15.72:0/3106148888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faadc0cda70 0x7faadc0ce350 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.191+0000 7faae2ce5640 1 -- 172.21.15.72:0/3106148888 >> 172.21.15.72:0/3106148888 conn(0x7faadc0b07b0 msgr2=0x7faadc0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:46.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.191+0000 7faae2ce5640 1 -- 172.21.15.72:0/3106148888 shutdown_connections 2023-12-13T00:29:46.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.191+0000 7faae2ce5640 1 -- 172.21.15.72:0/3106148888 wait complete. 2023-12-13T00:29:46.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.192+0000 7faae2ce5640 1 Processor -- start 2023-12-13T00:29:46.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.192+0000 7faae2ce5640 1 -- start start 2023-12-13T00:29:46.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.193+0000 7faae2ce5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faadc0cc420 0x7faadc1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:46.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.193+0000 7faae2ce5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faadc0cda70 0x7faadc0b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:46.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.193+0000 7faae2ce5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faadc159b50 0x7faadc0b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:46.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.193+0000 7faae2ce5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0b1840 con 0x7faadc159b50 2023-12-13T00:29:46.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.193+0000 7faae2ce5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc1f02b0 con 0x7faadc0cda70 2023-12-13T00:29:46.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.193+0000 7faae2ce5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc1f0550 con 0x7faadc0cc420 2023-12-13T00:29:46.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.194+0000 7faae1282640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faadc159b50 0x7faadc0b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:46.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.194+0000 7faae0a81640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faadc0cc420 0x7faadc1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:46.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.194+0000 7faae1282640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faadc159b50 0x7faadc0b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58578/0 (socket says 172.21.15.72:58578) 2023-12-13T00:29:46.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.194+0000 7faae1282640 1 -- 172.21.15.72:0/2749987869 learned_addr learned my addr 172.21.15.72:0/2749987869 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:29:46.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.194+0000 7faadbfff640 1 --2- 172.21.15.72:0/2749987869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faadc0cda70 0x7faadc0b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:46.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.197+0000 7faae1282640 1 -- 172.21.15.72:0/2749987869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faadc0cc420 msgr2=0x7faadc1595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:46.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.197+0000 7faae1282640 1 --2- 172.21.15.72:0/2749987869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faadc0cc420 0x7faadc1595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.197+0000 7faae1282640 1 -- 172.21.15.72:0/2749987869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faadc0cda70 msgr2=0x7faadc0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:46.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.197+0000 7faae1282640 1 --2- 172.21.15.72:0/2749987869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faadc0cda70 0x7faadc0b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.197+0000 7faae1282640 1 -- 172.21.15.72:0/2749987869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad0009400 con 0x7faadc159b50 2023-12-13T00:29:46.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.199+0000 7faae1282640 1 --2- 172.21.15.72:0/2749987869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faadc159b50 0x7faadc0b3a10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faad400caa0 tx=0x7faad400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:46.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.203+0000 7faad97fa640 1 -- 172.21.15.72:0/2749987869 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400ab40 con 0x7faadc159b50 2023-12-13T00:29:46.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.203+0000 7faad97fa640 1 -- 172.21.15.72:0/2749987869 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faad400aca0 con 0x7faadc159b50 2023-12-13T00:29:46.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.203+0000 7faad97fa640 1 -- 172.21.15.72:0/2749987869 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4012620 con 0x7faadc159b50 2023-12-13T00:29:46.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.203+0000 7faae2ce5640 1 -- 172.21.15.72:0/2749987869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc0b1a90 con 0x7faadc159b50 2023-12-13T00:29:46.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.203+0000 7faae2ce5640 1 -- 172.21.15.72:0/2749987869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc0b34f0 con 0x7faadc159b50 2023-12-13T00:29:46.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.204+0000 7faae2ce5640 1 -- 172.21.15.72:0/2749987869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc0b3710 con 0x7faadc159b50 2023-12-13T00:29:46.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.223+0000 7faad97fa640 1 -- 172.21.15.72:0/2749987869 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7faad4007070 con 0x7faadc159b50 2023-12-13T00:29:46.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.223+0000 7faad97fa640 1 --2- 172.21.15.72:0/2749987869 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faac006b210 0x7faac006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:46.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.224+0000 7faae0a81640 1 --2- 172.21.15.72:0/2749987869 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faac006b210 0x7faac006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:46.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.224+0000 7faae0a81640 1 --2- 172.21.15.72:0/2749987869 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faac006b210 0x7faac006d6d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faad0036000 tx=0x7faad0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:46.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.226+0000 7faad97fa640 1 -- 172.21.15.72:0/2749987869 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6605+0+0 (secure 0 0 0) 0x7faad4058730 con 0x7faadc159b50 2023-12-13T00:29:46.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.459+0000 7faad97fa640 1 -- 172.21.15.72:0/2749987869 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7faad4054a70 con 0x7faadc159b50 2023-12-13T00:29:46.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.665+0000 7faae2ce5640 1 -- 172.21.15.72:0/2749987869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7faadc067470 con 0x7faadc159b50 2023-12-13T00:29:46.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.758+0000 7faad97fa640 1 -- 172.21.15.72:0/2749987869 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v43) v1 ==== 161+0+0 (secure 0 0 0) 0x7faad4017070 con 0x7faadc159b50 2023-12-13T00:29:46.758 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-13T00:29:46.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.760+0000 7faae2ce5640 1 -- 172.21.15.72:0/2749987869 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faac006b210 msgr2=0x7faac006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:46.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.760+0000 7faae2ce5640 1 --2- 172.21.15.72:0/2749987869 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faac006b210 0x7faac006d6d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faad0036000 tx=0x7faad0008030 comp rx=0 tx=0).stop 2023-12-13T00:29:46.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.760+0000 7faae2ce5640 1 -- 172.21.15.72:0/2749987869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faadc159b50 msgr2=0x7faadc0b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:46.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.760+0000 7faae2ce5640 1 --2- 172.21.15.72:0/2749987869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faadc159b50 0x7faadc0b3a10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faad400caa0 tx=0x7faad400cf60 comp rx=0 tx=0).stop 2023-12-13T00:29:46.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.760+0000 7faae2ce5640 1 -- 172.21.15.72:0/2749987869 shutdown_connections 2023-12-13T00:29:46.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.760+0000 7faae2ce5640 1 --2- 172.21.15.72:0/2749987869 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7faac006b210 0x7faac006d6d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.760+0000 7faae2ce5640 1 --2- 172.21.15.72:0/2749987869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faadc159b50 0x7faadc0b3a10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.760+0000 7faae2ce5640 1 --2- 172.21.15.72:0/2749987869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faadc0cda70 0x7faadc0b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.760+0000 7faae2ce5640 1 --2- 172.21.15.72:0/2749987869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faadc0cc420 0x7faadc1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.760+0000 7faae2ce5640 1 -- 172.21.15.72:0/2749987869 >> 172.21.15.72:0/2749987869 conn(0x7faadc0b07b0 msgr2=0x7faadc0b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:46.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.760+0000 7faae2ce5640 1 -- 172.21.15.72:0/2749987869 shutdown_connections 2023-12-13T00:29:46.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.760+0000 7faae2ce5640 1 -- 172.21.15.72:0/2749987869 wait complete. 2023-12-13T00:29:46.771 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-13T00:29:46.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.878+0000 7f01e4597640 1 Processor -- start 2023-12-13T00:29:46.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.878+0000 7f01e4597640 1 -- start start 2023-12-13T00:29:46.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.879+0000 7f01e4597640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01dc0cda70 0x7f01dc0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:46.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.879+0000 7f01e4597640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01dc0cbda0 con 0x7f01dc0c9620 2023-12-13T00:29:46.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.879+0000 7f01e4597640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01dc0cb4e0 con 0x7f01dc0cc420 2023-12-13T00:29:46.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.879+0000 7f01e4597640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01dc0cc230 con 0x7f01dc0cda70 2023-12-13T00:29:46.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.880+0000 7f01e1b32640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f01dc0cc420 0x7f01dc159610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.72:35780/0 (socket says 172.21.15.72:35780) 2023-12-13T00:29:46.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.880+0000 7f01e1b32640 1 -- 172.21.15.72:0/3649914216 learned_addr learned my addr 172.21.15.72:0/3649914216 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-12-13T00:29:46.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.880+0000 7f01e2333640 1 --2- 172.21.15.72:0/3649914216 >> v2:172.21.15.72:3300/0 conn(0x7f01dc0cda70 0x7f01dc0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:46.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.882+0000 7f01e1331640 1 -- 172.21.15.72:0/3649914216 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259413228 0 0) 0x7f01dc0cb4e0 con 0x7f01dc0cc420 2023-12-13T00:29:46.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.882+0000 7f01e1331640 1 -- 172.21.15.72:0/3649914216 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01c8003520 con 0x7f01dc0cc420 2023-12-13T00:29:46.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.886+0000 7f01e1331640 1 -- 172.21.15.72:0/3649914216 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 905203468 0 0) 0x7f01c8003520 con 0x7f01dc0cc420 2023-12-13T00:29:46.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.886+0000 7f01e1331640 1 -- 172.21.15.72:0/3649914216 >> v2:172.21.15.72:3300/0 conn(0x7f01dc0cda70 msgr2=0x7f01dc0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:29:46.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.886+0000 7f01e1331640 1 --2- 172.21.15.72:0/3649914216 >> v2:172.21.15.72:3300/0 conn(0x7f01dc0cda70 0x7f01dc0ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.886+0000 7f01e1331640 1 -- 172.21.15.72:0/3649914216 >> v1:172.21.15.72:6789/0 conn(0x7f01dc0c9620 legacy=0x7f01dc163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:46.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.886+0000 7f01e1331640 1 -- 172.21.15.72:0/3649914216 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc0cce00 con 0x7f01dc0cc420 2023-12-13T00:29:46.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.886+0000 7f01e1331640 1 -- 172.21.15.72:0/3649914216 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1233568696 0 0) 0x7f01cc001670 con 0x7f01dc0cc420 2023-12-13T00:29:46.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.886+0000 7f01e1331640 1 -- 172.21.15.72:0/3649914216 >> v1:172.21.15.176:6789/0 conn(0x7f01dc0cc420 legacy=0x7f01dc159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:46.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.886+0000 7f01e1331640 1 --2- 172.21.15.72:0/3649914216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01c8003a30 0x7f01c8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:46.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.886+0000 7f01e1331640 1 --2- 172.21.15.72:0/3649914216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01c80047c0 0x7f01c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:46.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.886+0000 7f01e1331640 1 --2- 172.21.15.72:0/3649914216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c80051d0 0x7f01c800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:46.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.886+0000 7f01e1331640 1 -- 172.21.15.72:0/3649914216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc0cc230 con 0x7f01c80051d0 2023-12-13T00:29:46.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.886+0000 7f01e1331640 1 -- 172.21.15.72:0/3649914216 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c800c0e0 con 0x7f01c80047c0 2023-12-13T00:29:46.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.886+0000 7f01e1331640 1 -- 172.21.15.72:0/3649914216 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c800c2a0 con 0x7f01c8003a30 2023-12-13T00:29:46.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.886+0000 7f01e2333640 1 --2- 172.21.15.72:0/3649914216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01c8003a30 0x7f01c8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:46.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.889+0000 7f01e1b32640 1 --2- 172.21.15.72:0/3649914216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01c80047c0 0x7f01c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:46.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.890+0000 7f01e2333640 1 -- 172.21.15.72:0/3649914216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01c80047c0 msgr2=0x7f01c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:29:46.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.890+0000 7f01e2333640 1 --2- 172.21.15.72:0/3649914216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01c80047c0 0x7f01c8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.890+0000 7f01e2333640 1 -- 172.21.15.72:0/3649914216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c80051d0 msgr2=0x7f01c800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:29:46.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.890+0000 7f01e2333640 1 --2- 172.21.15.72:0/3649914216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c80051d0 0x7f01c800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.890+0000 7f01e2333640 1 -- 172.21.15.72:0/3649914216 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c8003520 con 0x7f01c8003a30 2023-12-13T00:29:46.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.890+0000 7f01e2b34640 1 -- 172.21.15.72:0/3649914216 reap_dead start 2023-12-13T00:29:46.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.892+0000 7f01e2333640 1 --2- 172.21.15.72:0/3649914216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01c8003a30 0x7f01c8003e50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009ac0 tx=0x7f01c80057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16dda1d005de8f3b server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:46.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.896+0000 7f01e1331640 1 -- 172.21.15.72:0/3649914216 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d802c710 con 0x7f01c8003a30 2023-12-13T00:29:46.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.896+0000 7f01e1331640 1 -- 172.21.15.72:0/3649914216 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f01d802c870 con 0x7f01c8003a30 2023-12-13T00:29:46.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.896+0000 7f01e1331640 1 -- 172.21.15.72:0/3649914216 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d802cc20 con 0x7f01c8003a30 2023-12-13T00:29:46.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.897+0000 7f01e4597640 1 -- 172.21.15.72:0/3649914216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01c8003a30 msgr2=0x7f01c8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:46.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.897+0000 7f01e4597640 1 --2- 172.21.15.72:0/3649914216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01c8003a30 0x7f01c8003e50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009ac0 tx=0x7f01c80057f0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.897+0000 7f01e4597640 1 -- 172.21.15.72:0/3649914216 shutdown_connections 2023-12-13T00:29:46.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.897+0000 7f01e4597640 1 --2- 172.21.15.72:0/3649914216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01c8003a30 0x7f01c8003e50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.898+0000 7f01e4597640 1 -- 172.21.15.72:0/3649914216 >> 172.21.15.72:0/3649914216 conn(0x7f01dc0b07b0 msgr2=0x7f01dc0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:46.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.898+0000 7f01e4597640 1 -- 172.21.15.72:0/3649914216 shutdown_connections 2023-12-13T00:29:46.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.898+0000 7f01e4597640 1 -- 172.21.15.72:0/3649914216 wait complete. 2023-12-13T00:29:46.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.899+0000 7f01e4597640 1 Processor -- start 2023-12-13T00:29:46.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.900+0000 7f01e4597640 1 -- start start 2023-12-13T00:29:46.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.901+0000 7f01e4597640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01c8003a30 0x7f01dc1ef0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:46.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.901+0000 7f01e4597640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01dc0b3d70 0x7f01dc14a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:46.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.901+0000 7f01e4597640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01dc14a760 0x7f01dc14f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:46.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.901+0000 7f01e4597640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc157d30 con 0x7f01dc14a760 2023-12-13T00:29:46.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.901+0000 7f01e4597640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc1502c0 con 0x7f01dc0b3d70 2023-12-13T00:29:46.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.901+0000 7f01e4597640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc150560 con 0x7f01c8003a30 2023-12-13T00:29:46.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.901+0000 7f01e1b32640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01dc0b3d70 0x7f01dc14a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:46.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.901+0000 7f01e2333640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01c8003a30 0x7f01dc1ef0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:46.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.901+0000 7f01e1b32640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01dc0b3d70 0x7f01dc14a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:44144/0 (socket says 172.21.15.72:44144) 2023-12-13T00:29:46.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.901+0000 7f01e1b32640 1 -- 172.21.15.72:0/1413505808 learned_addr learned my addr 172.21.15.72:0/1413505808 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:29:46.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.905+0000 7f01e2333640 1 -- 172.21.15.72:0/1413505808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01dc0b3d70 msgr2=0x7f01dc14a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:46.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.905+0000 7f01e2333640 1 --2- 172.21.15.72:0/1413505808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01dc0b3d70 0x7f01dc14a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.905+0000 7f01e2333640 1 -- 172.21.15.72:0/1413505808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01dc14a760 msgr2=0x7f01dc14f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:46.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.905+0000 7f01e2333640 1 --2- 172.21.15.72:0/1413505808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01dc14a760 0x7f01dc14f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:46.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.905+0000 7f01e2333640 1 -- 172.21.15.72:0/1413505808 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc150840 con 0x7f01c8003a30 2023-12-13T00:29:46.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.905+0000 7f01e1b32640 1 --2- 172.21.15.72:0/1413505808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01dc0b3d70 0x7f01dc14a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T00:29:46.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.907+0000 7f01e2333640 1 --2- 172.21.15.72:0/1413505808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01c8003a30 0x7f01dc1ef0e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f01c800c430 tx=0x7f01d8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:46.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.912+0000 7f01d2ffd640 1 -- 172.21.15.72:0/1413505808 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8003810 con 0x7f01c8003a30 2023-12-13T00:29:46.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.912+0000 7f01d2ffd640 1 -- 172.21.15.72:0/1413505808 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f01d8003990 con 0x7f01c8003a30 2023-12-13T00:29:46.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.912+0000 7f01d2ffd640 1 -- 172.21.15.72:0/1413505808 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8003d60 con 0x7f01c8003a30 2023-12-13T00:29:46.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.912+0000 7f01e4597640 1 -- 172.21.15.72:0/1413505808 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01dc150b20 con 0x7f01c8003a30 2023-12-13T00:29:46.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.912+0000 7f01e4597640 1 -- 172.21.15.72:0/1413505808 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01dc1510e0 con 0x7f01c8003a30 2023-12-13T00:29:46.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.913+0000 7f01e4597640 1 -- 172.21.15.72:0/1413505808 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01dc157fa0 con 0x7f01c8003a30 2023-12-13T00:29:46.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.937+0000 7f01d2ffd640 1 -- 172.21.15.72:0/1413505808 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f01d803b070 con 0x7f01c8003a30 2023-12-13T00:29:46.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.937+0000 7f01d2ffd640 1 --2- 172.21.15.72:0/1413505808 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f01c006b210 0x7f01c006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:46.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.937+0000 7f01e1b32640 1 --2- 172.21.15.72:0/1413505808 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f01c006b210 0x7f01c006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:46.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:46.938+0000 7f01e1b32640 1 --2- 172.21.15.72:0/1413505808 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f01c006b210 0x7f01c006d6d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0c20c0 tx=0x7f01cc007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:47.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:47.175+0000 7f01d2ffd640 1 -- 172.21.15.72:0/1413505808 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6863+0+0 (secure 0 0 0) 0x7f01d807a6c0 con 0x7f01c8003a30 2023-12-13T00:29:47.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:47.190+0000 7f01d2ffd640 1 -- 172.21.15.72:0/1413505808 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f01d8076a00 con 0x7f01c8003a30 2023-12-13T00:29:47.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:47.446+0000 7f01e4597640 1 -- 172.21.15.72:0/1413505808 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f01dc151270 con 0x7f01c8003a30 2023-12-13T00:29:47.954 INFO:tasks.ceph.mds.c.smithi072.stderr:==00:00:29:32.963 94347== 2023-12-13T00:29:47.954 INFO:tasks.ceph.mds.c.smithi072.stderr:==00:00:29:32.963 94347== Exit program on first error (--exit-on-first-error=yes) 2023-12-13T00:29:47.960 INFO:tasks.ceph.mds.f.smithi176.stderr:==00:00:29:32.958 94520== 2023-12-13T00:29:47.960 INFO:tasks.ceph.mds.f.smithi176.stderr:==00:00:29:32.958 94520== Exit program on first error (--exit-on-first-error=yes) 2023-12-13T00:29:48.000 INFO:tasks.ceph.mds.a.smithi072.stderr:==00:00:29:33.010 94346== 2023-12-13T00:29:48.000 INFO:tasks.ceph.mds.a.smithi072.stderr:==00:00:29:33.010 94346== Exit program on first error (--exit-on-first-error=yes) 2023-12-13T00:29:48.041 INFO:tasks.ceph.mds.f.smithi176.stderr:daemon-helper: command failed with exit status 42 2023-12-13T00:29:48.099 INFO:tasks.ceph.mds.a.smithi072.stderr:daemon-helper: command failed with exit status 42 2023-12-13T00:29:48.100 INFO:tasks.ceph.mds.c.smithi072.stderr:daemon-helper: command failed with exit status 42 2023-12-13T00:29:48.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.320+0000 7f01d2ffd640 1 -- 172.21.15.72:0/1413505808 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7f01d80390a0 con 0x7f01c8003a30 2023-12-13T00:29:48.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.322+0000 7f01e4597640 1 -- 172.21.15.72:0/1413505808 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f01c006b210 msgr2=0x7f01c006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:48.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.322+0000 7f01e4597640 1 --2- 172.21.15.72:0/1413505808 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f01c006b210 0x7f01c006d6d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0c20c0 tx=0x7f01cc007040 comp rx=0 tx=0).stop 2023-12-13T00:29:48.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.322+0000 7f01e4597640 1 -- 172.21.15.72:0/1413505808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01c8003a30 msgr2=0x7f01dc1ef0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:48.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.322+0000 7f01e4597640 1 --2- 172.21.15.72:0/1413505808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01c8003a30 0x7f01dc1ef0e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f01c800c430 tx=0x7f01d8004730 comp rx=0 tx=0).stop 2023-12-13T00:29:48.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.322+0000 7f01e4597640 1 -- 172.21.15.72:0/1413505808 shutdown_connections 2023-12-13T00:29:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.322+0000 7f01e4597640 1 --2- 172.21.15.72:0/1413505808 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f01c006b210 0x7f01c006d6d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.322+0000 7f01e4597640 1 --2- 172.21.15.72:0/1413505808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01dc14a760 0x7f01dc14f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.322+0000 7f01e4597640 1 --2- 172.21.15.72:0/1413505808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01dc0b3d70 0x7f01dc14a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.322+0000 7f01e4597640 1 --2- 172.21.15.72:0/1413505808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01c8003a30 0x7f01dc1ef0e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.322+0000 7f01e4597640 1 -- 172.21.15.72:0/1413505808 >> 172.21.15.72:0/1413505808 conn(0x7f01dc0b07b0 msgr2=0x7f01dc0afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.322+0000 7f01e4597640 1 -- 172.21.15.72:0/1413505808 shutdown_connections 2023-12-13T00:29:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.322+0000 7f01e4597640 1 -- 172.21.15.72:0/1413505808 wait complete. 2023-12-13T00:29:48.333 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-13T00:29:48.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.438+0000 7f543d97c640 1 Processor -- start 2023-12-13T00:29:48.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.438+0000 7f543d97c640 1 -- start start 2023-12-13T00:29:48.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.439+0000 7f543d97c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54381594c0 0x7f54380721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:48.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.439+0000 7f543d97c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5438159fb0 0x7f5438163d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:48.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.439+0000 7f543d97c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5438072af0 con 0x7f543806cbf0 2023-12-13T00:29:48.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.439+0000 7f543d97c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54380c04e0 con 0x7f5438159fb0 2023-12-13T00:29:48.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.439+0000 7f543d97c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5438072720 con 0x7f54381594c0 2023-12-13T00:29:48.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.440+0000 7f5436ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54381594c0 0x7f54380721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:48.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.440+0000 7f54377fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5438159fb0 0x7f5438163d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:48.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.440+0000 7f5436ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54381594c0 0x7f54380721e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:34816/0 (socket says 172.21.15.72:34816) 2023-12-13T00:29:48.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.440+0000 7f5436ffd640 1 -- 172.21.15.72:0/1886108140 learned_addr learned my addr 172.21.15.72:0/1886108140 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:29:48.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.443+0000 7f5436ffd640 1 -- 172.21.15.72:0/1886108140 >> v2:172.21.15.176:3300/0 conn(0x7f5438159fb0 msgr2=0x7f5438163d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:29:48.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.443+0000 7f5436ffd640 1 --2- 172.21.15.72:0/1886108140 >> v2:172.21.15.176:3300/0 conn(0x7f5438159fb0 0x7f5438163d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:48.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.443+0000 7f5436ffd640 1 -- 172.21.15.72:0/1886108140 >> v1:172.21.15.176:6789/0 conn(0x7f543806cbf0 legacy=0x7f54381598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:48.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.443+0000 7f5436ffd640 1 -- 172.21.15.72:0/1886108140 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54380c1c10 con 0x7f54381594c0 2023-12-13T00:29:48.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.445+0000 7f5436ffd640 1 --2- 172.21.15.72:0/1886108140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54381594c0 0x7f54380721e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5428009e50 tx=0x7f542802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb9fb8e677cd3a5e server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:48.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.449+0000 7f5435ffb640 1 -- 172.21.15.72:0/1886108140 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542802cb00 con 0x7f54381594c0 2023-12-13T00:29:48.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.449+0000 7f5435ffb640 1 -- 172.21.15.72:0/1886108140 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f542802cc60 con 0x7f54381594c0 2023-12-13T00:29:48.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.449+0000 7f5435ffb640 1 -- 172.21.15.72:0/1886108140 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54280343f0 con 0x7f54381594c0 2023-12-13T00:29:48.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.449+0000 7f543d97c640 1 -- 172.21.15.72:0/1886108140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54381594c0 msgr2=0x7f54380721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:48.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.449+0000 7f543d97c640 1 --2- 172.21.15.72:0/1886108140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54381594c0 0x7f54380721e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5428009e50 tx=0x7f542802bf60 comp rx=0 tx=0).stop 2023-12-13T00:29:48.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.449+0000 7f543d97c640 1 -- 172.21.15.72:0/1886108140 shutdown_connections 2023-12-13T00:29:48.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.449+0000 7f543d97c640 1 --2- 172.21.15.72:0/1886108140 >> v2:172.21.15.176:3300/0 conn(0x7f5438159fb0 0x7f5438163d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:48.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.449+0000 7f543d97c640 1 --2- 172.21.15.72:0/1886108140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54381594c0 0x7f54380721e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:48.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.449+0000 7f543d97c640 1 -- 172.21.15.72:0/1886108140 >> 172.21.15.72:0/1886108140 conn(0x7f54380c79a0 msgr2=0x7f54380c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:48.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.449+0000 7f543d97c640 1 -- 172.21.15.72:0/1886108140 shutdown_connections 2023-12-13T00:29:48.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.449+0000 7f543d97c640 1 -- 172.21.15.72:0/1886108140 wait complete. 2023-12-13T00:29:48.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.450+0000 7f543d97c640 1 Processor -- start 2023-12-13T00:29:48.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.451+0000 7f543d97c640 1 -- start start 2023-12-13T00:29:48.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.451+0000 7f543d97c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f543806cbf0 0x7f543814f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:48.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.451+0000 7f543d97c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54381594c0 0x7f54380c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:48.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.451+0000 7f543d97c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5438159fb0 0x7f5438148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:48.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.451+0000 7f543d97c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54381f3380 con 0x7f5438159fb0 2023-12-13T00:29:48.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.451+0000 7f543d97c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54381f2e30 con 0x7f54381594c0 2023-12-13T00:29:48.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.451+0000 7f543d97c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543814caf0 con 0x7f543806cbf0 2023-12-13T00:29:48.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.452+0000 7f54377fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5438159fb0 0x7f5438148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:48.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.452+0000 7f54377fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5438159fb0 0x7f5438148490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56764/0 (socket says 172.21.15.72:56764) 2023-12-13T00:29:48.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.452+0000 7f5436ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f543806cbf0 0x7f543814f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:48.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.452+0000 7f54377fe640 1 -- 172.21.15.72:0/3189646735 learned_addr learned my addr 172.21.15.72:0/3189646735 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:29:48.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.452+0000 7f54367fc640 1 --2- 172.21.15.72:0/3189646735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54381594c0 0x7f54380c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:48.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.455+0000 7f54377fe640 1 -- 172.21.15.72:0/3189646735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f543806cbf0 msgr2=0x7f543814f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:48.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.455+0000 7f54377fe640 1 --2- 172.21.15.72:0/3189646735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f543806cbf0 0x7f543814f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:48.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.455+0000 7f54377fe640 1 -- 172.21.15.72:0/3189646735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54381594c0 msgr2=0x7f54380c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:48.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.455+0000 7f54377fe640 1 --2- 172.21.15.72:0/3189646735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54381594c0 0x7f54380c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:48.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.455+0000 7f54377fe640 1 -- 172.21.15.72:0/3189646735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5428009b30 con 0x7f5438159fb0 2023-12-13T00:29:48.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.457+0000 7f54377fe640 1 --2- 172.21.15.72:0/3189646735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5438159fb0 0x7f5438148490 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f543000e880 tx=0x7f543000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:48.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.461+0000 7f541ffff640 1 -- 172.21.15.72:0/3189646735 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430009630 con 0x7f5438159fb0 2023-12-13T00:29:48.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.461+0000 7f541ffff640 1 -- 172.21.15.72:0/3189646735 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f543000c940 con 0x7f5438159fb0 2023-12-13T00:29:48.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.461+0000 7f543d97c640 1 -- 172.21.15.72:0/3189646735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5438150220 con 0x7f5438159fb0 2023-12-13T00:29:48.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.461+0000 7f541ffff640 1 -- 172.21.15.72:0/3189646735 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543000cd10 con 0x7f5438159fb0 2023-12-13T00:29:48.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.461+0000 7f543d97c640 1 -- 172.21.15.72:0/3189646735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543814efc0 con 0x7f5438159fb0 2023-12-13T00:29:48.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.462+0000 7f543d97c640 1 -- 172.21.15.72:0/3189646735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543814ee20 con 0x7f5438159fb0 2023-12-13T00:29:48.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.480+0000 7f541ffff640 1 -- 172.21.15.72:0/3189646735 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5430013470 con 0x7f5438159fb0 2023-12-13T00:29:48.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.480+0000 7f541ffff640 1 --2- 172.21.15.72:0/3189646735 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f542406b210 0x7f542406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:48.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.480+0000 7f5436ffd640 1 --2- 172.21.15.72:0/3189646735 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f542406b210 0x7f542406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:48.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.481+0000 7f5436ffd640 1 --2- 172.21.15.72:0/3189646735 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f542406b210 0x7f542406d6d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5428035000 tx=0x7f5428030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:48.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.483+0000 7f541ffff640 1 -- 172.21.15.72:0/3189646735 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6863+0+0 (secure 0 0 0) 0x7f543000ce70 con 0x7f5438159fb0 2023-12-13T00:29:48.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.716+0000 7f541ffff640 1 -- 172.21.15.72:0/3189646735 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5430054fa0 con 0x7f5438159fb0 2023-12-13T00:29:48.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:48.887+0000 7f543d97c640 1 -- 172.21.15.72:0/3189646735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f543814d270 con 0x7f5438159fb0 2023-12-13T00:29:49.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.469+0000 7f541ffff640 1 -- 172.21.15.72:0/3189646735 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f543814d270 con 0x7f5438159fb0 2023-12-13T00:29:49.469 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-12-13T00:29:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.471+0000 7f543d97c640 1 -- 172.21.15.72:0/3189646735 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f542406b210 msgr2=0x7f542406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.471+0000 7f543d97c640 1 --2- 172.21.15.72:0/3189646735 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f542406b210 0x7f542406d6d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5428035000 tx=0x7f5428030000 comp rx=0 tx=0).stop 2023-12-13T00:29:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.471+0000 7f543d97c640 1 -- 172.21.15.72:0/3189646735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5438159fb0 msgr2=0x7f5438148490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.471+0000 7f543d97c640 1 --2- 172.21.15.72:0/3189646735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5438159fb0 0x7f5438148490 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f543000e880 tx=0x7f543000ed40 comp rx=0 tx=0).stop 2023-12-13T00:29:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.472+0000 7f543d97c640 1 -- 172.21.15.72:0/3189646735 shutdown_connections 2023-12-13T00:29:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.472+0000 7f543d97c640 1 --2- 172.21.15.72:0/3189646735 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7f542406b210 0x7f542406d6d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.472+0000 7f543d97c640 1 --2- 172.21.15.72:0/3189646735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5438159fb0 0x7f5438148490 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.472+0000 7f543d97c640 1 --2- 172.21.15.72:0/3189646735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54381594c0 0x7f54380c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.472+0000 7f543d97c640 1 --2- 172.21.15.72:0/3189646735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f543806cbf0 0x7f543814f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.472+0000 7f543d97c640 1 -- 172.21.15.72:0/3189646735 >> 172.21.15.72:0/3189646735 conn(0x7f54380c79a0 msgr2=0x7f5438152780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.472+0000 7f543d97c640 1 -- 172.21.15.72:0/3189646735 shutdown_connections 2023-12-13T00:29:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.472+0000 7f543d97c640 1 -- 172.21.15.72:0/3189646735 wait complete. 2023-12-13T00:29:49.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-13T00:29:49.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.597+0000 7fa4be875640 1 Processor -- start 2023-12-13T00:29:49.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.597+0000 7fa4be875640 1 -- start start 2023-12-13T00:29:49.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.598+0000 7fa4be875640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4b80c46c0 0x7fa4b80c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:49.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.598+0000 7fa4be875640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa4b8150460 0x7fa4b80c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:49.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.598+0000 7fa4be875640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b80c76f0 con 0x7fa4b80c4aa0 2023-12-13T00:29:49.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.598+0000 7fa4be875640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b80c2bc0 con 0x7fa4b80c46c0 2023-12-13T00:29:49.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.598+0000 7fa4be875640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b80c6dc0 con 0x7fa4b8150460 2023-12-13T00:29:49.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.599+0000 7fa4bce12640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa4b8150460 0x7fa4b80c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:49.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.599+0000 7fa4b7fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4b80c46c0 0x7fa4b80c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:49.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.599+0000 7fa4bce12640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa4b8150460 0x7fa4b80c1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.72:44170/0 (socket says 172.21.15.72:44170) 2023-12-13T00:29:49.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.599+0000 7fa4bce12640 1 -- 172.21.15.72:0/1837616935 learned_addr learned my addr 172.21.15.72:0/1837616935 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:29:49.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.601+0000 7fa4bce12640 1 -- 172.21.15.72:0/1837616935 >> v2:172.21.15.72:3300/0 conn(0x7fa4b80c46c0 msgr2=0x7fa4b80c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:29:49.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.601+0000 7fa4bce12640 1 --2- 172.21.15.72:0/1837616935 >> v2:172.21.15.72:3300/0 conn(0x7fa4b80c46c0 0x7fa4b80c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:49.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.601+0000 7fa4bce12640 1 -- 172.21.15.72:0/1837616935 >> v1:172.21.15.176:6789/0 conn(0x7fa4b80c4aa0 legacy=0x7fa4b814fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:49.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.601+0000 7fa4bce12640 1 -- 172.21.15.72:0/1837616935 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b80c70a0 con 0x7fa4b8150460 2023-12-13T00:29:49.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.605+0000 7fa4bce12640 1 --2- 172.21.15.72:0/1837616935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b8150460 0x7fa4b80c1ec0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80c1380 tx=0x7fa4b002e190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93bfb5ddcf80e4c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:49.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.609+0000 7fa4b6ffd640 1 -- 172.21.15.72:0/1837616935 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b002ed30 con 0x7fa4b8150460 2023-12-13T00:29:49.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.609+0000 7fa4b6ffd640 1 -- 172.21.15.72:0/1837616935 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa4b002ee90 con 0x7fa4b8150460 2023-12-13T00:29:49.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.609+0000 7fa4b6ffd640 1 -- 172.21.15.72:0/1837616935 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0036630 con 0x7fa4b8150460 2023-12-13T00:29:49.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.609+0000 7fa4be875640 1 -- 172.21.15.72:0/1837616935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b8150460 msgr2=0x7fa4b80c1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:49.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.609+0000 7fa4be875640 1 --2- 172.21.15.72:0/1837616935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b8150460 0x7fa4b80c1ec0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80c1380 tx=0x7fa4b002e190 comp rx=0 tx=0).stop 2023-12-13T00:29:49.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.609+0000 7fa4be875640 1 -- 172.21.15.72:0/1837616935 shutdown_connections 2023-12-13T00:29:49.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.609+0000 7fa4be875640 1 --2- 172.21.15.72:0/1837616935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b8150460 0x7fa4b80c1ec0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:49.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.609+0000 7fa4be875640 1 --2- 172.21.15.72:0/1837616935 >> v2:172.21.15.72:3300/0 conn(0x7fa4b80c46c0 0x7fa4b80c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:49.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.609+0000 7fa4be875640 1 -- 172.21.15.72:0/1837616935 >> 172.21.15.72:0/1837616935 conn(0x7fa4b806c5f0 msgr2=0x7fa4b806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:49.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.609+0000 7fa4be875640 1 -- 172.21.15.72:0/1837616935 shutdown_connections 2023-12-13T00:29:49.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.609+0000 7fa4be875640 1 -- 172.21.15.72:0/1837616935 wait complete. 2023-12-13T00:29:49.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.610+0000 7fa4be875640 1 Processor -- start 2023-12-13T00:29:49.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.611+0000 7fa4be875640 1 -- start start 2023-12-13T00:29:49.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.611+0000 7fa4be875640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b80c46c0 0x7fa4b8143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.611+0000 7fa4be875640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b80c4aa0 0x7fa4b8155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.611+0000 7fa4be875640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4b8150460 0x7fa4b8153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.611+0000 7fa4be875640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b813de00 con 0x7fa4b80c46c0 2023-12-13T00:29:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.611+0000 7fa4be875640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80c87c0 con 0x7fa4b80c4aa0 2023-12-13T00:29:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.611+0000 7fa4be875640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b8072600 con 0x7fa4b8150460 2023-12-13T00:29:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.612+0000 7fa4b7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b80c46c0 0x7fa4b8143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.612+0000 7fa4b77fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b80c4aa0 0x7fa4b8155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.612+0000 7fa4bce12640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4b8150460 0x7fa4b8153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.612+0000 7fa4b7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b80c46c0 0x7fa4b8143ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56786/0 (socket says 172.21.15.72:56786) 2023-12-13T00:29:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.612+0000 7fa4b7fff640 1 -- 172.21.15.72:0/1424318373 learned_addr learned my addr 172.21.15.72:0/1424318373 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:29:49.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.615+0000 7fa4b7fff640 1 -- 172.21.15.72:0/1424318373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4b8150460 msgr2=0x7fa4b8153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:49.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.615+0000 7fa4b7fff640 1 --2- 172.21.15.72:0/1424318373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4b8150460 0x7fa4b8153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:49.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.615+0000 7fa4b7fff640 1 -- 172.21.15.72:0/1424318373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b80c4aa0 msgr2=0x7fa4b8155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:49.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.615+0000 7fa4b7fff640 1 --2- 172.21.15.72:0/1424318373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b80c4aa0 0x7fa4b8155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:49.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.615+0000 7fa4b7fff640 1 -- 172.21.15.72:0/1424318373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b0009b30 con 0x7fa4b80c46c0 2023-12-13T00:29:49.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.618+0000 7fa4b7fff640 1 --2- 172.21.15.72:0/1424318373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b80c46c0 0x7fa4b8143ab0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800d830 tx=0x7fa4a800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:49.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.621+0000 7fa4b4ff9640 1 -- 172.21.15.72:0/1424318373 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a800b6c0 con 0x7fa4b80c46c0 2023-12-13T00:29:49.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.621+0000 7fa4b4ff9640 1 -- 172.21.15.72:0/1424318373 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa4a800b820 con 0x7fa4b80c46c0 2023-12-13T00:29:49.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.621+0000 7fa4b4ff9640 1 -- 172.21.15.72:0/1424318373 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a800bbb0 con 0x7fa4b80c46c0 2023-12-13T00:29:49.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.621+0000 7fa4be875640 1 -- 172.21.15.72:0/1424318373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b80c8fd0 con 0x7fa4b80c46c0 2023-12-13T00:29:49.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.621+0000 7fa4be875640 1 -- 172.21.15.72:0/1424318373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b80c8cf0 con 0x7fa4b80c46c0 2023-12-13T00:29:49.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.622+0000 7fa4be875640 1 -- 172.21.15.72:0/1424318373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b8067470 con 0x7fa4b80c46c0 2023-12-13T00:29:49.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.641+0000 7fa4b4ff9640 1 -- 172.21.15.72:0/1424318373 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa4a8028430 con 0x7fa4b80c46c0 2023-12-13T00:29:49.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.641+0000 7fa4b4ff9640 1 --2- 172.21.15.72:0/1424318373 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa4a406b210 0x7fa4a406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:49.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.641+0000 7fa4b77fe640 1 --2- 172.21.15.72:0/1424318373 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa4a406b210 0x7fa4a406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:49.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.642+0000 7fa4b77fe640 1 --2- 172.21.15.72:0/1424318373 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa4a406b210 0x7fa4a406d6d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80c0680 tx=0x7fa4ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:49.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.645+0000 7fa4b4ff9640 1 -- 172.21.15.72:0/1424318373 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6425+0+0 (secure 0 0 0) 0x7fa4a8059510 con 0x7fa4b80c46c0 2023-12-13T00:29:49.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:49.878+0000 7fa4b4ff9640 1 -- 172.21.15.72:0/1424318373 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa4a8055850 con 0x7fa4b80c46c0 2023-12-13T00:29:50.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.045+0000 7fa4be875640 1 -- 172.21.15.72:0/1424318373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa4b806cec0 con 0x7fa4b80c46c0 2023-12-13T00:29:50.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.566+0000 7fa4b4ff9640 1 -- 172.21.15.72:0/1424318373 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa4a8058e70 con 0x7fa4b80c46c0 2023-12-13T00:29:50.566 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-12-13T00:29:50.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.569+0000 7fa4be875640 1 -- 172.21.15.72:0/1424318373 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa4a406b210 msgr2=0x7fa4a406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:50.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.569+0000 7fa4be875640 1 --2- 172.21.15.72:0/1424318373 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa4a406b210 0x7fa4a406d6d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80c0680 tx=0x7fa4ac009040 comp rx=0 tx=0).stop 2023-12-13T00:29:50.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.569+0000 7fa4be875640 1 -- 172.21.15.72:0/1424318373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b80c46c0 msgr2=0x7fa4b8143ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:50.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.569+0000 7fa4be875640 1 --2- 172.21.15.72:0/1424318373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b80c46c0 0x7fa4b8143ab0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800d830 tx=0x7fa4a800dcf0 comp rx=0 tx=0).stop 2023-12-13T00:29:50.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.569+0000 7fa4be875640 1 -- 172.21.15.72:0/1424318373 shutdown_connections 2023-12-13T00:29:50.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.569+0000 7fa4be875640 1 --2- 172.21.15.72:0/1424318373 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fa4a406b210 0x7fa4a406d6d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:50.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.569+0000 7fa4be875640 1 --2- 172.21.15.72:0/1424318373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4b8150460 0x7fa4b8153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:50.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.569+0000 7fa4be875640 1 --2- 172.21.15.72:0/1424318373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b80c4aa0 0x7fa4b8155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:50.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.569+0000 7fa4be875640 1 --2- 172.21.15.72:0/1424318373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b80c46c0 0x7fa4b8143ab0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:50.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.569+0000 7fa4be875640 1 -- 172.21.15.72:0/1424318373 >> 172.21.15.72:0/1424318373 conn(0x7fa4b806c5f0 msgr2=0x7fa4b814eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:50.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.569+0000 7fa4be875640 1 -- 172.21.15.72:0/1424318373 shutdown_connections 2023-12-13T00:29:50.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.569+0000 7fa4be875640 1 -- 172.21.15.72:0/1424318373 wait complete. 2023-12-13T00:29:50.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-13T00:29:50.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.692+0000 7fc817bc9640 1 Processor -- start 2023-12-13T00:29:50.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.692+0000 7fc817bc9640 1 -- start start 2023-12-13T00:29:50.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.693+0000 7fc817bc9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc810150530 0x7fc8100c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:50.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.693+0000 7fc817bc9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8100c7180 0x7fc8100c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:50.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.693+0000 7fc817bc9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc8100c4a10 0x7fc8101596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:50.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.693+0000 7fc817bc9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc810150910 con 0x7fc810150530 2023-12-13T00:29:50.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.693+0000 7fc817bc9640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8100c1ec0 con 0x7fc8100c4a10 2023-12-13T00:29:50.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.693+0000 7fc817bc9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81015a4e0 con 0x7fc8100c7180 2023-12-13T00:29:50.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.693+0000 7fc815965640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc810150530 0x7fc8100c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:50.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.693+0000 7fc815164640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8100c7180 0x7fc8100c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:50.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.694+0000 7fc815164640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8100c7180 0x7fc8100c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:34840/0 (socket says 172.21.15.72:34840) 2023-12-13T00:29:50.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.694+0000 7fc815164640 1 -- 172.21.15.72:0/829350801 learned_addr learned my addr 172.21.15.72:0/829350801 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:29:50.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.694+0000 7fc816166640 1 --2- 172.21.15.72:0/829350801 >> v2:172.21.15.176:3300/0 conn(0x7fc8100c4a10 0x7fc8101596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:50.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.696+0000 7fc815164640 1 -- 172.21.15.72:0/829350801 >> v2:172.21.15.176:3300/0 conn(0x7fc8100c4a10 msgr2=0x7fc8101596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:29:50.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.696+0000 7fc815164640 1 --2- 172.21.15.72:0/829350801 >> v2:172.21.15.176:3300/0 conn(0x7fc8100c4a10 0x7fc8101596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:50.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.696+0000 7fc815164640 1 -- 172.21.15.72:0/829350801 >> v2:172.21.15.72:3300/0 conn(0x7fc810150530 msgr2=0x7fc8100c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T00:29:50.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.696+0000 7fc815164640 1 --2- 172.21.15.72:0/829350801 >> v2:172.21.15.72:3300/0 conn(0x7fc810150530 0x7fc8100c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:50.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.696+0000 7fc815164640 1 -- 172.21.15.72:0/829350801 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8100c2110 con 0x7fc8100c7180 2023-12-13T00:29:50.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.698+0000 7fc815164640 1 --2- 172.21.15.72:0/829350801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8100c7180 0x7fc8100c44d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc8100c8870 tx=0x7fc80002b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=109d32b0be618cdc server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:50.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.701+0000 7fc814963640 1 -- 172.21.15.72:0/829350801 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc800030860 con 0x7fc8100c7180 2023-12-13T00:29:50.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.701+0000 7fc814963640 1 -- 172.21.15.72:0/829350801 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc8000309c0 con 0x7fc8100c7180 2023-12-13T00:29:50.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.701+0000 7fc814963640 1 -- 172.21.15.72:0/829350801 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc800030d70 con 0x7fc8100c7180 2023-12-13T00:29:50.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.702+0000 7fc817bc9640 1 -- 172.21.15.72:0/829350801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8100c7180 msgr2=0x7fc8100c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:50.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.702+0000 7fc817bc9640 1 --2- 172.21.15.72:0/829350801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8100c7180 0x7fc8100c44d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc8100c8870 tx=0x7fc80002b9a0 comp rx=0 tx=0).stop 2023-12-13T00:29:50.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.702+0000 7fc817bc9640 1 -- 172.21.15.72:0/829350801 shutdown_connections 2023-12-13T00:29:50.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.702+0000 7fc817bc9640 1 --2- 172.21.15.72:0/829350801 >> v2:172.21.15.176:3300/0 conn(0x7fc8100c4a10 0x7fc8101596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:50.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.702+0000 7fc817bc9640 1 --2- 172.21.15.72:0/829350801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8100c7180 0x7fc8100c44d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.702+0000 7fc817bc9640 1 --2- 172.21.15.72:0/829350801 >> v2:172.21.15.72:3300/0 conn(0x7fc810150530 0x7fc8100c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.702+0000 7fc817bc9640 1 -- 172.21.15.72:0/829350801 >> 172.21.15.72:0/829350801 conn(0x7fc81006c5f0 msgr2=0x7fc81006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.702+0000 7fc817bc9640 1 -- 172.21.15.72:0/829350801 shutdown_connections 2023-12-13T00:29:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.702+0000 7fc817bc9640 1 -- 172.21.15.72:0/829350801 wait complete. 2023-12-13T00:29:50.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.704+0000 7fc817bc9640 1 Processor -- start 2023-12-13T00:29:50.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.704+0000 7fc817bc9640 1 -- start start 2023-12-13T00:29:50.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.705+0000 7fc817bc9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8100c4a10 0x7fc8101572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:50.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.705+0000 7fc817bc9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8100c7180 0x7fc81014d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:50.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.705+0000 7fc817bc9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc810150530 0x7fc810144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:50.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.705+0000 7fc817bc9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81014d890 con 0x7fc810150530 2023-12-13T00:29:50.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.705+0000 7fc817bc9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8101593a0 con 0x7fc8100c4a10 2023-12-13T00:29:50.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.705+0000 7fc817bc9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81014cec0 con 0x7fc8100c7180 2023-12-13T00:29:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.706+0000 7fc815164640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8100c7180 0x7fc81014d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.706+0000 7fc815965640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8100c4a10 0x7fc8101572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.706+0000 7fc815164640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8100c7180 0x7fc81014d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.72:34856/0 (socket says 172.21.15.72:34856) 2023-12-13T00:29:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.706+0000 7fc815164640 1 -- 172.21.15.72:0/1435983559 learned_addr learned my addr 172.21.15.72:0/1435983559 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-12-13T00:29:50.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.710+0000 7fc815965640 1 -- 172.21.15.72:0/1435983559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8100c7180 msgr2=0x7fc81014d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:50.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.710+0000 7fc815965640 1 --2- 172.21.15.72:0/1435983559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8100c7180 0x7fc81014d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:50.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.710+0000 7fc815965640 1 -- 172.21.15.72:0/1435983559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc810150530 msgr2=0x7fc810144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:50.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.710+0000 7fc815965640 1 --2- 172.21.15.72:0/1435983559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc810150530 0x7fc810144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:50.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.710+0000 7fc815965640 1 -- 172.21.15.72:0/1435983559 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8000094d0 con 0x7fc8100c4a10 2023-12-13T00:29:50.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.712+0000 7fc815965640 1 --2- 172.21.15.72:0/1435983559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8100c4a10 0x7fc8101572b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00d5f0 tx=0x7fc80c00dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:50.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.717+0000 7fc8067fc640 1 -- 172.21.15.72:0/1435983559 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c0125f0 con 0x7fc8100c4a10 2023-12-13T00:29:50.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.717+0000 7fc8067fc640 1 -- 172.21.15.72:0/1435983559 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc80c012750 con 0x7fc8100c4a10 2023-12-13T00:29:50.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.717+0000 7fc8067fc640 1 -- 172.21.15.72:0/1435983559 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c012b20 con 0x7fc8100c4a10 2023-12-13T00:29:50.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.717+0000 7fc817bc9640 1 -- 172.21.15.72:0/1435983559 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8101ebc90 con 0x7fc8100c4a10 2023-12-13T00:29:50.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.717+0000 7fc817bc9640 1 -- 172.21.15.72:0/1435983559 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc810154370 con 0x7fc8100c4a10 2023-12-13T00:29:50.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.718+0000 7fc817bc9640 1 -- 172.21.15.72:0/1435983559 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8100723a0 con 0x7fc8100c4a10 2023-12-13T00:29:50.772 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-12-13T00:29:50.772 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-12-13T00:29:50.772 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2023-12-13T00:29:50.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.961+0000 7fc8067fc640 1 -- 172.21.15.72:0/1435983559 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc80c012c80 con 0x7fc8100c4a10 2023-12-13T00:29:50.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.961+0000 7fc8067fc640 1 --2- 172.21.15.72:0/1435983559 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc7f406b210 0x7fc7f406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T00:29:50.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.961+0000 7fc815164640 1 --2- 172.21.15.72:0/1435983559 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc7f406b210 0x7fc7f406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T00:29:50.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.961+0000 7fc815164640 1 --2- 172.21.15.72:0/1435983559 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc7f406b210 0x7fc7f406d6d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc80002b9e0 tx=0x7fc800008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T00:29:50.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.968+0000 7fc8067fc640 1 -- 172.21.15.72:0/1435983559 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5982+0+0 (secure 0 0 0) 0x7fc80c059a50 con 0x7fc8100c4a10 2023-12-13T00:29:50.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:50.980+0000 7fc8067fc640 1 -- 172.21.15.72:0/1435983559 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc80c055690 con 0x7fc8100c4a10 2023-12-13T00:29:51.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:51.162+0000 7fc817bc9640 1 -- 172.21.15.72:0/1435983559 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc810067470 con 0x7fc8100c4a10 2023-12-13T00:29:51.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:51.759+0000 7fc8067fc640 1 -- 172.21.15.72:0/1435983559 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7fc80c058cb0 con 0x7fc8100c4a10 2023-12-13T00:29:51.759 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data_ec' removed 2023-12-13T00:29:51.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:51.761+0000 7fc817bc9640 1 -- 172.21.15.72:0/1435983559 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc7f406b210 msgr2=0x7fc7f406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:51.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:51.761+0000 7fc817bc9640 1 --2- 172.21.15.72:0/1435983559 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc7f406b210 0x7fc7f406d6d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc80002b9e0 tx=0x7fc800008030 comp rx=0 tx=0).stop 2023-12-13T00:29:51.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:51.761+0000 7fc817bc9640 1 -- 172.21.15.72:0/1435983559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8100c4a10 msgr2=0x7fc8101572b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T00:29:51.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:51.761+0000 7fc817bc9640 1 --2- 172.21.15.72:0/1435983559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8100c4a10 0x7fc8101572b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00d5f0 tx=0x7fc80c00dab0 comp rx=0 tx=0).stop 2023-12-13T00:29:51.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:51.761+0000 7fc817bc9640 1 -- 172.21.15.72:0/1435983559 shutdown_connections 2023-12-13T00:29:51.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:51.761+0000 7fc817bc9640 1 --2- 172.21.15.72:0/1435983559 >> [v2:172.21.15.72:6800/3427715460,v1:172.21.15.72:6801/3427715460] conn(0x7fc7f406b210 0x7fc7f406d6d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:51.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:51.761+0000 7fc817bc9640 1 --2- 172.21.15.72:0/1435983559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc810150530 0x7fc810144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:51.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:51.761+0000 7fc817bc9640 1 --2- 172.21.15.72:0/1435983559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8100c7180 0x7fc81014d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:51.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:51.761+0000 7fc817bc9640 1 --2- 172.21.15.72:0/1435983559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8100c4a10 0x7fc8101572b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T00:29:51.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:51.761+0000 7fc817bc9640 1 -- 172.21.15.72:0/1435983559 >> 172.21.15.72:0/1435983559 conn(0x7fc81006c5f0 msgr2=0x7fc81014f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T00:29:51.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:51.761+0000 7fc817bc9640 1 -- 172.21.15.72:0/1435983559 shutdown_connections 2023-12-13T00:29:51.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-12-13T00:29:51.761+0000 7fc817bc9640 1 -- 172.21.15.72:0/1435983559 wait complete. 2023-12-13T00:29:51.772 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-13T00:29:51.772 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-13T00:29:51.772 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:29:51.772 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-13T00:29:51.773 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a" 2023-12-13T00:29:51.773 INFO:tasks.ceph.mds.a:Stopped 2023-12-13T00:29:51.774 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-13T00:29:51.774 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:29:51.774 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-13T00:29:51.774 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c" 2023-12-13T00:29:51.774 INFO:tasks.ceph.mds.c:Stopped 2023-12-13T00:29:51.774 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-12-13T00:29:51.774 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:29:51.788 INFO:tasks.ceph.mds.e.smithi072.stderr:2023-12-13T00:29:51.779+0000 b5ae640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e (PID: 94340) UID: 0 2023-12-13T00:29:51.789 INFO:tasks.ceph.mds.e.smithi072.stderr:2023-12-13T00:29:51.781+0000 b5ae640 -1 mds.e *** got signal Terminated *** 2023-12-13T00:29:57.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2023-12-13T00:29:57.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~7s 2023-12-13T00:29:57.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-12-13T00:29:57.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-12-13T00:29:57.876 INFO:tasks.ceph.mds.e:Stopped 2023-12-13T00:29:57.876 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-13T00:29:57.876 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:29:57.892 INFO:tasks.ceph.mds.b.smithi176.stderr:2023-12-13T00:29:57.880+0000 b5ae640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 94512) UID: 0 2023-12-13T00:29:57.892 INFO:tasks.ceph.mds.b.smithi176.stderr:2023-12-13T00:29:57.882+0000 b5ae640 -1 mds.b *** got signal Terminated *** 2023-12-13T00:30:03.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-13T00:30:03.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~13s 2023-12-13T00:30:03.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2023-12-13T00:30:03.978 INFO:tasks.ceph.mds.b:Stopped 2023-12-13T00:30:03.978 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-13T00:30:03.978 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:30:03.993 INFO:tasks.ceph.mds.d.smithi176.stderr:2023-12-13T00:30:03.982+0000 b5ae640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d (PID: 94514) UID: 0 2023-12-13T00:30:03.994 INFO:tasks.ceph.mds.d.smithi176.stderr:2023-12-13T00:30:03.984+0000 b5ae640 -1 mds.d *** got signal Terminated *** 2023-12-13T00:30:08.274 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:30:08.278 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:30:10.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-12-13T00:30:10.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~20s 2023-12-13T00:30:10.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-13T00:30:10.080 INFO:tasks.ceph.mds.d:Stopped 2023-12-13T00:30:10.080 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-12-13T00:30:10.080 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:30:10.080 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-13T00:30:10.080 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi176 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f" 2023-12-13T00:30:10.081 INFO:tasks.ceph.mds.f:Stopped 2023-12-13T00:30:10.081 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-13T00:30:10.081 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-13T00:30:10.081 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:30:10.082 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-12-13T00:30:10.081+0000 7f1166e5b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 88847) UID: 0 2023-12-13T00:30:10.082 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-12-13T00:30:10.081+0000 7f1166e5b640 -1 osd.0 34 *** Got signal Terminated *** 2023-12-13T00:30:16.182 INFO:tasks.ceph.osd.0:Stopped 2023-12-13T00:30:16.183 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-13T00:30:16.183 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:30:16.184 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-12-13T00:30:16.183+0000 7f5e91a70640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 88855) UID: 0 2023-12-13T00:30:16.184 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-12-13T00:30:16.183+0000 7f5e91a70640 -1 osd.1 35 *** Got signal Terminated *** 2023-12-13T00:30:16.215 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-12-13T00:30:16.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2023-12-13T00:30:16.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-12-13T00:30:22.285 INFO:tasks.ceph.osd.1:Stopped 2023-12-13T00:30:22.286 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-13T00:30:22.286 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:30:22.287 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-12-13T00:30:22.286+0000 7fb793f57640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 88860) UID: 0 2023-12-13T00:30:22.287 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-12-13T00:30:22.286+0000 7fb793f57640 -1 osd.2 37 *** Got signal Terminated *** 2023-12-13T00:30:22.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-12-13T00:30:22.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-12-13T00:30:28.334 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-12-13T00:30:28.334 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-12-13T00:30:28.387 INFO:tasks.ceph.osd.2:Stopped 2023-12-13T00:30:28.388 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-13T00:30:28.388 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:30:28.389 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-12-13T00:30:28.388+0000 7f8f5057a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 88864) UID: 0 2023-12-13T00:30:28.389 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-12-13T00:30:28.388+0000 7f8f5057a640 -1 osd.3 38 *** Got signal Terminated *** 2023-12-13T00:30:34.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-12-13T00:30:34.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-12-13T00:30:34.489 INFO:tasks.ceph.osd.3:Stopped 2023-12-13T00:30:34.489 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-13T00:30:34.489 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:30:34.491 INFO:tasks.ceph.osd.4.smithi176.stderr:2023-12-13T00:30:34.490+0000 7ff4e30eb640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 88963) UID: 0 2023-12-13T00:30:34.491 INFO:tasks.ceph.osd.4.smithi176.stderr:2023-12-13T00:30:34.490+0000 7ff4e30eb640 -1 osd.4 39 *** Got signal Terminated *** 2023-12-13T00:30:38.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:30:38.601 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:30:40.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-12-13T00:30:40.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-12-13T00:30:40.497 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:31:05.037 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:30:40.498 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:31:05.039 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:30:40.542 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:31:05.083 88575== Warning: unimplemented fcntl command: 1036 2023-12-13T00:30:40.572 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:31:05.106 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:30:40.574 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:31:05.108 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:30:40.574 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:31:05.109 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:30:40.576 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:31:05.110 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:30:40.591 INFO:tasks.ceph.osd.4:Stopped 2023-12-13T00:30:40.591 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-13T00:30:40.591 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:30:40.592 INFO:tasks.ceph.osd.5.smithi176.stderr:2023-12-13T00:30:40.592+0000 7fe04c021640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 88966) UID: 0 2023-12-13T00:30:40.592 INFO:tasks.ceph.osd.5.smithi176.stderr:2023-12-13T00:30:40.592+0000 7fe04c021640 -1 osd.5 40 *** Got signal Terminated *** 2023-12-13T00:30:40.625 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:31:05.159 88391== Warning: unimplemented fcntl command: 1036 2023-12-13T00:30:40.625 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:31:05.159 88390== Warning: unimplemented fcntl command: 1036 2023-12-13T00:30:45.753 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-12-13T00:30:45.753 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-12-13T00:30:46.693 INFO:tasks.ceph.osd.5:Stopped 2023-12-13T00:30:46.694 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-13T00:30:46.694 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:30:46.695 INFO:tasks.ceph.osd.6.smithi176.stderr:2023-12-13T00:30:46.695+0000 7fc0848bd640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 88968) UID: 0 2023-12-13T00:30:46.695 INFO:tasks.ceph.osd.6.smithi176.stderr:2023-12-13T00:30:46.695+0000 7fc0848bd640 -1 osd.6 41 *** Got signal Terminated *** 2023-12-13T00:30:51.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-12-13T00:30:51.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-12-13T00:30:52.795 INFO:tasks.ceph.osd.6:Stopped 2023-12-13T00:30:52.795 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-13T00:30:52.795 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:30:52.796 INFO:tasks.ceph.osd.7.smithi176.stderr:2023-12-13T00:30:52.797+0000 7f0348ff1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 88969) UID: 0 2023-12-13T00:30:52.796 INFO:tasks.ceph.osd.7.smithi176.stderr:2023-12-13T00:30:52.797+0000 7f0348ff1640 -1 osd.7 41 *** Got signal Terminated *** 2023-12-13T00:30:56.861 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-12-13T00:30:56.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-12-13T00:30:58.897 INFO:tasks.ceph.osd.7:Stopped 2023-12-13T00:30:58.897 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-13T00:30:58.898 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-13T00:30:58.898 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:30:58.899 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-13T00:30:58.898+0000 7f778b5d2640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 88589) UID: 0 2023-12-13T00:30:58.899 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-12-13T00:30:58.898+0000 7f778b5d2640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-12-13T00:30:58.927 INFO:tasks.ceph.mgr.y:Stopped 2023-12-13T00:30:58.927 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-13T00:30:58.927 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:30:58.953 INFO:tasks.ceph.mgr.x:Stopped 2023-12-13T00:30:58.953 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-13T00:30:58.954 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-13T00:30:58.954 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:30:58.982 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-12-13T00:30:58.971+0000 9f58640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 88552) UID: 0 2023-12-13T00:30:58.982 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-12-13T00:30:58.973+0000 9f58640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-13T00:31:02.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-12-13T00:31:08.686 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:31:08.689 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:31:12.557 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:31:37.098 88575== 2023-12-13T00:31:12.557 INFO:tasks.ceph.mon.a.smithi072.stderr:==00:00:31:37.098 88575== Exit program on first error (--exit-on-first-error=yes) 2023-12-13T00:31:12.570 INFO:tasks.ceph.mon.a.smithi072.stderr:daemon-helper: command failed with exit status 42 2023-12-13T00:31:17.259 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-13T00:31:17.259 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2023-12-13T00:31:17.259 INFO:tasks.ceph.mon.a:Stopped 2023-12-13T00:31:17.260 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-13T00:31:17.260 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:31:17.273 INFO:tasks.ceph.mon.b.smithi176.stderr:2023-12-13T00:31:17.264+0000 9f58640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 88383) UID: 0 2023-12-13T00:31:17.274 INFO:tasks.ceph.mon.b.smithi176.stderr:2023-12-13T00:31:17.266+0000 9f58640 -1 mon.b@1(leader) e1 *** Got Signal Terminated *** 2023-12-13T00:31:17.976 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:31:42.510 88390== 2023-12-13T00:31:17.976 INFO:tasks.ceph.mon.b.smithi176.stderr:==00:00:31:42.510 88390== Exit program on first error (--exit-on-first-error=yes) 2023-12-13T00:31:17.987 INFO:tasks.ceph.mon.b.smithi176.stderr:daemon-helper: command failed with exit status 42 2023-12-13T00:31:23.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-12-13T00:31:23.362 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-13T00:31:23.362 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi176 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2023-12-13T00:31:23.363 INFO:tasks.ceph.mon.b:Stopped 2023-12-13T00:31:23.363 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-13T00:31:23.363 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T00:31:23.378 INFO:tasks.ceph.mon.c.smithi176.stderr:2023-12-13T00:31:23.368+0000 9f58640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 88386) UID: 0 2023-12-13T00:31:23.379 INFO:tasks.ceph.mon.c.smithi176.stderr:2023-12-13T00:31:23.370+0000 9f58640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-12-13T00:31:24.030 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:31:48.564 88391== 2023-12-13T00:31:24.030 INFO:tasks.ceph.mon.c.smithi176.stderr:==00:00:31:48.564 88391== Exit program on first error (--exit-on-first-error=yes) 2023-12-13T00:31:24.040 INFO:tasks.ceph.mon.c.smithi176.stderr:daemon-helper: command failed with exit status 42 2023-12-13T00:31:28.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-12-13T00:31:28.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-12-13T00:31:29.465 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-13T00:31:29.465 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi176 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2023-12-13T00:31:29.466 INFO:tasks.ceph.mon.c:Stopped 2023-12-13T00:31:29.466 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-13T00:31:29.466 DEBUG:teuthology.orchestra.run.smithi072:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2023-12-13T00:31:29.504 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi072.front.sepia.ceph.com 2023-12-13T00:31:29.504 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-13T00:31:29.610 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi072.front.sepia.ceph.com 2023-12-13T00:31:29.610 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-13T00:31:29.666 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi072.front.sepia.ceph.com 2023-12-13T00:31:29.667 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-13T00:31:29.717 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi072.front.sepia.ceph.com 2023-12-13T00:31:29.717 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-13T00:31:29.768 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi176.front.sepia.ceph.com 2023-12-13T00:31:29.769 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-13T00:31:29.891 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi176.front.sepia.ceph.com 2023-12-13T00:31:29.892 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-13T00:31:29.958 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi176.front.sepia.ceph.com 2023-12-13T00:31:29.958 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-13T00:31:30.031 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi176.front.sepia.ceph.com 2023-12-13T00:31:30.032 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-13T00:31:30.088 INFO:tasks.ceph:Archiving mon data... 2023-12-13T00:31:30.089 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489252/data/mon.a.tgz 2023-12-13T00:31:30.089 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-12-13T00:31:30.105 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.DTLnmgdfqy 2023-12-13T00:31:30.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.DTLnmgdfqy 2023-12-13T00:31:30.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.DTLnmgdfqy 2023-12-13T00:31:30.328 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.DTLnmgdfqy is 322KB 2023-12-13T00:31:30.423 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.DTLnmgdfqy 2023-12-13T00:31:30.437 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489252/data/mon.b.tgz 2023-12-13T00:31:30.437 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2023-12-13T00:31:30.452 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.Q10x5LWj8G 2023-12-13T00:31:30.453 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Q10x5LWj8G 2023-12-13T00:31:30.590 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.Q10x5LWj8G 2023-12-13T00:31:30.673 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.Q10x5LWj8G is 325KB 2023-12-13T00:31:30.767 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.Q10x5LWj8G 2023-12-13T00:31:30.781 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489252/data/mon.c.tgz 2023-12-13T00:31:30.782 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2023-12-13T00:31:30.835 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.Vau5hJCPRq 2023-12-13T00:31:30.836 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Vau5hJCPRq 2023-12-13T00:31:30.961 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.Vau5hJCPRq 2023-12-13T00:31:31.045 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.Vau5hJCPRq is 325KB 2023-12-13T00:31:31.139 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.Vau5hJCPRq 2023-12-13T00:31:31.153 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-13T00:31:31.153 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-13T00:31:31.156 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-13T00:31:31.498 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc strdup 2023-12-13T00:31:31.768 INFO:tasks.ceph:Archiving crash dumps... 2023-12-13T00:31:31.770 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489252/remote/smithi072/crash 2023-12-13T00:31:31.771 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-13T00:31:31.800 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489252/remote/smithi176/crash 2023-12-13T00:31:31.801 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-13T00:31:31.828 INFO:tasks.ceph:Shutting down logrotate 2023-12-13T00:31:31.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:31:31.845 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T00:31:31.923 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-13T00:31:31.950 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-13T00:31:31.976 INFO:tasks.ceph:Compressing logs... 2023-12-13T00:31:31.977 DEBUG:teuthology.orchestra.run.smithi072:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-13T00:31:31.992 DEBUG:teuthology.orchestra.run.smithi176:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-13T00:31:32.016 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95371.log 2023-12-13T00:31:32.016 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96787.log 2023-12-13T00:31:32.017 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.95371.log: /var/log/ceph/ceph-client.admin.102449.log 2023-12-13T00:31:32.017 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.96787.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-13T00:31:32.018 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95371.log.gz 2023-12-13T00:31:32.018 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96508.log 2023-12-13T00:31:32.018 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99037.log 2023-12-13T00:31:32.018 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94144.log 2023-12-13T00:31:32.066 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-13T00:31:32.066 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88782.log 2023-12-13T00:31:32.066 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88742.log 2023-12-13T00:31:32.067 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.88782.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2023-12-13T00:31:32.067 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.88742.log: gzip -5 --verbose -- 87.6% /var/log/ceph/valgrind/mds.f.log -- replaced with /var/log/ceph/ceph-client.admin.88782.log.gz 2023-12-13T00:31:32.067 INFO:teuthology.orchestra.run.smithi176.stderr: 2023-12-13T00:31:32.067 INFO:teuthology.orchestra.run.smithi176.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.88742.log.gz 2023-12-13T00:31:32.067 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2023-12-13T00:31:32.067 INFO:teuthology.orchestra.run.smithi176.stderr: 74.7% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2023-12-13T00:31:32.067 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/valgrind/mds.f.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2023-12-13T00:31:32.067 INFO:teuthology.orchestra.run.smithi176.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2023-12-13T00:31:32.067 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2023-12-13T00:31:32.067 INFO:teuthology.orchestra.run.smithi176.stderr: 57.3% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2023-12-13T00:31:32.067 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88582.log 2023-12-13T00:31:32.067 INFO:teuthology.orchestra.run.smithi176.stderr: 74.7% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2023-12-13T00:31:32.068 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/valgrind/mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88873.log 2023-12-13T00:31:32.068 INFO:teuthology.orchestra.run.smithi176.stderr: 57.3% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2023-12-13T00:31:32.068 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.88582.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-13T00:31:32.068 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.88873.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88582.log.gz 2023-12-13T00:31:32.068 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-13T00:31:32.068 INFO:teuthology.orchestra.run.smithi176.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88873.log.gz 2023-12-13T00:31:32.068 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88622.log 2023-12-13T00:31:32.068 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-13T00:31:32.068 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.88622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88822.log 2023-12-13T00:31:32.068 INFO:teuthology.orchestra.run.smithi176.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88622.log.gz 2023-12-13T00:31:32.068 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-13T00:31:32.068 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.88822.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-13T00:31:32.069 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.7.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.88822.log.gz 2023-12-13T00:31:32.069 INFO:teuthology.orchestra.run.smithi176.stderr:gzip 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-13T00:31:32.069 INFO:teuthology.orchestra.run.smithi176.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.88662.log 2023-12-13T00:31:32.069 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2023-12-13T00:31:32.069 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.88662.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-13T00:31:32.069 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mds.f.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.88662.log.gz 2023-12-13T00:31:32.069 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-13T00:31:32.069 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-13T00:31:32.069 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-13T00:31:32.069 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-13T00:31:32.069 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mon.b.log: 93.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-13T00:31:32.069 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88702.log 2023-12-13T00:31:32.069 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mds.d.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-13T00:31:32.070 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-13T00:31:32.070 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.88702.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88702.log.gz 2023-12-13T00:31:32.072 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mon.c.log: 94.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-13T00:31:32.086 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96340.log 2023-12-13T00:31:32.086 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.102449.log: /var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.96508.log: /var/log/ceph/ceph-client.admin.99037.log: /var/log/ceph/ceph-client.admin.94144.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96787.log.gz 2023-12-13T00:31:32.086 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96508.log.gz 2023-12-13T00:31:32.086 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102449.log.gz 2023-12-13T00:31:32.086 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94144.log.gz 2023-12-13T00:31:32.086 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.96340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98821.log 2023-12-13T00:31:32.087 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98117.log 2023-12-13T00:31:32.087 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96340.log.gz 2023-12-13T00:31:32.087 INFO:teuthology.orchestra.run.smithi072.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.99037.log.gz 2023-12-13T00:31:32.087 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102407.log 2023-12-13T00:31:32.087 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94825.log 2023-12-13T00:31:32.087 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98821.log.gz 2023-12-13T00:31:32.087 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.102407.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98117.log.gz 2023-12-13T00:31:32.087 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94571.log 2023-12-13T00:31:32.087 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102407.log.gz 2023-12-13T00:31:32.087 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.94825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99551.log 2023-12-13T00:31:32.087 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.94571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98653.log 2023-12-13T00:31:32.087 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94825.log.gz 2023-12-13T00:31:32.088 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.99551.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94571.log.gz 2023-12-13T00:31:32.088 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102827.log 2023-12-13T00:31:32.088 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103551.log 2023-12-13T00:31:32.088 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.102827.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98653.log.gz 2023-12-13T00:31:32.088 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2023-12-13T00:31:32.088 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102827.log.gz 2023-12-13T00:31:32.088 INFO:teuthology.orchestra.run.smithi072.stderr:gzip/var/log/ceph/ceph-client.admin.103551.log: -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2023-12-13T00:31:32.088 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/valgrind/mds.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2023-12-13T00:31:32.088 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103551.log.gz 2023-12-13T00:31:32.088 INFO:teuthology.orchestra.run.smithi072.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2023-12-13T00:31:32.088 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/valgrind/mds.a.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2023-12-13T00:31:32.088 INFO:teuthology.orchestra.run.smithi072.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2023-12-13T00:31:32.088 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/valgrind/client.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2023-12-13T00:31:32.089 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98863.log 2023-12-13T00:31:32.089 INFO:teuthology.orchestra.run.smithi072.stderr: 76.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2023-12-13T00:31:32.089 INFO:teuthology.orchestra.run.smithi072.stderr: 74.7% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2023-12-13T00:31:32.089 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/valgrind/mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102659.log 2023-12-13T00:31:32.089 INFO:teuthology.orchestra.run.smithi072.stderr: 57.4% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2023-12-13T00:31:32.089 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97320.log 2023-12-13T00:31:32.089 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98863.log: /var/log/ceph/ceph-client.admin.102659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96879.log 2023-12-13T00:31:32.089 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98863.log.gz 2023-12-13T00:31:32.089 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97320.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102659.log.gz 2023-12-13T00:31:32.089 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88591.log 2023-12-13T00:31:32.089 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97320.log.gz 2023-12-13T00:31:32.089 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98025.log 2023-12-13T00:31:32.089 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.96879.log: /var/log/ceph/ceph-client.admin.88591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97574.log 2023-12-13T00:31:32.089 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96879.log.gz 2023-12-13T00:31:32.090 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94230.log 2023-12-13T00:31:32.090 INFO:teuthology.orchestra.run.smithi072.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.98025.log.gz 2023-12-13T00:31:32.090 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97574.log: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.88591.log.gz 2023-12-13T00:31:32.090 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103157.log 2023-12-13T00:31:32.090 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.94230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101870.log 2023-12-13T00:31:32.090 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97574.log.gz 2023-12-13T00:31:32.090 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.103157.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94230.log.gz 2023-12-13T00:31:32.090 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103425.log 2023-12-13T00:31:32.090 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103157.log.gz 2023-12-13T00:31:32.090 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.101870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101686.log 2023-12-13T00:31:32.090 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101870.log.gz 2023-12-13T00:31:32.090 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94783.log 2023-12-13T00:31:32.090 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.103425.log: /var/log/ceph/ceph-client.admin.101686.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.82563.log 2023-12-13T00:31:32.091 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103425.log.gz 2023-12-13T00:31:32.091 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.94783.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101686.log.gz 2023-12-13T00:31:32.091 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97315.log 2023-12-13T00:31:32.091 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94783.log.gz 2023-12-13T00:31:32.091 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101518.log 2023-12-13T00:31:32.091 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.tmp-client.admin.82563.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.82563.log.gz 2023-12-13T00:31:32.091 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95137.log 2023-12-13T00:31:32.091 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.101518.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97315.log.gz 2023-12-13T00:31:32.091 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102995.log 2023-12-13T00:31:32.091 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101518.log.gz 2023-12-13T00:31:32.091 INFO:teuthology.orchestra.run.smithi072.stderr:gzip/var/log/ceph/ceph-client.admin.95137.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.102617.log 2023-12-13T00:31:32.091 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.102995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95095.log 2023-12-13T00:31:32.091 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95137.log.gz 2023-12-13T00:31:32.091 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.102617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97533.log 2023-12-13T00:31:32.092 INFO:teuthology.orchestra.run.smithi072.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102995.log.gz 2023-12-13T00:31:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.95095.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102617.log.gz 2023-12-13T00:31:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98275.log 2023-12-13T00:31:32.092 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95095.log.gz 2023-12-13T00:31:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102281.log 2023-12-13T00:31:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97533.log: /var/log/ceph/ceph-client.admin.98275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98233.log 2023-12-13T00:31:32.092 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97533.log.gz 2023-12-13T00:31:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.102281.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98275.log.gz 2023-12-13T00:31:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102491.log 2023-12-13T00:31:32.092 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102281.log.gz 2023-12-13T00:31:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96156.log 2023-12-13T00:31:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98233.log: /var/log/ceph/ceph-client.admin.102491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103097.log 2023-12-13T00:31:32.092 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98233.log.gz 2023-12-13T00:31:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.96156.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.102491.log.gz 2023-12-13T00:31:32.093 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95179.log 2023-12-13T00:31:32.093 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96156.log.gz 2023-12-13T00:31:32.093 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-13T00:31:32.093 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.103097.log: /var/log/ceph/ceph-client.admin.95179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97633.log 2023-12-13T00:31:32.093 INFO:teuthology.orchestra.run.smithi072.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103097.log.gz 2023-12-13T00:31:32.093 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.audit.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95179.log.gz 2023-12-13T00:31:32.093 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102575.log 2023-12-13T00:31:32.093 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102533.log 2023-12-13T00:31:32.093 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97633.log: /var/log/ceph/ceph-client.admin.102575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96298.log 2023-12-13T00:31:32.093 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97633.log.gz 2023-12-13T00:31:32.093 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-13T00:31:32.093 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102575.log.gz 2023-12-13T00:31:32.093 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.102533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103509.log 2023-12-13T00:31:32.094 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.96298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94657.log 2023-12-13T00:31:32.094 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102533.log.gz 2023-12-13T00:31:32.094 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.103509.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96298.log.gz 2023-12-13T00:31:32.094 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94615.log 2023-12-13T00:31:32.094 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103509.log.gz 2023-12-13T00:31:32.094 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.94657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102197.log 2023-12-13T00:31:32.094 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.94615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95263.log 2023-12-13T00:31:32.094 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94657.log.gz 2023-12-13T00:31:32.094 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.102197.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94615.log.gz 2023-12-13T00:31:32.094 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97640.log 2023-12-13T00:31:32.094 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102197.log.gz 2023-12-13T00:31:32.094 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98191.log 2023-12-13T00:31:32.095 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.95263.log: /var/log/ceph/ceph-client.admin.97640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98527.log 2023-12-13T00:31:32.095 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95263.log.gz 2023-12-13T00:31:32.095 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98191.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97640.log.gz 2023-12-13T00:31:32.095 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101560.log 2023-12-13T00:31:32.095 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98191.log.gz 2023-12-13T00:31:32.095 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97985.log 2023-12-13T00:31:32.095 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98527.log: /var/log/ceph/ceph-client.admin.101560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98737.log 2023-12-13T00:31:32.095 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98527.log.gz 2023-12-13T00:31:32.095 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97985.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101560.log.gz 2023-12-13T00:31:32.095 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102743.log 2023-12-13T00:31:32.095 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97985.log.gz 2023-12-13T00:31:32.095 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94432.log 2023-12-13T00:31:32.095 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98737.log: /var/log/ceph/ceph-client.admin.102743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96972.log 2023-12-13T00:31:32.095 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98737.log.gz 2023-12-13T00:31:32.096 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102743.log.gz 2023-12-13T00:31:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.94432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102365.log 2023-12-13T00:31:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98971.log 2023-12-13T00:31:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.96972.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94432.log.gz 2023-12-13T00:31:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.102365.log: gzip -5 --verbose 87.1% -- -- replaced with /var/log/ceph/ceph-client.admin.96972.log.gz /var/log/ceph/ceph-client.admin.94885.log 2023-12-13T00:31:32.096 INFO:teuthology.orchestra.run.smithi072.stderr: 2023-12-13T00:31:32.096 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102365.log.gz 2023-12-13T00:31:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97317.log 2023-12-13T00:31:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98971.log: /var/log/ceph/ceph-client.admin.94885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95791.log 2023-12-13T00:31:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97317.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94885.log.gz 2023-12-13T00:31:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-13T00:31:32.096 INFO:teuthology.orchestra.run.smithi072.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.98971.log.gz 2023-12-13T00:31:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.95791.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97317.log.gz 2023-12-13T00:31:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94927.log 2023-12-13T00:31:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94474.log 2023-12-13T00:31:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.94927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101828.log 2023-12-13T00:31:32.097 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94927.log.gz 2023-12-13T00:31:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.94474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97319.log 2023-12-13T00:31:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:gzip/var/log/ceph/ceph-client.admin.101828.log: -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94474.log.gz 2023-12-13T00:31:32.097 INFO:teuthology.orchestra.run.smithi072.stderr: --verbose -- /var/log/ceph/ceph-client.admin.103467.log 2023-12-13T00:31:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97319.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.95791.log.gz 2023-12-13T00:31:32.097 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101828.log.gz 2023-12-13T00:31:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94390.log 2023-12-13T00:31:32.097 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97319.log.gz 2023-12-13T00:31:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102911.log 2023-12-13T00:31:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.103467.log: /var/log/ceph/ceph-client.admin.94390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96072.log 2023-12-13T00:31:32.097 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103467.log.gz 2023-12-13T00:31:32.098 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.102911.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97014.log 2023-12-13T00:31:32.098 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94390.log.gz 2023-12-13T00:31:32.098 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102911.log.gz 2023-12-13T00:31:32.098 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.96072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102155.log 2023-12-13T00:31:32.098 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96072.log.gz 2023-12-13T00:31:32.098 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97322.log 2023-12-13T00:31:32.098 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97014.log: /var/log/ceph/ceph-client.admin.102155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103299.log 2023-12-13T00:31:32.098 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97014.log.gz 2023-12-13T00:31:32.098 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102155.log.gz 2023-12-13T00:31:32.098 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97322.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-13T00:31:32.098 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.103299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95053.log 2023-12-13T00:31:32.098 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97322.log.gz 2023-12-13T00:31:32.099 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.3.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103299.log.gz 2023-12-13T00:31:32.099 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97965.log 2023-12-13T00:31:32.099 INFO:teuthology.orchestra.run.smithi072.stderr:gzip/var/log/ceph/ceph-client.admin.95053.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.101602.log 2023-12-13T00:31:32.099 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97965.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95053.log.gz 2023-12-13T00:31:32.099 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97697.log 2023-12-13T00:31:32.099 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97965.log.gz 2023-12-13T00:31:32.099 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97917.log 2023-12-13T00:31:32.099 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.101602.log: /var/log/ceph/ceph-client.admin.97697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103593.log 2023-12-13T00:31:32.099 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101602.log.gz 2023-12-13T00:31:32.099 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97697.log.gz 2023-12-13T00:31:32.099 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101954.log 2023-12-13T00:31:32.099 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97917.log.gz 2023-12-13T00:31:32.100 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.103593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102953.log 2023-12-13T00:31:32.100 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103593.log.gz 2023-12-13T00:31:32.100 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.101954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96837.log 2023-12-13T00:31:32.100 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5/var/log/ceph/ceph-client.admin.102953.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101954.log.gz 2023-12-13T00:31:32.100 INFO:teuthology.orchestra.run.smithi072.stderr: --verbose -- /var/log/ceph/ceph-client.admin.88869.log 2023-12-13T00:31:32.100 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.96837.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102953.log.gz 2023-12-13T00:31:32.100 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96628.log 2023-12-13T00:31:32.100 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96837.log.gz 2023-12-13T00:31:32.100 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.88869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97057.log 2023-12-13T00:31:32.100 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88869.log.gz 2023-12-13T00:31:32.100 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95011.log 2023-12-13T00:31:32.100 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.96628.log: /var/log/ceph/ceph-client.admin.97057.log: gzip -5 --verbose 88.3% -- /var/log/ceph/ceph-client.admin.98779.log 2023-12-13T00:31:32.101 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96628.log.gz 2023-12-13T00:31:32.101 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9%/var/log/ceph/ceph-client.admin.95011.log: -- replaced with /var/log/ceph/ceph-client.admin.97057.log.gz 2023-12-13T00:31:32.101 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97099.log 2023-12-13T00:31:32.101 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2%/var/log/ceph/ceph-client.admin.98779.log: -- replaced with /var/log/ceph/ceph-client.admin.95011.log.gz 2023-12-13T00:31:32.101 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96382.log 2023-12-13T00:31:32.101 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98779.log.gz 2023-12-13T00:31:32.101 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97141.log 2023-12-13T00:31:32.101 INFO:teuthology.orchestra.run.smithi072.stderr:gzip/var/log/ceph/ceph-client.admin.96382.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.101644.log 2023-12-13T00:31:32.101 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97099.log.gz 2023-12-13T00:31:32.101 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97141.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2023-12-13T00:31:32.101 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96382.log.gz 2023-12-13T00:31:32.101 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97141.log.gz 2023-12-13T00:31:32.102 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97323.log 2023-12-13T00:31:32.102 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.101644.log: gzip/var/log/ceph/ceph-mds.e.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.98443.log 2023-12-13T00:31:32.102 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101644.log.gz 2023-12-13T00:31:32.102 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97323.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-13T00:31:32.102 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97323.log.gz 2023-12-13T00:31:32.102 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96030.log 2023-12-13T00:31:32.102 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98443.log.gz 2023-12-13T00:31:32.102 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97309.log 2023-12-13T00:31:32.102 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.96030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98569.log 2023-12-13T00:31:32.102 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97309.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96030.log.gz 2023-12-13T00:31:32.103 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97309.log.gz 2023-12-13T00:31:32.103 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97855.log 2023-12-13T00:31:32.103 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96198.log 2023-12-13T00:31:32.103 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97855.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98569.log.gz 2023-12-13T00:31:32.103 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102323.log 2023-12-13T00:31:32.103 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97855.log.gz 2023-12-13T00:31:32.103 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.96198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97578.log 2023-12-13T00:31:32.103 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96198.log.gz/var/log/ceph/ceph-client.admin.102323.log: 2023-12-13T00:31:32.103 INFO:teuthology.orchestra.run.smithi072.stderr:gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102323.log.gz 2023-12-13T00:31:32.103 INFO:teuthology.orchestra.run.smithi072.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.98695.log 2023-12-13T00:31:32.103 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98077.log 2023-12-13T00:31:32.103 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97578.log.gz 2023-12-13T00:31:32.104 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103257.log 2023-12-13T00:31:32.104 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98077.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98695.log.gz 2023-12-13T00:31:32.104 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98077.log.gz 2023-12-13T00:31:32.104 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94345.log 2023-12-13T00:31:32.104 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94969.log 2023-12-13T00:31:32.104 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.94345.log: /var/log/ceph/ceph-client.admin.103257.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2023-12-13T00:31:32.104 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98359.log 2023-12-13T00:31:32.104 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94345.log.gz 2023-12-13T00:31:32.104 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103257.log.gz 2023-12-13T00:31:32.104 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.94969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98611.log 2023-12-13T00:31:32.104 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94969.log.gz 2023-12-13T00:31:32.104 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-13T00:31:32.104 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98359.log: /var/log/ceph/ceph-client.admin.98611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98401.log 2023-12-13T00:31:32.105 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.0.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98359.log.gz 2023-12-13T00:31:32.105 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98611.log.gz 2023-12-13T00:31:32.105 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96424.log 2023-12-13T00:31:32.105 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103055.log 2023-12-13T00:31:32.105 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98401.log: /var/log/ceph/ceph-client.admin.96424.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98401.log.gz 2023-12-13T00:31:32.105 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96424.log.gz 2023-12-13T00:31:32.105 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96730.log 2023-12-13T00:31:32.105 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98317.log 2023-12-13T00:31:32.105 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.96730.log: /var/log/ceph/ceph-client.admin.103055.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.103055.log.gz 2023-12-13T00:31:32.105 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96730.log.gz 2023-12-13T00:31:32.105 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103217.log 2023-12-13T00:31:32.105 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94699.log 2023-12-13T00:31:32.105 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98317.log: /var/log/ceph/ceph-client.admin.103217.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98317.log.gz 2023-12-13T00:31:32.105 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103217.log.gz 2023-12-13T00:31:32.106 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98905.log 2023-12-13T00:31:32.106 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-13T00:31:32.106 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.94699.log: /var/log/ceph/ceph-client.admin.98905.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94699.log.gz 2023-12-13T00:31:32.106 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89085.log 2023-12-13T00:31:32.106 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.98905.log.gz 2023-12-13T00:31:32.106 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-13T00:31:32.106 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.89085.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89085.log.gz 2023-12-13T00:31:32.106 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97638.log 2023-12-13T00:31:32.106 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.2.log: 87.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-13T00:31:32.106 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-13T00:31:32.106 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97638.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97638.log.gz 2023-12-13T00:31:32.106 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103383.log 2023-12-13T00:31:32.107 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103341.log 2023-12-13T00:31:32.107 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.103383.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.103383.log.gz 2023-12-13T00:31:32.108 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96114.log 2023-12-13T00:31:32.108 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.103341.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103341.log.gz 2023-12-13T00:31:32.108 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97875.log 2023-12-13T00:31:32.108 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.96114.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96114.log.gz 2023-12-13T00:31:32.118 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102239.log 2023-12-13T00:31:32.119 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97875.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97875.log.gz 2023-12-13T00:31:32.131 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96240.log 2023-12-13T00:31:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.102239.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102239.log.gz 2023-12-13T00:31:32.145 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94741.log 2023-12-13T00:31:32.145 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.96240.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96240.log.gz 2023-12-13T00:31:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101728.log 2023-12-13T00:31:32.166 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.94741.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94741.log.gz 2023-12-13T00:31:32.170 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102869.log 2023-12-13T00:31:32.170 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.101728.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101728.log.gz 2023-12-13T00:31:32.178 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101912.log 2023-12-13T00:31:32.192 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.102869.log: gzip -5 --verbose 87.7% -- /var/log/ceph/ceph-client.admin.96670.log 2023-12-13T00:31:32.192 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102869.log.gz 2023-12-13T00:31:32.192 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.101912.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101912.log.gz 2023-12-13T00:31:32.201 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96586.log 2023-12-13T00:31:32.214 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.96670.log: gzip -5 --verbose 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96670.log.gz 2023-12-13T00:31:32.214 INFO:teuthology.orchestra.run.smithi072.stderr: -- /var/log/ceph/ceph-client.admin.99165.log 2023-12-13T00:31:32.214 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.96586.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96586.log.gz 2023-12-13T00:31:32.222 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95305.log 2023-12-13T00:31:32.233 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.99165.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99165.log.gz 2023-12-13T00:31:32.236 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97314.log 2023-12-13T00:31:32.238 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.95305.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.95305.log.gz 2023-12-13T00:31:32.245 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95221.log 2023-12-13T00:31:32.259 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97314.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97314.log.gz 2023-12-13T00:31:32.261 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98485.log 2023-12-13T00:31:32.262 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.95221.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95221.log.gz 2023-12-13T00:31:32.280 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102785.log 2023-12-13T00:31:32.281 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.98485.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98485.log.gz 2023-12-13T00:31:32.293 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101786.log 2023-12-13T00:31:32.294 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.102785.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102785.log.gz 2023-12-13T00:31:32.302 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-12-13T00:31:32.312 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.101786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97526.log 2023-12-13T00:31:32.315 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mds.a.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101786.log.gz 2023-12-13T00:31:32.326 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96926.log 2023-12-13T00:31:32.327 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.97526.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97526.log.gz 2023-12-13T00:31:32.337 INFO:teuthology.orchestra.run.smithi072.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-13T00:31:32.340 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96466.log 2023-12-13T00:31:32.340 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.96926.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96926.log.gz 2023-12-13T00:31:32.341 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101996.log 2023-12-13T00:31:32.341 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.96466.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96466.log.gz 2023-12-13T00:31:32.341 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102701.log 2023-12-13T00:31:32.341 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.101996.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101996.log.gz 2023-12-13T00:31:32.342 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.102701.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102701.log.gz 2023-12-13T00:31:32.521 INFO:teuthology.orchestra.run.smithi176.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-13T00:31:32.632 INFO:teuthology.orchestra.run.smithi176.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-13T00:31:33.076 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-12-13T00:31:33.481 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-13T00:31:35.316 INFO:teuthology.orchestra.run.smithi176.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-13T00:31:35.649 INFO:teuthology.orchestra.run.smithi072.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-13T00:31:35.880 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-13T00:31:36.167 INFO:teuthology.orchestra.run.smithi176.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-13T00:31:36.975 INFO:teuthology.orchestra.run.smithi176.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-13T00:31:37.558 INFO:teuthology.orchestra.run.smithi072.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-13T00:31:37.680 INFO:teuthology.orchestra.run.smithi176.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-13T00:31:38.782 INFO:teuthology.orchestra.run.smithi072.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-13T00:31:39.713 INFO:teuthology.orchestra.run.smithi072.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-13T00:31:41.407 INFO:teuthology.orchestra.run.smithi072.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-13T00:31:43.817 INFO:teuthology.orchestra.run.smithi176.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2023-12-13T00:31:43.818 INFO:teuthology.orchestra.run.smithi176.stderr: 2023-12-13T00:31:43.819 INFO:teuthology.orchestra.run.smithi176.stderr:real 0m11.787s 2023-12-13T00:31:43.819 INFO:teuthology.orchestra.run.smithi176.stderr:user 0m29.844s 2023-12-13T00:31:43.819 INFO:teuthology.orchestra.run.smithi176.stderr:sys 0m0.934s 2023-12-13T00:31:47.406 INFO:teuthology.orchestra.run.smithi072.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.99551.log.gz 2023-12-13T00:31:47.408 INFO:teuthology.orchestra.run.smithi072.stderr: 2023-12-13T00:31:47.409 INFO:teuthology.orchestra.run.smithi072.stderr:real 0m15.404s 2023-12-13T00:31:47.409 INFO:teuthology.orchestra.run.smithi072.stderr:user 0m51.860s 2023-12-13T00:31:47.409 INFO:teuthology.orchestra.run.smithi072.stderr:sys 0m1.656s 2023-12-13T00:31:47.409 INFO:tasks.ceph:Archiving logs... 2023-12-13T00:31:47.410 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489252/remote/smithi072/log 2023-12-13T00:31:47.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-13T00:31:54.846 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489252/remote/smithi176/log 2023-12-13T00:31:54.847 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-13T00:31:59.230 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2023-12-13T00:31:59.232 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-13T00:31:59.243 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2023-12-13T00:31:59.244 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-13T00:31:59.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-13T00:31:59.247 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-13T00:31:59.340 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-13T00:31:59.349 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-13T00:31:59.350 DEBUG:teuthology.orchestra.run.smithi072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-13T00:31:59.352 DEBUG:teuthology.orchestra.run.smithi176:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-13T00:31:59.366 INFO:teuthology.orchestra.run.smithi072.stderr:bash: line 1: ntpq: command not found 2023-12-13T00:31:59.368 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2023-12-13T00:31:59.371 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-13T00:31:59.371 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2023-12-13T00:31:59.371 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 7 +1687us[+1687us] +/- 82ms 2023-12-13T00:31:59.371 INFO:teuthology.orchestra.run.smithi072.stdout:^* hv02.front.sepia.ceph.com 3 6 377 8 -509us[ -493us] +/- 50ms 2023-12-13T00:31:59.371 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -920us[ -920us] +/- 92ms 2023-12-13T00:31:59.371 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-13T00:31:59.372 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-13T00:31:59.372 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2023-12-13T00:31:59.372 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 8 +1729us[+1734us] +/- 82ms 2023-12-13T00:31:59.372 INFO:teuthology.orchestra.run.smithi176.stdout:^* hv02.front.sepia.ceph.com 3 6 377 7 -434us[ -430us] +/- 50ms 2023-12-13T00:31:59.373 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 10 -844us[ -839us] +/- 92ms 2023-12-13T00:31:59.373 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-13T00:31:59.373 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-13T00:31:59.487 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-13T00:31:59.487 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-13T00:31:59.499 DEBUG:teuthology.orchestra.run.smithi072:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-13T00:31:59.604 DEBUG:teuthology.orchestra.run.smithi176:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-13T00:31:59.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-13T00:31:59.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-13T00:31:59.737 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-13T00:31:59.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-13T00:31:59.770 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-13T00:31:59.780 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-13T00:31:59.789 INFO:teuthology.task.internal:Duration was 2810.003662 seconds 2023-12-13T00:31:59.789 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-13T00:31:59.799 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-13T00:31:59.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-13T00:31:59.801 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-13T00:31:59.843 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-13T00:31:59.853 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-13T00:32:00.145 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-13T00:32:00.145 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi072.front.sepia.ceph.com 2023-12-13T00:32:00.145 DEBUG:teuthology.orchestra.run.smithi072:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-13T00:32:00.204 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi176.front.sepia.ceph.com 2023-12-13T00:32:00.205 DEBUG:teuthology.orchestra.run.smithi176:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-13T00:32:00.224 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-13T00:32:00.224 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-13T00:32:00.247 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-13T00:32:00.292 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-13T00:32:00.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-13T00:32:00.314 DEBUG:teuthology.orchestra.run.smithi176:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-13T00:32:00.438 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-13T00:32:00.447 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-13T00:32:00.448 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-13T00:32:00.474 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-13T00:32:00.501 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-13T00:32:00.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-13T00:32:00.516 DEBUG:teuthology.orchestra.run.smithi176:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-13T00:32:00.539 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = core 2023-12-13T00:32:00.566 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = core 2023-12-13T00:32:00.588 DEBUG:teuthology.orchestra.run.smithi072:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-13T00:32:00.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-13T00:32:00.609 DEBUG:teuthology.orchestra.run.smithi176:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-13T00:32:00.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-13T00:32:00.642 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-13T00:32:00.653 INFO:teuthology.task.internal:Transferring archived files... 2023-12-13T00:32:00.654 DEBUG:teuthology.misc:Transferring archived files from smithi072:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489252/remote/smithi072 2023-12-13T00:32:00.654 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-13T00:32:00.691 DEBUG:teuthology.misc:Transferring archived files from smithi176:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489252/remote/smithi176 2023-12-13T00:32:00.691 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-13T00:32:00.726 INFO:teuthology.task.internal:Removing archive directory... 2023-12-13T00:32:00.726 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-13T00:32:00.729 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-13T00:32:00.776 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-13T00:32:00.788 INFO:teuthology.task.internal:Not uploading archives. 2023-12-13T00:32:00.788 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-13T00:32:00.798 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-13T00:32:00.798 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-13T00:32:00.800 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-13T00:32:00.812 INFO:teuthology.orchestra.run.smithi072.stdout: 265315 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 13 00:32 /home/ubuntu/cephtest 2023-12-13T00:32:00.830 INFO:teuthology.orchestra.run.smithi176.stdout: 265244 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 13 00:32 /home/ubuntu/cephtest 2023-12-13T00:32:00.831 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-13T00:32:00.842 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-13T00:32:00.853 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2023-12-13T00:32:00.853 INFO:teuthology.nuke:Checking targets against current locks 2023-12-13T00:32:00.880 DEBUG:teuthology.nuke:shortname: smithi072 2023-12-13T00:32:00.880 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T00:32:00.907 DEBUG:teuthology.nuke:shortname: smithi176 2023-12-13T00:32:00.907 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T00:32:00.911 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489252', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 23:36:43.766826', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwF4NBeLAivyQUn36Egw1iPnhpM7o1AAYzEbC4jbdxggLlYBOtHlITta1b7df29QS/Nr8bzgn06YWP3wh5i/zs='} 2023-12-13T00:32:00.935 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489252', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 23:36:43.765006', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNDXc5/kqFVWyPJTSE1nTsD7rqE/wiS2HCugJc4U+fW78MucX7iHMdSdp2AnMT9qzxdquoNKDxaCLbMHWoZRLic='} 2023-12-13T00:32:00.961 INFO:teuthology.orchestra.console.smithi072:Power off 2023-12-13T00:32:00.961 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T00:32:00.984 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-12-13T00:32:00.985 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T00:32:01.000 INFO:teuthology.orchestra.console.smithi176:Power off 2023-12-13T00:32:01.000 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T00:32:01.009 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-12-13T00:32:01.022 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off 2023-12-13T00:32:01.022 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T00:32:01.046 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-12-13T00:32:05.011 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T00:32:05.047 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T00:32:05.121 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-12-13T00:32:05.157 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-12-13T00:32:09.123 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T00:32:09.158 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T00:32:09.234 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-12-13T00:32:09.268 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2023-12-13T00:32:09.335 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-12-13T00:32:09.369 INFO:teuthology.orchestra.console.smithi176:Power off completed 2023-12-13T00:32:09.473 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/valgrind} duration: 2810.0036623477936 failure_reason: 'valgrind error: Leak_StillReachable malloc malloc strdup' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2023-12-13T00:32:09.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T00:32:09.556 INFO:teuthology.run:FAIL